Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Algebra

92 missions · 41 completed

The study of algebraic structures — groups, rings, and fields — and, through algebraic geometry, the geometry of the solution sets of polynomial equations. Using commutative algebra to describe these varieties, the field provides a common language of symmetry and structure that underlies much of modern mathematics.

Missions

Open51Completed41All92
AnalysisCombinatoricsFunctional Analysis+3·Captain: Lucas

Formal Conjectures Portfolio: Bateman-Horn and CompanionsOpen Problem

1. Motivation

Wikipedia's pages on open problems are, for many mathematicians, the first contact with a conjecture: a one-paragraph statement, a short history, a list of partial results. The Formal Conjectures library (Google DeepMind, Apache-2.0) turned a large part of that material into Lean 4 statements, so that the conjectures can be attacked — and, just as importantly, stated unambiguously — by machine.

This mission ports a coherent slice of that material to Prove2Me. It is deliberately a portfolio mission: the goal theorem is the Bateman–Horn conjecture, the strongest single statement in the collection, and the milestone list gathers the other conjectures and the landmark theorems that surround them. Some milestones are genuine steps toward the goal (the Bunyakovsky conjecture is literally the one-polynomial case); most are independent open problems from other fields, grouped here because they share a source, a level of difficulty, and a need for faithful formal statements. A reader should not assume that proving a milestone advances the goal theorem. The mission's value is that every statement in it has been written against the same Mathlib revision, checked to compile, and documented well enough to be attacked.

A rough timeline of the collection's landmarks:

  • 1947 — Mills: a real A>1A>1A>1 with ⌊A3n⌋\lfloor A^{3^n}\rfloor⌊A3n⌋ always prime.
  • 1962 — Radó: the busy beaver function outgrows every computable function.
  • 1971 — Davies: planar Kakeya sets have Hausdorff dimension 222.
  • 1978 — Apéry: ζ(3)\zeta(3)ζ(3) is irrational.
  • 1985 — Read (after Enflo, 1981): an operator on ℓ1\ell^1ℓ1 with no nontrivial closed invariant subspace.
  • 2001 — Zudilin: one of ζ(5),ζ(7),ζ(9),ζ(11)\zeta(5),\zeta(7),\zeta(9),\zeta(11)ζ(5),ζ(7),ζ(9),ζ(11) is irrational.
  • 2002 — Mihăilescu: 888 and 999 are the only consecutive perfect powers (Catalan's conjecture).
  • 2009 / 2021 — Dvir; Bukh–Chao: the finite-field Kakeya bound and its sharp density constant.
  • 2021 — Gardam: Kaplansky's unit conjecture is false (its zero-divisor and idempotent companions remain open).
  • 2024 — Saito: Mills' constant is irrational; bbchallenge: BB(5)=47 176 870\mathrm{BB}(5)=47\,176\,870BB(5)=47176870.
  • 2025 — Wang–Zahl: the Kakeya set conjecture in R3\mathbb{R}^3R3.

2. Setting

The goal theorem concerns prime values of polynomials. Fix a finite set S={f1,…,fk}⊆Z[X]S=\{f_1,\dots,f_k\}\subseteq\mathbb{Z}[X]S={f1​,…,fk​}⊆Z[X] of distinct polynomials. Say that fff satisfies the Bunyakovsky condition if its leading coefficient is positive, deg⁡f≥1\deg f\ge 1degf≥1, and fff is irreducible over Z\mathbb{Z}Z; say that SSS satisfies the Schinzel condition if for every prime ppp there is an integer nnn with p∤f1(n)⋯fk(n)p\nmid f_1(n)\cdots f_k(n)p∤f1​(n)⋯fk​(n) — i.e. no fixed prime divides the product at every argument.

For a prime ppp let ωp(S)\omega_p(S)ωp​(S) be the number of residue classes n mod pn \bmod pnmodp at which some fif_ifi​ vanishes, let D=∏ideg⁡fiD=\prod_i \deg f_iD=∏i​degfi​, and let

πS(x)=#{ n≤x:∣fi(n)∣ is prime for every i }.\pi_S(x)=\#\{\,n\le x : |f_i(n)| \text{ is prime for every } i\,\}.πS​(x)=#{n≤x:∣fi​(n)∣ is prime for every i}.

The Bateman–Horn constant is the (conditionally convergent) Euler product

C=lim⁡N→∞ ∏p<N(1−1p)−k(1−ωp(S)p).C=\lim_{N\to\infty}\ \prod_{p<N}\Big(1-\tfrac1p\Big)^{-k}\Big(1-\tfrac{\omega_p(S)}{p}\Big).C=N→∞lim​ p<N∏​(1−p1​)−k(1−pωp​(S)​).

The other groups use their own vocabulary, each fixed in a definition item of this mission: Kakeya sets in Rn\mathbb{R}^nRn and over Fq\mathbb{F}_qFq​; Mills' property ⌊A3n⌋∈P\lfloor A^{3^n}\rfloor \in \mathbb{P}⌊A3n⌋∈P; Wagstaff primes and Catalan–Mersenne numbers; polynomial self-maps and their Jacobian matrix; nontrivial closed invariant subspaces; linear extensions of a finite poset; Catalan's constant; and an explicit two-symbol Turing machine model with its maximum-shifts function BB\mathrm{BB}BB.

3. Target

The goal theorem is the Bateman–Horn asymptotic: under the Bunyakovsky and Schinzel hypotheses, CCC exists and is positive and

πS(x) ∼ CD x(log⁡x)k(x→∞).\pi_S(x)\ \sim\ \frac{C}{D}\,\frac{x}{(\log x)^{k}}\qquad (x\to\infty).πS​(x) ∼ DC​(logx)kx​(x→∞).

Weaker statements in the same direction appear as milestones, first of all Bunyakovsky's conjecture: under the same hypotheses with k=1k=1k=1, fff takes prime values infinitely often. The remaining milestones are listed in the milestone panel and are grouped by subject: Diophantine equations (Brocard, Pillai, Lebesgue–Nagell, Catalan/Mihăilescu), Mersenne-type primality (New Mersenne, infinitude of Mersenne primes, Catalan–Mersenne), prime-representing constants (Mills), geometric measure theory (Kakeya in Rn\mathbb{R}^nRn, Kakeya over Fq\mathbb{F}_qFq​, Falconer), operator theory (invariant subspace problem and Read's ℓ1\ell^1ℓ1 counterexample), group algebras (Kaplansky's zero-divisor and idempotent conjectures), affine algebraic geometry (the two-variable Jacobian conjecture), irrationality and transcendence (ζ(5)\zeta(5)ζ(5), all odd zeta values, Zudilin's theorem, e+πe+\pie+π, eπe\pieπ, γ\gammaγ, Catalan's constant), order theory (the 1/31/31/3–2/32/32/3 conjecture), and computability (Radó's theorem).

4. Significance

The results themselves. Bateman–Horn is the quantitative form of Schinzel's hypothesis H: it contains the twin prime conjecture, the infinitude of primes of the form n2+1n^2+1n2+1, and Bunyakovsky as special cases, and it is the standard heuristic behind prime-counting predictions. The other targets are each the headline question of their area: whether every bounded Hilbert-space operator has an invariant subspace; whether group algebras of torsion-free groups are domains; whether Kakeya sets must have full dimension. The solved milestones (Mihăilescu, Davies, Dvir, Zudilin, Read, Saito, Radó) are landmarks whose formal proofs would be significant library contributions in their own right.

Formalizing them. None of the open statements is expected to fall here; the concrete deliverable is a set of faithful, compiling, reusable statements plus formal proofs of the solved milestones, most of which are not in Mathlib today. Several are realistically in reach: the finite-field Kakeya bound (Dvir's polynomial method is short), the elementary fact that π+e\pi+eπ+e and πe\pi eπe cannot both be algebraic, and Radó's diagonal argument.

5. Difficulty

For Bateman–Horn, the obstruction is visible already for k=1k=1k=1, deg⁡f=2\deg f = 2degf=2: sieve methods bound πS(x)\pi_S(x)πS​(x) from above by a constant times the conjectured main term and produce almost-primes, but the parity problem blocks every known sieve from producing a single prime value of an irreducible quadratic. The conditional convergence of the Euler product is a second, smaller trap: the product over p<Np<Np<N must be taken in order, so any reformulation as an unordered infinite product changes the statement.

Each other group has its own obstruction, and they do not transfer: the parity problem says nothing about Kakeya, where the difficulty is that dimension is not stable under the natural compactness arguments, nor about the invariant subspace problem, where the known counterexamples on ℓ1\ell^1ℓ1 show that no soft argument can work.

6. Formalization scope

Conventions this mission commits to, all fixed in the definition items:

  • Polynomials are elements of ℤ[X]; primality of a polynomial value is primality of its absolute value, and the counting function ranges over natural numbers n≤⌊x⌋n \le \lfloor x\rfloorn≤⌊x⌋.
  • The Bateman–Horn constant is the limit of the ordered partial products over p<Np<Np<N, not an unordered infinite product.
  • Kakeya sets carry no compactness or measurability hypothesis, matching the source; the conjecture is stated as an equality of Hausdorff dimensions in [0,∞][0,\infty][0,∞].
  • Falconer's hypothesis is written d<2dim⁡HEd < 2\dim_H Ed<2dimH​E to avoid division in [0,∞][0,\infty][0,∞].
  • Torsion-freeness of a group is spelled out as "every element of finite order is the identity", which is the hypothesis the source intends (it is weaker than Mathlib's IsMulTorsionFree).
  • Linear extensions are order-preserving bijections onto {0,…,∣P∣−1}\{0,\dots,|P|-1\}{0,…,∣P∣−1}, and probabilities are quotients of set cardinalities in Q\mathbb{Q}Q.
  • The busy beaver model is an explicit nnn-state, 222-symbol machine with a bi-infinite Boolean tape; BB\mathrm{BB}BB counts transitions performed (maximum shifts), the halting transition included, and BB(0)=0\mathrm{BB}(0)=0BB(0)=0.
  • Several source statements are phrased as "is XXX true?" with an unknown answer. Prove2Me statements must be definite, so each such question is recorded in its affirmative form (e.g. "e+πe+\pie+π is irrational"); a solver who can refute one should submit a disproof. The one question with no statable answer, "what is BB(6)\mathrm{BB}(6)BB(6)?", is replaced by Radó's growth theorem rather than guessed at.
  • Nothing here is vacuous: each hypothesis set is satisfiable (e.g. closed unit balls are Kakeya sets, and X2+1X^2+1X2+1 satisfies the Bunyakovsky and Schinzel conditions).

Contributions welcome: proofs of the solved milestones; sharper variants; and additional faithful statements from the same source library, which contains far more than fits in one mission.

7. Selected references

  • P. T. Bateman and R. A. Horn, A heuristic asymptotic formula concerning the distribution of prime numbers, Math. Comp. 16 (1962), 363–367. DOI
  • T. Radó, On non-computable functions, Bell System Tech. J. 41 (1962), 877–884. DOI
  • R. O. Davies, Some remarks on the Kakeya problem, Math. Proc. Cambridge Philos. Soc. 69 (1971), 417–421. DOI
  • C. J. Read, A solution to the invariant subspace problem on the space ℓ1\ell_1ℓ1​, Bull. London Math. Soc. 17 (1985), 305–317. DOI
  • K. Falconer, On the Hausdorff dimensions of distance sets, Mathematika 32 (1985), 206–212. DOI
  • W. Zudilin, One of the numbers ζ(5),ζ(7),ζ(9),ζ(11)\zeta(5),\zeta(7),\zeta(9),\zeta(11)ζ(5),ζ(7),ζ(9),ζ(11) is irrational, Russian Math. Surveys 56 (2001), 774–776. DOI
  • P. Mihăilescu, Primary cyclotomic units and a proof of Catalan's conjecture, J. reine angew. Math. 572 (2004), 167–195. DOI
  • Z. Dvir, On the size of Kakeya sets in finite fields, J. Amer. Math. Soc. 22 (2009), 1093–1097. DOI
  • B. Bukh and T.-W. Chao, Sharp density bounds on the finite field Kakeya problem, Discrete Analysis 26 (2021). DOI
  • G. Gardam, A counterexample to the unit conjecture for group rings, Ann. of Math. 194 (2021), 967–979. DOI
  • K. Saito, Mills' constant is irrational, Mathematika 71 (2025), e70027. arXiv:2404.19461
  • H. Wang and J. Zahl, Volume estimates for unions of convex sets, and the Kakeya set conjecture in three dimensions, arXiv:2502.17655
  • Google DeepMind, Formal Conjectures, Apache-2.0, github.com/google-deepmind/formal-conjectures

Provenance note. The Lean statements in this mission are adaptations of the Formal Conjectures library (Apache-2.0), rewritten to depend only on Mathlib and on this mission's own definition items, and checked to compile against the platform's Mathlib revision. Each draft item carries a read-back; those read-backs are non-blind — they were written by the same agent that drafted the statements, and each says so in its first line. They are documentation, not independent testimony.

93 thms14 active usersReviewed
Number Theory·Captain: quesswho

Collapsible CubicsOpen Problem

Motivation

A polynomial f∈Q[x]f \in \mathbb{Q}[x]f∈Q[x] is split if deg⁡f≥1\deg f \ge 1degf≥1 and f(x)=a∏i=1n(x−ri)f(x) = a\prod_{i=1}^{n}(x - r_i)f(x)=a∏i=1n​(x−ri​) for some a∈Q×a \in \mathbb{Q}^\timesa∈Q× and r1,…,rn∈Qr_1,\dots,r_n \in \mathbb{Q}r1​,…,rn​∈Q. Split polynomials are the simplest non-constant maps defined over Q\mathbb{Q}Q that one can apply to an algebraic number: they are exactly the rational polynomials all of whose roots are rational. The question here is how much such a map can do — whether it can always push an algebraic number back down into Q\mathbb{Q}Q.

Say α\alphaα is kkk-collapsible if there are split f1,…,fkf_1,\dots,f_kf1​,…,fk​ with (fk∘⋯∘f1)(α)∈Q(f_k \circ \cdots \circ f_1)(\alpha) \in \mathbb{Q}(fk​∘⋯∘f1​)(α)∈Q, collapsible if it is 111-collapsible, and eventually collapsible if it is kkk-collapsible for some k≥1k \ge 1k≥1. Problem 3 of Griffin Macris's list of open problems asks whether every algebraic number is eventually collapsible. The two notions come apart at degree 333: Jordi Ribes settled the cubic case of eventual collapsibility using a composition of three split polynomials, and for eventual collapsibility the open frontier is deg⁡α≥4\deg\alpha \ge 4degα≥4. For the one-step notion the picture is different — degrees 111 and 222 are settled, and degree 333 is open. That one-step cubic case is this mission's goal.

Setting

Let α\alphaα be an algebraic number with [Q(α):Q]=3[\mathbb{Q}(\alpha):\mathbb{Q}] = 3[Q(α):Q]=3. After an affine change of variable over Q\mathbb{Q}Q one may assume α\alphaα is a root of a depressed cubic

m(x)=x3+d x+e,d,e∈Q,m(x) = x^3 + d\,x + e, \qquad d, e \in \mathbb{Q},m(x)=x3+dx+e,d,e∈Q,

with discriminant Δ=disc⁡(m)=−4d3−27e2\Delta = \operatorname{disc}(m) = -4d^3 - 27e^2Δ=disc(m)=−4d3−27e2. When Δ>0\Delta > 0Δ>0 the cubic is totally real (three real roots); when Δ<0\Delta < 0Δ<0 it has one real root and a complex-conjugate pair. In the latter case write the roots as

α1=−2u,α2,3=u±iv,d=v2−3u2,e=2u(u2+v2),\alpha_1 = -2u, \qquad \alpha_{2,3} = u \pm iv, \qquad d = v^2 - 3u^2, \quad e = 2u(u^2 + v^2),α1​=−2u,α2,3​=u±iv,d=v2−3u2,e=2u(u2+v2),

and set ψ=arctan⁡(3u/v)\psi = \arctan(3u/v)ψ=arctan(3u/v), the parameter that controls the archimedean obstruction below. Scaling α↦wα\alpha \mapsto w\alphaα↦wα sends (d,e)↦(w2d,w3e)(d,e) \mapsto (w^2 d, w^3 e)(d,e)↦(w2d,w3e), so the single rational invariant

τ=e2/d3\tau = e^2/d^3τ=e2/d3

determines the problem up to scaling: the search space is one rational parameter, not two.

Formalization targets

Goal — every cubic algebraic number is collapsible

∀ α∈C,[Q(α):Q]=3 ⟹ ∃ f split with f(α)∈Q.\forall\, \alpha \in \mathbb{C}, \quad [\mathbb{Q}(\alpha):\mathbb{Q}] = 3 \ \Longrightarrow\ \exists\, f \text{ split with } f(\alpha) \in \mathbb{Q}.∀α∈C,[Q(α):Q]=3 ⟹ ∃f split with f(α)∈Q.

This is the weakest statement that settles the case: it fixes no bound on deg⁡f\deg fdegf, and asserts only that some split fff exists. A version with a degree bound would be strictly stronger and is not the goal, because no such bound is known — indeed the archimedean milestone below shows no uniform one can exist.

Supporting targets

The milestone list runs from the reformulation and the invariance reductions, through the known sufficient conditions, to the two obstructions and the two genuinely open sub-targets. Ordered as they are stated there:

  1. the product criterion — α\alphaα is collapsible iff ∏i(α−ri)∈Q\prod_i(\alpha - r_i) \in \mathbb{Q}∏i​(α−ri​)∈Q for some nonempty finite multiset of rationals, which turns collapsibility into a multiplicative relation in K×/Q×K^\times/\mathbb{Q}^\timesK×/Q×;
  2. affine invariance, and the completeness of τ\tauτ as an invariant of the scaling action, which together justify the reduction to one parameter;
  3. two sufficient conditions: square discriminant, and the power-family condition subsuming it;
  4. three obstructions: gap parity in the totally real case; the archimedean degree bound when Δ<0\Delta < 0Δ<0; and the extension of that bound beyond cubics, to any algebraic number possessing both a real and a non-real conjugate.

The mission also carries, as a plain theorem rather than a milestone, the single open instance x3+6x+1x^3 + 6x + 1x3+6x+1 — the smallest cubic within computational reach for which no collapsing is known. It is an instance of the goal rather than a step toward it, which is why it is not on the attack path.

Significance

A proof of the goal closes the one-step cubic case and, with Ribes's composition result, would give a complete picture at degree 333. A disproof would be at least as informative: a single cubic α\alphaα admitting no split fff with f(α)∈Qf(\alpha) \in \mathbb{Q}f(α)∈Q would separate 111-collapsibility from eventual collapsibility by an explicit example, showing that composition is genuinely necessary and not an artefact of the known proof.

The supporting targets have value independent of the goal. The product criterion is the statement everything else is phrased against. The archimedean bound is the only known mechanism forcing deg⁡f→∞\deg f \to \inftydegf→∞, and it is what rules out a uniform-degree approach.

Status, stated precisely. Six of the eight milestones have machine-checked Lean 4 + Mathlib proofs in the author's development, against a newer Mathlib revision than this mission's environment; restating and reproving them here is a port, not new mathematics, and they are included because the goal cannot be attacked without them. The two archimedean milestones are not proved in that form. For the cubic bound both halves exist — the convexity argument and the Möbius reduction — but the statement in terms of a collapsing polynomial has not been assembled. The extension beyond cubics has not been formalised at all; the argument is the same one, since nothing in it uses cubicness beyond the identification of a single circle parameter, but that observation is not a proof. The instance x3+6x+1x^3 + 6x + 1x3+6x+1 and the goal itself are open.

Difficulty

The obvious approach is to write down a split fff with rational roots and force f(α)∈Qf(\alpha) \in \mathbb{Q}f(α)∈Q by solving for the roots. This works when Δ\DeltaΔ is a rational square, and more generally under the power-family condition, and produces the bulk of the known examples — but it cannot work in general, for a reason that is quantitative rather than technical.

Suppose Δ<0\Delta < 0Δ<0 and f=a∏i(x−ri)f = a\prod_i(x - r_i)f=a∏i​(x−ri​) is split with f(α)∈Qf(\alpha) \in \mathbb{Q}f(α)∈Q. Irreducibility of mmm forces f−cf - cf−c to be divisible by mmm, hence f(α1)=f(α2)≠0f(\alpha_1) = f(\alpha_2) \ne 0f(α1​)=f(α2​)=0, hence ∏iα1−riα2−ri=1\prod_i \frac{\alpha_1 - r_i}{\alpha_2 - r_i} = 1∏i​α2​−ri​α1​−ri​​=1. Each factor lies on a fixed circle through 000 and 111 determined by ψ\psiψ, and a convexity argument on log⁡cos⁡\log\coslogcos then forces

deg⁡f ≥ π/ψ.\deg f \ \ge\ \pi/\psi.degf ≥ π/ψ.

As τ→0+\tau \to 0^+τ→0+ one has ψ→0\psi \to 0ψ→0, so the required degree is unbounded: there is no uniform degree in which to search, and any construction must produce split polynomials of growing degree. This is the central difficulty. For x3+6x+1x^3 + 6x + 1x3+6x+1 the bound already gives deg⁡f≥32\deg f \ge 32degf≥32, which is why that cubic resists the searches that settle its neighbours.

Only one step of this argument is special to cubics: the identification of the circle parameter as 3u/v3u/v3u/v. For an algebraic number of any degree with a real conjugate α1\alpha_1α1​ and a non-real conjugate α2\alpha_2α2​, irreducibility gives the same relation ∏i(α1−ri)/(α2−ri)=1\prod_i (\alpha_1 - r_i)/(\alpha_2 - r_i) = 1∏i​(α1​−ri​)/(α2​−ri​)=1, the images again lie on a circle through 000 and 111, and the parameter is λ=(Re⁡α2−α1)/Im⁡α2\lambda = (\operatorname{Re}\alpha_2 - \alpha_1)/\operatorname{Im}\alpha_2λ=(Reα2​−α1​)/Imα2​, which specialises to 3u/v3u/v3u/v in the depressed-cubic case. The obstruction therefore constrains the whole conjecture, not merely its cubic case, which is why the extension is carried as a milestone in its own right.

In the totally real case (Δ>0\Delta > 0Δ>0) the archimedean argument gives nothing at all — the relevant Möbius maps are real and surject onto R^\widehat{\mathbb{R}}R — and the only known constraint is that each gap between consecutive conjugates contains an even number of roots of fff. Whether degrees stay bounded there is itself unsettled.

Formalization scope

Representation. IsSplit f says 0<deg⁡f0 < \deg f0<degf and f=C a⋅∏r∈rs(X−r)f = C\,a \cdot \prod_{r \in rs}(X - r)f=Ca⋅∏r∈rs​(X−r) for a nonzero rational aaa and a multiset rsrsrs of rationals; multiplicities are therefore allowed and the roots need not be distinct. Collapsible α is stated for α\alphaα in an arbitrary field KKK carrying a Q\mathbb{Q}Q-algebra structure, not only for K=CK = \mathbb{C}K=C, so the results apply verbatim to a root in R\mathbb{R}R, in C\mathbb{C}C, or in Q[x]/(m)\mathbb{Q}[x]/(m)Q[x]/(m). The goal theorem is stated over C\mathbb{C}C, with "cubic" expressed as deg⁡(minpoly⁡Qα)=3\deg(\operatorname{minpoly}_{\mathbb{Q}}\alpha) = 3deg(minpolyQ​α)=3.

Ruling out a trivialisation. Collapsible places no lower bound on deg⁡f\deg fdegf and does not require the value c=f(α)c = f(\alpha)c=f(α) to be nonzero, so one must check that the goal is not satisfiable by degenerate means. It is not: c=0c = 0c=0 would make m∣fm \mid fm∣f, impossible for an irreducible cubic mmm dividing a polynomial that splits over Q\mathbb{Q}Q. Constant fff is excluded by 0<deg⁡f0 < \deg f0<degf. Nothing in the statement is vacuous — the hypotheses of the goal are satisfied by every cubic irrationality.

Conventions in the archimedean milestones. In the cubic bound the parameters u,vu, vu,v enter as real numbers satisfying the factorisation identity, with the normalisation 0<uv0 < uv0<uv; this is not a restriction, since vvv is determined only up to sign and the sign may be chosen. Under it ψ=arctan⁡(3u/v)∈(0,π/2)\psi = \arctan(3u/v) \in (0, \pi/2)ψ=arctan(3u/v)∈(0,π/2), and the conclusion is π/ψ≤deg⁡f\pi/\psi \le \deg fπ/ψ≤degf with deg⁡f\deg fdegf the natural-number degree.

In the general bound the corresponding normalisation is 0<(Re⁡α2−α1)Im⁡α20 < (\operatorname{Re}\alpha_2 - \alpha_1)\operatorname{Im}\alpha_20<(Reα2​−α1​)Imα2​. It forces Im⁡α2≠0\operatorname{Im}\alpha_2 \neq 0Imα2​=0, so α2\alpha_2α2​ is genuinely non-real and λ>0\lambda > 0λ>0, hence ψ∈(0,π/2)\psi \in (0,\pi/2)ψ∈(0,π/2) and no division-by-zero value can arise in the conclusion. Passing to the complex conjugate of α2\alpha_2α2​ flips the sign of both factors, so the condition is a choice of conjugate rather than a restriction — except when Re⁡α2=α1\operatorname{Re}\alpha_2 = \alpha_1Reα2​=α1​, which the hypothesis excludes and which cannot occur for a depressed cubic with Δ<0\Delta<0Δ<0. No degree hypothesis on mmm is needed: possessing both a real and a non-real root already forces deg⁡m≥3\deg m \ge 3degm≥3.

Infrastructure. A complete development needs Polynomial, Multiset, minpoly, and for the archimedean bound Real.arctan, Complex.arg, and strict concavity of log⁡cos⁡\log\coslogcos on (−π/2,π/2)(-\pi/2, \pi/2)(−π/2,π/2). The convexity and Möbius lemmas are reusable well beyond this mission — they bound the number of factors in any product of complex numbers constrained to a circle through the origin. Contributions of any of the supporting targets are welcome independently of the goal; so is a disproof, and so is an explicit collapsing of x3+6x+1x^3 + 6x + 1x3+6x+1 of any degree.

Selected references

  • Griffin Macris, List of open problems, Problem 3. https://sites.google.com/view/griffinmacris/open-problems
  • Miles, Collapsible algebraic numbers, 2026. https://quesswho.github.io/miles-blog/2026/08/20/collapsible/ — source of the definitions of split, kkk-collapsible, collapsible and eventually collapsible used above, of Ribes's cubic result for eventual collapsibility, and of the statement that the degree-333 case of one-step collapsibility is open.
21 thms6 active usersReviewed
Pure Mathematics·Captain: ShouqiaoWang

Arbitrary Torsion in Moment-Angle Homology and Loop HomologyResearch Paper

Motivation

Moment-angle complexes are central objects in toric topology. They convert the combinatorics of a simplicial complex into a topological space assembled from disks and circles, allowing face structure to influence homotopy and homology. When the simplicial complex triangulates a sphere, the resulting space is a moment-angle manifold. Torsion in the integral homology of these manifolds is difficult to realize in low simplicial dimension, and torsion in the homology of their based loop spaces is even more constrained. Yang Han and Keke Li's Theorem 1.7 asserts that dimension four is already universal: every finitely generated abelian group can occur as a subgroup of both homology theories for one and the same simplicial 444-sphere.

This mission formalizes that headline existence statement. It is not restricted to a chosen finite list of groups or primes, and it requires a common simplicial sphere rather than permitting separate witnesses for ordinary and loop homology.

Setting

Let LLL be an abstract simplicial complex on a finite vertex set [m][m][m]. Its geometric realization ∣L∣|L|∣L∣ is formed from probability vectors whose supports are faces of LLL. The condition that LLL is a simplicial 444-sphere means that this realization is homeomorphic to the unit sphere S4⊂R5S^4\subset\mathbb R^5S4⊂R5.

For each face σ∈L\sigma\in Lσ∈L, assign a copy of the closed disk D2D^2D2 at vertices in σ\sigmaσ and the boundary circle S1S^1S1 at vertices outside σ\sigmaσ. The associated moment-angle complex is

ZL=⋃σ∈L∏i=1mYi(σ),Yi(σ)={D2,i∈σ,S1,i∉σ.\mathcal Z_L =\bigcup_{\sigma\in L} \prod_{i=1}^{m}Y_i(\sigma), \qquad Y_i(\sigma)= \begin{cases} D^2,&i\in\sigma,\\ S^1,&i\notin\sigma. \end{cases}ZL​=σ∈L⋃​i=1∏m​Yi​(σ),Yi​(σ)={D2,S1,​i∈σ,i∈/σ.​

The all-ones point is a canonical basepoint. Write ΩZL\Omega\mathcal Z_LΩZL​ for the based loop space with the compact-open topology. For a space XXX, the mission uses total integral singular homology

H∗(X;Z)=⨁q≥0Hq(X;Z)H_*(X;\mathbb Z)=\bigoplus_{q\ge0}H_q(X;\mathbb Z)H∗​(X;Z)=q≥0⨁​Hq​(X;Z)

as an additive abelian group. Saying that an abelian group GGG is a subgroup means that there is an injective additive homomorphism G↪H∗(X;Z)G\hookrightarrow H_*(X;\mathbb Z)G↪H∗​(X;Z).

Formalization targets

Arbitrary torsion in one moment-angle manifold

For every finitely generated abelian group GGG, prove that there are an integer mmm and a simplicial complex LLL on Fin m such that ∣L∣≅S4|L|\cong S^4∣L∣≅S4 and there are injective homomorphisms

G↪H∗(ZL;Z),G↪H∗(ΩZL;Z).G\hookrightarrow H_*(\mathcal Z_L;\mathbb Z), \qquad G\hookrightarrow H_*(\Omega\mathcal Z_L;\mathbb Z).G↪H∗​(ZL​;Z),G↪H∗​(ΩZL​;Z).

The quantifier order matters: the same mmm and the same LLL must support both embeddings. The target concerns additive subgroups of total graded homology; it does not require the two embeddings to land in the same degree or to preserve multiplicative structures.

Significance

The theorem gives a universality statement for moment-angle manifolds over simplicial 444-spheres. It says that no classification by a bounded list of torsion primes or exponents can describe all such homology and loop-homology groups. Requiring both embeddings for a single LLL connects the ordinary topology of the manifold to its based-loop topology rather than proving two unrelated existence results.

Formalizing the theorem requires reusable foundations in several areas: finite abstract simplicial complexes, geometric realization, polyhedral products, based loop spaces, integral singular homology, graded direct sums, and additive embeddings. The published article presents a human proof; this mission records its intended main theorem as an open Lean target. The definitions do not assume the existence of the required sphere or embeddings, so a solver must supply the mathematical construction and all homological consequences.

Difficulty

The assertion ranges over arbitrary finitely generated abelian groups, including free parts and prime-power torsion of unbounded exponent. A finite check of selected groups cannot establish the target. The same finite simplicial object must simultaneously control two different homology theories, one of which is applied to an infinite-dimensional function space. Standard library support is strongest for singular homology as a functor, while concrete calculations for moment-angle spaces and loop spaces require additional bridges.

There is also a substantial representation boundary between combinatorics and topology. The face data of LLL, the union of disk-circle products, the homeomorphism ∣L∣≅S4|L|\cong S^4∣L∣≅S4, and the induced maps on homology must all refer to compatible spaces and basepoints. A formal solution cannot replace “simplicial sphere” by a mere Boolean flag or replace homology by an arbitrary group-valued field.

Formalization scope

Lean represents LLL using AbstractSimplicialComplex (Fin m). Because Mathlib's structure includes singleton faces automatically, the auxiliary face predicate explicitly restores the conventional empty face where the moment-angle union needs it. The geometric realization is the standard support-restricted probability simplex, and the sphere condition is an actual homeomorphism to the Euclidean unit 444-sphere.

The moment-angle space is a subtype of (Fin m → ℂ) defined by the literal disk/circle coordinate condition. The loop space consists of based continuous paths with matching endpoints and carries the compact-open topology inherited from Mathlib's path construction. Homology is singularHomologyFunctor with coefficients in Z\mathbb ZZ, and total homology is a direct sum over all natural degrees.

The statement permits the two embeddings to occupy different degrees and makes no ring-embedding claim; these choices match the source phrase “contain GGG as a subgroup.” It rules out vacuity by requiring an actual simplicial complex, an actual sphere homeomorphism, and injective additive maps. Contributions that isolate degree-specific refinements, compute homology of standard polyhedral products, or formalize reusable loop-space equivalences are welcome, provided they reconnect to the stated root theorem.

Selected references

  • Yang Han and Keke Li, Moment Angle Manifolds Corresponding to S4S^4S4 Whose Homology and Loop Homology May Have Arbitrary Torsion, International Mathematics Research Notices 2026(4), 1--7, 2026. DOI
  • A. Bahri, M. Bendersky, F. R. Cohen, and S. Gitler, The polyhedral product functor: a method of decomposition for moment-angle complexes, arrangements and related spaces, Advances in Mathematics 225(3), 2010, 1634--1668. DOI
17 thms6 active usersReviewed
Quantum Information·Captain: wenxinzhang

Existence of complete sets of mutually unbiased basesOpen Problem

Motivation

Two orthonormal bases of C^d are mutually unbiased when every transition amplitude has squared modulus 1/d. At most d+1 such bases can coexist, and complete families are known in prime-power dimensions through finite-field constructions. Dimension six is the smallest famous composite case where existence of the complete seven-base family remains unknown.

This mission turns CUHK-Shenzhen AI Math Problem 16, Existence of complete sets of mutually unbiased bases, into an auditable Lean campaign. The objective is not merely to transcribe notation: it is to expose the mathematical model, the capstone, and a smaller attack surface as separate artifacts that other formalizers can inspect and reuse.

Setting

Construct seven 6 by 6 unitary-column matrices whose every distinct pair has all transition amplitudes of squared modulus 1/6. The baseline milestone constructs three pairwise mutually unbiased bases, a known lower bound that tests all matrix conventions.

Significance

Solving this target would settle the precise finite or analytic core represented by the Lean statement and would create reusable infrastructure in quantum information theory, mutually unbiased bases, finite fields, Hilbert spaces. Even a rigorous disproof is valuable: several entries in this collection deliberately ask whether an attractive extrapolation is true, and Lean forces a counterexample to satisfy every side condition. The mission therefore treats theorem proving and model criticism as equally legitimate research outcomes.

Difficulty

The equations are a large coupled system of polynomial equalities over complex phases, modulo substantial gauge symmetry. Numerical near-solutions do not certify exact existence, while nonexistence would require a global obstruction beyond currently known bounds. Dimension six lacks the finite-field structure that supplies complete prime-power constructions.

Suggested attack route

Formalize standard gauge reductions: fix the first basis to the identity and dephase transition Hadamard matrices. Verify a three-basis tensor-product construction. Then encode additional bases through complex Hadamard matrices and study algebraic constraints, Gröbner-style eliminations, semidefinite bounds, or exact certificates. Computational searches may guide conjectures, but uploaded proofs must convert numerical evidence to exact algebraic identities or certified inequalities.

Formalization scope

The Lean target is exact: column orthonormality is U-adjoint times U equals identity, and mutual unbiasedness uses Mathlib complex norm squared. Seven bases are indexed by Fin 7. No quotient by phase, permutation, or global unitary is built into the statement, since these symmetries preserve the predicate and can be used within proofs.

The natural-language source remains authoritative for motivation, while the Lean declaration is authoritative for what Prove2Me will verify. The mission description calls out restrictions where the current formal target is a finite-dimensional core, a fixed interpretation of informal terminology, or one sharpened subquestion from a broader classification problem. Those restrictions should not be silently generalized in a proof claim.

Milestones

Publish an exact three-basis construction in dimension six, then formalize dephasing and obstruction lemmas for extending a partial family.

The capstone is marked as the mission's main item and is never duplicated as a milestone. Definitions precede theorem statements in the proposal order. A milestone is considered complete only when its own exact statement is proved; proving a nearby theorem with stronger-looking prose but mismatched quantifiers, signs, supports, dimensions, or asymptotic constants does not complete it.

Timeline and literature status

The CUHK-Shenzhen AI Math Problems page added this problem on June 23, 2026. At the drafting date, August 31, 2026, the status and target corrections described above were checked against the source page and the cited primary material.

Acceptance criteria

A contribution may prove the displayed theorem or refute it by constructing data satisfying every Lean hypothesis while negating the conclusion. Informal changes of model do not count: any proposed correction must be submitted as a separately reviewed statement with an explanation of which source ambiguity or false implication it repairs. Definitions must remain computational or mathematically constrained; fields that simply assume the desired conclusion are not acceptable. Every proof must compile against the mission's pinned Mathlib revision, use no sorry, and expose a top-level theorem solution when submitted to Prove2Me.

The main theorem is intentionally separated from a smaller milestone. Contributors should preserve that dependency order, publish reusable lemmas rather than monolithic tactics, and report whether a lemma is analytic, algebraic, combinatorial, or infrastructure-only. Numerical evidence, external computer algebra, and exhaustive search are welcome for discovery, but a final certificate must be replayable by Lean. If an external result is invoked, its hypotheses must be represented in the formal statement or proved in the dependency tree.

Formal verification policy

The files were built locally with Lean 4.30.0 and Mathlib revision c5ea00351c28e24afc9f0f84379aa41082b1188f, the supported Prove2Me environment at drafting time. The mission definition file is ordered before all theorem files, and each theorem imports exactly that public definition module or Mathlib. Independent blind read-backs accompany the draft items so reviewers can compare what the Lean code literally says with this mathematical description. Human confirmation remains required before the public proposal can be submitted for moderation.

Selected references

  • Original problem
  • Durt et al., review of MUBs
14 thms5 active usersReviewed
Captain: mysticflounder

Equational Magmas: E677 → E255 (finite case)Open Problem

Motivation

An equation for a magma constrains a binary operation without assuming that it is associative, commutative, or has an identity. Which laws imply which others, over all magmas or over finite magmas only, is the question the Equational Theories Project studies at scale. Restricting the underlying set to be finite can change the answer: a structural argument may depend on the fact that a surjective self-map of a finite set is injective.

The project's December 2025 paper reports the finite implication from E677 to E255 as unresolved, while reporting a counterexample to the implication when infinite magmas are allowed. The paper also tentatively conjectures that a finite counterexample exists. This mission makes the affirmative implication its formal target and also accepts a rigorous refutation of the complete finite statement.

This mission treats the universal target as open. Supporting structural facts and conditional reductions are separately identified, so that progress on one does not assert completion of the target.

Setting

A magma here is a type α\alphaα with a total binary operation ⋄:α×α→α\diamond:\alpha\times\alpha\to\alpha⋄:α×α→α. Parentheses specify the order of evaluation throughout; no reassociation is permitted. The condition E677 means

∀x,y∈α,x=y⋄(x⋄((y⋄x)⋄y)).\forall x,y\in\alpha,\quad x=y\diamond\bigl(x\diamond((y\diamond x)\diamond y)\bigr).∀x,y∈α,x=y⋄(x⋄((y⋄x)⋄y)).

The condition E255 means

∀x∈α,x=((x⋄x)⋄x)⋄x.\forall x\in\alpha,\quad x=((x\diamond x)\diamond x)\diamond x.∀x∈α,x=((x⋄x)⋄x)⋄x.

These are the two laws used in Chapter 13 of the project blueprint. For a fixed element yyy, the left translation (left multiplication) map is Ly(x)=y⋄xL_y(x)=y\diamond xLy​(x)=y⋄x. A fixer of xxx is an element yyy with y⋄x=xy\diamond x=xy⋄x=x; it acts on xxx from the left. This definition concerns one element xxx; it does not require yyy to act as an identity on every element. The left orbit of xxx is the forward orbit x,Lx(x),Lx2(x),…x,L_x(x),L_x^2(x),\ldotsx,Lx​(x),Lx2​(x),… of xxx under its own left translation.

Formalization targets

The supporting targets expose the relevant distinction between a constraint on a possible fixer and the existence of a fixer. For every finite α\alphaα satisfying E677, the first supporting statement is

∀y∈α,Ly is bijective.\forall y\in\alpha,\quad L_y\text{ is bijective}.∀y∈α,Ly​ is bijective.

The second supporting statement determines any fixer:

∀x,y∈α,y⋄x=x ⟹ y=(x⋄x)⋄x.\forall x,y\in\alpha,\quad y\diamond x=x\ \Longrightarrow\ y=(x\diamond x)\diamond x.∀x,y∈α,y⋄x=x ⟹ y=(x⋄x)⋄x.

The third supporting statement is the backward recurrence

∀x,y∈α,x=(y⋄x)⋄((y⋄(y⋄x))⋄y).\forall x,y\in\alpha,\quad x=(y\diamond x)\diamond\bigl((y\diamond(y\diamond x))\diamond y\bigr).∀x,y∈α,x=(y⋄x)⋄((y⋄(y⋄x))⋄y).

These three statements are blueprint Lemma 13.1(i)–(iii) and are Proved on this platform. The following fixer-existence assertion is the same obligation as E255 under E677 and finiteness (blueprint Lemma 13.2); it is a reduction node, not a milestone:

∀x∈α,∃y∈α,y⋄x=x.\forall x\in\alpha,\quad\exists y\in\alpha,\quad y\diamond x=x.∀x∈α,∃y∈α,y⋄x=x.

The mission goal is

∀ finite magmas α,E677⁡(α) ⟹ E255⁡(α).\forall\text{ finite magmas }\alpha,\quad \operatorname{E677}(\alpha)\ \Longrightarrow\ \operatorname{E255}(\alpha).∀ finite magmas α,E677(α) ⟹ E255(α).

For finite E677 magmas, E255 at xxx supplies the fixer (x⋄x)⋄x(x\diamond x)\diamond x(x⋄x)⋄x; from any fixer yyy of xxx, Lemma 13.1(ii) gives y=(x⋄x)⋄xy=(x\diamond x)\diamond xy=(x⋄x)⋄x and hence E255 at xxx. Each direction is one line, so fixer existence is not a strictly weaker milestone.

Three open sub-goals come from the case split in the accepted reduction sketches for the fixer-existence node. Sub-goal 1 is orbit-local: for a fixed xxx, if two elements of the left orbit of xxx have equal right products by xxx, then they are equal or xxx has a fixer. Sub-goal 2 concerns the case of exactly one element AAA outside the left orbit of xxx, with xxx having no fixer: a right-translation collision c⋄x=A⋄xc\diamond x=A\diamond xc⋄x=A⋄x between an orbit point ccc and AAA must propagate to the orbit successor x⋄cx\diamond cx⋄c. Sub-goal 3 assumes x⋄x≠xx\diamond x\ne xx⋄x=x and at least two elements outside the left orbit: if right translation by xxx sends an orbit point outside the orbit, then xxx has a fixer. Sub-goal 3 is not a smaller case of the goal. If it holds for every finite E677 magma, the mission goal follows by a product construction (item 1 of Known reductions and results below), and the mission goal gives Sub-goal 3 because E255 at xxx supplies the fixer (x⋄x)⋄x(x\diamond x)\diamond x(x⋄x)⋄x. So a proof of Sub-goal 3 alone proves the goal, and a route through Sub-goals 1 and 2 still needs Sub-goal 3. The D4 milestones specialize Sub-goal 1 to a left orbit of exact period four; D4.0, D4.1, D4.2 and D4.4a–e are Proved, and the series is open at D4.3 and its five branch closeouts D4.3a–e. One conditional result (E677 together with conjugacy-closed left translations implies E255; Padilla, 2026) is Proved on this platform. The counterexample milestone is the disproof target. None of the displayed statements restricts the cardinality to a tested range.

In the authors' repository, Sub-goal 1 is called Piece 1, the unique-outsider case containing Sub-goal 2 is called Gap 1, and the case of Sub-goal 3 is called Gap ≥ 2; those names appear in some theorem sources and file names.

Significance

A resolution determines whether this particular law gains E255 as a consequence upon restriction to finite carriers. An affirmative proof must cover every finite cardinality, every operation on each carrier, and every assignment of the universally quantified elements. A finite counterexample must supply an operation that satisfies every instance of E677 while failing E255 at some element.

The formal package provides small, reusable statements of the two laws, the left translation property, and the fixer constraint. Keeping these statements separate allows their precise hypotheses and conclusions to be checked individually. In particular, the second supporting result says what a fixer must be when one exists; the fixer-existence formulation records the additional mathematical content needed to ensure existence.

Difficulty

The left translation conclusion concerns maps with the left input fixed. The fixer-existence formulation instead asks about the image of the map y↦y⋄xy\mapsto y\diamond xy↦y⋄x, with its right input fixed. No assumption in the formal goal makes these two maps interchangeable. Bijectivity of every left translation map alone does not state that a fixer exists.

Because the implication fails for infinite magmas, E255 is not an equational consequence of E677, so any proof must use finiteness in an essential way. The blueprint's linear and linear-extension constructions cannot produce a finite counterexample (blueprint Lemmas 13.3 and 13.4); community members have formalized on this platform the scalar-coefficient case of the linear lemma, the Type I and Type II affine families, and the linear-extension lemma (see the discussion thread).

Likewise, checking a collection of finite operation tables does not quantify over arbitrary finite cardinalities. Such computation does not discharge the goal submitted here. Any proof must justify every use of finiteness and retain the displayed parenthesization of the laws.

Formalization scope

The representation uses an arbitrary universe-polymorphic type, an explicit binary operation, and a Fintype instance for finite targets. Passing the operation explicitly avoids importing a separate magma package or imposing algebraic typeclass laws. The predicates E677 and E255 themselves do not assume finiteness; each theorem states its own finite-carrier hypothesis.

Empty carriers are included. Both laws hold vacuously on them; the pointwise fixer statement is also vacuous because there is no element xxx. Consequently an empty carrier cannot refute the main goal. Nonempty carriers of every finite size are included without further assumptions. There is no associativity, commutativity, idempotence, identity element, or cancellation hypothesis hidden in the representation.

The definition bundle FiniteMagmaE677 provides E677, E255, HasFixerAt (existence of a fixer of xxx), InLeftOrbit (membership in the left orbit of xxx) and OrbitRightCollisionOrFixer. Three further bundles, FiniteMagmaE677_seventh_element_growth, FiniteMagmaE677_d4_first_return and FiniteMagmaE677_sswap_renewal, hold the period-four packet types used by the D4 milestones.

Status (2026-10-17 UTC). Proved on this platform: Lemma 13.1(i)–(iii), the Sub-goal 1 and Sub-goal 2 support lemmas, D4.0, D4.1, D4.2, D4.4a–e, the conditional conjugacy-closure theorem, and three further conditional theorems by omegaestable (existential row transport, parametrized row transport, left-parameter transport; see the discussion thread). Open: Sub-goals 1–3, D4.3 with D4.3a–e, and the counterexample target. Community members have also formalized the blueprint's 496-element non-right-cancellative E677 magma (see the discussion thread).

Welcome contributions: a proof of any open sub-goal or D4.3 branch (a proof of Sub-goal 3 proves the goal; see item 1 below); a proof sketch that reduces an open leaf to new lemmas; a concrete operation table on Fin n proving finite_counterexample, which would make the main theorem false.

Known reductions and results from the captain's repository

These results are in the captain's private repository and are not on this platform. Readers cannot open that repository, so each statement is given in full. For a Lean result, the axioms that Lean reports are listed.

1. Sub-goal 3 alone gives the mission goal. PROVEN (Lean; axioms propext, Classical.choice, Quot.sound). Let KKK be the E677 magma on {0,…,6}\{0,\dots,6\}{0,…,6} whose rows a⋄0,…,a⋄6a\diamond 0,\dots,a\diamond 6a⋄0,…,a⋄6 for a=0,…,6a=0,\dots,6a=0,…,6 are 6304251, 5620143, 2063514, 1256430, 0431625, 3145062, 4512306 (file db/7/1 of the public collection memoryleak47/eq677). The left orbit of 000 in KKK is 0,6,1,3,4,20,6,1,3,4,20,6,1,3,4,2, the only element outside it is 555, and the orbit point L02(0)=1L_0^2(0)=1L02​(0)=1 has 1⋄0=51\diamond 0=51⋄0=5. Let α\alphaα be a finite E677 magma and x∈αx\in\alphax∈α with x⋄x≠xx\diamond x\ne xx⋄x=x. Then α×K\alpha\times Kα×K with the componentwise operation satisfies E677 (product_e677 on this platform), and the second coordinates of the left orbit of X=(x,0)X=(x,0)X=(x,0) are the left orbit of 000 in KKK. So X⋄X≠XX\diamond X\ne XX⋄X=X; (x,5)(x,5)(x,5) and (x⋄x,5)(x\diamond x,5)(x⋄x,5) are two distinct elements outside the left orbit of XXX; and LX2(X)⋄XL_X^2(X)\diamond XLX2​(X)⋄X has second coordinate 555, so it is outside the orbit. These are the hypotheses of Sub-goal 3 at XXX, and a fixer (y1,y2)(y_1,y_2)(y1​,y2​) of XXX gives the fixer y1y_1y1​ of xxx. If x⋄x=xx\diamond x=xx⋄x=x, then xxx is a fixer of xxx. So Sub-goal 3, for every finite E677 magma, gives a fixer of every element of every finite E677 magma, and E255 follows by Lemma 13.1(ii). Source: Adam McKenna, The Missing Pair (private repository), revision 4100763b, lean/E677/Transport.lean, e677_fixer_exists_of_d7_leaf. The hypothesis of that theorem is the repository's D7TwoOutsiderRightDipPacket (lean/E677/Spine/D7NonFullCore.lean). Each part of it and the matching hypothesis of Sub-goal 3 give each other in one step: ¬∃i, a=Lxi(x)\neg\exists i,\ a=L_x^i(x)¬∃i, a=Lxi​(x) against ∀n, a≠Lxn(x)\forall n,\ a\ne L_x^n(x)∀n, a=Lxn​(x) for an outsider, and an escaping orbit point Lxk(x)L_x^k(x)Lxk​(x) against its index kkk. The conclusion is the same formula ∃y, y⋄x=x\exists y,\ y\diamond x=x∃y, y⋄x=x.

2. Normal form of a counterexample. PROVEN (Lean; axioms propext, Classical.choice, Quot.sound). Write D(z)=((z⋄z)⋄z)⋄zD(z)=((z\diamond z)\diamond z)\diamond zD(z)=((z⋄z)⋄z)⋄z. A congruence is a reflexive, symmetric and transitive relation θ\thetaθ such that a θ ba\,\theta\,baθb and c θ dc\,\theta\,dcθd imply (a⋄c) θ (b⋄d)(a\diamond c)\,\theta\,(b\diamond d)(a⋄c)θ(b⋄d). If some finite E677 magma fails E255, then for some nnn there are an E677 operation on {0,…,n−1}\{0,\dots,n-1\}{0,…,n−1} and a point zzz with D(z)≠zD(z)\ne zD(z)=z such that every element is a ⋄\diamond⋄-term in zzz alone, and every congruence that relates two distinct elements also relates zzz and D(z)D(z)D(z). The proof takes the least such nnn; otherwise a submagma or a quotient would be a smaller counterexample. Source: Adam McKenna, The Missing Pair (private repository), revision 4100763b, lean/E677/CriticalCore.lean, E677Crit.exists_pairCritical_counterexample. By E677Crit.not_pairCritical_prod_of_q_ne in the same file (no axioms), if two magmas each have at least two elements, no point of their product at which E255 fails has the congruence property. So a counterexample in this normal form is never such a product, and the construction of item 1 never produces one. Axiom record: docs/current/critical-core-audit-2026-08-03.md.

3. A refuted intermediate statement. NEGATIVE; computational (exhaustive check of one explicit table, run twice with independent encodings; not kernel-checked). Let S(x)S(x)S(x) be the closure of the left orbit of xxx under z↦z⋄xz\mapsto z\diamond xz↦z⋄x. The repository's gate CP asserted: in a finite E677 magma, if the hypotheses of Sub-goal 3 hold at xxx and z↦z⋄xz\mapsto z\diamond xz↦z⋄x is not injective on S(x)S(x)S(x), then the left orbit of xxx has minimal period 777. Let MMM be the E677 magma of order 777777 in file db/77/65 of the same collection. In M×KM\times KM×K (order 539539539; E677 checked on all 5392539^25392 pairs), the point (0,0)(0,0)(0,0) satisfies these hypotheses, and its left orbit has minimal period lcm⁡(7,6)=42\operatorname{lcm}(7,6)=42lcm(7,6)=42. The point (0,0)(0,0)(0,0) has the fixer (76,4)(76,4)(76,4), so this is not a counterexample to E255, and it refutes CP only in the form without a no-fixer hypothesis. With that hypothesis added, the construction of item 1 derives from CP a fixer of every element of every finite E677 magma, and hence the mission goal (PROVEN, Lean: lean/E677/Transport.lean, e677_fixer_exists_of_gate_cp; axioms propext, Classical.choice, Quot.sound). Source: Adam McKenna, The Missing Pair (private repository), revision 4100763b, docs/current/dead-ends/gap-ge-2.md, entry D7-6.

4. Φ(x)=(x⋄x)⋄x\Phi(x)=(x\diamond x)\diamond xΦ(x)=(x⋄x)⋄x is not injective in general. EMPIRICAL. In the 2026-09-27 snapshot of the community database (4091 tables), every table satisfies E255, and Φ\PhiΦ is not injective in 1107 of them; the smallest such order is 777. In one table of order 7, row 6 is the identity row, so 666 is a fixer of every xxx and Lemma 13.1(ii) gives Φ(x)=6\Phi(x)=6Φ(x)=6 for every xxx. So global injectivity of Φ\PhiΦ is not a usable intermediate target. Source: Adam McKenna, The Missing Pair (private repository), revision 4100763b, docs/professor-phi-injectivity.md, correction of 2026-10-14.

5. Solver ledger for one period-four configuration. EMPIRICAL, incomplete. One CNF encoding of a period-four collision configuration of Sub-goal 1 on 11 elements, with added derived constraints, is split into 37 cubes. Twenty cubes are UNSAT, each with an LRAT proof accepted by the native drat-trim LRAT checker (unverified C code, not a kernel-checked proof). The other 17 have no recorded result; each was UNKNOWN under an earlier 300-second limit. No conclusion about Sub-goal 1 follows. Source: Adam McKenna, The Missing Pair (private repository), revision 4100763b, docs/current/e677-closure-plan-2026-08-04.md, section "Live strict PiQD campaign for the 37-cube n = 11 diagnostic".

6. Period-four refinements. PROVEN in the private repository; not ported to this platform (Lean; axioms propext, Classical.choice, Quot.sound). A repository theorem refines the five branches of the D4.2 first-return packet and keeps every case. Write q=c2⋄xq=c_2\diamond xq=c2​⋄x. In the R-through-one branch (the repository's name), each outcome is a fixer of xxx, a strict decrease of a finite contact budget, a new LxL_xLx​-cycle disjoint from the elements already accounted for (with its exact size), or a closed trace of Lq−1L_q^{-1}Lq−1​ that is reduced to two phase-contact families. In the two unswapped S branches, each outcome is a fixer of xxx, a decrease by one of the number of unmarked phases on the LxL_xLx​-cycle of qqq, or a new disjoint LxL_xLx​-cycle with its exact size. These results do not close D4.3 or any of D4.3a–e, because the outcomes are not yet combined into one state with a strictly decreasing well-founded measure. Source: Adam McKenna, The Missing Pair (private repository), revision 4100763b, lean/E677/Spine/Piece1D4RefinedFirstReturn.lean, e677_d4_q_refinedFirstReturnPacket_of_firstReturnPacket; closure plan docs/current/e677-closure-plan-2026-08-04.md, sections "D4 R/S finite renewal integration" and "Production-interface correction".

7. Whole-orbit form of the q-subdiagonal identity. PROVEN in the private repository; not ported to this platform (Lean; axioms propext, Classical.choice, Quot.sound). In a finite E677 magma, fix xxx and write ck=Lxk(x)c_k=L_x^k(x)ck​=Lxk​(x) and qk=ck⋄((ck+1⋄ck)⋄ck+1)q_k=c_k\diamond((c_{k+1}\diamond c_k)\diamond c_{k+1})qk​=ck​⋄((ck+1​⋄ck​)⋄ck+1​). If qi=qjq_i=q_jqi​=qj​ implies ci=cjc_i=c_jci​=cj​ for all i,ji,ji,j, then right translation by xxx is injective on the left orbit of xxx, so Sub-goal 1 holds at xxx through its first alternative. Conversely, if right translation by xxx is injective on the left orbit of xxx, then qi=qjq_i=q_jqi​=qj​ implies ci=cjc_i=c_jci​=cj​ for all i,ji,ji,j. Sub-goal 1 support (b) and (c) are the pointwise statements. So a no-repeat property of the qqq-subdiagonal is not a weaker target than injectivity of right translation on the orbit. Source: Adam McKenna, The Missing Pair (private repository), revision 4100763b, lean/E677/CoreBase.lean, e677_orbitQ_subdiag_injective_iff_Rx_injective_on_orbit.

Selected references

  • Matthew Bolan et al., The Equational Theories Project: Advancing Collaborative Mathematical Research at Scale, arXiv:2512.07087v2 (December 16, 2025), paper.
  • The Equational Theories Project contributors, Equational Theories, online proof blueprint, Chapter 13, equations (1)–(2) and Lemmas 13.1–13.4, chapter, accessed September 7, 2026 and October 13, 2026.
  • J. I. Padilla (GitHub: omegaestable), Prove E677 implies E255 under left translation conjugacy closure, Equational Theories Project pull request #1518, 2026 (closed without merge by its author on 2026-10-13; the theorem is Proved on this platform), pull request.
38 thms4 active usersReviewed
Group TheoryNumber Theory·Captain: Lucas

The Inverse Galois ProblemOpen Problem

Motivation

Galois theory attaches to every finite Galois extension L/KL/KL/K a finite group Gal(L/K)\mathrm{Gal}(L/K)Gal(L/K), the group of field automorphisms of LLL fixing KKK pointwise, and the fundamental theorem of Galois theory turns the subfield structure of L/KL/KL/K into the subgroup structure of that group. The inverse Galois problem asks whether this correspondence is surjective over the rationals: given an arbitrary finite group GGG, is there a Galois extension L/QL/\mathbb{Q}L/Q with Gal(L/Q)≅G\mathrm{Gal}(L/\mathbb{Q}) \cong GGal(L/Q)≅G? The question was posed in the early nineteenth century and is unsolved.

What makes it a live research question rather than a curiosity is that the known positive results come from genuinely different sources, and none of them covers all finite groups.

  • Cyclic and, more generally, finite abelian groups are realizable over Q\mathbb{Q}Q by an explicit cyclotomic construction resting on Dirichlet's theorem on primes in arithmetic progressions.
  • Symmetric and alternating groups are realizable over Q\mathbb{Q}Q; this is due to Hilbert, who realized them first over the rational function field Q(t)\mathbb{Q}(t)Q(t) and then specialized ttt using his irreducibility theorem.
  • Every finite solvable group is realizable over Q\mathbb{Q}Q; this is Shafarevich's theorem (I. R. Shafarevich, The imbedding problem for splitting extensions, Dokl. Akad. Nauk SSSR 120 (1958), 1217–1219), obtained by solving embedding problems.
  • Over C(t)\mathbb{C}(t)C(t) — and over K(t)K(t)K(t) for any algebraically closed KKK of characteristic zero — every finite group is realizable, by the Riemann existence theorem. The obstruction to the goal is not the group theory; it is descending the field of constants to Q\mathbb{Q}Q.
  • Case-by-case work covers large finite lists: all transitive permutation groups of degree at most 232323, and every sporadic simple group, are known to be realizable over Q\mathbb{Q}Q.

Setting

Fix a field KKK and a group GGG. A Galois realization of GGG over KKK is a field LLL equipped with a KKK-algebra structure such that the extension L/KL/KL/K is Galois — normal and separable — together with a group isomorphism

G  ≅  Gal(L/K),G \;\cong\; \mathrm{Gal}(L/K),G≅Gal(L/K),

where Gal(L/K)\mathrm{Gal}(L/K)Gal(L/K) denotes the group of KKK-algebra automorphisms of LLL under composition. The group GGG is realizable over KKK, written IsRealizable K G, when at least one Galois realization of GGG over KKK exists. No finiteness of L/KL/KL/K is imposed in the definition; it is automatic once GGG is finite, because an infinite Galois extension has infinite automorphism group.

Two base fields beyond Q\mathbb{Q}Q appear throughout. K(t)K(t)K(t) denotes the field of rational functions in one variable over KKK, written RatFunc K; and for the statement that a group is realizable over some number field, the base field ranges over the intermediate fields of C/Q\mathbb{C}/\mathbb{Q}C/Q.

Formalization targets

Goal — the inverse Galois problem

for every finite group G,∃ L/Q Galois with Gal(L/Q)≅G.\text{for every finite group } G, \qquad \exists\, L/\mathbb{Q} \text{ Galois with } \mathrm{Gal}(L/\mathbb{Q}) \cong G.for every finite group G,∃L/Q Galois with Gal(L/Q)≅G.

The goal fixes no degree, no polynomial and no construction: it asserts only the shape of the truth, so no later refinement of the known constructions can invalidate it.

Milestones — the known partial results

G cyclic  ⟹  G realizable over Q,G abelian  ⟹  G realizable over Q,G \text{ cyclic} \;\Longrightarrow\; G \text{ realizable over } \mathbb{Q}, \qquad G \text{ abelian} \;\Longrightarrow\; G \text{ realizable over } \mathbb{Q},G cyclic⟹G realizable over Q,G abelian⟹G realizable over Q, Sym(S),  An realizable over Q,G solvable  ⟹  G realizable over Q,\mathrm{Sym}(S),\; A_n \text{ realizable over } \mathbb{Q}, \qquad G \text{ solvable} \;\Longrightarrow\; G \text{ realizable over } \mathbb{Q},Sym(S),An​ realizable over Q,G solvable⟹G realizable over Q, ∃ K, Q⊆K⊆C, G realizable over K,\exists\, K,\ \mathbb{Q} \subseteq K \subseteq \mathbb{C},\ G \text{ realizable over } K,∃K, Q⊆K⊆C, G realizable over K, G realizable over C(t),G realizable over K(t) (K algebraically closed, char 0),G \text{ realizable over } \mathbb{C}(t), \qquad G \text{ realizable over } K(t) \ (K \text{ algebraically closed, char } 0),G realizable over C(t),G realizable over K(t) (K algebraically closed, char 0), G realizable over Q(t)  ⟹  G realizable over Q.G \text{ realizable over } \mathbb{Q}(t) \;\Longrightarrow\; G \text{ realizable over } \mathbb{Q}.G realizable over Q(t)⟹G realizable over Q.

The last milestone is the Hilbert-irreducibility descent step; together with the geometric milestones it makes precise which half of the classical programme is missing.

Significance

The result itself would settle a two-century-old question and, with it, the surjectivity of the Galois correspondence over Q\mathbb{Q}Q: every abstract finite group would be known to arise from an explicit arithmetic object, a polynomial with rational coefficients. Its absence is felt in practice — constructing a single new Galois group over Q\mathbb{Q}Q is publishable work, as the recent additions of the degree-171717 group 17T717T717T7 (van Bommel–Costa–Elkies–Keller–Schiavone–Voight, 2024) and of the Mathieu group M23M_{23}M23​ show.

Formalizing it produces something available today independently of the goal: a machine-checked library of the known realizability results. Mathlib has the fundamental theorem of Galois theory, cyclotomic extensions, the Kronecker–Weber theorem, solvability of groups and symmetric/alternating group theory, but it does not have a predicate for "GGG is a Galois group over KKK", nor any of the milestones above. Every milestone here is a proved theorem of classical number theory and an unformalized one; the cyclic and abelian cases are within reach of current Mathlib, while the Shafarevich and Riemann-existence milestones are substantial formalization projects in their own right.

Difficulty

The obvious strategy fails at a well-understood point. Over C(t)\mathbb{C}(t)C(t) the problem is solved: by the Riemann existence theorem every finite group occurs as the deck-transformation group of a branched cover of the projective line. Hilbert's irreducibility theorem then descends realizability from Q(t)\mathbb{Q}(t)Q(t) to Q\mathbb{Q}Q. What is missing is the step in between: producing the cover over Q\mathbb{Q}Q rather than over C\mathbb{C}C, i.e. showing that the geometric solution can be chosen with rational field of constants. The rigidity method makes this work for many groups, but there is no known argument covering all of them; an approach that only produces realizability over some number field is not enough, and that weaker statement is included as a milestone precisely to mark the line.

A second, purely formal difficulty: the milestones are classical but their published proofs are long. Shafarevich's theorem rests on a delicate analysis of embedding problems, and the Riemann existence theorem is analytic input that Mathlib does not currently have in the required form.

Formalization scope

The mission fixes one definition file, published first, carrying the structure GaloisRealization and the one-field class IsRealizable. Conventions it commits to:

  • IsGalois K L is Mathlib's Galois condition (normal and separable); finiteness of the extension is not assumed.
  • The isomorphism is with the full automorphism group L≃alg[K]LL \simeq_{\mathrm{alg}[K]} LL≃alg[K]​L, not with a quotient or a subgroup of it.
  • The carrier LLL of a realization is required to live in the same universe as KKK. This costs no generality for the statements of the mission — for finite GGG a realization is a finite extension of KKK — and keeps every statement universe-monomorphic.
  • Sym(S)\mathrm{Sym}(S)Sym(S) is Equiv.Perm S for a finite type SSS, and AnA_nAn​ is alternatingGroup (Fin n); degenerate small cases are included rather than excluded.
  • Solvability is Group.IsSolvable.

The statements cannot be satisfied vacuously: IsRealizable K G asserts the existence of data, so a solver must exhibit an extension; and the hypotheses of the milestones (cyclic, abelian, solvable, or none at all) are all satisfiable, so no milestone is empty. The one conditional milestone, Hilbert descent, is stated with realizability over Q(t)\mathbb{Q}(t)Q(t) as an explicit hypothesis.

Infrastructure a complete development needs, most of it reusable well beyond this mission: transport of a Galois realization along an isomorphism of groups and along an isomorphism of base fields; the fixed-field construction and the fundamental theorem in the form "Gal(L/LH)≅H\mathrm{Gal}(L/L^H) \cong HGal(L/LH)≅H"; Galois groups of cyclotomic fields; Dirichlet's theorem on primes in arithmetic progressions (already in Mathlib); Hilbert's irreducibility theorem (not in Mathlib). Contributions of any of these as reusable platform definitions or lemmas are welcome, as are decompositions of the harder milestones into sketches.

Selected references

  • Inverse Galois problem, Wikipedia. https://en.wikipedia.org/wiki/Inverse_Galois_problem
  • I. R. Shafarevich, The imbedding problem for splitting extensions, Dokl. Akad. Nauk SSSR 120 (1958), 1217–1219.
  • C. U. Jensen, A. Ledet, N. Yui, Generic Polynomials: Constructive Aspects of the Inverse Galois Problem, MSRI Publications 45, Cambridge University Press, 2002. http://library.msri.org/books/Book45/files/book45.pdf
  • G. Malle, B. H. Matzat, Inverse Galois Theory, Springer Monographs in Mathematics, 1999.
  • R. van Bommel, E. Costa, N. D. Elkies, T. Keller, S. Schiavone, J. Voight, 17T7 is a Galois group over the rationals, arXiv:2411.07857, 2024. https://arxiv.org/abs/2411.07857
22 thms3 active usersReviewed
Group TheoryMathematical Logic·Captain: wurtle

Finite algebraic envelopes and the Boone–Higman conjectureResearch Paper

Motivation

The word problem for a group with a finite generating set asks whether a given word in the generators and their inverses represents the identity; it is decidable if one algorithm answers this for every word. Since Higman's embedding theorem (1961), a recurring theme in combinatorial group theory has been to characterize algorithmic properties of groups by embeddings into groups with good algebraic properties. Boone and Higman (1974) proved that a finitely generated group has decidable word problem if and only if it embeds in a simple subgroup of a finitely presented group, and asked whether the simple group can itself be taken finitely presented. This is the Boone–Higman conjecture.

This preprint states a proof of the conjecture: a finitely generated group has decidable word problem if and only if it embeds in a finitely presented simple group.

Background

  • 1961. Higman characterizes finitely generated subgroups of finitely presented groups as the recursively presented groups.
  • 1974. Boone and Higman prove the characterization G≤H≤KG \le H \le KG≤H≤K with HHH simple and KKK finitely presented, and ask whether HHH can be finitely presented.
  • 1980. Thompson embeds every finitely generated group with decidable word problem into a finitely generated simple group with decidable word problem; a later proof is given by Darbinyan and Steenbock (2022).
  • 2022. Belk and Zaremsky introduce twisted Brin–Thompson groups, which embed an acting group in a simple group; Zaremsky (2024) gives a finite-presentation criterion requiring a finitely presented acting group with finitely generated point stabilizers and finitely many orbits on unordered pairs.
  • 2023–2026. The conjecture is verified for hyperbolic groups and contracting self-similar groups (Belk, Bleak, Matucci, Zaremsky), Baumslag–Solitar and free-by-cyclic groups (Bux, Llosa Isenrich, Wu), and Aut(Fn)\mathrm{Aut}(F_n)Aut(Fn​) and mapping class groups of punctured surfaces (Belk, Fournier-Facio, Hyde, Zaremsky); see the survey of Belk, Bleak, Matucci and Zaremsky.
  • 2026. The OpenAI preprint Finite algebraic envelopes and the Boone–Higman conjecture (dated September 23, 2026) states a proof of the conjecture in general. It has not been peer reviewed; the Lean goal is open on this platform.

Setting

A group GGG is finitely generated if some finite tuple g1,…,gng_1, \dots, g_ng1​,…,gn​ generates it. A word is a finite list of letters gi±1g_i^{\pm1}gi±1​; GGG has decidable word problem if for some finite generating tuple the set of words evaluating to 111 is computable. A group is finitely presented if it has a presentation with finitely many generators and relations, and simple if it is nontrivial with no normal subgroups other than 111 and itself. An embedding is an injective homomorphism.

In Lean (OAI.FiniteAlgebraicEnvelopes, definitions BooneHigman), words are List (Fin n × Bool), evalWord multiplies generators or their inverses, HasDecidableWordProblem G asserts a generating tuple whose identity predicate is ComputablePred, and EmbedsInFinitelyPresentedSimpleGroup G asserts a group in the same universe that is Group.IsFinitelyPresented and IsSimpleGroup, with an injective homomorphism from GGG.

Formalization targets

Goal: Theorem 1.1 (Boone–Higman conjecture)

For every finitely generated group GGG,

G has decidable word problem  ⟺  G embeds in a finitely presented simple group.G \text{ has decidable word problem} \iff G \text{ embeds in a finitely presented simple group.}G has decidable word problem⟺G embeds in a finitely presented simple group.

The implication from right to left is classical (a finitely presented simple group has decidable word problem, and the property passes to finitely generated subgroups); the content is the forward implication.

Significance

The result. Theorem 1.1 gives a purely algebraic characterization of decidability of the word problem and settles a question open since 1974. Its intermediate result, Theorem 1.2, embeds every finitely generated group with decidable word problem in a finitely presented group with a faithful two-transitive action on a countably infinite set with finitely generated point stabilizers, which feeds Zaremsky's criterion for twisted Brin–Thompson groups.

Formalizing it. No machine-checked proof exists, and the source is an unrefereed preprint. Formalizing it requires computability of word problems, finite presentations (available in Mathlib as Group.IsFinitelyPresented), Steinberg groups over noncommutative rings, and twisted Brin–Thompson groups, which are not in Mathlib. The proof also uses Zaremsky's finite-presentation theorem (Theorem 2.3) from the literature, which a complete formalization must include.

Difficulty

Finite presentation does not pass to subgroups, so Boone and Higman's simple group HHH and finitely presented group KKK cannot simply be merged. Thompson's construction gives a finitely generated simple overgroup but provides no finite presentation. The new route needs a finitely presented group acting faithfully and two-transitively, built from a finitely presented algebra whose simplicity appears only after passing to a direct limit, and an exact calculation removing the kernel of the Steinberg group without assuming it is central.

Formalization scope

  • GroupType : Type u with [Group GroupType] [Group.FG GroupType]; the target group lives in the same universe.
  • Decidability is ComputablePred on words over a specified finite generating tuple (Subgroup.closure (range generators) = ⊤); since the word problem's decidability is independent of the finite generating set, this matches the source.
  • IsSimpleGroup includes nontriviality, matching the paper's convention.

The statement is not trivially true: both directions are required for every finitely generated group, including infinitely presented ones.

Needed infrastructure: computable group presentations, Steinberg groups, mapping tori of endomorphisms, twisted Brin–Thompson groups and Zaremsky's criterion. Contributions toward the classical backward implication, or toward Theorem 1.2, are welcome.

Selected references

  • OpenAI, Finite algebraic envelopes and the Boone–Higman conjecture, OpenAI Math Release preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Finite-algebraic-envelopes-and-the-Boone-Higman-conjecture-September-23-2026/paper.pdf
  • W. W. Boone, G. Higman, An algebraic characterization of groups with soluble word problem, J. Austral. Math. Soc. 18 (1974). https://doi.org/10.1017/S1446788700019108
  • G. Higman, Subgroups of finitely presented groups, Proc. Roy. Soc. London Ser. A 262 (1961). https://doi.org/10.1098/rspa.1961.0132
  • R. J. Thompson, Embeddings into finitely generated simple groups which preserve the word problem, in Word Problems II, North-Holland, 1980. https://doi.org/10.1016/S0049-237X(08)71348-X
  • J. Belk, M. C. B. Zaremsky, Twisted Brin–Thompson groups, Geom. Topol. 26 (2022). https://doi.org/10.2140/gt.2022.26.1189
  • M. C. B. Zaremsky, Finite presentability of twisted Brin–Thompson groups, Proc. Roy. Soc. Edinburgh Sect. A (2024). https://doi.org/10.1017/prm.2024.131
  • J. Belk, C. Bleak, F. Matucci, M. C. B. Zaremsky, Hyperbolic groups satisfy the Boone–Higman conjecture, Duke Math. J. 175 (2026). https://doi.org/10.1215/00127094-2025-0055
  • J. Belk, C. Bleak, F. Matucci, M. C. B. Zaremsky, Progress around the Boone–Higman conjecture, 2025. https://arxiv.org/abs/2306.16356
  • K.-U. Bux, C. Llosa Isenrich, X. Wu, On the Boone–Higman conjecture for groups acting on locally finite trees, 2025. https://arxiv.org/abs/2408.05673
  • J. Belk, F. Fournier-Facio, J. Hyde, M. C. B. Zaremsky, Boone–Higman embeddings of Aut(F_n) and mapping class groups of punctured surfaces, 2026. https://arxiv.org/abs/2503.21882
  • A. Darbinyan, M. Steenbock, Embeddings into left-orderable simple groups, J. London Math. Soc. 105 (2022). https://doi.org/10.1112/jlms.12552
8 thms2 active usersReviewed
Algebraic GeometryConvex OptimizationOptimization·Captain: mikedeng1

Semidefinite Programming Relaxations for Semialgebraic Problems 1: A Polynomial System Has No Real Solution if and only if Its Degree-d Positivstellensatz SDP Is Feasible for All Large dResearch Paper

Motivation

Deciding whether a system of real polynomial equations, inequations and inequalities has a solution is the basic feasibility question behind nonconvex quadratic programming, polynomial optimization, robustness analysis in control, and combinatorial relaxations. Over the complex numbers, Hilbert's Nullstellensatz turns infeasibility into an algebraic identity whose bounded-degree instances are found by linear algebra. Over the reals this fails: x2+1=0x^2+1=0x2+1=0 has no real solution, yet 111 is not in the ideal generated by x2+1x^2+1x2+1.

The real substitute is the Positivstellensatz of Stengle (Stengle 1974; see Bochnak–Coste–Roy, Real Algebraic Geometry, Theorem 4.4.2): a real polynomial system is infeasible exactly when an identity f+g2+h=0f+g^2+h=0f+g2+h=0 holds, with fff built from sums of squares and the inequality constraints, ggg a product of the inequation polynomials and hhh in the ideal of the equations. Parrilo (2003), building on his thesis (2000), observed that once the degrees are bounded, the search for such an identity is a semidefinite program (SDP), because a polynomial is a sum of squares exactly when it has a positive semidefinite Gram matrix. This yields a hierarchy of SDPs that is sound at every level and complete in the limit, and it is the origin of the sum-of-squares (SOS) method used throughout polynomial optimization.

Timeline:

  • 1974: Stengle proves the Positivstellensatz for semialgebraic sets over real closed fields.
  • 1995: Choi, Lam and Reznick analyze the Gram matrix method for sums of squares.
  • 2000–2003: Parrilo (thesis; Math. Program. Ser. B 96) formulates bounded-degree Positivstellensatz refutations as SDPs (Theorem 5.1); Lasserre (2001) develops the dual moment approach independently.

Setting

Write R[x1,…,xn]\mathbb R[x_1,\dots,x_n]R[x1​,…,xn​] for real polynomials in nnn variables. Fix three finite, possibly empty, families: f1,…,fsf_1,\dots,f_sf1​,…,fs​ (inequalities), g1,…,gtg_1,\dots,g_tg1​,…,gt​ (inequations), h1,…,huh_1,\dots,h_uh1​,…,hu​ (equations). They define the basic semialgebraic set

K={x∈Rn∣fj(x)≥0, gk(x)≠0, hℓ(x)=0 for all j,k,ℓ}.(4.4)K=\{x\in\mathbb R^n \mid f_j(x)\ge 0,\ g_k(x)\ne 0,\ h_\ell(x)=0\ \text{for all } j,k,\ell\}.\qquad(4.4)K={x∈Rn∣fj​(x)≥0, gk​(x)=0, hℓ​(x)=0 for all j,k,ℓ}.(4.4)

A cone of R[x1,…,xn]\mathbb R[x_1,\dots,x_n]R[x1​,…,xn​] is a subset closed under addition and multiplication that contains every square a2a^2a2; P(S)P(S)P(S) is the smallest cone containing SSS, and P(∅)P(\emptyset)P(∅) is the set of sums of squares. MMM is the multiplicative monoid generated by the gkg_kgk​ (with the empty product 111), and III is the ideal generated by the hℓh_\ellhℓ​.

For a degree bound DDD, let zzz be the vector of all monomials xαx^\alphaxα of total degree at most DDD; it has (n+DD)\binom{n+D}{D}(Dn+D​) entries. For a real matrix QQQ indexed by these monomials, the Gram polynomial is zTQz=∑α,βQαβxαxβz^TQz=\sum_{\alpha,\beta}Q_{\alpha\beta}x^\alpha x^\betazTQz=∑α,β​Qαβ​xαxβ.

The degree-ddd Positivstellensatz SDP SDPd\mathrm{SDP}_dSDPd​: with G=∑kdeg⁡gkG=\sum_k\deg g_kG=∑k​deggk​ and N(d)=d(2G+1)N(d)=d(2G+1)N(d)=d(2G+1), find positive semidefinite matrices QTQ_TQT​ over the monomials of degree at most N(d)N(d)N(d), one for each T⊆{1,…,s}T\subseteq\{1,\dots,s\}T⊆{1,…,s}, and polynomials qℓq_\ellqℓ​ of degree at most 2N(d)2N(d)2N(d), such that

∑T(zTQTz)∏j∈Tfj+(∏k=1tgk2d)2+∑ℓ=1uqℓhℓ=0.\sum_{T}(z^TQ_Tz)\prod_{j\in T}f_j+\Big(\prod_{k=1}^t g_k^{2d}\Big)^2+\sum_{\ell=1}^u q_\ell h_\ell=0 .T∑​(zTQT​z)j∈T∏​fj​+(k=1∏t​gk2d​)2+ℓ=1∑u​qℓ​hℓ​=0.

Its unknowns are finitely many real numbers, the constraint is linear in them, and the matrices are constrained to be positive semidefinite.

Formalization targets

Goal: Theorem 5.1

(∀d, SDPd feasible⇒K=∅)and(K=∅⇒∃d0 ∀d≥d0, SDPd feasible).\big(\forall d,\ \mathrm{SDP}_d\ \text{feasible}\Rightarrow K=\emptyset\big)\quad\text{and}\quad\big(K=\emptyset\Rightarrow\exists d_0\ \forall d\ge d_0,\ \mathrm{SDP}_d\ \text{feasible}\big).(∀d, SDPd​ feasible⇒K=∅)and(K=∅⇒∃d0​ ∀d≥d0​, SDPd​ feasible).

The first half says every feasible point is a refutation; the second says the hierarchy is complete once the degree bound is large enough. No bound on d0d_0d0​ is asserted, matching the paper.

Milestones

  • Theorem 4.6, 2⇒12\Rightarrow12⇒1: an identity f+g2+h=0f+g^2+h=0f+g2+h=0 with f∈Pf\in Pf∈P, g∈Mg\in Mg∈M, h∈Ih\in Ih∈I forces K=∅K=\emptysetK=∅.
  • A positive semidefinite Gram matrix gives a sum of squares (§3.2).
  • Theorem 4.6, 1⇒21\Rightarrow21⇒2 (Stengle's Positivstellensatz): K=∅K=\emptysetK=∅ forces such an identity.
  • P(∅)P(\emptyset)P(∅) is the set of sums of squares and the smallest cone; the finite-generator form P(S)={p+∑iqibi}P(S)=\{p+\sum_i q_ib_i\}P(S)={p+∑i​qi​bi​}; the squarefree form ∑TpT∏j∈Tfj\sum_T p_T\prod_{j\in T}f_j∑T​pT​∏j∈T​fj​ of the cone used in the proof of Theorem 5.1.
  • A sum of squares of degree at most 2d2d2d has a positive semidefinite Gram matrix over the monomials of degree at most ddd; Theorem 3.3 combining both directions with the size (n+dd)\binom{n+d}{d}(dn+d​); the count (n+dd)\binom{n+d}{d}(dn+d​) of the monomial vector.

Significance

Theorem 5.1 is the statement that makes Positivstellensatz certificates computable: it converts an existence theorem of real algebraic geometry into a sequence of convex feasibility problems, each solvable by interior-point methods, and any solution is an exact proof of infeasibility. Lower bounds in polynomial optimization (Example 5.4), the copositivity tests of §7.5, SOS relaxations for MAX-CUT and stable sets, and Lyapunov-function searches in control are all instances of this scheme.

The paper proves only the soundness direction of the Positivstellensatz and cites the converse. A complete formal development therefore contains the first machine-checked statement chain from Stengle's theorem to the SDP hierarchy. To the best of current searches, neither Mathlib nor Prove2Me contains the real Positivstellensatz, the Gram matrix characterization of sums of squares, or the monomial count; Mathlib has sums of squares in rings (IsSumSq), positive semidefinite matrices, and the complex Nullstellensatz.

Difficulty

The soundness half is elementary. Completeness rests on Stengle's Positivstellensatz, whose standard proofs pass through real closed fields, orderings of rings and the Tarski–Seidenberg transfer principle, none of which is available in Mathlib in usable form. A tempting shortcut, proving completeness by reasoning only about R\mathbb RR-points, does not work: the certificate must be an algebraic identity, and points cannot produce it.

A second, smaller difficulty is degree bookkeeping. Each level of the hierarchy has a fixed shape (the exponent of the gkg_kgk​ and the degree of every multiplier are tied to ddd), while a certificate supplied by the Positivstellensatz has arbitrary degrees and exponents. A Gram representation also needs a degree bound on every square in a sum of squares, not only on the sum.

Formalization scope

  • Polynomials are MvPolynomial (Fin n) ℝ; n,s,t,un,s,t,un,s,t,u are arbitrary natural numbers, including 000; the families are indexed by Fin s, Fin t, Fin u. The set (4.4) lives in Rn\mathbb R^nRn = Fin n → ℝ.
  • P(S)P(S)P(S) is the smallest set closed under +++, ⋅\cdot⋅ and containing all squares (Definition 4.5), an inductive predicate. Mathlib's RingPreordering is not used: it excludes −1-1−1, which an infeasible system's cone typically contains.
  • Sums of squares are IsSumSq; positive semidefiniteness is Matrix.PosSemidef (symmetric, which is the paper's Q∈SnQ\in\mathcal S^nQ∈Sn); MMM is Submonoid.closure, III is Ideal.span.
  • The meta-claim "the search … can be done using semidefinite programming" is the definition of SDPd\mathrm{SDP}_dSDPd​: finitely many PSD Gram matrices indexed by a finite type of monomials, and ideal multipliers of bounded total degree. The degree choices (m=dm=dm=d in g=∏gk2mg=\prod g_k^{2m}g=∏gk2m​; multiplier degree d2=2d(2G+1)d_2=2d(2G+1)d2​=2d(2G+1)) fill the freedom the proof leaves and satisfy its printed bounds d2≥dd_2\ge dd2​≥d, d2≥deg⁡gd_2\ge\deg gd2​≥degg. "Large enough" is ∃d0 ∀d≥d0\exists d_0\,\forall d\ge d_0∃d0​∀d≥d0​.
  • A formalization without the degree bounds or with an infinite index type would make SDPd\mathrm{SDP}_dSDPd​ equivalent to Theorem 4.6 item 2 and is ruled out; so is a goal stated for a fixed nnn, for empty families only, or with soundness only at large ddd.
  • Needed infrastructure: Stengle's Positivstellensatz over R\mathbb RR (real closed field theory or a direct proof), the Gram matrix correspondence, and degree lemmas for sums of squares. The Positivstellensatz and the Gram correspondence are reusable far beyond this mission; contributions toward either are welcome.

Selected references

  • P. A. Parrilo, Semidefinite programming relaxations for semialgebraic problems, Math. Program. Ser. B 96 (2003) 293–320. https://doi.org/10.1007/s10107-003-0387-5
  • G. Stengle, A Nullstellensatz and a Positivstellensatz in semialgebraic geometry, Math. Ann. 207 (1974) 87–97. https://doi.org/10.1007/BF01362149
  • J. Bochnak, M. Coste, M.-F. Roy, Real Algebraic Geometry, Springer, 1998, Theorem 4.4.2. https://doi.org/10.1007/978-3-662-03718-8
  • M. D. Choi, T. Y. Lam, B. Reznick, Sums of squares of real polynomials, Proc. Sympos. Pure Math. 58 (1995) 103–126. https://doi.org/10.1090/pspum/058.2/1327293
  • J. B. Lasserre, Global optimization with polynomials and the problem of moments, SIAM J. Optim. 11 (2001) 796–817. https://doi.org/10.1137/S1052623400366802
13 thms2 active usersReviewed
Information TheoryTheoretical Computer Science·Captain: mikedeng1

Fuzzy Extractors: How to Generate Strong Keys from Biometrics and Other Noisy Data 3: Shingling plus PinSketch Gives an Average-Case Secure Sketch for Edit DistanceResearch Paper

Why noisy secrets need sketches

Biometric readings, physical unclonable functions and typed passphrases share two defects as cryptographic keys: they are not uniformly distributed, and they are never reproduced exactly. Dodis, Ostrovsky, Reyzin and Smith (SIAM J. Comput. 38(1), 2008; preprint arXiv:cs/0602007v4) introduced the secure sketch to handle the second defect without destroying what entropy the secret has. A secure sketch publishes a string sss from which any reading close to the original recovers the original exactly, while the original keeps a guaranteed amount of min-entropy given sss. Many sources of noise are not substitutions but insertions and deletions: keystroke sequences, sequenced DNA, and any reading whose alignment drifts. For these the relevant distance is the edit distance, and §7 of the paper gives a secure sketch for it.

This mission formalizes that construction: Theorem 7.5 (p. 27), together with the results it is assembled from, PinSketch for set difference (Theorem 6.3, p. 23, with the BCH decoding argument of Appendix E) and the shingling embedding (Lemma 7.3, p. 25), glued by Lemma 4.7 (p. 15).

Setting

All logarithms are base 2. A random variable is identified with its distribution. The min-entropy of WWW is H∞(W)=−log⁡max⁡wPr⁡[W=w]\mathbf H_\infty(W) = -\log \max_w \Pr[W = w]H∞​(W)=−logmaxw​Pr[W=w], and the average min-entropy of WWW given III is H~∞(W∣I)=−log⁡∑imax⁡wPr⁡[W=w∧I=i]\tilde{\mathbf H}_\infty(W \mid I) = -\log \sum_i \max_w \Pr[W = w \wedge I = i]H~∞​(W∣I)=−log∑i​maxw​Pr[W=w∧I=i].

Let M\mathcal MM be a set with an integer-valued distance dis\mathrm{dis}dis. An average-case (M,m,m~,t)(\mathcal M, m, \tilde m, t)(M,m,m~,t)-secure sketch is a pair of randomized procedures (SS,Rec)(\mathsf{SS}, \mathsf{Rec})(SS,Rec) such that Rec(w′,SS(w))=w\mathsf{Rec}(w', \mathsf{SS}(w)) = wRec(w′,SS(w))=w whenever dis(w,w′)≤t\mathrm{dis}(w, w') \le tdis(w,w′)≤t, and H~∞(W∣SS(W),I)≥m~\tilde{\mathbf H}_\infty(W \mid \mathsf{SS}(W), I) \ge \tilde mH~∞​(W∣SS(W),I)≥m~ for every pair (W,I)(W, I)(W,I) with H~∞(W∣I)≥m\tilde{\mathbf H}_\infty(W \mid I) \ge mH~∞​(W∣I)≥m. The difference m−m~m - \tilde mm−m~ is the entropy loss.

Three spaces occur.

  1. EditF(n)\mathrm{Edit}_{\mathcal F}(n)EditF​(n): strings of length nnn over a finite alphabet F\mathcal FF of FFF letters, with distance the smallest number of character insertions and deletions turning one string into the other.
  2. SDif(U)\mathrm{SDif}(\mathcal U)SDif(U): all subsets of a finite universe U\mathcal UU, with distance ∣w△w′∣|w \triangle w'|∣w△w′∣.
  3. For PinSketch, U=GF(2μ)∗\mathcal U = GF(2^\mu)^*U=GF(2μ)∗, of size n=2μ−1n = 2^\mu - 1n=2μ−1. A subset www has syndrome entries si(w)=∑x∈wxis_i(w) = \sum_{x \in w} x^isi​(w)=∑x∈w​xi, computed in the field. PinSketch publishes (s1,s3,…,s2t−1)(s_1, s_3, \dots, s_{2t-1})(s1​,s3​,…,s2t−1​).

A ccc-shingle of a string is a length-ccc consecutive substring, and the ccc-shingling SHc(w)⊆Fc\mathrm{SH}_c(w) \subseteq \mathcal F^cSHc​(w)⊆Fc is the set of all of them. A map f:M1→M2f : \mathcal M_1 \to \mathcal M_2f:M1​→M2​ is a (t1,t2,λ)(t_1, t_2, \lambda)(t1​,t2​,λ)-biometric embedding with recovery information ggg if it maps distance ≤t1\le t_1≤t1​ to distance ≤t2\le t_2≤t2​, ggg takes at most 2λ2^\lambda2λ values, and www is determined by (f(w),g(w))(f(w), g(w))(f(w),g(w)).

Formalization targets

Goal: Theorem 7.5

For every finite alphabet F\mathcal FF with FFF letters, all n,c,t∈Nn, c, t \in \mathbb Nn,c,t∈N with 1≤c≤n1 \le c \le n1≤c≤n and every real mmm, there is an average-case secure sketch

(EditF(n), m, m−⌈nc⌉log⁡2(n−c+1)−(2c−1) t ⌈log⁡(Fc+1)⌉, t).\Big(\mathrm{Edit}_{\mathcal F}(n),\ m,\ m - \big\lceil \tfrac nc \big\rceil \log_2(n - c + 1) - (2c - 1)\,t\,\lceil \log(F^c + 1) \rceil,\ t\Big).(EditF​(n), m, m−⌈cn​⌉log2​(n−c+1)−(2c−1)t⌈log(Fc+1)⌉, t).

Milestones

  1. Set difference. Theorem 6.3: PinSketch is an average-case (SDif(U),m,m−tlog⁡(n+1),t)(\mathrm{SDif}(\mathcal U), m, m - t\log(n+1), t)(SDif(U),m,m−tlog(n+1),t) secure sketch. On the way:
    • the Appendix E identity s2i=si2s_{2i} = s_i^2s2i​=si2​;
    • the key equation S(z)σ(z)≡ω(z) mod zδS(z)\sigma(z) \equiv \omega(z) \bmod z^\deltaS(z)σ(z)≡ω(z)modzδ;
    • the uniqueness of ω/σ\omega/\sigmaω/σ among low-degree solutions;
    • Lemma 6.2: a word of weight ≤(δ−1)/2\le (\delta - 1)/2≤(δ−1)/2 is determined by its first δ−1\delta - 1δ−1 syndromes;
    • step 4 of Construction 6: decoding returns w△w′w \triangle w'w△w′.
  2. Edit distance into set difference. Lemma 7.3: SHc\mathrm{SH}_cSHc​ is an average-case (t1,(2c−1)t1,m1,m1−⌈n/c⌉log⁡2(n−c+1))(t_1, (2c-1)t_1, m_1, m_1 - \lceil n/c \rceil \log_2(n - c + 1))(t1​,(2c−1)t1​,m1​,m1​−⌈n/c⌉log2​(n−c+1)) biometric embedding. Its strengthening: SHc\mathrm{SH}_cSHc​ has recovery information gcg_cgc​ with λ=⌈n/c⌉log⁡2(n−c+1)\lambda = \lceil n/c \rceil \log_2(n - c + 1)λ=⌈n/c⌉log2​(n−c+1).
  3. Composition. Lemma 4.7: an embedding with recovery information turns an average-case sketch on M2\mathcal M_2M2​ for entropy m1−λm_1 - \lambdam1​−λ into one on M1\mathcal M_1M1​ for entropy m1m_1m1​, with the same residual entropy.

Significance

Theorem 7.5 gives a secure sketch for the edit metric whose entropy loss is, for a good choice of ccc, about 2.38 (tlog⁡F)1/3(nlog⁡n)2/32.38\,(t \log F)^{1/3}(n \log n)^{2/3}2.38(tlogF)1/3(nlogn)2/3 (p. 26). This is sublinear in nnn for ttt up to nearly linear, and for large ttt it improves on the low-distortion embedding approach of §7.1. Combined with a strong extractor it yields fuzzy extractors for edit distance (Theorem 7.4). PinSketch is itself the standard set-difference sketch, and Lemma 4.7 is a general transfer principle between metrics.

All results here are proved in the paper. None has a machine-checked proof that we know of. A complete development would also formalize a fragment of BCH decoding over GF(2μ)GF(2^\mu)GF(2μ), the syndrome-uniqueness theorem for binary BCH codes, and a combinatorial lemma on how insertions and deletions act on shingle sets. Each is reusable outside this mission.

Difficulty

There are two hard steps.

The first is Lemma 6.2. That a low-weight word is determined by δ−1\delta - 1δ−1 power sums is a statement about Vandermonde systems in characteristic 2, where the even power sums carry no new information. Newton's identities, the usual characteristic-zero route from power sums to elementary symmetric functions, fail there because they divide by integers that vanish in characteristic 2. The paper argues through the error-locator and error-evaluator polynomials instead.

The second is the distance clause of Lemma 7.3. An edit path between two strings of length nnn passes through strings of other lengths, so a per-step bound on the shingle sets must hold for strings of every length, including lengths below ccc.

The entropy statements involve average min-entropy over arbitrary auxiliary variables, and each needs the chain-rule bound of Lemma 2.2(b) in average-case form.

Formalization scope

  • Laws and kernels. Random variables are PMFs, and randomized procedures are kernels M → PMF S. The auxiliary variable of every average-case statement ranges over every ι : Type, not only finite types. Average min-entropy uses the joint form above. "Min-entropy mmm" means ≥m\ge m≥m, and mmm is real.
  • The field. The paper's GF(2m)GF(2^m)GF(2m) is any finite field K of characteristic 2, and its degree is renamed μ\muμ because mmm denotes min-entropy. Appendix E's large field F\mathcal FF is this K, distinct from §7's alphabet F\mathcal FF. Only binary words are formalized, as subsets (Finset Kˣ); the qqq-ary generality of Lemma E.1 is not.
  • The key equation. ω(z)\omega(z)ω(z) is written without division, congruence mod zδz^\deltazδ is divisibility by XδX^\deltaXδ, and the ratio identity is cross-multiplied.
  • Edit distance. It reuses the published weighted edit distance MasekPaterson.Shared.editDist with cost 1 per insertion or deletion and 2 per replacement, which equals the insertion/deletion count.
  • Shingling and gcg_cgc​. Shingling is defined for strings of all lengths. gcg_cgc​ is the concrete function of the proof, with 0-based indices.
  • Explicit hypotheses.
    • The Appendix E uniqueness statement takes the BCH designed distance to satisfy 1≤δ1 \le \delta1≤δ; at δ=0\delta=0δ=0 its congruence is vacuous and the conclusion can fail.
    • 1≤c≤n1 \le c \le n1≤c≤n, which the paper leaves implicit, is assumed in Lemma 7.3 and Theorem 7.5.
    • ϵ\epsilonϵ is dropped from Theorem 7.5, where it does not occur in the conclusion.
    • ⌈log⁡(Fc+1)⌉\lceil \log(F^c + 1) \rceil⌈log(Fc+1)⌉ is Nat.clog 2 (F ^ c + 1).
  • Misprints, read as corrected.
    • In Definition 7, f(w2)f(w_2)f(w2​) is read as f(w1′)f(w_1')f(w1′​).
    • In Lemma 4.7, Rec(w′,s)\mathsf{Rec}(w', s)Rec(w′,s) is read as Rec(f(w′),s)\mathsf{Rec}(f(w'), s)Rec(f(w′),s).
    • In Appendix E, w′(z)w'(z)w′(z) is read as ω′(z)\omega'(z)ω′(z).
  • Efficiency. Every claim of efficiency or running time (Lemma 6.2, Theorem 6.3, Theorem 7.5) is dropped: Mathlib has no complexity substrate, and no vacuous substitute is used.
  • Excluded trivializations. The distance is the insertion/deletion distance, not the Hamming distance on length-nnn strings (a different and easier problem). It is not a degenerate cost that is identically 0: insertion and deletion each cost 1.
  • Not posed here. Lemma 2.2(b) and Lemma 3.1 are posed in the companion mission on Hamming fuzzy extractors. Proofs that need them may restate them.

Contributions are welcome on any milestone. The BCH part (Appendix E, Lemma 6.2) and the shingling part (Lemma 7.3) are independent.

Selected references

  • Y. Dodis, R. Ostrovsky, L. Reyzin, A. Smith, Fuzzy Extractors: How to Generate Strong Keys from Biometrics and Other Noisy Data, SIAM J. Comput. 38(1):97–139, 2008. https://doi.org/10.1137/060651380 ; arXiv:cs/0602007v4, https://arxiv.org/abs/cs/0602007
  • J. H. van Lint, Introduction to Coding Theory, 2nd ed., Springer, 1992 (BCH codes and their decoding; the reference [vL92] of Appendix E).
  • A. Z. Broder, On the resemblance and containment of documents, Compression and Complexity of Sequences, IEEE, 1997 (shingling). https://doi.org/10.1109/SEQUEN.1997.666900
  • W. J. Masek, M. S. Paterson, A faster algorithm computing string edit distances, J. Comput. System Sci. 20(1):18–31, 1980 (the weighted edit distance reused here). https://doi.org/10.1016/0022-0000(80)90002-1
13 thms2 active usersReviewed
Analysis·Captain: Lucas

Smale's Mean Value ConjectureOpen Problem

Motivation

The mean value problem, also called Smale's mean value conjecture, was posed by Stephen Smale in 1981 in his study of the complexity of root-finding algorithms for polynomials (Smale 1981). For a real differentiable function the mean value theorem produces, between two points, a point where the derivative equals a difference quotient. For a complex polynomial no such point need exist on a segment, and Smale asked for a substitute in which the special point is a critical point of the polynomial (a zero of its derivative). Estimates of this kind control how far Newton-type iterations can move, which is where Smale's original interest came from. The problem appears in lists of unsolved problems in mathematics, including Smale's own list of problems for the next century.

Timeline

  • 1981 — Smale poses the problem and proves the inequality below with constant K=4K = 4K=4 (Smale 1981). The example P(z)=zd−dzP(z) = z^d - dzP(z)=zd−dz shows that the constant cannot be smaller than d−1d\frac{d-1}{d}dd−1​ in degree ddd, so no constant below 111 works in all degrees.
  • 1989 — Tischler proves the inequality with the optimal constant K=d−1dK = \frac{d-1}{d}K=dd−1​ when all roots of PPP are real, and when all roots of PPP have the same absolute value (Tischler 1989).
  • 2007 — Conte, Fujikawa and Lakic prove K≤4d−1d+1K \le 4\frac{d-1}{d+1}K≤4d+1d−1​ (Conte–Fujikawa–Lakic 2007). Crane proves K<4−2.263dK < 4 - \frac{2.263}{\sqrt d}K<4−d​2.263​ for d≥8d \ge 8d≥8 (Crane 2007).
  • 2009 — Dubinin and Sugawa prove the reverse (dual) inequality with constant 1d 4d\frac{1}{d\,4^d}d4d1​ (Dubinin–Sugawa 2009); optimizing this lower bound is the dual mean value problem (Ng–Zhang 2016).

No absolute constant K<4K < 4K<4 is known that works in every degree.

Setting

Let PPP be a polynomial with complex coefficients of degree d≥2d \ge 2d≥2, and write P′P'P′ for its derivative. A critical point of PPP is a complex number ccc with P′(c)=0P'(c) = 0P′(c)=0; since d≥2d \ge 2d≥2, P′P'P′ is a nonconstant polynomial of degree d−1d-1d−1, so PPP has at least one and at most d−1d-1d−1 distinct critical points. Fix a complex number zzz that is not a critical point, P′(z)≠0P'(z) \ne 0P′(z)=0. For every critical point ccc we then have c≠zc \ne zc=z, and the difference quotient

P(z)−P(c)z−c\frac{P(z) - P(c)}{z - c}z−cP(z)−P(c)​

is well defined. The question is how small this quotient can be made, relative to ∣P′(z)∣|P'(z)|∣P′(z)∣, by choosing the critical point ccc well.

Formalization targets

Goal: Smale's mean value conjecture (K=1K = 1K=1)

For every complex polynomial PPP of degree d≥2d \ge 2d≥2 and every z∈Cz \in \mathbb Cz∈C with P′(z)≠0P'(z) \ne 0P′(z)=0 there is a critical point ccc of PPP with

∣P(z)−P(c)z−c∣≤∣P′(z)∣.\left| \frac{P(z) - P(c)}{z - c} \right| \le |P'(z)|.​z−cP(z)−P(c)​​≤∣P′(z)∣.

Stronger: the optimal constant

The same with ∣P′(z)∣|P'(z)|∣P′(z)∣ replaced by d−1d ∣P′(z)∣\frac{d-1}{d}\,|P'(z)|dd−1​∣P′(z)∣; the example zd−dzz^d - dzzd−dz shows this constant cannot be lowered.

Known results (milestones)

  1. Smale's inequality with K=4K = 4K=4.
  2. The extremal example P(z)=zd−dzP(z) = z^d - dzP(z)=zd−dz at z=0z = 0z=0, where every critical point gives exactly d−1d∣P′(0)∣\frac{d-1}{d}|P'(0)|dd−1​∣P′(0)∣, and its consequence that no constant K<1K < 1K<1 works in all degrees.
  3. Tischler's optimal inequality for polynomials with only real roots, and for polynomials whose roots all have the same absolute value.
  4. The Conte–Fujikawa–Lakic bound K≤4d−1d+1K \le 4\frac{d-1}{d+1}K≤4d+1d−1​.
  5. Crane's bound K<4−2.263dK < 4 - \frac{2.263}{\sqrt d}K<4−d​2.263​ for d≥8d \ge 8d≥8.
  6. The Dubinin–Sugawa dual inequality ∣P(z)−P(c)z−c∣≥∣P′(z)∣d 4d\left|\frac{P(z)-P(c)}{z-c}\right| \ge \frac{|P'(z)|}{d\,4^d}​z−cP(z)−P(c)​​≥d4d∣P′(z)∣​ for some critical point ccc.

Significance

The result itself. A positive answer gives a sharp, degree-independent mean value inequality for complex polynomials: for every non-critical point, some critical value is reachable along a chord whose slope is at most the local derivative. Bounds of this type feed into the analysis of Newton's method and of path-following root finders, and into the study of how critical values of a polynomial are distributed relative to its values. The conjecture is part of a family of open extremal problems on the geometry of critical points, alongside Sendov's conjecture.

Formalizing it. The goal and the optimal-constant form are open. The milestones are published theorems, none of which is known to have a machine-checked proof. Formalizing Smale's K=4K = 4K=4 bound and Tischler's special cases would put the classical tools of the subject (critical points of polynomials, univalent function estimates, root location) on a formal footing that later attempts can reuse.

Difficulty

The obvious strategies control the quotient through one critical point at a time: for instance, bounding ∣P(z)−P(c)∣|P(z) - P(c)|∣P(z)−P(c)∣ by integrating P′P'P′ along the segment from ccc to zzz. Such estimates lose a constant factor that depends on how the critical points are spread out, and the known uniform arguments all pass through distortion theorems for univalent functions, whose constants lead to KKK close to 444. Reaching K=1K = 1K=1 requires using all critical points simultaneously, and no argument doing this in every degree is known. The equality case zd−dzz^d - dzzd−dz, in which every critical point is equally bad, shows that any successful argument must be sharp for polynomials with maximally symmetric critical configurations.

Formalization scope

Polynomials are elements of ℂ[X] (Mathlib's Polynomial ℂ); the degree is natDegree, the derivative is Polynomial.derivative, evaluation is Polynomial.eval, and the roots of PPP are the multiset P.roots (counted with multiplicity). A critical point is a c : ℂ with P.derivative.eval c = 0. The absolute value is the norm ‖·‖ on ℂ, and the constants d−1d\frac{d-1}{d}dd−1​ and 4d−1d+14\frac{d-1}{d+1}4d+1d−1​ are computed in ℝ from the cast of natDegree.

Every statement assumes P′(z)≠0P'(z) \ne 0P′(z)=0. This is the standard normalization and is essential in Lean: division by zero returns 000, so without it the choice c=zc = zc=z would make the inequality trivially true whenever zzz is itself a critical point. With the hypothesis, every critical point ccc differs from zzz and the quotient is a genuine difference quotient.

Crane's bound is stated as the existence, for each degree d≥8d \ge 8d≥8, of a constant strictly below 4−2.263d4 - \frac{2.263}{\sqrt d}4−d​2.263​ that works for all polynomials of degree exactly ddd; this is equivalent to the best constant in degree ddd being strictly below that value.

A complete development needs basic facts on critical points of complex polynomials (existence, the Gauss–Lucas theorem), and, for the classical bounds, results from the theory of univalent functions such as the Koebe quarter theorem and coefficient estimates. These are reusable well beyond this mission. Contributions of any milestone, of supporting lemmas, and of partial results in fixed small degree are welcome.

Selected references

  • S. Smale, The fundamental theorem of algebra and complexity theory, Bull. Amer. Math. Soc. (N.S.) 4 (1981), 1–36. https://doi.org/10.1090/S0273-0979-1981-14858-8
  • D. Tischler, Critical points and values of complex polynomials, J. Complexity 5 (1989), 438–456. https://doi.org/10.1016/0885-064X(89)90019-8
  • A. Conte, E. Fujikawa, N. Lakic, Smale's mean value conjecture and the coefficients of univalent functions, Proc. Amer. Math. Soc. 135 (2007), 3295–3300. https://doi.org/10.1090/S0002-9939-07-08861-2
  • E. Crane, A bound for Smale's mean value conjecture for complex polynomials, Bull. London Math. Soc. 39 (2007), 781–791. https://doi.org/10.1112/blms/bdm063
  • V. Dubinin, T. Sugawa, Dual mean value problem for complex polynomials, Proc. Japan Acad. Ser. A 85 (2009), 135–137. https://arxiv.org/abs/0906.4605
  • T.-W. Ng, Y. Zhang, Smale's mean value conjecture for finite Blaschke products, J. Anal. 24 (2016), 331–345. https://arxiv.org/abs/1609.00170
  • Wikipedia, Mean value problem. https://en.wikipedia.org/w/index.php?title=Mean_value_problem&oldid=1374678764
10 thms2 active usersReviewed
Algebraic GeometryNumber Theory·Captain: vatsj

Milnor conjecture (Voevodsky 2003), formalizedResearch Paper

Motivation

For a field FFF, two invariants built from very different data turn out to carry the same mod-2 information. One is Milnor K-theory KnM(F)K^M_n(F)KnM​(F), defined by generators and relations from the multiplicative group F×F^\timesF× alone. The other is Galois cohomology Hn(F,Z/2)H^n(F,\mathbb{Z}/2)Hn(F,Z/2), the continuous cohomology of the absolute Galois group of FFF. In 1970 Milnor considered a natural map KnM(F)/2→Hn(F,Z/2)K^M_n(F)/2 \to H^n(F,\mathbb{Z}/2)KnM​(F)/2→Hn(F,Z/2) in all degrees, verified that it is an isomorphism for several classes of fields, and remarked that he knew of no field where it fails (Milnor 1970). The statement that it is always an isomorphism when char⁡F≠2\operatorname{char} F \neq 2charF=2 became known as the Milnor conjecture. Its companion conjecture on quadratic forms was later deduced from it (Orlov–Vishik–Voevodsky 2007). Together they identify the graded Witt ring of quadratic forms, Galois cohomology mod 2, and K∗M(F)/2K^M_*(F)/2K∗M​(F)/2.

Timeline. The attributions below follow the introduction of Voevodsky 2003.

  • 1970: Milnor considers the map KnM(F)/2→Hn(F,Z/2)K^M_n(F)/2 \to H^n(F,\mathbb{Z}/2)KnM​(F)/2→Hn(F,Z/2) in all degrees and gives classes of fields where it is an isomorphism (Milnor 1970).
  • Bass–Tate (published 1973): the Kummer classes satisfy the Steinberg relation, so the Kummer map extends to a ring homomorphism on K∗M(F)K^M_*(F)K∗M​(F) (Bass–Tate 1973).
  • Degrees 0 and 1: the map is an isomorphism, by Kummer theory and Hilbert's Theorem 90.
  • 1981: Merkurjev proves degree 2 with 222 as the coefficient prime.
  • 1982: Merkurjev and Suslin extend degree 2 to every prime ℓ\ellℓ (Merkurjev–Suslin 1982).
  • Degree 3, ℓ=2\ell = 2ℓ=2: proved by Merkurjev–Suslin and, independently, by Rost.
  • 2003: Voevodsky proves all degrees, in every characteristic ≠2\neq 2=2 (Voevodsky 2003, Cor. 7.5), using the motivic Steenrod operations constructed in Voevodsky 2003b. This work was cited for his 2002 Fields Medal.
  • 2011: the analogue for odd primes, the Bloch–Kato conjecture, is proved (Voevodsky 2011); a book-length account is Haesemeyer–Weibel 2019.

Setting

Let FFF be a field with 2≠02 \neq 02=0 in FFF.

Milnor K-theory. For n≥0n \ge 0n≥0, KnM(F)K^M_n(F)KnM​(F) is the quotient of the nnn-fold tensor power (F×)⊗n(F^\times)^{\otimes n}(F×)⊗n, taken over Z\mathbb{Z}Z with F×F^\timesF× written additively, by the subgroup generated by the pure tensors a1⊗⋯⊗ana_1\otimes\cdots\otimes a_na1​⊗⋯⊗an​ in which some adjacent pair satisfies ai+ai+1=1a_i + a_{i+1} = 1ai​+ai+1​=1. This is the degree-nnn part of T(F×)/IT(F^\times)/IT(F×)/I, where III is the two-sided ideal generated by a⊗(1−a)a\otimes(1-a)a⊗(1−a). The class of a1⊗⋯⊗ana_1\otimes\cdots\otimes a_na1​⊗⋯⊗an​ is the symbol {a1,…,an}\{a_1,\dots,a_n\}{a1​,…,an​}. In particular K0M(F)=ZK^M_0(F) = \mathbb{Z}K0M​(F)=Z and K1M(F)=F×K^M_1(F) = F^\timesK1M​(F)=F×. In Lean these are MilnorK F n and symbol a for a : Fin n → Fˣ.

Galois cohomology. Let FsepF^{\mathrm{sep}}Fsep be a separable closure and GF=Gal⁡(Fsep/F)G_F = \operatorname{Gal}(F^{\mathrm{sep}}/F)GF​=Gal(Fsep/F) the absolute Galois group, a profinite group under the Krull topology. Hn(F,Z/2)H^n(F,\mathbb{Z}/2)Hn(F,Z/2) is the continuous cohomology Hctsn(GF,Z/2)H^n_{\mathrm{cts}}(G_F,\mathbb{Z}/2)Hctsn​(GF​,Z/2) with trivial action, computed from GFG_FGF​-invariant continuous homogeneous cochains. In Lean this is H F n, Mathlib's continuousCohomology n of the trivial representation.

The Galois symbol. For a∈F×a \in F^\timesa∈F× fix a∈Fsep\sqrt a \in F^{\mathrm{sep}}a​∈Fsep. The Kummer character χa:GF→Z/2\chi_a : G_F \to \mathbb{Z}/2χa​:GF​→Z/2 is χa(σ)=0\chi_a(\sigma) = 0χa​(σ)=0 if σ(a)=a\sigma(\sqrt a) = \sqrt aσ(a​)=a​ and 111 otherwise. It is a continuous homomorphism representing the Kummer class δa∈H1\delta a \in H^1δa∈H1. The Galois symbol of (a1,…,an)(a_1,\dots,a_n)(a1​,…,an​) is the class of the homogeneous cocycle

(x0,…,xn) ⟼ ∏j=1n(χaj(xj)−χaj(xj−1)),(x_0,\dots,x_n)\ \longmapsto\ \prod_{j=1}^{n}\bigl(\chi_{a_j}(x_j)-\chi_{a_j}(x_{j-1})\bigr),(x0​,…,xn​) ⟼ j=1∏n​(χaj​​(xj​)−χaj​​(xj−1​)),

the homogeneous form of (σ1,…,σn)↦χa1(σ1)⋯χan(σn)(\sigma_1,\dots,\sigma_n) \mapsto \chi_{a_1}(\sigma_1)\cdots\chi_{a_n}(\sigma_n)(σ1​,…,σn​)↦χa1​​(σ1​)⋯χan​​(σn​), i.e. the cup product δa1∪⋯∪δan\delta a_1\cup\cdots\cup\delta a_nδa1​∪⋯∪δan​. In Lean this is galoisSymbol a.

Formalization targets

Goal: the Milnor conjecture (Voevodsky 2003, Corollary 7.5)

For every field FFF with char⁡F≠2\operatorname{char} F \neq 2charF=2 and every n≥0n \ge 0n≥0 there is a homomorphism

φ:KnM(F)→Hn(F,Z/2),φ{a1,…,an}=δa1∪⋯∪δan,\varphi : K^M_n(F) \to H^n(F,\mathbb{Z}/2),\qquad \varphi\{a_1,\dots,a_n\} = \delta a_1\cup\cdots\cup\delta a_n,φ:KnM​(F)→Hn(F,Z/2),φ{a1​,…,an​}=δa1​∪⋯∪δan​,

which is surjective and whose kernel is exactly 2 KnM(F)2\,K^M_n(F)2KnM​(F).

Since symbols generate KnM(F)K^M_n(F)KnM​(F), such a φ\varphiφ is unique; it is the norm residue homomorphism. The statement is therefore equivalent to KnM(F)/2≅Hn(F,Z/2)K^M_n(F)/2 \cong H^n(F,\mathbb{Z}/2)KnM​(F)/2≅Hn(F,Z/2) via the norm residue map. Its existence, i.e. the fact that the Steinberg relations map to zero, is part of the claim.

Significance

The result itself. The theorem gives a presentation of mod-2 Galois cohomology by generators and relations: every class is a sum of cup products of degree-one classes, and every relation among such products comes from Steinberg relations and multiples of 2. With Orlov–Vishik–Voevodsky 2007 it yields Milnor's conjecture on quadratic forms, which classifies quadratic forms up to Witt equivalence by their Galois-cohomological invariants.

Formalizing it. The theorem is proved but not formalized. At the time of writing, Mathlib has neither Milnor K-theory nor cup products in group or continuous cohomology, and has Hilbert 90 only for finite Galois extensions. This mission's definitions provide a sorry-free Galois symbol in Mathlib's continuous cohomology, which already makes the degree 0 and degree 1 cases (Kummer theory) meaningful targets. A complete development would formalize the IHES proof, including motivic cohomology with Z/2\mathbb{Z}/2Z/2 coefficients and the motivic Steenrod algebra. No part of that is currently available in Lean. Related existing work: on this platform, a graded cup product (groupCohomology.exists_isGradedCupProduct) and a Kummer theory and Hilbert 90 for level-constant cocycles have been formalized on top of Mathlib's discrete groupCohomology. The cup product is for discrete groups, and the Kummer and Hilbert 90 results use finite-level hypotheses in place of continuity, so none of them transfers directly to continuousCohomology.

Difficulty

Degrees 0 and 1 follow from Kummer theory and Hilbert 90. Degree 2 is Merkurjev's theorem, whose proof goes through the K-theory of Severi–Brauer varieties. No argument internal to Galois cohomology or K-theory of fields is known in higher degrees. The known proof reformulates the statement as a vanishing theorem for motivic cohomology of fields, the "Hilbert 90" property for weight nnn. It then argues by induction on nnn through geometry over FFF: splitting varieties of symbols (Pfister quadrics), their motives, and cohomology operations on motivic cohomology. Each of these is a substantial theory, none of it exists in Mathlib, and the induction passes through statements about arbitrary smooth varieties, not only fields.

Formalization scope

Scope. The target is the Milnor conjecture, i.e. the prime 222 with coefficients Z/2≅μ2\mathbb{Z}/2 \cong \mu_2Z/2≅μ2​. The Bloch–Kato conjecture for odd primes is out of scope.

Conventions.

  • The field is F : Type, universe 0. Mathlib's continuousCohomology requires the coefficient module to live in the universe of the group. For FFF in a higher universe this forces ULift (ZMod 2), for which the needed Module and ContinuousSMul instances are not available as global instances. Universe polymorphism is not part of this mission. It does not follow by plain transport, since a field in a higher universe need not be isomorphic to any field in Type; one route is a limit argument, using that both sides commute with directed unions of fields and that every field is the directed union of its countable subfields, each isomorphic to a field in Type.
  • The hypothesis char⁡F≠2\operatorname{char} F \neq 2charF=2 is [NeZero (2 : F)].
  • HnH^nHn is Mathlib's continuousCohomology, built from homogeneous cochains, with Z/2\mathbb{Z}/2Z/2 as a trivial representation of GFG_FGF​ with the Krull topology.
  • KnM(F)K^M_n(F)KnM​(F) is defined one degree at a time, not as a graded ring.
  • "Kernel =2KnM= 2K^M_n=2KnM​" means φ(x)=0  ⟺  ∃y, x=2y\varphi(x)=0 \iff \exists y,\ x = 2yφ(x)=0⟺∃y, x=2y.

Ruling out trivializations. The Galois symbol is not a free parameter. It is a fixed, sorry-free definition, and the existence of φ\varphiφ with the prescribed values on symbols is part of the goal. Neither can be chosen to make the statement vacuous.

Route. Reductions should follow Voevodsky 2003 together with Voevodsky 2003b. That route avoids resolution of singularities and works in every characteristic ≠2\neq 2=2. The following rely on resolution of singularities (or on characteristic-0 reductions) and should not be used as inputs:

  • Mazza–Voevodsky–Weibel (MVW 2006), results 16.24, 16.25 and 20.1, and the cdh-topology and compactly-supported-motive material;
  • the original Suslin–Voevodsky paper relating Bloch–Kato to Beilinson–Lichtenbaum (Suslin–Voevodsky 2000); use Haesemeyer–Weibel 2019, Chapter 2, instead;
  • Haesemeyer–Weibel Part II, and their reduction to characteristic 0 (Lemma 1.3);
  • Voevodsky's 1995–96 preprints on the Milnor conjecture.

Infrastructure needed and reusable. A complete development needs:

  • the ring structure on K∗M(F)K^M_*(F)K∗M​(F) (cf. Carlier's KMilnorWitt for Milnor–Witt K-theory);
  • cup products in continuous cohomology;
  • Hilbert 90 for profinite Galois groups;
  • Galois cohomology as étale cohomology of Spec⁡F\operatorname{Spec} FSpecF;
  • the Nisnevich topology;
  • presheaves with transfers, motivic complexes and motivic cohomology;
  • motivic Steenrod operations;
  • motives of Pfister quadrics.

Most of this is reusable well beyond the mission. The homogeneous-cochain construction in the definition files, which turns an invariant continuous cocycle Gn+1→MG^{n+1}\to MGn+1→M into a class in Mathlib's continuousCohomology, applies to any locally compact group with trivial coefficients. Contributions of any of these components, and of the degree 0 and 1 cases, are welcome.

Selected references

  • V. Voevodsky, Motivic cohomology with Z/2\mathbb{Z}/2Z/2-coefficients, Publ. Math. IHÉS 98 (2003), 59–104. https://doi.org/10.1007/s10240-003-0010-6
  • V. Voevodsky, Reduced power operations in motivic cohomology, Publ. Math. IHÉS 98 (2003), 1–57. https://doi.org/10.1007/s10240-003-0009-z
  • J. Milnor, Algebraic K-theory and quadratic forms, Invent. Math. 9 (1970), 318–344. https://doi.org/10.1007/BF01425486
  • H. Bass, J. Tate, The Milnor ring of a global field, in Algebraic K-theory II, Lecture Notes in Math. 342, Springer, 1973. https://doi.org/10.1007/BFb0073733
  • A. S. Merkurjev, A. A. Suslin, K-cohomology of Severi–Brauer varieties and the norm residue homomorphism, Math. USSR Izv. 21 (1983). https://doi.org/10.1070/IM1983v021n02ABEH001793
  • D. Orlov, A. Vishik, V. Voevodsky, An exact sequence for K∗M/2K^M_*/2K∗M​/2 with applications to quadratic forms, Ann. of Math. 165 (2007), 1–13. https://doi.org/10.4007/annals.2007.165.1
  • V. Voevodsky, On motivic cohomology with Z/l\mathbb{Z}/lZ/l-coefficients, Ann. of Math. 174 (2011), 401–438. https://doi.org/10.4007/annals.2011.174.1.11
  • C. Haesemeyer, C. Weibel, The Norm Residue Theorem in Motivic Cohomology, Annals of Math. Studies 200, Princeton, 2019. https://doi.org/10.1515/9780691189635
  • C. Mazza, V. Voevodsky, C. Weibel, Lecture Notes on Motivic Cohomology, Clay Math. Monographs 2, AMS, 2006. https://www.claymath.org/wp-content/uploads/2022/03/Motivic-Cohomology.pdf
  • A. Suslin, V. Voevodsky, Bloch–Kato conjecture and motivic cohomology with finite coefficients, in The Arithmetic and Geometry of Algebraic Cycles, NATO Sci. Ser. C 548, Kluwer, 2000. https://doi.org/10.1007/978-94-011-4098-0_5
14 thms2 active usersReviewed
Number Theory·Captain: tomasz

Philippon: Multiplicity estimates in commutative algebraic groupsResearch Paper

Why multiplicity estimates matter

Formalization status, 10 October 2026: all eight milestones are complete. Both corrected addenda are Proved. The subgroup upper Hilbert estimate has an accepted proof with eight Proved inputs and no Open dependencies (submission 07198c4c-ea10-4c9a-89b8-b4a5319c40b5). Together with the accepted sharp contact-rank and ambient lower Hilbert bounds, this discharges every dependency of the corrected converse. The corrected 26-part full-paper goal remains Open, with exactly two frontier leaves: quadratic parameter-stalk germs and the local complex model for the closure action. The common-shift forward conclusion, quadratic first-input addition hypothesis in the converse, all constants and degree thresholds, and all 24 unaffected goal clauses are unchanged. The separately published Chardin theorem in arbitrary characteristic remains Open; it is no longer required by this mission proof.

An auxiliary polynomial in a transcendence proof is constructed to vanish to high order at many points. A multiplicity estimate limits how often that can happen without a geometric reason: a positive-dimensional algebraic subgroup can make the apparent vanishing conditions dependent. Such estimates are used to turn analytic approximations into algebraic-independence conclusions. The theory applies to products of commutative algebraic groups with both archimedean and nonarchimedean analytic directions.

The mission's objective is a faithful formalization of the complete 1986 paper, Patrice Philippon's Lemmes de zéros dans les groupes algébriques commutatifs, including every theorem, corollary, proposition, lemma, definition, and mathematical supporting claim. All results remain required whether or not a current application uses them. Necessary source corrections are explicit and their counterexamples remain part of the completion goal. The author's 1987 corrections are applied transparently, and the addendum's additional results are recorded separately (original, errata and addenda).

Groups, analytic directions, and geometric degree

Let K be the complex field or the completed algebraic closure of the field of ℓ-adic numbers for a prime ℓ, as in the source. Let G be a product of finitely many commutative algebraic groups G₁,…,Gᵣ over K, with each factor embedded as a quasi-projective variety in a projective space. Write n for the sum of their dimensions. A point of the product embedding has one block of homogeneous coordinates for each factor.

A nonzero multihomogeneous polynomial P has a degree Dᵢ in its i-th block of coordinates. Its zeros define a hypersurface of the ambient product of projective spaces. An analytic subgroup A is locally parametrized by an analytic homomorphism from a finite-dimensional additive K-space. The order of P along A at a group point g is the vanishing order of P after composing local projective coordinates with the translated parametrization. This definition must be independent of the choice of nonzero local coordinate representatives.

Let Σ be a finite set of group points containing the identity. Its n-fold sumset Σ(n) consists of all sums of n, not necessarily distinct, elements of Σ; Σ(0) is the singleton identity. For a connected algebraic subgroup H, the integer s is the analytic codimension of A∩H in A. The expression |(Σ+H)/H| counts distinct H-cosets meeting Σ. Codimension concerns the analytic tangent dimension; it does not assert that the point-set intersection is finite.

The source's Hilbert degree form ℋ(V;D₁,…,Dᵣ) is (dim V)! times the highest homogeneous part of the multigraded Hilbert–Samuel polynomial of the projective closure of V, evaluated at the degrees. It must be constructed from the coordinate ring, rather than supplied as an arbitrary numerical function. For one projective factor it is deg(V)D^(dim V). These definitions are fixed in §§2–3 of the original paper.

Formalization targets

The completion target is all results of the paper, with an aggregate goal that requires their individual formal statements. Theorem 2.1 is one milestone within that target. For each fixed family of embedded group factors, it chooses positive integers cᵢ, each depending only on its corresponding embedding. These constants precede the analytic subgroup, the finite sampling set, the polynomial degrees, the polynomial, and the contact parameter T. If P has order at least nT+1 along A at every point of Σ(n), there is a connected algebraic subgroup H with

(T+ss) ∣(Σ+H)/H∣ H(H;D1,…,Dr)≤H(G;c1D1,…,crDr).\binom{T+s}{s}\, |(\Sigma+H)/H|\, \mathcal H(H;D_1,\ldots,D_r) \leq \mathcal H(G;c_1D_1,\ldots,c_rD_r).(sT+s​)∣(Σ+H)/H∣H(H;D1​,…,Dr​)≤H(G;c1​D1​,…,cr​Dr​).

The same H is contained in a translate of the zero locus of P on G and is incompletely defined by equations of multidegrees at most (c₁D₁,…,cᵣDᵣ): it is an irreducible component of the common zero locus in G of equations with those degree bounds. Both geometric conclusions are part of the target. A formalization retaining only the displayed numerical inequality would omit part of the original result.

The 1986 paper has 13 numbered results. Section 2 contains Theorem 2.1 and Corollaries 2.2–2.3, including the one-dimensional analytic result and the result for disjoint group factors. Section 3 contains Lemmas 3.1–3.2, Proposition 3.3 and Lemma 3.4. Section 4 contains Propositions 4.3–4.4, Lemmas 4.5–4.6 and Proposition 4.7. Section 5 contains Lemma 5.1. Every clause of these statements belongs to the mission.

Definitions 3.5, 4.1 and 4.2, the unnumbered setup, the internal Facts A–E, the counterexample after Proposition 3.3, and the mathematical claims in remarks also require coverage. Source numbers and page references identify the correspondence between the prose and Lean declarations. The two 1987 addendum targets are explicitly corrected variants. The forward statement assumes ambient connectedness and allows one common shift v∈Gv\in Gv∈G, so g+v+H⊆{P=0}∩Gg+v+H\subseteq\{P=0\}\cap Gg+v+H⊆{P=0}∩G for every sampled ggg, with the same connected subgroup HHH satisfying incomplete definition and the full coset-count inequality. Its embedding-dependent constants are chosen before the sample and polynomial. This is not an exact transcription of the printed strengthening. The converse assumes ambient connectedness and explicit local addition formulas of degree at most two in the first input for every embedded factor. Its subgroup may remain disconnected; the degree threshold, constant 1/(4nn!)1/(4^n n!)1/(4nn!), and polynomial nonzero somewhere on GGG are unchanged. All original sampling and contact assumptions remain. No desired estimate is encoded as a geometric assumption.

Eight milestones and the completion goal

The completion goal is PhilipponMultiplicity.paper_results_corrected_erratum, a conjunction of 26 concrete propositions. This is a collection goal requiring the source statements and the additional mathematical claims in the coverage record. It is separate from the paper's original Theorem 2.1, which remains individually named and reusable.

The mission has eight milestones; seven are currently Proved:

SourceMilestoneStatus
Theorem 2.1General multiplicity estimate, with every geometric and numerical conclusion.Proved
Corollary 2.2One-dimensional analytic-subgroup consequence.Proved
Corollary 2.3Consequence for disjoint group factors and sampling grids.Proved
Proposition 3.3Multigraded intersection bounds, including the multiplicity-sensitive bound.Proved
Proposition 4.7Binomial lower bound for contact multiplicity.Proved
Lemma 5.1Stabilizer construction and the geometric counting estimate.Proved
1987 addendum, p. 398Corrected common-shift vanishing in a connected ambient group.Proved
1987 addendum, p. 398Connected converse with first-input addition degree at most two.Open

The full statement package has 27 compiled theorem statements: all thirteen numbered results, both addenda, eleven supporting or correction targets, and the aggregate goal. The fourteen original admission-free definition bundles and one erratum supplement supply their actual geometric and algebraic objects. All 41 original statement and definition items have independent blind readbacks. The eight milestones above retain their existing identities.

The supporting clauses include Hilbert-polynomial existence, primary components and Facts A–E; the geometric interpretation of mixed degree; the actual counterexample after Proposition 3.3; translation operators and their comparison with intrinsic ideals; contact invariance; translation-invariance and embedding remarks; the component/stabilizer construction; counting estimates; and the exact Masser–Wüstholz Theorem I consequence claimed on p.361. Proof-internal recursive ideals and tangent/exponential arguments belong to their corresponding theorem proofs.

Source corrections are visible for review. Lemma 3.1 and Corollary 2.2 require positive equation degrees; explicit zero-degree counterexamples are required goal clauses. Both addenda require positive ambient dimension; the goal also requires their dimension-zero counterexamples. The three-generator ideal printed on p.370 is nonradical, contrary to the printed word “prime”; its valid degree-four versus length-six counterexample is preserved, together with an explicit nilpotent witness. Connectedness is stated in the translation-invariance and Lange reembedding remarks. These are mathematical corrections documented during the source comparison, beyond the author's 1987 errata. They are not silent changes to the source.

Existing completed proofs and all 24 unaffected goal clauses are retained. The corrected forward addendum is Proved. The repaired converse and the replacement collection goal remain Open; two general geometry lemmas also remain on the frontier. The existing proved local-algebra references remain reusable ingredients.

What a completed formalization enables

The output is a reusable development of the paper's multigraded commutative algebra, translation and differential operators, geometric multiplicity theory, and zero estimates. All source results are required for completion. A downstream Weierstrass application can consume a specialization of Theorem 2.1; its needs do not determine the scope or completion of this mission (example application).

These are established mathematical results whose proofs are being formalized. The complete original Theorem 2.1 has an accepted proof. The selected Weierstrass application uses individually named Philippon results, with its application-specific model and subgroup bridges proved in the Senthil mission. The remaining general results stay required even though that application is complete.

The foundational difficulty

Vanishing conditions need not be independent: many can occur on the same component or on translates with a nontrivial stabilizer. Counting coefficients of P therefore does not bound their total multiplicity. The development needs geometric degree for actual components, multiplicities measured by lengths of localized quotient rings, and uniform control of translations in fixed projective embeddings.

Proposition 3.3 supplies multigraded intersection bounds, Proposition 4.7 controls contact multiplicity, and Lemma 5.1 connects the stabilizer to the geometric counting estimate. These three results and Theorem 2.1 now have checked proofs. The remaining corollaries, general geometric and analytic claims, examples and addenda are independent deliverables. Application-specific contact results do not discharge the remaining general statements.

Formalization scope

The declarations use the namespace PhilipponMultiplicity. Source statements retain their conclusions, constants, quantifier order, and complex or ℓ-adic scope, with the visible boundary and wording corrections listed above. Intermediate specializations are labelled as such and do not discharge a more general source result. Natural-number and zero-degree conventions have been compared with the original scans; the discovered failures and corrected hypotheses are recorded explicitly for human review. Corrections and inferred conventions must be documented rather than silently changing the source.

The required definitions include embedded commutative algebraic groups and their connected subgroups; products of projective spaces and multihomogeneous coordinate rings; analytic local homomorphisms and intrinsic contact order; multigraded Hilbert polynomials and their degree forms; local component lengths; and finite coset counts. No model may assume the desired multiplicity inequality, hide it as a structure field, or replace geometric degree by an unconstrained function.

The 26 individual target statements, replacement collection goal, original definition bundles, and erratum supplement compile in Lean 4.33.1 with Mathlib revision 0df444a360eaa60ab8c11dca51a86af692955474. Source comparisons and independent readbacks document the fixed statements and their explicit corrections. The goal remains the concrete 26-part full-paper collection. The completed proofs supply reusable Hilbert theory, primary-component multiplicities, polynomial differential operators, bounded translation atlases and the Section 5 construction. Contributions to the remaining targets, including results unused by Senthil, complete the original scope.

The previous aggregate, original sampled-translates addendum, and original converse remain available with their prior submissions and disproofs. The replacement statements changed the mission goal explicitly before proofs were supplied. The corrected common-shift forward statement has since received an accepted proof.

Selected references

  • P. Philippon, Lemmes de zéros dans les groupes algébriques commutatifs, Bulletin de la Société Mathématique de France 114 (1986), 355–383. DOI and original paper.
  • P. Philippon, Errata et addenda à « Lemmes de zéros dans les groupes algébriques commutatifs », Bulletin de la Société Mathématique de France 115 (1987), 397–398. DOI and addendum.
  • Senthil Kumar K, Algebraic independence of values of Weierstrass elliptic and zeta functions, Proceedings of the Edinburgh Mathematical Society (2026), including Robert Tubbs's appendix. DOI.
296 thms2 active users
Number Theory·Captain: Lucas

Schanuel's ConjectureOpen Problem

Motivation

Almost every classical transcendence theorem is a statement about the interaction between the additive structure of C\mathbb{C}C and the exponential function. Hermite proved in 1873 that eee is transcendental, Lindemann in 1882 that eαe^{\alpha}eα is transcendental for every nonzero algebraic α\alphaα — hence that π\piπ is transcendental and the circle cannot be squared — and Weierstrass in 1885 extended this to the linear independence of eα1,…,eαne^{\alpha_1},\dots,e^{\alpha_n}eα1​,…,eαn​ over Q‾\overline{\mathbb{Q}}Q​ for distinct algebraic αi\alpha_iαi​. Gelfond and Schneider settled Hilbert's seventh problem in 1934, and Baker's 1966 theorem on linear forms in logarithms made the subject effective.

Schanuel's conjecture, formulated by Stephen Schanuel in the 1960s and first published by Lang (Introduction to Transcendental Numbers, Addison–Wesley, 1966, Chapter III), is a single statement that contains all of these as special cases, together with a large number of statements that remain open — for instance that eee and π\piπ are algebraically independent, or that e+πe + \pie+π is irrational. No case of it is known beyond those already covered by the Lindemann–Weierstrass theorem or by Baker's theorem.

Timeline, with the hypotheses each result actually assumes:

  • 1882, Lindemann: eαe^{\alpha}eα is transcendental for algebraic α≠0\alpha \neq 0α=0.
  • 1885, Weierstrass: for pairwise distinct algebraic α1,…,αn\alpha_1,\dots,\alpha_nα1​,…,αn​, the values eα1,…,eαne^{\alpha_1},\dots,e^{\alpha_n}eα1​,…,eαn​ are linearly independent over Q‾\overline{\mathbb{Q}}Q​.
  • 1934, Gelfond and Schneider, independently: if λ≠0\lambda \neq 0λ=0 is a logarithm of an algebraic number and β\betaβ is algebraic and irrational, then eβλe^{\beta\lambda}eβλ is transcendental.
  • 1960s, Siegel, Lang and Ramachandra: the six exponentials theorem, unconditional; the analogous four exponentials statement is still open.
  • 1966, Baker: if logarithms λ1,…,λn\lambda_1,\dots,\lambda_nλ1​,…,λn​ of algebraic numbers are linearly independent over Q\mathbb{Q}Q, then 1,λ1,…,λn1,\lambda_1,\dots,\lambda_n1,λ1​,…,λn​ are linearly independent over Q‾\overline{\mathbb{Q}}Q​.
  • 1971, Ax: the function-field analogue of Schanuel's conjecture, for formal power series and, more generally, differential fields of characteristic zero.

Setting

Write exp⁡\expexp for the complex exponential function. A tuple z1,…,znz_1,\dots,z_nz1​,…,zn​ of complex numbers is linearly independent over Q\mathbb{Q}Q when the only rationals q1,…,qnq_1,\dots,q_nq1​,…,qn​ with ∑iqizi=0\sum_i q_i z_i = 0∑i​qi​zi​=0 are q1=⋯=qn=0q_1 = \dots = q_n = 0q1​=⋯=qn​=0; here C\mathbb{C}C is viewed as a vector space over Q\mathbb{Q}Q.

For a subset S⊆CS \subseteq \mathbb{C}S⊆C, let Q(S)\mathbb{Q}(S)Q(S) denote the subfield of C\mathbb{C}C generated by SSS over Q\mathbb{Q}Q. The transcendence degree trdeg⁡QQ(S)\operatorname{trdeg}_{\mathbb{Q}} \mathbb{Q}(S)trdegQ​Q(S) is the cardinality of a transcendence basis of Q(S)\mathbb{Q}(S)Q(S) over Q\mathbb{Q}Q: the largest number of elements of Q(S)\mathbb{Q}(S)Q(S) that are algebraically independent over Q\mathbb{Q}Q. A number xxx is transcendental over Q\mathbb{Q}Q when no nonzero polynomial with rational coefficients vanishes at xxx, and numbers x1,…,xmx_1,\dots,x_mx1​,…,xm​ are algebraically independent over Q\mathbb{Q}Q when no nonzero polynomial in mmm variables with rational coefficients vanishes at (x1,…,xm)(x_1,\dots,x_m)(x1​,…,xm​).

Formalization targets

Goal

z1,…,zn linearly independent over Q  ⟹  trdeg⁡QQ(z1,…,zn, ez1,…,ezn)  ≥  n.z_1,\dots,z_n \text{ linearly independent over } \mathbb{Q} \;\Longrightarrow\; \operatorname{trdeg}_{\mathbb{Q}} \mathbb{Q}\bigl(z_1,\dots,z_n,\,e^{z_1},\dots,e^{z_n}\bigr) \;\ge\; n .z1​,…,zn​ linearly independent over Q⟹trdegQ​Q(z1​,…,zn​,ez1​,…,ezn​)≥n.

The goal fixes no numerical constant and no special shape for the ziz_izi​: it asserts only the inequality, for every nnn and every Q\mathbb{Q}Q-linearly independent tuple. The case n=0n = 0n=0 is vacuous and the conclusion is a bound on a cardinal, so nothing is hidden in a degenerate convention.

Milestones

The milestone list consists of the landmark unconditional theorems that Schanuel's conjecture generalizes, the known function-field analogue, and one conditional corollary that records what the conjecture buys:

  • Hermite–Lindemann (1882): α\alphaα algebraic and nonzero ⇒\Rightarrow⇒ eαe^{\alpha}eα transcendental.
  • Lindemann–Weierstrass (1885): ∑iβieαi≠0\sum_i \beta_i e^{\alpha_i} \neq 0∑i​βi​eαi​=0 for distinct algebraic αi\alpha_iαi​ and algebraic βi\beta_iβi​ not all zero.
  • Gelfond–Schneider (1934): λ≠0\lambda \neq 0λ=0 a logarithm of an algebraic number, β\betaβ algebraic irrational ⇒\Rightarrow⇒ eβλe^{\beta\lambda}eβλ transcendental.
  • Six exponentials theorem: x1,x2x_1,x_2x1​,x2​ and y1,y2,y3y_1,y_2,y_3y1​,y2​,y3​ each Q\mathbb{Q}Q-linearly independent ⇒\Rightarrow⇒ at least one of the six numbers exiyje^{x_i y_j}exi​yj​ is transcendental.
  • Baker (1966): Q\mathbb{Q}Q-linearly independent logarithms of algebraic numbers, together with 111, are linearly independent over Q‾\overline{\mathbb{Q}}Q​.
  • Ax (1971), power series form: trdeg⁡CC(f1,…,fn,g1,…,gn)≥n+1\operatorname{trdeg}_{\mathbb{C}} \mathbb{C}(f_1,\dots,f_n,g_1,\dots,g_n) \ge n+1trdegC​C(f1​,…,fn​,g1​,…,gn​)≥n+1 when gi′=fi′gig_i' = f_i' g_igi′​=fi′​gi​, the gig_igi​ are units, and no nontrivial Q\mathbb{Q}Q-linear combination of the fif_ifi​ is constant.
  • Conditional corollary: Schanuel's conjecture implies that eee and π\piπ are algebraically independent over Q\mathbb{Q}Q.

Significance

Schanuel's conjecture decides, in one stroke, a long list of questions that are individually open: the algebraic independence of eee and π\piπ, the irrationality of e+πe+\pie+π and of eπe\pieπ, the transcendence of eee^{e}ee and ππ\pi^{\pi}ππ, the four exponentials conjecture, and — combined with work of Macintyre and Wilkie — the decidability of the first-order theory of the real exponential field. Its restriction to algebraic ziz_izi​ is exactly the Lindemann–Weierstrass theorem, and its restriction to ziz_izi​ whose exponentials are algebraic is exactly Baker's theorem, so the conjecture is a common generalization of the two main unconditional pillars of the subject.

On the formalization side, the state of the art in Lean's mathematical library is modest relative to this history: the analytic core of the Lindemann–Weierstrass argument is present, but the Hermite–Lindemann theorem, the Lindemann–Weierstrass theorem, the transcendence of π\piπ, the Gelfond–Schneider theorem, the six exponentials theorem and Baker's theorem are not available as usable statements in the pinned environment. Each milestone here is therefore a genuine formalization project with a known mathematical proof, and none of them is a restatement of an existing library result. The goal theorem itself is open mathematically; the realistic contributions to it are reductions — implications between the goal and other statements — and closing the milestones that the conjecture generalizes.

Difficulty

The obvious approach to any single case — build an auxiliary function with many zeros, bound its derivatives, and derive a contradiction from an integrality argument — is the method behind every result on the milestone list, and it is exactly what fails for the conjecture in general. Those proofs need the exponentials, or the arguments, to be algebraic somewhere, so that heights and denominators can be controlled; for a general Q\mathbb{Q}Q-linearly independent tuple there is no arithmetic input at all, and no known construction produces the required auxiliary function. Ax's theorem shows that the differential-algebraic shadow of the statement is true, but its proof uses the derivation on the function field and has no arithmetic counterpart. A solver should not expect the conjecture itself to fall to a variation of the classical method.

Formalization scope

All statements are over C\mathbb{C}C, with the complex exponential. Tuples are indexed by Fin n, ℚ-linear independence is Mathlib's LinearIndependent ℚ, transcendence degree is Mathlib's Algebra.trdeg, the generated field is IntermediateField.adjoin, and the inequality is between cardinals, so the goal reads (n : Cardinal) ≤ Algebra.trdeg ℚ (adjoin ℚ (Set.range z ∪ Set.range (Complex.exp ∘ z))). Algebraicity is IsAlgebraic ℚ, transcendence is Transcendental ℚ, and algebraic independence is AlgebraicIndependent ℚ.

There is no trivializing formalization here: the hypothesis LinearIndependent ℚ z is satisfiable for every nnn, so the goal is not vacuous, and the conclusion is an inequality of cardinals rather than a statement about a definition introduced for this mission.

The Ax milestone is stated for formal power series in one variable over C\mathbb{C}C: the exponential relation is expressed as the differential equation gi′=fi′gig_i' = f_i' g_igi′​=fi′​gi​ with PowerSeries.derivative, and the conclusion bounds Algebra.trdeg ℂ of the ℂ-subalgebra generated by the fif_ifi​ and the gig_igi​. The conditional corollary takes the full statement of Schanuel's conjecture as an explicit hypothesis, so it is provable unconditionally as stated.

Infrastructure that a complete development needs, and that is reusable well beyond this mission: Siegel's lemma and height machinery for algebraic numbers, the standard auxiliary-function construction with derivative bounds, and interface lemmas relating Algebra.trdeg, AlgebraicIndependent and Transcendental. Reductions between the milestones — for example deriving Hermite–Lindemann from Lindemann–Weierstrass, or the six exponentials theorem from a general Baker-type statement — are welcome as sketches.

Selected references

  • S. Lang, Introduction to Transcendental Numbers, Addison–Wesley, 1966. (Schanuel's conjecture is stated in Chapter III.)
  • A. Baker, Linear forms in the logarithms of algebraic numbers I, Mathematika 13 (1966), 204–216. https://doi.org/10.1112/S0025579300003971
  • J. Ax, On Schanuel's conjectures, Annals of Mathematics 93 (1971), 252–268. https://doi.org/10.2307/1970774
  • A. Macintyre and A. J. Wilkie, On the decidability of the real exponential field, in Kreiseliana, A K Peters, 1996, 441–467.
  • M. Waldschmidt, Diophantine Approximation on Linear Algebraic Groups, Springer, 2000.
  • Wikipedia, Schanuel's conjecture. https://en.wikipedia.org/wiki/Schanuel%27s_conjecture
39 thms2 active usersReviewed
CombinatoricsDiscrete GeometryInformation Theory·Captain: mikedeng1

A Large Family of Maximum Scattered Linear Sets of PG(1, q^n) and Their Associated MRD Codes 2: For Odd q = p^r and t > 4, a Lower Bound on the Number of PΓL-Classes of the Linear Sets L_{h,t}Research Paper

Motivation

A linear set of the projective line PG(1,qn)\mathrm{PG}(1, q^n)PG(1,qn) is the set of points ⟨u⟩Fqn\langle u\rangle_{\mathbb F_{q^n}}⟨u⟩Fqn​​ spanned by the nonzero vectors uuu of an Fq\mathbb F_qFq​-subspace U⊆Fqn2U \subseteq \mathbb F_{q^n}^2U⊆Fqn2​. The extremal ones, the maximum scattered linear sets, are given by scattered polynomials fff over Fqn\mathbb F_{q^n}Fqn​, and each such fff also gives an Fqn\mathbb F_{q^n}Fqn​-linear maximum rank-distance (MRD) code Cf={ax+bf(x):a,b∈Fqn}\mathcal C_f = \{ax + bf(x) : a, b \in \mathbb F_{q^n}\}Cf​={ax+bf(x):a,b∈Fqn​} of minimum distance n−1n-1n−1 (Sheekey, Adv. Math. Commun. 10, 2016). Rank-distance codes are used in network coding, and linear sets appear in the study of semifields, blocking sets and two-intersection sets.

Linear sets and codes are classified up to equivalence: two linear sets are the same object if a collineation of the line, an element of PΓL(2,qn)\mathrm{P\Gamma L}(2, q^n)PΓL(2,qn), maps one onto the other. The question is therefore not only whether new scattered polynomials exist but how many inequivalent linear sets they produce.

  • 2000–2001. The monomials xqsx^{q^s}xqs, gcd⁡(s,n)=1\gcd(s,n) = 1gcd(s,n)=1 (Blokhuis–Lavrauw 2000), all give a single linear set of PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn) (pseudoregulus type); the binomials δxqs+xqn−s\delta x^{q^s} + x^{q^{n-s}}δxqs+xqn−s (Lunardon–Polverino 2001) give at most φ(n)\varphi(n)φ(n) times a function of qqq classes.
  • 2018. Csajbók, Marino and Polverino (J. Combin. Theory Ser. A 157, 2018) develop the equivalence theory of linear sets of PG(1,qn)\mathrm{PG}(1, q^n)PG(1,qn), including coefficient identities that two qqq-polynomials defining the same linear set must satisfy.
  • 2021. Longobardi and Zanella (J. Algebraic Combin. 2021) give a third family, again with at most φ(n)/2\varphi(n)/2φ(n)/2 classes.
  • 2021. Longobardi, Marino, Trombetti and Zhou (arXiv:2102.08287v3) construct the family ψh,t\psi_{h,t}ψh,t​ (Theorem 3.1, the companion mission) and show (Theorem 5.1) that it contains a number of PΓL\mathrm{P\Gamma L}PΓL-classes growing exponentially in nnn. This mission formalizes that count.

Setting

Let ppp be an odd prime, r≥1r \ge 1r≥1, q=prq = p^rq=pr, t≥1t \ge 1t≥1, n=2tn = 2tn=2t, and let F=FqnF = \mathbb F_{q^n}F=Fqn​ be the finite field of order q2tq^{2t}q2t. Its subfield Fq\mathbb F_qFq​ is {c:cq=c}\{c : c^q = c\}{c:cq=c}.

A qqq-polynomial is a map f(x)=∑i=0n−1αixqif(x) = \sum_{i=0}^{n-1} \alpha_i x^{q^i}f(x)=∑i=0n−1​αi​xqi with αi∈F\alpha_i \in Fαi​∈F (qpoly). It is scattered (IsScatteredPoly) if for all z,y∈F∗z, y \in F^*z,y∈F∗, f(z)/z=f(y)/yf(z)/z = f(y)/yf(z)/z=f(y)/y forces z=cyz = cyz=cy with c∈Fqc \in \mathbb F_qc∈Fq​.

The graph of fff is Uf={(x,f(x)):x∈F}⊆F2U_f = \{(x, f(x)) : x \in F\} \subseteq F^2Uf​={(x,f(x)):x∈F}⊆F2 (graph). A point ⟨v⟩Fqn\langle v \rangle_{\mathbb F_{q^n}}⟨v⟩Fqn​​ of PG(1,qn)\mathrm{PG}(1, q^n)PG(1,qn) is the set of all FFF-multiples of a nonzero v∈F2v \in F^2v∈F2 (point), and the linear set of fff is the point set

Lf={⟨(x,f(x))⟩Fqn:x∈F∗}(linSet).L_f = \{\langle (x, f(x))\rangle_{\mathbb F_{q^n}} : x \in F^*\} \quad (\texttt{linSet}).Lf​={⟨(x,f(x))⟩Fqn​​:x∈F∗}(linSet).

For a field automorphism σ\sigmaσ and an invertible 2×22 \times 22×2 matrix AAA over FFF, the map v↦Avσv \mapsto A v^\sigmav↦Avσ (σ\sigmaσ acting on coordinates, act) is an element of ΓL(2,qn)\Gamma\mathrm L(2, q^n)ΓL(2,qn); with σ=id\sigma = \mathrm{id}σ=id it is in GL(2,qn)\mathrm{GL}(2, q^n)GL(2,qn). Two subsets U,W⊆F2U, W \subseteq F^2U,W⊆F2 are GL- or ΓL-equivalent (GLEquiv, GammaLEquiv) if such a map sends UUU onto WWW. Two point sets are PGL- or PΓL-equivalent (PGLEquiv, PGammaLEquiv) if the induced map on points, P↦{Avσ:v∈P}P \mapsto \{A v^\sigma : v \in P\}P↦{Avσ:v∈P}, sends one onto the other.

The family. For h∈Fh \in Fh∈F,

ψh,t(x)=xq+xqt−1−h1−qt+1xqt+1+h1−q2t−1xq2t−1(psi),\psi_{h,t}(x) = x^q + x^{q^{t-1}} - h^{1-q^{t+1}} x^{q^{t+1}} + h^{1-q^{2t-1}} x^{q^{2t-1}} \quad (\texttt{psi}),ψh,t​(x)=xq+xqt−1−h1−qt+1xqt+1+h1−q2t−1xq2t−1(psi),

H={h∈F:hqt+1=−1}H = \{h \in F : h^{q^t+1} = -1\}H={h∈F:hqt+1=−1} (hSet), Uh=Uψh,tU_h = U_{\psi_{h,t}}Uh​=Uψh,t​​ and Lh,t=Lψh,tL_{h,t} = L_{\psi_{h,t}}Lh,t​=Lψh,t​​. For t≥3t \ge 3t≥3 and h∈H∖Fqth \in H \setminus \mathbb F_{q^t}h∈H∖Fqt​, ψh,t\psi_{h,t}ψh,t​ is scattered and Lh,tL_{h,t}Lh,t​ is a maximum scattered linear set (Theorem 3.1).

Formalization targets

Goal: Theorem 5.1

For t>4t > 4t>4, the number MMM of PΓL(2,qn)\mathrm{P\Gamma L}(2,q^n)PΓL(2,qn)-classes met by the sets Lh,tL_{h,t}Lh,t​, h∈Hh \in Hh∈H, satisfies

M≥{⌊qt+18rt⌋,t≢2(mod4),⌊qt+14rt(q2+1)⌋,t≡2(mod4).M \ge \begin{cases} \left\lfloor \dfrac{q^t+1}{8rt} \right\rfloor, & t \not\equiv 2 \pmod 4,\\[1.5ex] \left\lfloor \dfrac{q^t+1}{4rt(q^2+1)} \right\rfloor, & t \equiv 2 \pmod 4.\end{cases}M≥⎩⎨⎧​⌊8rtqt+1​⌋,⌊4rt(q2+1)qt+1​⌋,​t≡2(mod4),t≡2(mod4).​

It is stated as: some S⊆HS \subseteq HS⊆H of at least that size has pairwise PΓL\mathrm{P\Gamma L}PΓL-inequivalent Lh,tL_{h,t}Lh,t​. The goal fixes the paper's constants; the proof on p. 26 in fact counts classes exactly in terms of class sizes, so a sharper bound is a natural follow-up.

Milestones

  1. Proposition 3.2 (p. 7): h∈H⇒hq2+1≠1h \in H \Rightarrow h^{q^2+1} \ne 1h∈H⇒hq2+1=1 and hqt−2≠−hh^{q^{t-2}} \ne -hhqt−2=−h.
  2. ∣H∣=qt+1|H| = q^t + 1∣H∣=qt+1 (p. 26).
  3. Display (29) (p. 16): for h,k∈Hh, k \in Hh,k∈H, Uh∼GLUkU_h \sim_{\mathrm{GL}} U_kUh​∼GL​Uk​ iff h=±kh = \pm kh=±k (t≢2t \not\equiv 2t≡2) or h=ℓkh = \ell kh=ℓk with ℓq2+1=1\ell^{q^2+1} = 1ℓq2+1=1 (t≡2 mod 4t \equiv 2 \bmod 4t≡2mod4).
  4. Theorem 4.2 (a)–(b) (p. 16), in the UhU_hUh​ form: Uh∼ΓLUkU_h \sim_{\Gamma\mathrm L} U_kUh​∼ΓL​Uk​ iff h=±kρh = \pm k^\rhoh=±kρ (resp. ℓkρ\ell k^\rhoℓkρ) for some ρ∈Aut(Fqn)\rho \in \mathrm{Aut}(\mathbb F_{q^n})ρ∈Aut(Fqn​).
  5. Proof of Corollary 4.3 (p. 18): the GL-class of UhU_hUh​ in the family has ξh=2\xi_h = 2ξh​=2 (resp. q2+1q^2+1q2+1) members, and its ΓL-class at most nrξhnr\xi_hnrξh​.
  6. Lemma 2.2 (p. 5, from Csajbók–Marino–Polverino): Lf=LgL_f = L_gLf​=Lg​ forces α0=β0\alpha_0 = \beta_0α0​=β0​ and two families of coefficient identities.
  7. Display (37) (pp. 20–21): PGL-equivalence of Lf,LgL_f, L_gLf​,Lg​ as an equality of sets of quotients.
  8. The case b=0b = 0b=0 of (37) (p. 21): c=0c = 0c=0.
  9. Lemma 5.2 (p. 21): the case b=0b = 0b=0 for ψh,t,ψk,t\psi_{h,t}, \psi_{k,t}ψh,t​,ψk,t​ gives (h/k)q2+1=1(h/k)^{q^2+1} = 1(h/k)q2+1=1 and Uh∼ΓLUkU_h \sim_{\Gamma\mathrm L} U_kUh​∼ΓL​Uk​.
  10. Lemma 5.3 (p. 22): the case b=1b = 1b=1, with its three conclusions.

Significance

The result. Theorem 5.1 shows that maximum scattered linear sets of PG(1,qn)\mathrm{PG}(1, q^n)PG(1,qn), and hence Fqn\mathbb F_{q^n}Fqn​-linear MRD codes, exist in numbers exponential in nnn up to equivalence, whereas each previously known infinite family yields at most φ(n)\varphi(n)φ(n) times a function of qqq classes (Table 1, p. 3). Remark 5.4 draws the consequence that the family is new. Its intermediate results, the classification of the GL\mathrm{GL}GL- and ΓL\Gamma\mathrm LΓL-equivalences between the UhU_hUh​ (Theorem 4.2) and the reduction of PGL\mathrm{PGL}PGL-equivalence to sets of quotients, are the standard tools for any later classification of this family.

Formalizing it. The theorem has a complete published proof; none of it is machine-checked. The platform has no action of GL(2,qn)\mathrm{GL}(2, q^n)GL(2,qn) or ΓL(2,qn)\Gamma\mathrm L(2, q^n)ΓL(2,qn) on the projective line, no linear sets of PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn) as point sets, and no coefficient identities for qqq-polynomials defining the same linear set. The mission produces these, then the class counts. Lemma 2.2 is a result of an earlier paper (Csajbók–Marino–Polverino 2018) cited without proof, so formalizing it means formalizing part of that paper too.

Difficulty

Equality of two linear sets is equality of sets of points, which says nothing directly about the polynomials: different qqq-polynomials can define the same linear set (all xqsx^{q^s}xqs with gcd⁡(s,n)=1\gcd(s,n)=1gcd(s,n)=1 do). The obvious idea, that PΓL\mathrm{P\Gamma L}PΓL-equivalent linear sets come from ΓL\Gamma\mathrm LΓL-equivalent subspaces UhU_hUh​, fails in general (p. 3), so the count cannot be read off Theorem 4.2. The step that needs the restriction t>4t > 4t>4 is the comparison of coefficients in the qqq-polynomial identities, which for t=3,4t = 3, 4t=3,4 is open (Remark 5.5). A second difficulty is bookkeeping: the exponents qt±1q^{t\pm1}qt±1, q2t−1q^{2t-1}q2t−1, the negative powers of hhh and the case split on t mod 4t \bmod 4tmod4 must all be tracked through every identity.

Formalization scope

  • Field. FFF is a finite field with CharP F p, p prime, Odd p ("qqq odd"), q = p ^ r with 0 < r, and Fintype.card F = q ^ (2 * t). rrr is the exponent of q=prq = p^rq=pr, as in Theorem 5.1, so ∣Aut(Fqn)∣=rn|\mathrm{Aut}(\mathbb F_{q^n})| = rn∣Aut(Fqn​)∣=rn. Lemma 2.2, (37) and the b=0b = 0b=0 step are stated for general n≥1n \ge 1n≥1 and Fintype.card F = q ^ n, without "qqq odd", as printed.
  • Exponents. xqix^{q^i}xqi is x ^ q ^ i; negative powers of hhh are field quotients (h / h ^ q ^ (t+1) for h1−qt+1h^{1-q^{t+1}}h1−qt+1), exact since h≠0h \ne 0h=0 on HHH. Natural-number subtractions t−1t-1t−1, 2t−12t-12t−1, 3t−23t-23t−2, n−kn-kn−k, qi−1q^i - 1qi−1 are exact in the stated ranges.
  • Geometry. The plane is Fin 2 → F; points are sets of scalar multiples; linear sets are sets of points. Equivalences are stated as images of sets under v↦Avσv \mapsto A v^\sigmav↦Avσ with det⁡A\det AdetA a unit and σ:F≃F\sigma : F \simeq Fσ:F≃F a ring automorphism.
  • Pinned readings.
    1. "Scattered" is the p. 2 quotient definition with Fq={c:cq=c}\mathbb F_q = \{c : c^q = c\}Fq​={c:cq=c}.
    2. Proposition 3.2's hqt−2h^{q^{t-2}}hqt−2 is read as hq3t−2h^{q^{3t-2}}hq3t−2 (equal for t≥2t \ge 2t≥2), and "qqq odd" is added.
    3. Theorem 4.2 (a)–(b), stated for codes Ch,t\mathcal C_{h,t}Ch,t​, is formalized as the ΓL\Gamma\mathrm LΓL-equivalence of Uh,UkU_h, U_kUh​,Uk​, which the proof establishes and which is the code equivalence by Theorem 2.1 (from Sheekey 2016). The automorphism-group sentence is omitted.
    4. Lemma 5.3's hypothesis "(41) holds" is read in the setting of p. 21: b=1b = 1b=1, cˉ=c−da≠0\bar c = c - da \ne 0cˉ=c−da=0, gˉ=∑γiyqi\bar g = \sum \gamma_i y^{q^i}gˉ​=∑γi​yqi inverse to x↦ax+g(x)x \mapsto ax + g(x)x↦ax+g(x) (47), and d+cˉγ0=0d + \bar c\gamma_0 = 0d+cˉγ0​=0 (40).
    5. In (37), ax+bg(x)≠0ax + bg(x) \ne 0ax+bg(x)=0 for x≠0x \ne 0x=0 is part of the condition (stated on p. 21 for b=1b = 1b=1).
    6. "The total number MMM of inequivalent Lh,tL_{h,t}Lh,t​" is the number of classes met by {Lh,t:h∈H}\{L_{h,t} : h \in H\}{Lh,t​:h∈H}, formalized through a pairwise-inequivalent subset of HHH. HHH is not restricted to h∉Fqth \notin \mathbb F_{q^t}h∈/Fqt​, as in the count ∣H∣=qt+1|H| = q^t+1∣H∣=qt+1 of p. 26; "maximum scattered" is descriptive.
  • Trivializing formalizations ruled out. Equivalence is stated on point sets, never on quotient sets {f(x)/x}\{f(x)/x\}{f(x)/x}, where Lean's y/0=0y/0 = 0y/0=0 could merge inequivalent sets; the goal requires pairwise inequivalence, not distinctness of the parameters hhh (note ψ−h,t=ψh,t\psi_{-h,t} = \psi_{h,t}ψ−h,t​=ψh,t​); and the hypotheses are satisfiable, with bound ⌊244/40⌋=6\lfloor 244/40 \rfloor = 6⌊244/40⌋=6 at q=3q = 3q=3, t=5t = 5t=5.
  • Citation basis. All indices and pages refer to arXiv:2102.08287v3 (printed page = PDF page). The Combinatorica version is not used.
  • Welcome contributions. The ΓL(2,qn)\Gamma\mathrm L(2,q^n)ΓL(2,qn) action on F2F^2F2 and on point sets, the cardinality of {h:hqt+1=−1}\{h : h^{q^t+1} = -1\}{h:hqt+1=−1}, and Lemma 2.2 are reusable beyond this mission. Proofs of any milestone, and of Theorem 3.1 in the companion mission, are welcome.

Selected references

  • G. Longobardi, G. Marino, R. Trombetti, Y. Zhou, A large family of maximum scattered linear sets of PG(1, q^n) and their associated MRD codes, arXiv:2102.08287v3, 2021 (Combinatorica 43, 2023). https://arxiv.org/abs/2102.08287v3
  • B. Csajbók, G. Marino, O. Polverino, Classes and equivalence of linear sets in PG(1, q^n), J. Combin. Theory Ser. A 157, 402–426, 2018.
  • J. Sheekey, A new family of linear maximum rank distance codes, Adv. Math. Commun. 10(3), 475–488, 2016.
  • G. Longobardi, C. Zanella, Linear sets and MRD-codes arising from a class of scattered linearized polynomials, J. Algebraic Combin., 2021. https://doi.org/10.1007/s10801-020-01011-9
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geometriae Dedicata 81(1), 231–243, 2000.
  • G. Lunardon, O. Polverino, Blocking sets and derivable partial spreads, J. Algebraic Combin. 14(1), 49–56, 2001.
  • B. Csajbók, C. Zanella, On the equivalence of linear sets, Des. Codes Cryptogr. 81(2), 269–281, 2016.
13 thms1 active userReviewed
CombinatoricsDiscrete Geometry·Captain: mikedeng1

A Large Family of Maximum Scattered Linear Sets of PG(1, q^n) and Their Associated MRD Codes 1: For q Odd, t ≥ 3, h ∉ 𝔽_{q^t} and h^(q^t+1) = −1, ψ_{h,t} Is Scattered over 𝔽_{q^{2t}}Research Paper

Motivation

A linear set of a projective space over a finite field is the set of points spanned by the nonzero vectors of a subspace over a subfield. They have been used to construct and characterize semifields, rank-metric codes, translation spreads, translation ovoids, two-intersection sets and the blocking sets for which Lunardon introduced them (Polverino 2010; Lavrauw–Van de Voorde 2015). On the projective line PG(1,qn)\mathrm{PG}(1, q^n)PG(1,qn) the extremal objects, the maximum scattered linear sets, are equivalent to scattered polynomials over Fqn\mathbb F_{q^n}Fqn​, and each scattered polynomial fff gives an Fq\mathbb F_qFq​-linear maximum rank-distance (MRD) code Cf={ax+bf(x):a,b∈Fqn}\mathcal C_f = \{ax + bf(x) : a, b \in \mathbb F_{q^n}\}Cf​={ax+bf(x):a,b∈Fqn​} of minimum distance n−1n-1n−1 (Sheekey 2016). Rank-distance codes are studied in network coding theory (p. 2).

Scattered polynomials are scarce. Before this paper, only three families were known for infinitely many nnn:

  • 2000. The monomials xqsx^{q^s}xqs with gcd⁡(s,n)=1\gcd(s, n) = 1gcd(s,n)=1 (pseudoregulus type). Blokhuis and Lavrauw (2000) proved that a scattered linear set of PG(1,qn)\mathrm{PG}(1, q^n)PG(1,qn) has rank at most nnn.
  • 2001, 2016. The binomials δxqs+xqn−s\delta x^{q^s} + x^{q^{n-s}}δxqs+xqn−s with Nqn/q(δ)∉{0,1}N_{q^n/q}(\delta) \notin \{0, 1\}Nqn/q​(δ)∈/{0,1} (Lunardon–Polverino 2001, Sheekey 2016).
  • 2021. For qqq odd and n=2tn = 2tn=2t, the polynomial 12(xq+xqt−1−xqt+1+xq2t−1)\tfrac12(x^q + x^{q^{t-1}} - x^{q^{t+1}} + x^{q^{2t-1}})21​(xq+xqt−1−xqt+1+xq2t−1) and its variants (Longobardi–Zanella 2021).
  • 2018–2020. Further families exist only for n∈{6,8}n \in \{6, 8\}n∈{6,8} (Csajbók–Marino–Polverino–Zanella 2018; Csajbók–Marino–Zullo 2018; Bartoli–Zanella–Zullo 2020). Asymptotic classification results suggest that scattered polynomials are rare (Bartoli–Zhou 2018).

Longobardi, Marino, Trombetti and Zhou construct a fourth family, defined for every even n≥6n \ge 6n≥6 and odd qqq. This mission formalizes that construction, Theorem 3.1 of the paper.

Setting

Let ppp be an odd prime, r≥1r \ge 1r≥1, q=prq = p^rq=pr, t≥3t \ge 3t≥3 and n=2tn = 2tn=2t. Let F=FqnF = \mathbb F_{q^n}F=Fqn​ be the finite field of order q2tq^{2t}q2t. For m∣nm \mid nm∣n, write Fqm\mathbb F_{q^m}Fqm​ for its subfield of order qmq^mqm, the set of xxx with xqm=xx^{q^m} = xxqm=x.

A qqq-polynomial over FFF is a map f(x)=∑i=0n−1cixqif(x) = \sum_{i=0}^{n-1} c_i x^{q^i}f(x)=∑i=0n−1​ci​xqi with ci∈Fc_i \in Fci​∈F. It is Fq\mathbb F_qFq​-linear. Its graph Uf={(x,f(x)):x∈F}U_f = \{(x, f(x)) : x \in F\}Uf​={(x,f(x)):x∈F} is an nnn-dimensional Fq\mathbb F_qFq​-subspace of F2F^2F2, and it defines the linear set Lf={⟨(x,f(x))⟩Fqn:x∈F∗}L_f = \{\langle (x, f(x))\rangle_{\mathbb F_{q^n}} : x \in F^*\}Lf​={⟨(x,f(x))⟩Fqn​​:x∈F∗} of PG(1,qn)\mathrm{PG}(1, q^n)PG(1,qn).

The polynomial fff is scattered when, for all z,y∈F∗z, y \in F^*z,y∈F∗,

f(z)z=f(y)y⟹z and y are Fq-linearly dependent.\frac{f(z)}{z} = \frac{f(y)}{y} \quad\Longrightarrow\quad z \text{ and } y \text{ are } \mathbb F_q\text{-linearly dependent.}zf(z)​=yf(y)​⟹z and y are Fq​-linearly dependent.

Equivalently, LfL_fLf​ has the maximum size (qn−1)/(q−1)(q^n - 1)/(q - 1)(qn−1)/(q−1).

Fix h∈Fh \in Fh∈F with hqt+1=−1h^{q^t + 1} = -1hqt+1=−1. The paper's polynomial is

ψh,t(x)=xq+xqt−1−h1−qt+1xqt+1+h1−q2t−1xq2t−1.\psi_{h,t}(x) = x^q + x^{q^{t-1}} - h^{1-q^{t+1}} x^{q^{t+1}} + h^{1-q^{2t-1}} x^{q^{2t-1}}.ψh,t​(x)=xq+xqt−1−h1−qt+1xqt+1+h1−q2t−1xq2t−1.

The proof splits it as ψh,t=L+M\psi_{h,t} = L + Mψh,t​=L+M with

L(x)=xq−h1−qt+1xqt+1,M(x)=xqt−1+h1−q2t−1xq2t−1,L(x) = x^q - h^{1-q^{t+1}} x^{q^{t+1}}, \qquad M(x) = x^{q^{t-1}} + h^{1-q^{2t-1}} x^{q^{2t-1}},L(x)=xq−h1−qt+1xqt+1,M(x)=xqt−1+h1−q2t−1xq2t−1,

and it also uses the Fqt\mathbb F_{q^t}Fqt​-linear maps R(x)=xqt+hqt−1−qxR(x) = x^{q^t} + h^{q^{t-1}-q} xR(x)=xqt+hqt−1−qx and T(x)=xqt+hq−qt−1xT(x) = x^{q^t} + h^{q-q^{t-1}} xT(x)=xqt+hq−qt−1x. The Lean development uses the same letters: psi, Lmap, Mmap, Rmap, Tmap, IsScatteredPoly, qpoly, graph.

Formalization targets

Goal: Theorem 3.1

For qqq odd, n=2tn = 2tn=2t, t≥3t \ge 3t≥3, and every h∈Fqn∖Fqth \in \mathbb F_{q^n} \setminus \mathbb F_{q^t}h∈Fqn​∖Fqt​ with hqt+1=−1h^{q^t+1} = -1hqt+1=−1,

∀z,y∈Fqn∗:ψh,t(z)z=ψh,t(y)y  ⟹  ∃c∈Fq, z=c y.\forall z, y \in \mathbb F_{q^n}^* :\quad \frac{\psi_{h,t}(z)}{z} = \frac{\psi_{h,t}(y)}{y} \;\Longrightarrow\; \exists c \in \mathbb F_q,\ z = c\,y .∀z,y∈Fqn∗​:zψh,t​(z)​=yψh,t​(y)​⟹∃c∈Fq​, z=cy.

Milestones

  1. The equivalence of three conditions (§1, p. 2): LfL_fLf​ is scattered; fff is scattered; and f(γx)=γf(x)f(\gamma x) = \gamma f(x)f(γx)=γf(x) with x≠0x \neq 0x=0 forces γ∈Fq\gamma \in \mathbb F_qγ∈Fq​.
  2. Proposition 3.2: hqt+1=−1h^{q^t+1} = -1hqt+1=−1 implies hq2+1≠1h^{q^2+1} \neq 1hq2+1=1 and hqt−2≠−hh^{q^{t-2}} \neq -hhqt−2=−h.
  3. LLL and MMM are Fqt\mathbb F_{q^t}Fqt​-semilinear (p. 7).
  4. The kernels of LLL and MMM, displays (4)–(5), are 1-dimensional Fqt\mathbb F_{q^t}Fqt​-subspaces.
  5. The images of LLL and MMM, displays (6)–(7), are 1-dimensional Fqt\mathbb F_{q^t}Fqt​-subspaces.
  6. Proposition 3.3: Fqn=ker⁡L⊕ker⁡M=im⁡L⊕im⁡M\mathbb F_{q^n} = \ker L \oplus \ker M = \operatorname{im} L \oplus \operatorname{im} MFqn​=kerL⊕kerM=imL⊕imM.
  7. dim⁡ker⁡R=dim⁡ker⁡T=1\dim \ker R = \dim \ker T = 1dimkerR=dimkerT=1 and ker⁡T=hqt−1−qker⁡R\ker T = h^{q^{t-1}-q}\ker RkerT=hqt−1−qkerR (p. 8).
  8. Lemma 3.4: the Fqt\mathbb F_{q^t}Fqt​-bases {1,ρ}\{1, \rho\}{1,ρ}, {1,τ}\{1, \tau\}{1,τ} and the change of components (9).
  9. Proposition 3.5: a∈ker⁡R  ⟺  av∈ker⁡L  ⟺  aM(u)∈im⁡La \in \ker R \iff av \in \ker L \iff aM(u) \in \operatorname{im} La∈kerR⟺av∈kerL⟺aM(u)∈imL.
  10. Proposition 3.6: b∈ker⁡T  ⟺  bu∈ker⁡M  ⟺  bL(v)∈im⁡Mb \in \ker T \iff bu \in \ker M \iff bL(v) \in \operatorname{im} Mb∈kerT⟺bu∈kerM⟺bL(v)∈imM.

Significance

The result. Theorem 3.1 produces, for every odd qqq and even n≥6n \ge 6n≥6, maximum scattered linear sets of PG(1,qn)\mathrm{PG}(1, q^n)PG(1,qn) and MRD codes of Fqn×n\mathbb F_q^{n \times n}Fqn×n​ with minimum distance n−1n - 1n−1. For t=3t = 3t=3 the polynomials ψh,3\psi_{h,3}ψh,3​ are those of Bartoli, Zanella and Zullo. If hhh were allowed in Fqt\mathbb F_{q^t}Fqt​, then h∈Fq2h \in \mathbb F_{q^2}h∈Fq2​ and ψh,t\psi_{h,t}ψh,t​ would reduce to the Longobardi–Zanella polynomials (p. 6). The second half of the paper (Theorem 5.1, a companion mission) shows that for t>4t > 4t>4 the family contains a number of PΓL\mathrm{P\Gamma L}PΓL-inequivalent members that grows exponentially in nnn. Every previously known family contributes fewer than q2φ(n)/2q^2\varphi(n)/2q2φ(n)/2 classes.

Formalizing it. The theorem has a complete published proof. No scattered polynomial, linear set of the projective line or linearized-polynomial kernel computation is formalized on the platform, and none appears in Mathlib. The work is to formalize the paper's proof: the semilinear-algebra lemmas of §3 and the case analysis that follows them. The milestones are reusable statements about qqq-polynomials of Fq2t\mathbb F_{q^{2t}}Fq2t​ seen as an Fqt\mathbb F_{q^t}Fqt​-plane.

Difficulty

Writing ψh,t(γx)=γψh,t(x)\psi_{h,t}(\gamma x) = \gamma \psi_{h,t}(x)ψh,t​(γx)=γψh,t​(x) out coefficient by coefficient gives a system in xxx and γ\gammaγ with exponents q,qt±1,q2t−1q, q^{t\pm1}, q^{2t-1}q,qt±1,q2t−1 that does not separate directly. The paper's route goes through two Fqt\mathbb F_{q^t}Fqt​-direct-sum decompositions of Fqn\mathbb F_{q^n}Fqn​ and two changes of Fqt\mathbb F_{q^t}Fqt​-basis. Each identity involves negative powers of hhh and holds only through hqt+1=−1h^{q^t+1} = -1hqt+1=−1 and the parity of qqq. The hypothesis h∉Fqth \notin \mathbb F_{q^t}h∈/Fqt​ enters only at the end, and a formalization must carry the arithmetic of the exponent towers modulo q2t−1q^{2t} - 1q2t−1 throughout. The tempting shortcut, checking the statement on a few small fields, proves nothing: the theorem is uniform in qqq and ttt.

Formalization scope

  • Field. FFF is a finite field with CharP F p, p prime, Odd p, q=prq = p^rq=pr with r≥1r \ge 1r≥1 (an explicit q with hq : q = p ^ r), and Fintype.card F = q ^ (2 * t). So FFF is Fq2t\mathbb F_{q^{2t}}Fq2t​ up to isomorphism, and no particular model is chosen.
  • Subfields. Fq\mathbb F_qFq​ and Fqt\mathbb F_{q^t}Fqt​ are the fixed fields of x↦xqx \mapsto x^qx↦xq and x↦xqtx \mapsto x^{q^t}x↦xqt, taken from the published definition ScatCaps.LinearSets.subfieldOf F p r m.
  • Scattered. "Scattered" is the literal definition of p. 2, with z,yz, yz,y ranging over all of F∗F^*F∗. The scattered-linear-set side of milestone 1 uses the published weight-one predicate ScatCaps.LinearSets.IsScattered, which is equivalent to the cardinality definition of p. 1.
  • Powers of hhh. A negative or difference power of hhh is written as a field quotient, e.g. h1−qt+1h^{1-q^{t+1}}h1−qt+1 as h / h ^ q ^ (t+1). This is exact because hqt+1=−1h^{q^t+1} = -1hqt+1=−1 forces h≠0h \neq 0h=0. Natural-number subtractions in exponents (t−1t-1t−1, 2t−12t-12t−1, 3t−23t-23t−2) are exact in the stated ranges.
  • Linear-algebra encodings. "1-dimensional Fqt\mathbb F_{q^t}Fqt​-subspace" means closed under addition and Fqt\mathbb F_{q^t}Fqt​-scalars, containing 000, and of cardinality ∣Fqt∣|\mathbb F_{q^t}|∣Fqt​∣ (published IsFqSubspace, HasRank). A direct sum is stated as unique decomposition, and an Fqt\mathbb F_{q^t}Fqt​-basis {1,ρ}\{1, \rho\}{1,ρ} as unique representation λ+μρ\lambda + \mu\rhoλ+μρ with λ,μ∈Fqt\lambda, \mu \in \mathbb F_{q^t}λ,μ∈Fqt​.
  • Pinned readings. (1) The standing hypotheses of §3 (qqq odd, n=2tn = 2tn=2t, t≥3t \ge 3t≥3, hqt+1=−1h^{q^t+1} = -1hqt+1=−1) are carried into every §3 lemma, even where its printed statement omits them. h∉Fqth \notin \mathbb F_{q^t}h∈/Fqt​ is added only to Theorem 3.1, because the lemmas do not use it. (2) Proposition 3.2 is printed with t≥1t \ge 1t≥1 and without "qqq odd". "qqq odd" is added (its proof uses it, and qqq even gives a counterexample), and hqt−2h^{q^{t-2}}hqt−2 is read as hq3t−2h^{q^{3t-2}}hq3t−2, which is equal to it for t≥2t \ge 2t≥2 and defined at t=1t = 1t=1.
  • Ruling out trivial versions. A formalization in which Fq\mathbb F_qFq​ is the whole field (every map is then "scattered"), in which γ\gammaγ or z,yz, yz,y range only over a subfield, or in which h1−qt+1h^{1-q^{t+1}}h1−qt+1 is a truncated natural-number power, would not state the theorem. The statements here quantify over all of F∗F^*F∗ and conclude membership in the fixed field of x↦xqx \mapsto x^qx↦xq.
  • Infrastructure. A complete development needs: Frobenius iterates on finite fields, fixed fields and their cardinalities, kernels and images of Fqt\mathbb F_{q^t}Fqt​-semilinear maps of Fq2t\mathbb F_{q^{2t}}Fq2t​, and the solution count of xqt−1=cx^{q^t - 1} = cxqt−1=c. These are reusable well beyond this mission. Proofs of any milestone, and alternative arguments, are welcome.

Selected references

  • G. Longobardi, G. Marino, R. Trombetti, Y. Zhou, A large family of maximum scattered linear sets of PG(1, q^n) and their associated MRD codes, arXiv:2102.08287v3, 2021 (Combinatorica 43, 2023). https://arxiv.org/abs/2102.08287v3
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geometriae Dedicata 81, 2000.
  • G. Lunardon, O. Polverino, Blocking sets and derivable partial spreads, J. Algebraic Combin. 14, 2001.
  • J. Sheekey, A new family of linear maximum rank distance codes, Adv. Math. Commun. 10(3), 2016.
  • G. Longobardi, C. Zanella, Linear sets and MRD-codes arising from a class of scattered linearized polynomials, J. Algebraic Combin., 2021. https://doi.org/10.1007/s10801-020-01011-9
  • D. Bartoli, C. Zanella, F. Zullo, A new family of maximum scattered linear sets in PG(1, q^6), Ars Math. Contemp. 19(1), 2020.
  • B. Csajbók, G. Marino, O. Polverino, C. Zanella, A new family of MRD-codes, Linear Algebra Appl. 548, 2018.
  • B. Csajbók, G. Marino, F. Zullo, New maximum scattered linear sets of the projective line, Finite Fields Appl. 54, 2018.
  • D. Bartoli, Y. Zhou, Exceptional scattered polynomials, J. Algebra 509, 2018.
  • M. Lavrauw, G. Van de Voorde, Field reduction and linear sets in finite geometry, Contemp. Math. 632, AMS, 2015, pp. 271–293.
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. (22): 3096–3107, 2010.
13 thms1 active userReviewed
Theoretical Computer Science·Captain: mikedeng1

Fast Polynomial Factorization and Modular Composition 3: The Frobenius Lift φ and Projection π Recover f(α) from the Kronecker Substitution f*(Y) = f(Y, Y^h, …, Y^{h^{m−1}})Research Paper

Motivation

Multivariate multipoint evaluation asks for the values f(α0),…,f(αN−1)f(\alpha_0), \dots, f(\alpha_{N-1})f(α0​),…,f(αN−1​) of one polynomial f∈Fq[X0,…,Xm−1]f \in \mathbb F_q[X_0, \dots, X_{m-1}]f∈Fq​[X0​,…,Xm−1​] at NNN points of Fqm\mathbb F_q^mFqm​. Kedlaya and Umans showed that this problem is equivalent to modular composition, the computation of f(g(X)) mod h(X)f(g(X)) \bmod h(X)f(g(X))modh(X) for univariate polynomials, and that fast algorithms for it yield the fastest known algorithms for factoring univariate polynomials over finite fields (Kedlaya–Umans, Dagstuhl Seminar Proceedings 08381, 2008; journal version SIAM J. Comput. 40(6), 2011, doi:10.1137/08073408X). Modular composition is the bottleneck of the factoring algorithms of von zur Gathen and Shoup (1992) and Kaltofen and Shoup (1998), so a near-linear multipoint evaluation algorithm translates directly into a faster factoring algorithm.

The paper gives two such algorithms. Section 4 works over any ring Z/rZ\mathbb Z/r\mathbb ZZ/rZ and is not algebraic: it lifts the problem to the integers and reduces modulo many small primes. Section 6, the subject of this mission, gives an algebraic algorithm, using only ring operations, for fields of small characteristic. Its correctness rests on one identity, Lemma 6.1, which lets the evaluation of the mmm-variate fff at a point be read off from the evaluation of a single univariate polynomial f∗f^*f∗ at a related point of an extension ring.

Setting

Let ppp be a prime and Fq\mathbb F_qFq​ a finite field of characteristic ppp. Fix integers m≥0m \ge 0m≥0 and d≥1d \ge 1d≥1. Let h=pch = p^ch=pc be a power of ppp with h>m2dh > m^2 dh>m2d (the paper takes the least such power), and let P(W)∈Fp[W]P(W) \in \mathbb F_p[W]P(W)∈Fp​[W] be a polynomial of degree ccc that is irreducible over Fp\mathbb F_pFp​. Then:

  • K=Fp[W]/(P(W))K = \mathbb F_p[W]/(P(W))K=Fp​[W]/(P(W)) is a field with hhh elements. Let η\etaη be a primitive element of KKK, a generator of its multiplicative group, so η\etaη has multiplicative order h−1h-1h−1.
  • R=Fq[W]/(P(W))R = \mathbb F_q[W]/(P(W))R=Fq​[W]/(P(W)), with PPP viewed over Fq\mathbb F_qFq​. PPP need not remain irreducible over Fq\mathbb F_qFq​, so RRR is a ring containing Fq\mathbb F_qFq​ and KKK but in general not a field.
  • σ:R→R\sigma : R \to Rσ:R→R, x↦xhx \mapsto x^hx↦xh, is a power of the Frobenius endomorphism; σi\sigma^iσi is x↦xhix \mapsto x^{h^i}x↦xhi. On Fq\mathbb F_qFq​ it is an automorphism, with inverse σ−i\sigma^{-i}σ−i.
  • E(Z)=Zh−1−η∈R[Z]E(Z) = Z^{h-1} - \eta \in R[Z]E(Z)=Zh−1−η∈R[Z] and S=R[Z]/(E(Z))S = R[Z]/(E(Z))S=R[Z]/(E(Z)). Every element of SSS has a canonical representative, its remainder modulo the monic EEE, of degree less than h−1h-1h−1.

Three maps connect the problem to SSS:

  • the lift φ:Fqm→S\varphi : \mathbb F_q^m \to Sφ:Fqm​→S sends α=(α0,…,αm−1)\alpha = (\alpha_0, \dots, \alpha_{m-1})α=(α0​,…,αm−1​) to the class of the polynomial gα(Z)∈R[Z]g_\alpha(Z) \in R[Z]gα​(Z)∈R[Z] of degree at most m−1m-1m−1 with gα(ηi)=σ−i(αi)g_\alpha(\eta^i) = \sigma^{-i}(\alpha_i)gα​(ηi)=σ−i(αi​) for i=0,…,m−1i = 0, \dots, m-1i=0,…,m−1 (Eq. (6.1));
  • the projection π:S→R\pi : S \to Rπ:S→R sends an element with canonical representative g(Z)g(Z)g(Z) to g(1)g(1)g(1);
  • the Kronecker substitution sends f∈Fq[X0,…,Xm−1]f \in \mathbb F_q[X_0, \dots, X_{m-1}]f∈Fq​[X0​,…,Xm−1​] to the univariate
f∗(Y)=f(Y,Yh,Yh2,…,Yhm−1)∈S[Y].f^*(Y) = f\big(Y, Y^h, Y^{h^2}, \dots, Y^{h^{m-1}}\big) \in S[Y].f∗(Y)=f(Y,Yh,Yh2,…,Yhm−1)∈S[Y].

In the Lean development these are K, R, h, ι (the inclusion K⊆RK \subseteq RK⊆R), sigma i (=σi=\sigma^i=σi), E, S, sigmaInv i (=σ−i=\sigma^{-i}=σ−i on Fq\mathbb F_qFq​), gAlpha, phi, pi, gIter (gα(i)g_\alpha^{(i)}gα(i)​) and fStar, in the namespace KedlayaUmans.FrobeniusLift.

Formalization targets

Goal: Lemma 6.1 (p. 19)

For every f∈Fq[X0,…,Xm−1]f \in \mathbb F_q[X_0, \dots, X_{m-1}]f∈Fq​[X0​,…,Xm−1​] with degree at most d−1d-1d−1 in each variable and every α∈Fqm⊆Rm\alpha \in \mathbb F_q^m \subseteq R^mα∈Fqm​⊆Rm,

π(f∗(φ(α)))=f(α).\pi\big(f^*(\varphi(\alpha))\big) = f(\alpha).π(f∗(φ(α)))=f(α).

Milestones, in the order the proof uses them

  1. Properties of η\etaη (p. 18): η\etaη has order h−1h-1h−1 in RRR, and ηi−ηj\eta^i - \eta^jηi−ηj is a unit of RRR for i≠ji \ne ji=j in {0,…,m−1}\{0, \dots, m-1\}{0,…,m−1}.
  2. Eq. (6.1) (p. 19): σi(σ−i(a))=a\sigma^i(\sigma^{-i}(a)) = aσi(σ−i(a))=a for a∈Fqa \in \mathbb F_qa∈Fq​; deg⁡gα≤m−1\deg g_\alpha \le m-1deggα​≤m−1; gα(ηi)=σ−i(αi)g_\alpha(\eta^i) = \sigma^{-i}(\alpha_i)gα​(ηi)=σ−i(αi​).
  3. The Frobenius congruence (p. 19): η\etaη is fixed by σ\sigmaσ, and (g(Z))hi≡σi(g)(ηiZ)(modE(Z))(g(Z))^{h^i} \equiv \sigma^i(g)(\eta^i Z) \pmod{E(Z)}(g(Z))hi≡σi(g)(ηiZ)(modE(Z)) for every g∈R[Z]g \in R[Z]g∈R[Z].
  4. Eq. (6.2) (p. 19): with gα(i)=gαhi mod Eg_\alpha^{(i)} = g_\alpha^{h^i} \bmod Egα(i)​=gαhi​modE, deg⁡gα(i)=deg⁡gα\deg g_\alpha^{(i)} = \deg g_\alphadeggα(i)​=deggα​ and gα(i)(1)=αig_\alpha^{(i)}(1) = \alpha_igα(i)​(1)=αi​ for i<mi < mi<m.
  5. No reduction (pp. 19–20): the canonical representative of f∗(φ(α))f^*(\varphi(\alpha))f∗(φ(α)) is f(gα(0),…,gα(m−1)) mod Ef(g_\alpha^{(0)}, \dots, g_\alpha^{(m-1)}) \bmod Ef(gα(0)​,…,gα(m−1)​)modE, and this remainder equals f(gα(0),…,gα(m−1))f(g_\alpha^{(0)}, \dots, g_\alpha^{(m-1)})f(gα(0)​,…,gα(m−1)​) itself.

Significance

The result. Lemma 6.1 is the correctness half of Theorem 6.2: to evaluate fff at NNN points one computes the NNN lifts φ(αk)\varphi(\alpha_k)φ(αk​), evaluates the one univariate polynomial f∗f^*f∗ at all of them by fast univariate multipoint evaluation, and projects back with π\piπ. Since univariate multipoint evaluation runs in nearly linear time, the identity turns a multivariate problem into a univariate one at the cost of the degree growth deg⁡f∗≤dm hm\deg f^* \le dm\,h^mdegf∗≤dmhm. Corollary 6.3 turns this into an operation count of (dm+N)1+δ(dm+N)^{1+\delta}(dm+N)1+δ for every δ>0\delta>0δ>0, provided m≤do(1)m \le d^{o(1)}m≤do(1) and the characteristic satisfies p≤do(1)p \le d^{o(1)}p≤do(1).

Formalizing it. The lemma is proved in the paper; no machine-checked version is known to exist. This mission states it for the objects exactly as constructed in Section 6 (an explicit interpolant for φ\varphiφ, the canonical-representative projection for π\piπ) and splits its proof into the five steps above. The definitions of the rings RRR and SSS, the Frobenius powers on a ring that is not a field, and the Kronecker substitution into a quotient ring are reusable for formalizing other uses of the Frobenius-lift technique, such as the Parvaresh–Vardy codes and their Guruswami–Rudra instantiation, which the paper names as the inspiration for this algorithm (§1.5, p. 6).

Difficulty

The obvious attempt is to treat π\piπ as evaluation at Z=1Z = 1Z=1 and push it through f∗f^*f∗. This fails: E(1)=1−ηE(1) = 1 - \etaE(1)=1−η is a unit, not zero, so evaluation at 111 does not factor through S=R[Z]/(E)S = R[Z]/(E)S=R[Z]/(E), and π\piπ is not a ring homomorphism. The identity holds only because the polynomial f(gα(0),…,gα(m−1))f(g_\alpha^{(0)}, \dots, g_\alpha^{(m-1)})f(gα(0)​,…,gα(m−1)​) is already reduced modulo EEE, which requires both the degree bound h−1≥m2dh - 1 \ge m^2 dh−1≥m2d and the fact that raising to the power hih^ihi does not raise the degree of gαg_\alphagα​ modulo EEE. The second fact depends on η\etaη being fixed by σ\sigmaσ and on η(hi−1)/(h−1)=ηi\eta^{(h^i-1)/(h-1)} = \eta^iη(hi−1)/(h−1)=ηi. The equality deg⁡gα(i)=deg⁡gα\deg g_\alpha^{(i)} = \deg g_\alphadeggα(i)​=deggα​ further needs that σi\sigma^iσi does not kill the leading coefficient in RRR, a ring with possible zero divisors. Finally, interpolation must happen in RRR, not a field, which is possible only because the nodes ηi\eta^iηi lie in the subfield KKK.

Formalization scope

  • Fq\mathbb F_qFq​ is a type F with [Field F] [Fintype F] [CharP F p], ppp a prime ([Fact p.Prime]). PPP is a polynomial over ZMod p with [Fact (Irreducible P)]; ccc is P.natDegree and hhh is p ^ P.natDegree. RRR is AdjoinRoot of PPP mapped to F; RRR is never assumed to be a field and PPP is never assumed irreducible over F.
  • The paper's hhh is the least power of ppp above m2dm^2 dm2d; the statements assume only m ^ 2 * d < h, which contains the paper's case. d≥1d \ge 1d≥1 is a hypothesis.
  • "Primitive element" is IsPrimitiveRoot η (h - 1), equivalent to generating K×K^\timesK× since ∣K∣=h|K| = h∣K∣=h.
  • "Individual degrees d−1d-1d−1" means at most d−1d-1d−1: ∀ i, f.degreeOf i ≤ d - 1.
  • Variables and points are indexed by Fin m, starting at 000; f∗f^*f∗ substitutes YhiY^{h^i}Yhi for XiX_iXi​.
  • gαg_\alphagα​ is the explicit Lagrange interpolant: Mathlib's Lagrange.basis over the field KKK at the nodes η0,…,ηm−1\eta^0, \dots, \eta^{m-1}η0,…,ηm−1, mapped into R[Z]R[Z]R[Z], with coefficients σ−i(αi)\sigma^{-i}(\alpha_i)σ−i(αi​). π\piπ is the remainder modulo EEE (AdjoinRoot.modByMonicHom) evaluated at 111.
  • Only correctness is formalized. The operation counts of Theorem 6.2 and Corollary 6.3, and the cost of finding PPP and η\etaη, are out of scope.

A formalization that takes φ(α)\varphi(\alpha)φ(α) to be any element satisfying (6.2), or defines π\piπ as a ring homomorphism, would make the goal trivial or false; both are ruled out because φ\varphiφ and π\piπ are explicit definitions with no hypotheses attached, and (6.1) and (6.2) are milestones to be proved.

Infrastructure a full proof needs: the Frobenius on polynomial rings in characteristic ppp (gp=σ(g)(Zp)g^{p} = \sigma(g)(Z^{p})gp=σ(g)(Zp), cf. Mathlib's expand and map_frobenius_expand), Lagrange interpolation transported along a ring homomorphism from a field, degree bounds for MvPolynomial.eval₂, and reducedness of RRR (from separability of PPP over the perfect field Fp\mathbb F_pFp​). Proofs of any milestone, and alternative arguments, are welcome.

Selected references

  • K. S. Kedlaya, C. Umans, Fast polynomial factorization and modular composition, Dagstuhl Seminar Proceedings 08381, version of Aug. 31, 2008. http://drops.dagstuhl.de/opus/volltexte/2008/1777
  • K. S. Kedlaya, C. Umans, Fast polynomial factorization and modular composition, SIAM J. Comput. 40(6), 2011. https://doi.org/10.1137/08073408X
  • F. Parvaresh, A. Vardy, Correcting errors beyond the Guruswami–Sudan radius in polynomial time, FOCS 2005, pp. 285–294. https://doi.org/10.1109/SFCS.2005.29
  • V. Guruswami, A. Rudra, Explicit capacity-achieving list-decodable codes, STOC 2006, pp. 1–10. https://doi.org/10.1145/1132516.1132518
8 thms1 active userReviewed
Number TheoryTheoretical Computer Science·Captain: mikedeng1

Fast Polynomial Factorization and Modular Composition 2: Multimodular Reduction with Primes up to 16 log N and Kronecker Lifting Correctly Evaluate Multivariate Polynomials over (ℤ/rℤ)[Z]/(E(Z))Research Paper

Motivation

Multivariate multipoint evaluation asks for the values f(α0),…,f(αN−1)f(\alpha_0),\dots,f(\alpha_{N-1})f(α0​),…,f(αN−1​) of a polynomial f(X0,…,Xm−1)f(X_0,\dots,X_{m-1})f(X0​,…,Xm−1​) over a ring RRR, with individual degrees at most d−1d-1d−1, at NNN given points of RmR^mRm. Kedlaya and Umans showed that, over finite fields and rings (Z/rZ)[Z]/(E(Z))(\mathbb Z/r\mathbb Z)[Z]/(E(Z))(Z/rZ)[Z]/(E(Z)), this problem can be solved in time nearly linear in the input size dm+mNd^m + mNdm+mN, for m≤do(1)m \le d^{o(1)}m≤do(1) (Kedlaya–Umans 2008, §4). Through their reduction of modular composition, the computation of f(g(X)) mod h(X)f(g(X)) \bmod h(X)f(g(X))modh(X), to multipoint evaluation (§3 of the same paper), this gives the first nearly-linear-time algorithm for modular composition over finite fields. That in turn gives the fastest known algorithms for factoring univariate polynomials over Fq\mathbb F_qFq​, with O(n1.5+o(1)log⁡1+o(1)q+n1+o(1)log⁡2+o(1)q)O(n^{1.5+o(1)}\log^{1+o(1)} q + n^{1+o(1)}\log^{2+o(1)} q)O(n1.5+o(1)log1+o(1)q+n1+o(1)log2+o(1)q) bit operations for a randomized algorithm on degree-nnn polynomials (abstract and §8).

Timeline. Brent and Kung (1978) gave the O(n(ω+1)/2)O(n^{(\omega+1)/2})O(n(ω+1)/2) baby-step/giant-step algorithm for modular composition (J. ACM 25). Huang and Pan (1997) improved the exponent using fast rectangular matrix multiplication. Kaltofen and Shoup (1998) introduced the factoring framework that the factoring application builds on (Math. Comp. 67). Kedlaya and Umans (2008, SIAM J. Comput. 2011) gave the multimodular algorithm formalized here, together with an algebraic algorithm for small characteristic.

Setting

Let r≥1r \ge 1r≥1 and write Z/rZ\mathbb Z/r\mathbb ZZ/rZ for the integers modulo rrr. Every element of Z/rZ\mathbb Z/r\mathbb ZZ/rZ has a lift, its representative in {0,…,r−1}\{0,\dots,r-1\}{0,…,r−1}. For f∈(Z/rZ)[X0,…,Xm−1]f \in (\mathbb Z/r\mathbb Z)[X_0,\dots,X_{m-1}]f∈(Z/rZ)[X0​,…,Xm−1​], f~∈Z[X0,…,Xm−1]\tilde f \in \mathbb Z[X_0,\dots,X_{m-1}]f~​∈Z[X0​,…,Xm−1​] replaces each coefficient by its lift; α~∈Zm\tilde\alpha \in \mathbb Z^mα~∈Zm lifts a point coordinatewise.

Algorithm MULTIMODULAR with degree parameter ddd and t≥1t \ge 1t≥1 rounds takes fff (degree at most d−1d-1d−1 in each variable) and a point α\alphaα. It lists the primes p1,…,pkp_1,\dots,p_kp1​,…,pk​ at most ℓ=16log⁡(dm(r−1)md)\ell = 16\log(d^m(r-1)^{md})ℓ=16log(dm(r−1)md), reduces f~\tilde ff~​ and α~\tilde\alphaα~ modulo each php_hph​, and evaluates the reductions fh(αh)∈Fphf_h(\alpha_h) \in \mathbb F_{p_h}fh​(αh​)∈Fph​​. It does this directly when t=1t = 1t=1, and by recursion with t−1t-1t−1 rounds otherwise. It then returns, reduced modulo rrr, the unique integer in {0,…,p1⋯pk−1}\{0,\dots,p_1\cdots p_k - 1\}{0,…,p1​⋯pk​−1} congruent to fh(αh)f_h(\alpha_h)fh​(αh​) modulo every php_hph​.

Let E(Z)∈(Z/rZ)[Z]E(Z) \in (\mathbb Z/r\mathbb Z)[Z]E(Z)∈(Z/rZ)[Z] be monic of degree eee and R=(Z/rZ)[Z]/(E(Z))R = (\mathbb Z/r\mathbb Z)[Z]/(E(Z))R=(Z/rZ)[Z]/(E(Z)). The lift of x∈Rx \in Rx∈R is its representative of degree at most e−1e-1e−1, with coefficients lifted to {0,…,r−1}\{0,\dots,r-1\}{0,…,r−1}, an element of Z[Z]\mathbb Z[Z]Z[Z]. Put

M=dm(e(r−1))(d−1)m+1+1,r′=M(e−1)dm+1.M = d^m\bigl(e(r-1)\bigr)^{(d-1)m+1} + 1,\qquad r' = M^{(e-1)dm+1}.M=dm(e(r−1))(d−1)m+1+1,r′=M(e−1)dm+1.

Algorithm MULTIMODULAR-FOR-EXTENSION-RING runs in four steps.

  1. Lift f∈R[X0,…,Xm−1]f \in R[X_0,\dots,X_{m-1}]f∈R[X0​,…,Xm−1​] and α∈Rm\alpha \in R^mα∈Rm to Z[Z]\mathbb Z[Z]Z[Z].
  2. Substitute Z=MZ = MZ=M and reduce modulo r′r'r′.
  3. Run MULTIMODULAR over Z/r′Z\mathbb Z/r'\mathbb ZZ/r′Z, obtaining β\betaβ.
  4. Form the polynomial Q(Z)Q(Z)Q(Z) whose coefficients are the base-MMM digits of β\betaβ, and return QQQ reduced modulo rrr and E(Z)E(Z)E(Z).

Formalization targets

Goal: Theorem 4.4 (correctness)

For EEE monic of degree e≥1e \ge 1e≥1, m≥1m \ge 1m≥1, d≥2d \ge 2d≥2, t≥1t \ge 1t≥1, every f∈R[X0,…,Xm−1]f \in R[X_0,\dots,X_{m-1}]f∈R[X0​,…,Xm−1​] of degree at most d−1d-1d−1 in each variable, and every α∈Rm\alpha \in R^mα∈Rm:

MULTIMODULAR-FOR-EXTENSION-RINGd(f,α,t)=f(α).\mathrm{MULTIMODULAR\text{-}FOR\text{-}EXTENSION\text{-}RING}_d(f,\alpha,t) = f(\alpha).MULTIMODULAR-FOR-EXTENSION-RINGd​(f,α,t)=f(α).

Milestones

In the order the paper's proofs use them:

  1. Lemma 2.4. For every integer N≥2N \ge 2N≥2, ∏p≤16log⁡Np>N\displaystyle\prod_{p \le 16\log N} p > Np≤16logN∏​p>N.
  2. Magnitude bound (proof of Theorem 4.2). 0≤f~(α~)≤dm(r−1)md<p1⋯pk0 \le \tilde f(\tilde\alpha) \le d^m(r-1)^{md} < p_1\cdots p_k0≤f~​(α~)≤dm(r−1)md<p1​⋯pk​.
  3. Theorem 4.2 (correctness). MULTIMODULARd(f,α,r,t)=f(α)\mathrm{MULTIMODULAR}_d(f,\alpha,r,t) = f(\alpha)MULTIMODULARd​(f,α,r,t)=f(α) over Z/rZ\mathbb Z/r\mathbb ZZ/rZ.
  4. Coefficient bound (proof of Theorem 4.4). f~(α~)∈Z[Z]\tilde f(\tilde\alpha) \in \mathbb Z[Z]f~​(α~)∈Z[Z] has degree at most (e−1)dm(e-1)dm(e−1)dm and coefficients in {0,…,M−1}\{0,\dots,M-1\}{0,…,M−1}.
  5. Coincidence (proof of Theorem 4.4). The digit polynomial QQQ of fˉ(αˉ)\bar f(\bar\alpha)fˉ​(αˉ) equals f~(α~)\tilde f(\tilde\alpha)f~​(α~), and the reduction of f~(α~)\tilde f(\tilde\alpha)f~​(α~) modulo rrr and E(Z)E(Z)E(Z) is f(α)f(\alpha)f(α).

Significance

The result makes multivariate multipoint evaluation exact and fast over every finite ring of the form (Z/rZ)[Z]/(E(Z))(\mathbb Z/r\mathbb Z)[Z]/(E(Z))(Z/rZ)[Z]/(E(Z)), which includes every finite field Fq\mathbb F_qFq​. Combined with the paper's reduction from modular composition (Theorem 3.1) it yields modular composition of degree-nnn polynomials over Fq\mathbb F_qFq​ in n1+o(1)log⁡1+o(1)qn^{1+o(1)}\log^{1+o(1)} qn1+o(1)log1+o(1)q bit operations (§7). That is the step on which the paper's improvements to univariate polynomial factorization, irreducibility testing and minimal-polynomial computation rest (§§7–8). The same algorithm gives a data structure answering polynomial-evaluation queries in time polylogarithmic in the degree (§5).

The theorem is proved in the paper; nothing in it is open. As far as is known, no part of it has been machine-checked. This mission formalizes the correctness of both algorithms exactly as the paper defines them, step for step, including the Chinese-remainder recombination, the explicit prime threshold 16log⁡N16\log N16logN, and the base-MMM digit recovery. Lemma 2.4 is an explicit Chebyshev-type lower bound on the primorial, valid for all N≥2N \ge 2N≥2, and is reusable independently of this mission.

Difficulty

The recursion itself is routine. Two points carry the content. The first is the explicit prime threshold: the algorithm uses only primes up to 16log⁡N16\log N16logN, so its correctness depends on the explicit inequality of Lemma 2.4 for every N≥2N \ge 2N≥2, not on an asymptotic prime-number estimate. The small cases are part of the claim. The second is the extension-ring step: the integer β\betaβ produced over Z/r′Z\mathbb Z/r'\mathbb ZZ/r′Z must determine the polynomial f~(α~)∈Z[Z]\tilde f(\tilde\alpha) \in \mathbb Z[Z]f~​(α~)∈Z[Z] exactly. That needs simultaneous control of its degree and of every coefficient, against the specific constants MMM and r′r'r′. A bound on f~(α~)\tilde f(\tilde\alpha)f~​(α~) evaluated at a point does not by itself suffice.

Formalization scope

Lean represents Z/rZ\mathbb Z/r\mathbb ZZ/rZ as ZMod r with r≥1r \ge 1r≥1 (NeZero r, excluding ZMod 0 = ℤ), polynomials as MvPolynomial (Fin m) _ with variables indexed 0,…,m−10,\dots,m-10,…,m−1, and RRR as AdjoinRoot E for a monic E with 1≤1 \le1≤ E.natDegree. "Degree at most d−1d-1d−1 in each variable" is ∀ i, f.degreeOf i ≤ d - 1. log⁡\loglog is the natural logarithm; the paper does not fix a base, and the natural log is the strongest reading of Lemma 2.4. The primes p≤xp \le xp≤x for real xxx are the primes p≤⌊x⌋p \le \lfloor x\rfloorp≤⌊x⌋. Each algorithm is defined for a single evaluation point, since the paper processes the NNN points independently. The leaf t=1t = 1t=1 evaluates fhf_hfh​ at αh\alpha_hαh​ directly; that value is what Theorem 4.1's FFT algorithm outputs. r′r'r′ is M(e−1)dm+1M^{(e-1)dm+1}M(e−1)dm+1 as printed on p. 15; p. 16 prints M(e−1)(d−1)m+1M^{(e-1)(d-1)m+1}M(e−1)(d−1)m+1.

The hypotheses d≥2d \ge 2d≥2 and m≥1m \ge 1m≥1 are not written in the paper but are needed. For r=2r = 2r=2, d=1d = 1d=1, f=1f = 1f=1 the threshold ℓ\ellℓ is 000, no prime is used, and MULTIMODULAR returns 000. For m=0m = 0m=0 the inequality dm(r−1)(d−1)m+1≤dm(r−1)mdd^m(r-1)^{(d-1)m+1} \le d^m(r-1)^{md}dm(r−1)(d−1)m+1≤dm(r−1)md and the degree bound (e−1)dm(e-1)dm(e−1)dm both fail.

Only correctness is formalized. Every running-time bound in Theorems 4.1, 4.2, 4.4 and Corollaries 4.3, 4.5 is out of scope. The Chinese-remainder step and the digit step are defined from the residues and from β\betaβ alone: an algorithm that evaluates f~(α~)\tilde f(\tilde\alpha)f~​(α~) in Z\mathbb ZZ and reduces it, or that computes f(α)f(\alpha)f(α) in RRR directly, would make the theorems trivial and is not the algorithm stated here.

Needed infrastructure: explicit primorial lower bounds (Mathlib has primorial and Chebyshev's θ\thetaθ), the Chinese remainder theorem for several moduli (ZMod.prodEquivPi), bounds on evaluations of polynomials with nonnegative coefficients, and uniqueness of base-MMM representations of polynomials. Lemma 2.4 and the base-MMM uniqueness are reusable beyond this mission. Proofs of any milestone are welcome, as are alternative proofs of Lemma 2.4.

Selected references

  • K. S. Kedlaya, C. Umans, Fast polynomial factorization and modular composition, Dagstuhl Seminar Proceedings 08381 (version of Aug. 31, 2008). http://drops.dagstuhl.de/opus/volltexte/2008/1777 — published in SIAM J. Comput. 40(6), 2011, https://doi.org/10.1137/08073408X.
  • R. P. Brent, H. T. Kung, Fast algorithms for manipulating formal power series, J. ACM 25(4), 1978. https://doi.org/10.1145/322092.322099
  • E. Kaltofen, V. Shoup, Subquadratic-time factoring of polynomials over finite fields, Math. Comp. 67, 1998. https://doi.org/10.1090/S0025-5718-98-00944-2
  • J. von zur Gathen, J. Gerhard, Modern Computer Algebra, Cambridge University Press, 1999. https://doi.org/10.1017/CBO9781139856065
8 thms1 active userReviewed
Theoretical Computer Science·Captain: mikedeng1

Fast Polynomial Factorization and Modular Composition 1: The Inverse Kronecker Map ψ Reduces Modular Composition f(g₀, …, g_{m−1}) mod h to One Multivariate Multipoint EvaluationResearch Paper

Motivation

Modular composition asks, given univariate polynomials f,g,hf, g, hf,g,h over a ring, for f(g(X)) mod h(X)f(g(X)) \bmod h(X)f(g(X))modh(X). It is the bottleneck step in the classical algorithms for factoring univariate polynomials over finite fields (Cantor–Zassenhaus, von zur Gathen–Shoup, Kaltofen–Shoup), for irreducibility testing and for computing minimal polynomials. Brent and Kung (1978) gave an algorithm using O(n(ω+1)/2)O(n^{(\omega+1)/2})O(n(ω+1)/2) operations for degree nnn, and for three decades no algorithm with a near-linear operation count was known in general.

Kedlaya and Umans (Dagstuhl Seminar Proceedings 08381, 2008; journal version SIAM J. Comput. 40(6), 2011, doi:10.1137/08073408X) obtained near-linear modular composition over finite fields, and with it asymptotically faster algorithms for factoring polynomials over finite fields. Their route has two halves: a reduction of modular composition to multivariate multipoint evaluation (Section 3), and new fast algorithms for the latter (Sections 4 and 6). This mission formalizes the correctness of the first half, Theorem 3.1. The paper notes that Shoup and Smolensky used essentially the same transformation in an unpublished 1992 manuscript.

Setting

Throughout, RRR is an arbitrary commutative ring. Variables are indexed from 000.

MULTIVARIATE MULTIPOINT EVALUATION (Problem 2.1): given f∈R[X0,…,Xm−1]f \in R[X_0, \dots, X_{m-1}]f∈R[X0​,…,Xm−1​] with individual degrees at most d−1d-1d−1 and points α0,…,αN−1∈Rm\alpha_0, \dots, \alpha_{N-1} \in R^mα0​,…,αN−1​∈Rm, output f(α0),…,f(αN−1)f(\alpha_0), \dots, f(\alpha_{N-1})f(α0​),…,f(αN−1​).

MODULAR COMPOSITION (Problem 2.2): given f∈R[X0,…,Xm−1]f \in R[X_0, \dots, X_{m-1}]f∈R[X0​,…,Xm−1​] with individual degrees at most d−1d-1d−1, and g0,…,gm−1,h∈R[X]g_0, \dots, g_{m-1}, h \in R[X]g0​,…,gm−1​,h∈R[X] of degree at most N−1N-1N−1 with the leading coefficient of hhh a unit, output f(g0(X),…,gm−1(X)) mod h(X)f(g_0(X), \dots, g_{m-1}(X)) \bmod h(X)f(g0​(X),…,gm−1​(X))modh(X), the unique rrr with deg⁡r<deg⁡h\deg r < \deg hdegr<degh and h∣f(g0,…,gm−1)−rh \mid f(g_0, \dots, g_{m-1}) - rh∣f(g0​,…,gm−1​)−r.

The inverse Kronecker map (Definition 2.3) ψh,ℓ:R[X0,…,Xm−1]→R[Y0,0,…,Ym−1,ℓ−1]\psi_{h,\ell} : R[X_0, \dots, X_{m-1}] \to R[Y_{0,0}, \dots, Y_{m-1,\ell-1}]ψh,ℓ​:R[X0​,…,Xm−1​]→R[Y0,0​,…,Ym−1,ℓ−1​] is the RRR-linear map that sends the monomial ∏iXiei\prod_i X_i^{e_i}∏i​Xiei​​ to ∏i∏j<ℓYi,jai,j\prod_i \prod_{j<\ell} Y_{i,j}^{a_{i,j}}∏i​∏j<ℓ​Yi,jai,j​​, where ei=∑j≥0ai,jhje_i = \sum_{j \ge 0} a_{i,j} h^jei​=∑j≥0​ai,j​hj is the base-hhh expansion. It trades individual degree for number of variables: every individual degree of ψh,ℓ(f)\psi_{h,\ell}(f)ψh,ℓ​(f) is below hhh.

The algorithm of Theorem 3.1 takes 2≤d0<d2 \le d_0 < d2≤d0​<d, sets ℓ=⌈log⁡d0d⌉\ell = \lceil \log_{d_0} d \rceilℓ=⌈logd0​​d⌉ and N′=Nmℓd0N' = N m \ell d_0N′=Nmℓd0​, receives points β0,…,βN′−1∈R\beta_0, \dots, \beta_{N'-1} \in Rβ0​,…,βN′−1​∈R whose differences are units, and

  1. computes f′=ψd0,ℓ(f)f' = \psi_{d_0,\ell}(f)f′=ψd0​,ℓ​(f);
  2. computes gi,j=gid0 j mod hg_{i,j} = g_i^{d_0^{\,j}} \bmod hgi,j​=gid0j​​modh for all iii and j<ℓj < \ellj<ℓ;
  3. computes αi,j,k=gi,j(βk)\alpha_{i,j,k} = g_{i,j}(\beta_k)αi,j,k​=gi,j​(βk​);
  4. computes f′(α0,0,k,…,αm−1,ℓ−1,k)f'(\alpha_{0,0,k}, \dots, \alpha_{m-1,\ell-1,k})f′(α0,0,k​,…,αm−1,ℓ−1,k​) for k<N′k < N'k<N′ (one multivariate multipoint evaluation);
  5. interpolates these N′N'N′ values at the nodes βk\beta_kβk​;
  6. outputs the result modulo hhh.

Formalization targets

Goal: Theorem 3.1, correctness

algorithm(d0,d,f,g,h,β)  =  f(g0(X),…,gm−1(X)) mod h(X),\mathrm{algorithm}(d_0, d, f, g, h, \beta) \;=\; f\bigl(g_0(X), \dots, g_{m-1}(X)\bigr) \bmod h(X),algorithm(d0​,d,f,g,h,β)=f(g0​(X),…,gm−1​(X))modh(X),

for all m,N≥1m, N \ge 1m,N≥1, 2≤d0<d2 \le d_0 < d2≤d0​<d, fff with individual degrees ≤d−1\le d-1≤d−1, gi,hg_i, hgi​,h of degree ≤N−1\le N-1≤N−1 with lc(h)\mathrm{lc}(h)lc(h) a unit, and β0,…,βN′−1\beta_0, \dots, \beta_{N'-1}β0​,…,βN′−1​ distinct with unit differences. The right-hand side is stated through the characterization of the remainder (divisibility by hhh and degree below deg⁡h\deg hdegh).

Milestones (in the order the proof uses them)

  • Definition 2.3, remark: if every individual degree of fff is at most hℓ−1h^\ell - 1hℓ−1, then ψh,ℓ(f)(X0h0,…,Xm−1hℓ−1)=f\psi_{h,\ell}(f)\bigl(X_0^{h^0}, \dots, X_{m-1}^{h^{\ell-1}}\bigr) = fψh,ℓ​(f)(X0h0​,…,Xm−1hℓ−1​)=f.
  • Definition 2.3, remark: ψh,ℓ\psi_{h,\ell}ψh,ℓ​ is injective on such polynomials (not used by the goal).
  • Proof of Theorem 3.1: f′(g0,0,…,gm−1,ℓ−1)≡f(g0,…,gm−1)(modh)f'(g_{0,0}, \dots, g_{m-1,\ell-1}) \equiv f(g_0, \dots, g_{m-1}) \pmod{h}f′(g0,0​,…,gm−1,ℓ−1​)≡f(g0​,…,gm−1​)(modh).
  • Proof of Theorem 3.1, Step 5: deg⁡f′(g0,0(X),…,gm−1,ℓ−1(X))<N′\deg f'(g_{0,0}(X), \dots, g_{m-1,\ell-1}(X)) < N'degf′(g0,0​(X),…,gm−1,ℓ−1​(X))<N′.

A supporting theorem states that the interpolation formula over a commutative ring (Figure 1) recovers every polynomial of degree <n< n<n from its values at nnn nodes with unit differences.

Significance

Theorem 3.1 says that modular composition is no harder than one multivariate multipoint evaluation with mℓm\ellmℓ variables, individual degrees below d0d_0d0​, and N′N'N′ points, up to quasi-linear univariate work. Combined with the paper's fast multipoint evaluation algorithms this gives modular composition over Fq\mathbb F_qFq​ in n1+o(1)log⁡1+o(1)qn^{1+o(1)}\log^{1+o(1)} qn1+o(1)log1+o(1)q bit operations, and from there the paper's improved bounds for polynomial factorization, irreducibility testing, minimal polynomials and modular power projection (Sections 7–8). The converse reduction (Theorem 3.3) shows the two problems are essentially equivalent.

The paper's proof of correctness is a short paragraph; the operation counts are the paper's main concern. This mission makes the correctness exact: the algorithm is defined step for step, and its output is proved equal to the specification. As far as the platform's corpus shows, neither the inverse Kronecker map nor this reduction has a machine-checked statement; the running-time half is not part of this mission.

Difficulty

The obvious argument substitutes gid0jg_i^{d_0^j}gid0j​​ for Yi,jY_{i,j}Yi,j​ and invokes the inverse Kronecker identity. Two points keep this from being immediate. First, ψh,ℓ\psi_{h,\ell}ψh,ℓ​ is linear but not multiplicative, and it discards base-hhh digits beyond position ℓ−1\ell-1ℓ−1; the identity holds only for individual degrees at most hℓ−1h^\ell - 1hℓ−1, which here requires d≤d0⌈log⁡d0d⌉d \le d_0^{\lceil \log_{d_0} d\rceil}d≤d0⌈logd0​​d⌉​. Second, the algorithm never sees f′(g0,0,… )f'(g_{0,0}, \dots)f′(g0,0​,…) itself, only its values at N′N'N′ points: interpolation recovers it only if its degree is below N′N'N′, which is why Step 2 reduces modulo hhh before substituting, and interpolation over a ring (not a field) needs the unit-difference hypothesis throughout. Mathlib's Lagrange interpolation is stated over fields, so the ring version must be handled directly.

Formalization scope

  • RRR is any commutative ring (CommRing R); there is no field or nontriviality assumption.
  • Variables are Fin m; the new variables Yi,jY_{i,j}Yi,j​ are Fin m × Fin ℓ; points are Fin N'.
  • Individual degrees are MvPolynomial.degreeOf; "degree at most N−1N-1N−1" is natDegree ≤ N - 1.
  • ℓ\ellℓ is Nat.clog d₀ d and N′=Nmℓd0N' = N m \ell d_0N′=Nmℓd0​; ℓ\ellℓ is not a free parameter.
  • "mod hhh" for hhh with unit leading coefficient is the remainder on division by the monic associate h⋅lc(h)−1h \cdot \mathrm{lc}(h)^{-1}h⋅lc(h)−1; interpolation is the Lagrange formula with Ring.inverse of the node differences.
  • Step 4 is MvPolynomial.eval, which is exactly the output of Problem 2.1.
  • Added hypotheses: m≥1m \ge 1m≥1 and N≥1N \ge 1N≥1 (the paper does not consider m=0m = 0m=0, where N′=0N' = 0N′=0, or N=0N = 0N=0, where "degree at most N−1N - 1N−1" would collapse in natural-number arithmetic).
  • In the goal, "deg⁡r<deg⁡h\deg r < \deg hdegr<degh" is weakened to "deg⁡r<deg⁡h\deg r < \deg hdegr<degh or r=0r = 0r=0" only to cover the zero ring; in any nontrivial ring the two agree.
  • Only correctness is formalized. Operation counts, the O(⋅)O(\cdot)O(⋅) and polylog⁡\mathrm{poly}\logpolylog bounds, and the count of invocations are out of scope.

Step 5 is the interpolation formula applied to the N′N'N′ computed values and nodes alone; it is not defined as the polynomial f′(g0,0,…,gm−1,ℓ−1)f'(g_{0,0}, \dots, g_{m-1,\ell-1})f′(g0,0​,…,gm−1,ℓ−1​), and the goal is the six-step output, not the congruence alone, so the statement cannot be closed by unfolding definitions.

Useful infrastructure, reusable beyond this mission: base-hhh digit manipulation of exponent vectors, Lagrange interpolation over commutative rings with unit node differences, and remainders modulo polynomials with unit leading coefficient. Proofs of any milestone, and of the supporting interpolation theorem, are welcome independently.

Selected references

  • K. S. Kedlaya, C. Umans, Fast polynomial factorization and modular composition, Dagstuhl Seminar Proceedings 08381, 2008. http://drops.dagstuhl.de/opus/volltexte/2008/1777
  • K. S. Kedlaya, C. Umans, Fast polynomial factorization and modular composition, SIAM J. Comput. 40(6):1767–1802, 2011. https://doi.org/10.1137/08073408X
  • R. P. Brent, H. T. Kung, Fast algorithms for manipulating formal power series, J. ACM 25(4):581–595, 1978. https://doi.org/10.1145/322092.322099
  • J. von zur Gathen, J. Gerhard, Modern Computer Algebra, Cambridge University Press, 1999. https://doi.org/10.1017/CBO9781139856065
8 thms1 active userReviewed
CombinatoricsDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 5: For h ≥ 2, Two h-Scattered Linear Sets Are PΓL(r, qⁿ)-Equivalent iff Their Subspaces Are ΓL(r, qⁿ)-EquivalentResearch Paper

Motivation

Linear sets are point sets of a finite projective space defined by a subspace over a subfield. They appear throughout finite geometry, for instance in the study of semifields and, through the correspondence studied by Sheekey and Van de Voorde (arXiv:1806.05929), maximum rank distance (MRD) codes; see Polverino's survey (doi:10.1016/j.disc.2009.04.007). In these applications one needs to decide when two linear sets are the same up to a collineation, which can be difficult (Csajbók–Zanella, arXiv:1501.03441; Csajbók–Marino–Polverino, arXiv:1607.06962). The natural candidate answer, "when their defining subspaces are in the same orbit of the semilinear group", is only a sufficient condition: on the projective line PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn) there are maximum scattered subspaces in different ΓL(2,qn)\Gamma\mathrm L(2,q^n)ΓL(2,qn)-orbits defining equivalent linear sets (the two papers just cited).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590, Combinatorica 41 (2021)) introduced hhh-scattered subspaces, a generalisation of scattered subspaces, and showed in their §4 that for h≥2h \ge 2h≥2 the sufficient condition is also necessary. This mission formalizes that result, Theorem 4.5.

Setting

Let Fq⊆Fqn\mathbb F_q \subseteq \mathbb F_{q^n}Fq​⊆Fqn​ be finite fields and let VVV be an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​; it is also a vector space over Fq\mathbb F_qFq​. The projective space PG(V,Fqn)=PG(r−1,qn)\mathrm{PG}(V,\mathbb F_{q^n}) = \mathrm{PG}(r-1,q^n)PG(V,Fqn​)=PG(r−1,qn) has as points the one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces ⟨u⟩Fqn\langle u\rangle_{\mathbb F_{q^n}}⟨u⟩Fqn​​, u≠0u \ne 0u=0.

For an Fq\mathbb F_qFq​-subspace UUU of VVV, the Fq\mathbb F_qFq​-linear set of UUU is

LU={⟨u⟩Fqn:u∈U∖{0}},L_U = \{\langle u\rangle_{\mathbb F_{q^n}} : u \in U\setminus\{0\}\},LU​={⟨u⟩Fqn​​:u∈U∖{0}},

of rank dim⁡FqU\dim_{\mathbb F_q} UdimFq​​U.

For 0<h≤r−10 < h \le r-10<h≤r−1, the subspace UUU is hhh-scattered (Definition 1.1) if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U) \le hdimFq​​(S∩U)≤h. The linear set LUL_ULU​ of an hhh-scattered UUU is called hhh-scattered (Definition 4.1); for h=2h = 2h=2 it is scattered with respect to lines.

The group ΓL(r,qn)\Gamma\mathrm L(r,q^n)ΓL(r,qn) consists of the bijective additive maps fff of VVV that are semilinear: f(av)=aσf(v)f(av) = a^\sigma f(v)f(av)=aσf(v) for some field automorphism σ\sigmaσ of Fqn\mathbb F_{q^n}Fqn​. Each fff induces a collineation φf\varphi_fφf​ of PG(V,Fqn)\mathrm{PG}(V,\mathbb F_{q^n})PG(V,Fqn​), ⟨u⟩↦⟨f(u)⟩\langle u\rangle \mapsto \langle f(u)\rangle⟨u⟩↦⟨f(u)⟩, and these collineations form PΓL(r,qn)\mathrm P\Gamma\mathrm L(r,q^n)PΓL(r,qn). Two linear sets are PΓL\mathrm P\Gamma\mathrm LPΓL-equivalent if φf(LU)=LW\varphi_f(L_U) = L_Wφf​(LU​)=LW​ for some fff; two subspaces are ΓL\Gamma\mathrm LΓL-equivalent if f(U)=Wf(U) = Wf(U)=W for some fff.

Formalization targets

Goal: Theorem 4.5 (p. 14)

For h≥2h \ge 2h≥2 and hhh-scattered Fq\mathbb F_qFq​-subspaces UUU, WWW of V(r,qn)V(r,q^n)V(r,qn),

LU∼PΓL(r,qn)LW  ⟺  U∼ΓL(r,qn)W.L_U \sim_{\mathrm P\Gamma\mathrm L(r,q^n)} L_W \iff U \sim_{\Gamma\mathrm L(r,q^n)} W .LU​∼PΓL(r,qn)​LW​⟺U∼ΓL(r,qn)​W.

Milestones (in the order of the proof)

  1. Proposition 2.1 (p. 3): an hhh-scattered subspace is iii-scattered for every 0<i<h0 < i < h0<i<h.
  2. Proposition 4.2 (p. 13, quoted from Bonoli–Polverino [5]): on a projective line PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn), (1) a linear set with q+1q+1q+1 points has rank 222; (2) two subspaces defining the same linear set of size q+1q+1q+1 and sharing a nonzero vector coincide.
  3. Proposition 4.3 (p. 13): if UUU is 222-scattered and LW=LUL_W = L_ULW​=LU​, then dim⁡FqW=dim⁡FqU\dim_{\mathbb F_q} W = \dim_{\mathbb F_q} UdimFq​​W=dimFq​​U.
  4. Lemma 4.4 (p. 13): if UUU is 222-scattered and LU=LWL_U = L_WLU​=LW​, then U=λWU = \lambda WU=λW for some λ∈Fqn∗\lambda\in\mathbb F_{q^n}^*λ∈Fqn∗​.

Significance

The result. Theorem 4.5 says that, for h≥2h\ge2h≥2, an hhh-scattered linear set remembers its defining subspace up to a scalar and up to the semilinear group. The equivalence problem for such linear sets, a geometric question about point sets, becomes the equivalence problem for subspaces, which is algebraic and can be attacked with linearized polynomials. Through the correspondence of Sheekey and Van de Voorde between maximum (r−1)(r-1)(r−1)-scattered subspaces and MRD codes, the paper derives from it (Theorem 4.10, not part of this mission) that two Fq\mathbb F_qFq​-linear MRD codes with minimum distance n−r+1n-r+1n−r+1, r>2r>2r>2, and left idealiser isomorphic to Fqn\mathbb F_{q^n}Fqn​ are equivalent if and only if their associated linear sets in PG(r−1,qn)\mathrm{PG}(r-1,q^n)PG(r−1,qn) are PΓL\mathrm P\Gamma\mathrm LPΓL-equivalent. Lemma 4.4 and Proposition 4.3 are of independent use: they say that the rank and, up to scalars, the subspace of any linear set scattered with respect to lines are invariants of the point set.

The formalization. The theorem is proved in the paper; no part of it, nor any statement about linear sets over a field extension, is machine-checked in Mathlib. The mission produces a formal model of linear sets, of the semilinear group and of its induced collineations that later finite-geometry missions can reuse, together with formal proofs of the four milestones. Proposition 4.2 is quoted from [5] without proof in the paper, so formalizing it means formalizing Bonoli and Polverino's argument.

Difficulty

The "if" direction is a direct computation, LUf=LUφfL_{U^f} = L_U^{\varphi_f}LUf​=LUφf​​. The obvious approach to the converse, reconstructing UUU from LUL_ULU​ point by point, fails because a point ⟨u⟩\langle u\rangle⟨u⟩ of LUL_ULU​ determines U∩⟨u⟩U\cap\langle u\rangleU∩⟨u⟩ only up to a scalar of Fqn∗\mathbb F_{q^n}^*Fqn∗​, and these scalars can a priori differ from point to point. Without the condition h≥2h \ge 2h≥2 they really do differ: for h=1h = 1h=1 the theorem is false. The step that needs h≥2h\ge2h≥2 is the rigidity of the intersections of UUU with two-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces, which is where the quoted result on linear sets of size q+1q+1q+1 on a projective line enters. Proposition 4.2 itself is a counting statement about point weights on PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn) and is not available in any library.

Formalization scope

  • Fq\mathbb F_qFq​ and Fqn\mathbb F_{q^n}Fqn​ are arbitrary finite fields F, K with [Algebra F K]; qqq is Fintype.card F. VVV is a finite-dimensional K-module with a compatible F-module structure ([IsScalarTower F K V]), and rrr is Module.finrank K V.
  • IsHScattered F K h U includes the range 0<h<r0 < h < r0<h<r and the spanning condition ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V, as in Definition 1.1. With h≥2h\ge2h≥2 this forces r≥3r\ge3r≥3.
  • A point is the K-submodule K ∙ u; linearSet F K U is a Set (Submodule K V) and ∣LU∣|L_U|∣LU​∣ is its Set.ncard.
  • ΓL\Gamma\mathrm LΓL is the set of f : V ≃+ V for which some σ : K ≃+* K gives f (a • v) = σ a • f v. The collineation φf\varphi_fφf​ sends a subspace PPP to Submodule.span K (f '' P). The image UfU^fUf is the set f '' U, and λW\lambda WλW is (λ • ·) '' W with λ≠0\lambda\ne0λ=0.
  • Two trivializing readings are excluded. Restricting to linear maps (GL, PGL) would prove a different, weaker statement; taking PΓL\mathrm{P}\Gamma\mathrm{L}PΓL-equivalence to mean "some bijection of points maps LUL_ULU​ to LWL_WLW​" would make the "only if" direction false. Both equivalences quantify over the full semilinear group, and the collineation is the one induced by the same fff.
  • Proposition 4.2 is a result the paper numbers but quotes from [5] (Bonoli–Polverino, Fq\mathbb F_qFq​-linear blocking sets in PG(2,q4)\mathrm{PG}(2,q^4)PG(2,q4)). It is a milestone with its own proof obligation and is not assumed. The two parts are separate items.
  • Proposition 2.1's "for any i<hi < hi<h" is read as 0<i<h0 < i < h0<i<h, the range on which Definition 1.1 defines iii-scattered.

Welcome contributions: the general theory of linear sets (point weights, ∣LU∣≤(qk−1)/(q−1)|L_U| \le (q^k-1)/(q-1)∣LU​∣≤(qk−1)/(q−1) with equality iff UUU is scattered), the fact that a semilinear map of VVV maps Fq\mathbb F_qFq​-subspaces to Fq\mathbb F_qFq​-subspaces, and the counting argument behind Proposition 4.2. These are reusable for every linear-set mission.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, Combinatorica 41 (2021); arXiv:1906.10590v2 (2020). https://arxiv.org/abs/1906.10590
  • G. Bonoli, O. Polverino, Fq\mathbb F_qFq​-linear blocking sets in PG(2,q4)\mathrm{PG}(2,q^4)PG(2,q4), Innov. Incidence Geom. 2 (2005), 35–56. https://doi.org/10.2140/iig.2005.2.35
  • B. Csajbók, G. Marino, O. Polverino, Classes and equivalence of linear sets in PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn), J. Combin. Theory Ser. A 157 (2018), 402–426. https://arxiv.org/abs/1607.06962
  • B. Csajbók, C. Zanella, On the equivalence of linear sets, Des. Codes Cryptogr. 81 (2016), 269–281. https://arxiv.org/abs/1501.03441
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. 310 (2010), 3096–3107. https://doi.org/10.1016/j.disc.2009.04.007
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://arxiv.org/abs/1806.05929
9 thms1 active userReviewed
CombinatoricsDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 4: For n ≥ h + 3, the Delsarte Dual of a Maximum h-Scattered Subspace of Dimension rn/(h + 1) Is Maximum (n − h − 2)-ScatteredResearch Paper

Motivation

Scattered subspaces are a central object of finite geometry. An Fq\mathbb F_qFq​-subspace UUU of an Fqn\mathbb F_{q^n}Fqn​-vector space is scattered when every one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace meets it in Fq\mathbb F_qFq​-dimension at most one. They give the largest scattered linear sets of projective spaces, and through them constructions of two-intersection sets, two-weight codes, strongly regular graphs and, most prominently, maximum rank distance (MRD) codes. Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2) generalise the notion to hhh-scattered subspaces, which meet every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace in Fq\mathbb F_qFq​-dimension at most hhh, prove the dimension bound rn/(h+1)rn/(h+1)rn/(h+1), and ask when it is attained.

When h+1h+1h+1 divides rrr, direct sums of known examples reach the bound (Theorem 2.6 of the paper). For other values of rrr the paper introduces a duality, the Delsarte dual, which turns a maximum hhh-scattered subspace of one space into a maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspace of a space of another dimension. The name comes from Delsarte's duality on MRD codes, which the paper shows corresponds to it (Theorem 4.12). This mission is about that duality: Theorem 3.3 of the paper.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, with n=dim⁡FqFqnn=\dim_{\mathbb F_q}\mathbb F_{q^n}n=dimFq​​Fqn​. Write V(r,qn)V(r,q^n)V(r,qn) for an rrr-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space; it is also an Fq\mathbb F_qFq​-space of dimension rnrnrn.

Definition 1.1. For 0<h≤r−10<h\le r-10<h≤r−1, an Fq\mathbb F_qFq​-subspace UUU of V=V(r,qn)V=V(r,q^n)V=V(r,qn) is hhh-scattered if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}}=V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h. It is maximum hhh-scattered if no hhh-scattered subspace of VVV has larger Fq\mathbb F_qFq​-dimension. The paper's Theorem 2.3 shows that an hhh-scattered subspace either has dimension rrr and defines a subgeometry, or has dimension at most rn/(h+1)rn/(h+1)rn/(h+1).

The setting of §3. Let V\mathbb VV be a kkk-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space, written as a direct sum V=Λ⊕Γ\mathbb V=\Lambda\oplus\GammaV=Λ⊕Γ of Fqn\mathbb F_{q^n}Fqn​-subspaces with dim⁡Λ=r\dim\Lambda=rdimΛ=r and dim⁡Γ=k−r\dim\Gamma=k-rdimΓ=k−r. Let WWW be a kkk-dimensional Fq\mathbb F_qFq​-subspace of V\mathbb VV with ⟨W⟩Fqn=V\langle W\rangle_{\mathbb F_{q^n}}=\mathbb V⟨W⟩Fqn​​=V and W∩Γ={0}W\cap\Gamma=\{0\}W∩Γ={0}, and put

U=⟨W,Γ⟩Fq∩Λ,U=\langle W,\Gamma\rangle_{\mathbb F_q}\cap\Lambda ,U=⟨W,Γ⟩Fq​​∩Λ,

an Fq\mathbb F_qFq​-subspace of Λ\LambdaΛ. Every kkk-dimensional Fq\mathbb F_qFq​-subspace of Λ\LambdaΛ with k>rk>rk>r arises in this way (Lunardon and Polverino, cited as [21, Theorems 1, 2] in the paper). Let β:V×V→Fqn\beta:\mathbb V\times\mathbb V\to\mathbb F_{q^n}β:V×V→Fqn​ be a non-degenerate reflexive sesquilinear form with companion automorphism σ\sigmaσ (linear in the first argument, β(v,aw)=aσβ(v,w)\beta(v,aw)=a^\sigma\beta(v,w)β(v,aw)=aσβ(v,w)) which takes values in Fq\mathbb F_qFq​ on W×WW\times WW×W; equivalently, β\betaβ extends a non-degenerate reflexive form β′:W×W→Fq\beta':W\times W\to\mathbb F_qβ′:W×W→Fq​. Write Γ⊥={v:β(v,g)=0 ∀g∈Γ}\Gamma^\perp=\{v:\beta(v,g)=0\ \forall g\in\Gamma\}Γ⊥={v:β(v,g)=0 ∀g∈Γ}, an rrr-dimensional subspace. The Delsarte dual of UUU (Definition 3.2) is the Fq\mathbb F_qFq​-subspace

Uˉ=W+Γ⊥={w+Γ⊥:w∈W}⊆V/Γ⊥,\bar U=W+\Gamma^\perp=\{w+\Gamma^\perp:w\in W\}\subseteq\mathbb V/\Gamma^\perp ,Uˉ=W+Γ⊥={w+Γ⊥:w∈W}⊆V/Γ⊥,

a subspace of a (k−r)(k-r)(k−r)-dimensional Fqn\mathbb F_{q^n}Fqn​-space.

Formalization targets

Goal: Theorem 3.3

Suppose UUU is a maximum hhh-scattered Fq\mathbb F_qFq​-subspace of Λ=V(r,qn)\Lambda=V(r,q^n)Λ=V(r,qn) of dimension k=rn/(h+1)k=rn/(h+1)k=rn/(h+1), and n≥h+3n\ge h+3n≥h+3. Then

Uˉ is a maximum (n−h−2)-scattered Fq-subspace of V/Γ⊥=V ⁣(rnh+1−r, qn),dim⁡FqUˉ=k.\bar U \text{ is a maximum } (n-h-2)\text{-scattered } \mathbb F_q\text{-subspace of } \mathbb V/\Gamma^\perp=V\!\left(\tfrac{rn}{h+1}-r,\ q^n\right),\qquad \dim_{\mathbb F_q}\bar U=k .Uˉ is a maximum (n−h−2)-scattered Fq​-subspace of V/Γ⊥=V(h+1rn​−r, qn),dimFq​​Uˉ=k.

The statement holds for every admissible choice of the embedding and of β\betaβ.

Milestones

  1. Theorem 2.7 (p. 8): a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) meets every hyperplane HHH in dimension between rn/(h+1)−nrn/(h+1)-nrn/(h+1)−n and rn/(h+1)−n+hrn/(h+1)-n+hrn/(h+1)−n+h.
  2. The identity (S∗)⊥=(S⊥′)∗(S^*)^\perp=(S^{\perp'})^*(S∗)⊥=(S⊥′)∗ (p. 9) for Fq\mathbb F_qFq​-subspaces SSS of WWW, where S∗=⟨S⟩FqnS^*=\langle S\rangle_{\mathbb F_{q^n}}S∗=⟨S⟩Fqn​​ and ⊥′\perp'⊥′ is orthogonality for β′\beta'β′.
  3. Proposition 3.1 (p. 9): if k>rk>rk>r and every hyperplane MMM of Λ\LambdaΛ satisfies dim⁡Fq(M∩U)<k−1\dim_{\mathbb F_q}(M\cap U)<k-1dimFq​​(M∩U)<k−1 (condition (⋄)(\diamond)(⋄)), then dim⁡FqUˉ=k\dim_{\mathbb F_q}\bar U=kdimFq​​Uˉ=k.
  4. Theorem 2.3 (p. 4): the dimension bound rn/(h+1)rn/(h+1)rn/(h+1) for hhh-scattered subspaces.

Significance

The result. Theorem 3.3 converts a maximum hhh-scattered subspace of V(r,qn)V(r,q^n)V(r,qn) of dimension rn/(h+1)rn/(h+1)rn/(h+1) into a maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspace of V(rn/(h+1)−r,qn)V(rn/(h+1)-r,q^n)V(rn/(h+1)−r,qn). For h=r−1h=r-1h=r−1 it was known through MRD codes; the paper proves it for every hhh. Its consequences in the paper are Corollaries 3.4 and 3.5 and Theorem 3.6: when n≥4n\ge4n≥4 is even and r≥3r\ge3r≥3 is odd, maximum (n−3)(n-3)(n−3)-scattered subspaces of V(r(n−2)/2,qn)V(r(n-2)/2,q^n)V(r(n−2)/2,qn) exist which the direct sum construction of Theorem 2.6 cannot produce, because n−2n-2n−2 does not divide r(n−2)/2r(n-2)/2r(n−2)/2. Theorem 3.3 is also the geometric counterpart of Delsarte duality of MRD codes (Theorem 4.12 of the paper).

Formalizing it. The theorem is proved in the paper; no machine-checked version exists. A formalization would provide a reusable treatment of sesquilinear forms whose restriction to an Fq\mathbb F_qFq​-form is controlled, of orthogonal complements across the field extension Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​, and of the passage between Λ\LambdaΛ, V/Γ\mathbb V/\GammaV/Γ and V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥. Theorems 2.3 and 2.7 are also the goals of companion missions in this series; here they enter as milestones.

Difficulty

The definition of Uˉ\bar UUˉ is easy; the content is in two dimension statements. First, W+Γ⊥W+\Gamma^\perpW+Γ⊥ must not collapse: W∩Γ⊥={0}W\cap\Gamma^\perp=\{0\}W∩Γ⊥={0} is not automatic and depends on the hyperplane condition (⋄)(\diamond)(⋄) on UUU, which in turn needs the upper bound of Theorem 2.7, whose proof in the paper is a long counting argument with Gaussian binomials (Section 5). Second, the scattered property must be transported through the duality: a large intersection of Uˉ\bar UUˉ with an (n−h−2)(n-h-2)(n−h−2)-dimensional subspace of V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥ must be converted into a large intersection of UUU with a hyperplane of Λ\LambdaΛ. This conversion runs through three different spaces and two different orthogonalities, ⊥\perp⊥ over Fqn\mathbb F_{q^n}Fqn​ and ⊥′\perp'⊥′ over Fq\mathbb F_qFq​, and the identification (S∗)⊥=(S⊥′)∗(S^*)^\perp=(S^{\perp'})^*(S∗)⊥=(S⊥′)∗ between them requires that WWW have an Fq\mathbb F_qFq​-basis which is an Fqn\mathbb F_{q^n}Fqn​-basis of V\mathbb VV. Maximality is a further step that uses the bound of Theorem 2.3 in V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥.

Formalization scope

Fq\mathbb F_qFq​ and Fqn\mathbb F_{q^n}Fqn​ are finite fields F, K with Algebra F K; V\mathbb VV is a finite-dimensional K-module with a compatible F-structure (IsScalarTower F K 𝕍). The setting of §3 is a structure DelsarteSetting F K 𝕍 holding Λ,Γ\Lambda,\GammaΛ,Γ (complementary), WWW (with dim⁡FqW=dim⁡FqnV\dim_{\mathbb F_q}W=\dim_{\mathbb F_{q^n}}\mathbb VdimFq​​W=dimFqn​​V, spanning, W∩Γ=0W\cap\Gamma=0W∩Γ=0), σ:Fqn≃Fqn\sigma:\mathbb F_{q^n}\simeq\mathbb F_{q^n}σ:Fqn​≃Fqn​ and β:V→FqnV→σFqn\beta:\mathbb V\to_{\mathbb F_{q^n}}\mathbb V\to_{\sigma}\mathbb F_{q^n}β:V→Fqn​​V→σ​Fqn​ with non-degeneracy, reflexivity and β(W,W)⊆Fq\beta(W,W)\subseteq\mathbb F_qβ(W,W)⊆Fq​. The embedding of Λ\LambdaΛ into V\mathbb VV is data, not a theorem; its existence is cited by the paper and is not an item. The paper's β′\beta'β′ is the restriction of β\betaβ to WWW.

Conventions pinned:

  • UUU is an F-subspace of the type ↥Λ, and "h-scattered in Λ\LambdaΛ" is Definition 1.1 with ambient space Λ\LambdaΛ, including 0<h<r0<h<r0<h<r and ⟨U⟩Fqn=Λ\langle U\rangle_{\mathbb F_{q^n}}=\Lambda⟨U⟩Fqn​​=Λ. The dual is (n − h − 2)-scattered in the quotient 𝕍 ⧸ Γ^⊥, whose dimension is k−rk-rk−r.
  • Every rn/(h+1)rn/(h+1)rn/(h+1) is multiplied out: (h+1)dim⁡U=rn(h+1)\dim U=rn(h+1)dimU=rn. Hyperplanes are subspaces with dim⁡+1=dim⁡\dim+1=\dimdim+1=dim of the ambient space; dim⁡<k−1\dim<k-1dim<k−1 is written dim⁡+1<k\dim+1<kdim+1<k. The only natural-number subtraction is the index n−h−2n-h-2n−h−2, exact because n≥h+3n\ge h+3n≥h+3.
  • The paper's k>rk>rk>r is a hypothesis of Proposition 3.1, as on the page, and is derived (not assumed) in Theorem 3.3.

The form must be non-degenerate and Fq\mathbb F_qFq​-valued on WWW: with β=0\beta=0β=0 one would get Γ⊥=V\Gamma^\perp=\mathbb VΓ⊥=V and a zero quotient, and without β(W,W)⊆Fq\beta(W,W)\subseteq\mathbb F_qβ(W,W)⊆Fq​ the subspace W+Γ⊥W+\Gamma^\perpW+Γ⊥ is not the paper's Delsarte dual; both conditions are fields of the setting and may not be dropped.

Cited inputs: none of the milestones is proved elsewhere; Theorems 2.3 and 2.7 duplicate the goals of companion missions 1 and 3 and may be closed by importing their proofs once published. Contributions welcome: the sesquilinear-form infrastructure (dimension of orthogonal complements, the extension of β′\beta'β′ from WWW to V\mathbb VV), Proposition 3.1, and the transport argument of Theorem 3.3.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, arXiv:1906.10590v2, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/1906.10590v2
  • G. Lunardon, O. Polverino, Translation ovoids of orthogonal polar spaces, Forum Math. 16 (2004), 663–669 (the embedding used in §3).
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243 (the case h = 1 of the bound).
  • P. Delsarte, Bilinear forms over a finite field, with applications to coding theory, J. Combin. Theory Ser. A 25 (1978), 226–241 (Delsarte duality of rank-metric codes).
8 thms1 active userReviewed
CombinatoricsComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy 1: Folded Symmetric PCSPs Avoiding Parity, Majority and Alternating-Threshold Have Only C-Fixing PolymorphismsResearch Paper

Why promise constraint satisfaction

A constraint satisfaction problem (CSP) asks whether variables can be assigned values so that every constraint, drawn from a fixed finite set of relations, holds. The algebraic approach to CSPs explains their complexity through polymorphisms, the operations that preserve all constraint relations; this programme culminated in the CSP dichotomy theorem of Bulatov and Zhuk (2017). A promise CSP (PCSP) pairs each relation PPP with a weaker relation Q⊇PQ \supseteq PQ⊇P: given an instance that is promised to be satisfiable with the PPP-constraints, one must distinguish it from instances that are not even satisfiable with the QQQ-constraints. Approximate graph colouring (is a 3-colourable graph 100-colourable?) and (2+ε)(2+\varepsilon)(2+ε)-SAT are PCSPs, and their complexity is not captured by the classical theory.

Brakensiek and Guruswami (arXiv:1704.01937) developed the polymorphism theory of PCSPs and classified the Boolean, symmetric, folded case.

Timeline.

  • 1978: Schaefer classifies Boolean CSPs into polynomial-time and NP-complete.
  • 2014: Austrin, Guruswami and Håstad prove (2+ε)(2+\varepsilon)(2+ε)-SAT NP-hard with an argument based on polymorphisms (SIAM J. Comput. 46(5), 2017).
  • 2016–2018: Brakensiek and Guruswami introduce the general PCSP framework and prove a dichotomy for folded symmetric Boolean PCSPs (SODA 2018; arXiv:1704.01937v2, 2021; SIAM J. Comput. 50(6), 2021).
  • 2019–2021: Barto, Bulín, Krokhin and Opršal recast the theory in terms of minions (J. ACM 68(4), 2021). Ficak, Kozik, Olšák and Stankiewicz extend the Boolean symmetric dichotomy beyond the folded case (ICALP 2019).

Setting

Fix the Boolean domain {0,1}\{0,1\}{0,1}. A promise relation of arity kkk is a pair (P,Q)(P, Q)(P,Q) with P⊆Q⊆{0,1}kP \subseteq Q \subseteq \{0,1\}^kP⊆Q⊆{0,1}k, and a family Γ\GammaΓ is a finite set of promise relations, possibly of different arities. A function f:{0,1}L→{0,1}f : \{0,1\}^L \to \{0,1\}f:{0,1}L→{0,1} is a polymorphism of (P,Q)(P,Q)(P,Q) if, whenever x(1),…,x(L)∈Px^{(1)}, \dots, x^{(L)} \in Px(1),…,x(L)∈P, applying fff coordinate-wise gives a tuple in QQQ; Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) is the set of functions that are polymorphisms of every member of Γ\GammaΓ.

A relation is symmetric if it is closed under permuting coordinates. Every symmetric relation has the form Hamk(S)={x:∣x∣∈S}\mathrm{Ham}_k(S) = \{x : |x| \in S\}Hamk​(S)={x:∣x∣∈S}, where ∣x∣|x|∣x∣ is the Hamming weight. A function is folded if f(xˉ)=¬f(x)f(\bar x) = \neg f(x)f(xˉ)=¬f(x), and idempotent if f(0,…,0)=0f(0,\dots,0) = 0f(0,…,0)=0 and f(1,…,1)=1f(1,\dots,1) = 1f(1,…,1)=1; a family is folded (idempotent) if all its polymorphisms are. For odd LLL the paper singles out three function families:

ParL(x)=⨁i=1Lxi,MajL(x)=[∑ixi>L2],ATL(x)=[∑i=1L(−1)i−1xi>0],\mathrm{Par}_L(x) = \bigoplus_{i=1}^L x_i, \qquad \mathrm{Maj}_L(x) = \Big[\sum_{i} x_i > \tfrac L2\Big], \qquad \mathrm{AT}_L(x) = \Big[\sum_{i=1}^L (-1)^{i-1} x_i > 0\Big],ParL​(x)=i=1⨁L​xi​,MajL​(x)=[i∑​xi​>2L​],ATL​(x)=[i=1∑L​(−1)i−1xi​>0],

and their negations Par‾L,Maj‾L,AT‾L\overline{\mathrm{Par}}_L, \overline{\mathrm{Maj}}_L, \overline{\mathrm{AT}}_LParL​,Maj​L​,ATL​. Finally, fff is CCC-fixing if some set SSS of at most CCC coordinates satisfies f(x)=f(0,…,0)f(x) = f(0,\dots,0)f(x)=f(0,…,0) whenever xxx vanishes on SSS.

Formalization targets

Goal: Theorem 4.13

Let Γ\GammaΓ be a finite, folded, symmetric family. If there are odd L1,…,L6L_1, \dots, L_6L1​,…,L6​ with

ParL1, ATL2, MajL3, Par‾L4, AT‾L5, Maj‾L6∉Pol(Γ),\mathrm{Par}_{L_1},\ \mathrm{AT}_{L_2},\ \mathrm{Maj}_{L_3},\ \overline{\mathrm{Par}}_{L_4},\ \overline{\mathrm{AT}}_{L_5},\ \overline{\mathrm{Maj}}_{L_6} \notin \mathrm{Pol}(\Gamma),ParL1​​, ATL2​​, MajL3​​, ParL4​​, ATL5​​, Maj​L6​​∈/Pol(Γ),

then

∃ C(Γ)  ∀L  ∀f∈Pol(Γ)∩{0,1}{0,1}L: f is C(Γ)-fixing.\exists\, C(\Gamma)\ \ \forall L\ \ \forall f \in \mathrm{Pol}(\Gamma) \cap \{0,1\}^{\{0,1\}^L}:\ f \text{ is } C(\Gamma)\text{-fixing}.∃C(Γ)  ∀L  ∀f∈Pol(Γ)∩{0,1}{0,1}L: f is C(Γ)-fixing.

No value of CCC is fixed: the goal asserts only that one bound works for all arities.

Milestones

The milestones follow the paper's proof:

  • the tools of §2: Propositions 2.10, 2.12 and 2.15 and Lemma 2.13(1), which split polymorphisms into idempotent and negated idempotent ones;
  • the arity-reduction Claims 4.2, 4.3 and 4.4;
  • the closure computations Claim 4.6 (AT\mathrm{AT}AT) and Claim 4.8 (Maj\mathrm{Maj}Maj);
  • the relaxation Lemmas 4.5 and 4.7, which replace Γ\GammaΓ by a single canonical symmetric promise relation;
  • the additive-combinatorics Lemma 4.9 and its bounded Remark;
  • Lemma 4.10 and Corollary 4.11, which bound the coordinates iii with f(ei)=1f(e_i) = 1f(ei​)=1;
  • Lemma 4.12, the idempotent case of the goal.

Significance

Theorem 4.13 is the structural half of the paper's main dichotomy (Theorem 2.16): a folded symmetric Boolean PCSP is polynomial-time solvable if it has one of the six families as polymorphisms for every odd arity, and NP-hard otherwise. Hardness follows by feeding the CCC-fixing structure into a Label Cover reduction (Theorem 5.3). Bounded "fixing" or junta-like structure of all polymorphisms is the standard route from algebra to NP-hardness for PCSPs. This theorem is the cleanest Boolean instance of it, and it underlies later classifications of symmetric Boolean PCSPs.

The result has been proved and published since 2018. To our knowledge none of it has been formalized. A formalization supplies a checked Boolean polymorphism toolkit (Hamming-weight relations, folding, idempotence, relaxations), checked closure computations under alternating-threshold and majority operations, and a uniform-constant Frobenius-type lemma. All of these can be reused by other Boolean PCSP missions.

Difficulty

The obvious argument fixes a polymorphism fff and bounds its relevant coordinates directly from a constraint that Par\mathrm{Par}Par, AT\mathrm{AT}AT or Maj\mathrm{Maj}Maj violates. This gives a bound that depends on the arity LLL, and an LLL-dependent bound is trivial (C=LC = LC=L always works). The work is in making the constant uniform. The proof has to replace Γ\GammaΓ by a single canonical promise relation that does not depend on fff, classify exactly which symmetric relations exclude ATL\mathrm{AT}_LATL​ and MajL\mathrm{Maj}_LMajL​, and use an additive-combinatorics lemma whose constants depend only on that relation's arity. Its bounded version must hold with the same constants. The non-idempotent polymorphisms need a separate reduction through the negated family ¬Γ\neg\Gamma¬Γ.

Formalization scope

The domain {0,1}\{0,1\}{0,1} is Bool (false =0= 0=0). A family Γ\GammaΓ is a pair of relational structures 𝔸 𝔹 : RelStruct τ ar Bool from the published definition PCSPBLPAff_Symmetric_Setting, with [Fintype τ] (finitely many relations) and 𝔸.rel R ⊆ 𝔹.rel R (promise). IsPolymorphism 𝔸 𝔹 f from that file is Definition 2.4. Coordinates are Fin L, so the 1-based sign (−1)i−1(-1)^{i-1}(−1)i−1 of ATL\mathrm{AT}_LATL​ becomes (−1)i(-1)^{i}(−1)i. Anti-functions negate the output. Family properties (folded, idempotent, non-degenerate) quantify over polymorphisms of every arity L≥0L \ge 0L≥0. A folded or idempotent family has no nullary polymorphisms, so admitting L=0L = 0L=0 changes nothing. The constants C(Γ)C(\Gamma)C(Γ), c(Γ)c(\Gamma)c(Γ), A(n)A(n)A(n) and d(n)d(n)d(n) are quantified before the arity and the function (respectively before S0,S1S_0, S_1S0​,S1​). A statement that lets the constant depend on fff or LLL is trivially true and is not the goal.

Out of scope are the complexity conclusions: "PCSP(Γ\GammaΓ) is NP-hard" (Theorems 2.16 and 5.3) and item 2 of Lemma 2.13 (transfer of tractability). The cited inputs for those conclusions are also out of scope: the PCP theorem with parallel repetition (Proposition 5.2) and Schaefer's theorem. No complexity predicate appears in any statement.

A complete development needs the following, with Mathlib's Nat.frobeniusNumber as a starting point for Lemma 4.9:

  • explicit matrix constructions for Claims 4.6 and 4.8;
  • closure of polymorphisms under projections (minors), used in Lemma 4.10 and Corollary 4.11;
  • a Frobenius-coin argument with constants uniform in the sets S0,S1S_0, S_1S0​,S1​.

Contributions are welcome at any milestone, including separate proofs of the closure computations and of Lemma 4.9.

Selected references

  • J. Brakensiek, V. Guruswami, Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy, arXiv:1704.01937v2, 2021; SIAM J. Comput. 50(6), 2021. https://arxiv.org/abs/1704.01937
  • P. Austrin, V. Guruswami, J. Håstad, (2+ε)-SAT is NP-hard, SIAM J. Comput. 46(5), 2017. https://doi.org/10.1137/15M1006507
  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, J. ACM 68(4), 2021. https://doi.org/10.1145/3457606
  • M. Ficak, M. Kozik, M. Olšák, S. Stankiewicz, Dichotomy for symmetric Boolean PCSPs, ICALP 2019. https://doi.org/10.4230/LIPIcs.ICALP.2019.57
  • T. J. Schaefer, The complexity of satisfiability problems, STOC 1978. https://doi.org/10.1145/800133.804350
19 thms1 active userReviewed
CombinatoricsDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 2: If h + 1 Divides r and n ≥ h + 1, Maximum h-Scattered 𝔽_q-Subspaces of V(r, qⁿ) of Dimension rn/(h + 1) ExistResearch Paper

Motivation

A scattered subspace is an Fq\mathbb F_qFq​-subspace UUU of an Fqn\mathbb F_{q^n}Fqn​-vector space VVV that meets every one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace of VVV in an Fq\mathbb F_qFq​-subspace of dimension at most one. Scattered subspaces produce scattered linear sets in projective spaces over finite fields, and through them two-intersection sets, two-weight codes, translation caps and maximum rank distance (MRD) codes. Blokhuis and Lavrauw (Geom. Dedicata 2000) proved that a scattered subspace of V(r,qn)V(r,q^n)V(r,qn) has dimension at most rn/2rn/2rn/2, and constructions of that dimension are known whenever rnrnrn is even (see Bartoli, Giulietti, Marino, Polverino 2018 and the references there).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2, Combinatorica 41, 2021) replace "one-dimensional" by "hhh-dimensional". The resulting hhh-scattered subspaces interpolate between scattered subspaces (h=1h=1h=1) and subspaces meeting every hyperplane in small dimension (h=r−1h=r-1h=r−1), which Sheekey and Van de Voorde (Des. Codes Cryptogr. 2020) showed to be equivalent to MRD codes with an idealiser isomorphic to Fqn\mathbb F_{q^n}Fqn​. For the new notion the paper proves an upper bound on the dimension (Theorem 2.3) and shows that the bound is attained when h+1h+1h+1 divides rrr (Theorem 2.6). This mission is the attainment half.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, so n=[Fqn:Fq]n=[\mathbb F_{q^n}:\mathbb F_q]n=[Fqn​:Fq​], and let V=V(r,qn)V=V(r,q^n)V=V(r,qn) be an rrr-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space with r≥1r\ge1r≥1. Every Fqn\mathbb F_{q^n}Fqn​-space is also an Fq\mathbb F_qFq​-space of dimension rnrnrn. For an integer hhh with 0<h≤r−10<h\le r-10<h≤r−1, an Fq\mathbb F_qFq​-subspace U≤VU\le VU≤V is hhh-scattered (Definition 1.1) if

  1. UUU spans VVV over Fqn\mathbb F_{q^n}Fqn​, ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}}=V⟨U⟩Fqn​​=V, and
  2. dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h for every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV.

An hhh-scattered subspace of largest possible Fq\mathbb F_qFq​-dimension is maximum hhh-scattered. Theorem 2.3 of the paper says that an hhh-scattered UUU either has dimension rrr and defines a subgeometry (an Fq\mathbb F_qFq​-basis of UUU is an Fqn\mathbb F_{q^n}Fqn​-basis of VVV), or satisfies

dim⁡FqU≤rnh+1.(1)\dim_{\mathbb F_q}U\le\frac{rn}{h+1}.\tag{1}dimFq​​U≤h+1rn​.(1)

Two building blocks appear in the statements. If V=V1⊕⋯⊕VtV=V_1\oplus\dots\oplus V_tV=V1​⊕⋯⊕Vt​ with Vi=V(ri,qn)V_i=V(r_i,q^n)Vi​=V(ri​,qn) and Ui≤ViU_i\le V_iUi​≤Vi​ are Fq\mathbb F_qFq​-subspaces, then U=U1⊕⋯⊕UtU=U_1\oplus\dots\oplus U_tU=U1​⊕⋯⊕Ut​ is the direct sum of the UiU_iUi​. For r≤nr\le nr≤n the Gabidulin-type subspace of Fqn r\mathbb F_{q^n}^{\,r}Fqnr​ is

Gr={(x,xq,xq2,…,xqr−1):x∈Fqn},G_r=\{(x,x^{q},x^{q^2},\dots,x^{q^{r-1}}) : x\in\mathbb F_{q^n}\},Gr​={(x,xq,xq2,…,xqr−1):x∈Fqn​},

the image of an Fq\mathbb F_qFq​-linear map, since x↦xqjx\mapsto x^{q^j}x↦xqj fixes Fq\mathbb F_qFq​.

Formalization targets

Goal: Theorem 2.6 (p. 7)

If h≥1h\ge1h≥1, h+1h+1h+1 divides rrr and n≥h+1n\ge h+1n≥h+1, then V(r,qn)V(r,q^n)V(r,qn) contains an Fq\mathbb F_qFq​-subspace UUU that is maximum hhh-scattered and satisfies

dim⁡FqU=rnh+1.\dim_{\mathbb F_q}U=\frac{rn}{h+1}.dimFq​​U=h+1rn​.

Milestones, in the order the paper uses them

  • Proposition 2.1 (p. 3): for h>1h>1h>1, every hhh-scattered subspace is iii-scattered for all 0<i<h0<i<h0<i<h.
  • Theorem 2.3 (p. 4): the dichotomy above, subgeometry or bound (1).
  • Theorem 2.4 (p. 6): if UiU_iUi​ is hih_ihi​-scattered in ViV_iVi​, then U1⊕⋯⊕UtU_1\oplus\dots\oplus U_tU1​⊕⋯⊕Ut​ is min⁡ihi\min_i h_imini​hi​-scattered in V1⊕⋯⊕VtV_1\oplus\dots\oplus V_tV1​⊕⋯⊕Vt​.
  • Theorem 2.4, second sentence (p. 6): if every UiU_iUi​ is hhh-scattered with dim⁡FqUi=rin/(h+1)\dim_{\mathbb F_q}U_i=r_in/(h+1)dimFq​​Ui​=ri​n/(h+1), then the direct sum is hhh-scattered of dimension rn/(h+1)rn/(h+1)rn/(h+1).
  • Example 2.5 (p. 7): for 2≤r≤n2\le r\le n2≤r≤n, GrG_rGr​ is maximum (r−1)(r-1)(r−1)-scattered of dimension nnn.

Significance

Together with Theorem 2.3, the goal settles the largest dimension of an hhh-scattered subspace of V(r,qn)V(r,q^n)V(r,qn) whenever h+1∣rh+1\mid rh+1∣r and n≥h+1n\ge h+1n≥h+1: it is exactly rn/(h+1)rn/(h+1)rn/(h+1). The subspaces it produces are the input of the paper's Delsarte duality (Theorem 3.3), which turns maximum hhh-scattered subspaces of V(r,qn)V(r,q^n)V(r,qn) reaching bound (1) into maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspaces of V(rn/(h+1)−r,qn)V(rn/(h+1)-r,q^n)V(rn/(h+1)−r,qn) and so gives constructions also when h+1∤rh+1\nmid rh+1∤r. The direct-sum theorem is also of independent use: it extends the direct-sum construction for scattered linear sets of Bartoli, Giulietti, Marino and Polverino to every hhh, and Example 2.5 gives the subspace counterpart of Gabidulin codes.

All results in this mission are proved in the paper. To our knowledge none of them has a machine-checked proof; no formal library contains scattered subspaces, linear sets or Gabidulin-type subspaces. The remaining work is formalizing the paper's arguments: the counting of roots of linearized polynomials behind Example 2.5, the Grassmann-formula and quotient-space argument of Theorem 2.4, and the bound (1) of Theorem 2.3, which the companion mission on the dimension bound states as its goal.

Difficulty

The construction itself is short; the work lies in the three ingredients. The obvious approach to Theorem 2.4 fails: an hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace WWW of V1⊕V2V_1\oplus V_2V1​⊕V2​ need not be the sum of its intersections with V1V_1V1​ and V2V_2V2​, so the intersection W∩UW\cap UW∩U cannot be bounded summand by summand. Example 2.5 needs that a nonzero qqq-polynomial ∑j<rajxqj\sum_{j<r}a_jx^{q^j}∑j<r​aj​xqj has at most qr−1q^{r-1}qr−1 roots in Fqn\mathbb F_{q^n}Fqn​, and the root set is an Fq\mathbb F_qFq​-subspace. Maximality is not a property of a single subspace: it quantifies over every hhh-scattered subspace of VVV and so needs the full upper bound of Theorem 2.3, including the case n<h+1n<h+1n<h+1 handled there by Proposition 2.1.

Formalization scope

Fq\mathbb F_qFq​ is a finite field F, Fqn\mathbb F_{q^n}Fqn​ a finite field K with Algebra F K, so q=q=q= Fintype.card F and n=n=n= Module.finrank F K. VVV is a finite-dimensional K-module with a compatible F-module structure (IsScalarTower F K V), and r=r=r= Module.finrank K V. An Fq\mathbb F_qFq​-subspace is a Submodule F V; its intersection with an Fqn\mathbb F_{q^n}Fqn​-subspace S is S.restrictScalars F ⊓ U.

Conventions the statements commit to:

  • The range 0<h<r0<h<r0<h<r and the spanning condition are part of IsHScattered; without the range every spanning subspace would be hhh-scattered for h≥rh\ge rh≥r.
  • Every quotient rn/(h+1)rn/(h+1)rn/(h+1) is multiplied out, as (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U=rn(h+1)dimFq​​U=rn or ≤rn\le rn≤rn; no natural-number division is used.
  • The direct sum in Theorem 2.4 is external: V=∏i<tViV=\prod_{i<t}V_iV=∏i<t​Vi​ ((i : Fin t) → V i) and U=U=U= Submodule.pi Set.univ U. The minimum h=min⁡ihih=\min_i h_ih=mini​hi​ is given by h≤hih\le h_ih≤hi​ for all iii and h=hih=h_ih=hi​ for some iii. The second part of Theorem 2.4 assumes t≥1t\ge1t≥1.
  • Example 2.5 is stated on Fin r → K, with GrG_rGr​ the range of the F-linear map x↦(xqj)j<rx\mapsto(x^{q^j})_{j<r}x↦(xqj)j<r​, and assumes r≥2r\ge2r≥2 so that (r−1)(r-1)(r−1)-scattered is within Definition 1.1's range.
  • The goal assumes r≥1r\ge1r≥1: h+1h+1h+1 divides 000, but the zero space has no hhh-scattered subspace. The upper end h<rh<rh<r follows from h+1∣rh+1\mid rh+1∣r.
  • "Defines a subgeometry" in Theorem 2.3 is: some subset of UUU spans UUU over Fq\mathbb F_qFq​ and is an Fqn\mathbb F_{q^n}Fqn​-basis of VVV.

The goal is not satisfied by a small subspace: both the dimension equality (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U=rn(h+1)dimFq​​U=rn and maximality among all hhh-scattered subspaces of VVV are part of its conclusion.

Results the paper cites without a number (the Blokhuis–Lavrauw bound for h=1h=1h=1, the direct-sum theorem for scattered linear sets) are not items. Theorem 2.3 is restated here because the maximality in Theorem 2.6 rests on it; it duplicates the goal of the companion mission. Useful infrastructure beyond this mission: roots of linearized polynomials over finite fields, dimension formulas for subspaces under restriction of scalars, and direct sums of hhh-scattered subspaces. Contributions on any milestone are welcome, and the goal can be closed from the milestones alone.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, arXiv:1906.10590v2, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/1906.10590, https://doi.org/10.1007/s00493-020-4347-y
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • D. Bartoli, M. Giulietti, G. Marino, O. Polverino, Maximum scattered linear sets and complete caps in Galois spaces, Combinatorica 38 (2018), 255–278. https://doi.org/10.1007/s00493-016-3531-6
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets, and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://doi.org/10.1007/s10623-019-00703-z
10 thms1 active userReviewed
Complexity TheoryLinear OptimizationTheoretical Computer Science·Captain: mikedeng1

Algebraic Approach to Promise Constraint Satisfaction 3: BLP Solves PCSP(A, B) iff Pol(A, B) Has Symmetric Functions of All Arities iff Q_conv Maps to Pol(A, B)Research Paper

Motivation

A promise constraint satisfaction problem PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) is given by two finite relational structures with a homomorphism A→B\mathbf A\to\mathbf BA→B. An instance is a finite structure I\mathbf II over the same signature, promised to map to A\mathbf AA; the task is to find a homomorphism to the weaker structure B\mathbf BB (or, in the decision version, to tell I→A\mathbf I\to\mathbf AI→A apart from I↛B\mathbf I\not\to\mathbf BI→B). Approximate graph colouring (A=Kk\mathbf A=K_kA=Kk​, B=Kℓ\mathbf B=K_\ellB=Kℓ​) is the standard example.

The most direct polynomial-time algorithm one can try is linear programming. The basic LP relaxation (BLP) of an instance replaces the 0–1 program "assign one value to each variable, one allowed tuple to each constraint" by probability distributions on values and on tuples, with consistent marginals. Barto, Bulín, Krokhin and Opršal (arXiv:1811.00970v3, Theorem 7.9) characterise exactly when this relaxation decides PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B), in terms of the polymorphisms of the template. The result extends the CSP case of Kun, O'Donnell, Tamaki, Yoshida and Zhou (KOT+12, Theorem 2(5)&(6)) to promise problems.

Setting

A relational structure A\mathbf AA on a set AAA assigns to each symbol RRR of a finite signature a relation RA⊆Aar(R)R^{\mathbf A}\subseteq A^{\mathrm{ar}(R)}RA⊆Aar(R), with ar(R)≥1\mathrm{ar}(R)\ge 1ar(R)≥1. A polymorphism from A\mathbf AA to B\mathbf BB is a function f:An→Bf:A^n\to Bf:An→B, n≥1n\ge1n≥1, that maps every nnn tuples of RAR^{\mathbf A}RA, applied coordinatewise, to a tuple of RBR^{\mathbf B}RB; these form Pol(A,B)\mathrm{Pol}(\mathbf A,\mathbf B)Pol(A,B). A function is symmetric if f(xπ(1),…,xπ(n))=f(x1,…,xn)f(x_{\pi(1)},\dots,x_{\pi(n)})=f(x_1,\dots,x_n)f(xπ(1)​,…,xπ(n)​)=f(x1​,…,xn​) for every permutation π\piπ.

A minion on (A,B)(A,B)(A,B) is a nonempty family of functions An→BA^n\to BAn→B, n≥1n\ge 1n≥1, closed under minors g↦g(xπ(1),…,xπ(m))g\mapsto g(x_{\pi(1)},\dots,x_{\pi(m)})g↦g(xπ(1)​,…,xπ(m)​) for maps π:[m]→[n]\pi:[m]\to[n]π:[m]→[n]; a minion homomorphism preserves arities and minors. The minion Qconv\mathcal Q_{\mathrm{conv}}Qconv​ on (Q,Q)(\mathbb Q,\mathbb Q)(Q,Q) consists of the convex linear functions f(x1,…,xn)=∑iαixif(x_1,\dots,x_n)=\sum_i\alpha_ix_if(x1​,…,xn​)=∑i​αi​xi​ with αi∈[0,1]\alpha_i\in[0,1]αi​∈[0,1] and ∑iαi=1\sum_i\alpha_i=1∑i​αi​=1. The structure Qconv\mathbf Q_{\mathrm{conv}}Qconv​ has domain Q\mathbb QQ and one relation {x∈Qk∣∑icixi≤d}\{x\in\mathbb Q^k\mid\sum_i c_ix_i\le d\}{x∈Qk∣∑i​ci​xi​≤d} for every rational linear inequality; a finite reduct keeps finitely many of them.

For an instance I\mathbf II, the basic LP has variables μv(a)∈[0,1]\mu_v(a)\in[0,1]μv​(a)∈[0,1] for elements vvv and μv,R(a)∈[0,1]\mu_{\mathbf v,R}(\mathbf a)\in[0,1]μv,R​(a)∈[0,1] for constraints v∈RI\mathbf v\in R^{\mathbf I}v∈RI, constrained by ∑aμv(a)=1\sum_a\mu_v(a)=1∑a​μv​(a)=1 and the marginal equations ∑a(i)=aμv,R(a)=μv(i)(a)\sum_{\mathbf a(i)=a}\mu_{\mathbf v,R}(\mathbf a)=\mu_{\mathbf v(i)}(a)∑a(i)=a​μv,R​(a)=μv(i)​(a). BLPA(I)=1\mathrm{BLP}_{\mathbf A}(\mathbf I)=1BLPA​(I)=1 means that a solution exists in which every μv,R\mu_{\mathbf v,R}μv,R​ is supported on RAR^{\mathbf A}RA. BLP solves PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) if every I\mathbf II with BLPA(I)=1\mathrm{BLP}_{\mathbf A}(\mathbf I)=1BLPA​(I)=1 maps to B\mathbf BB.

pp-constructions combine two operations on templates: an nnn-th pp-power (domains AnA^nAn, BnB^nBn, relations defined by one primitive positive formula in both structures) and a homomorphic relaxation (A′,B′)(\mathbf A',\mathbf B')(A′,B′) of (A,B)(\mathbf A,\mathbf B)(A,B) (homomorphisms A′→A\mathbf A'\to\mathbf AA′→A and B→B′\mathbf B\to\mathbf B'B→B′).

Formalization targets

Goal: Theorem 7.9

For a PCSP template (A,B)(\mathbf A,\mathbf B)(A,B), the following are equivalent:

(1) BLP solves PCSP(A,B)  ⟺  (2) Pol(A,B) has symmetric functions of every arity n≥1\text{(1) BLP solves }\mathrm{PCSP}(\mathbf A,\mathbf B)\iff\text{(2) }\mathrm{Pol}(\mathbf A,\mathbf B)\text{ has symmetric functions of every arity }n\ge1(1) BLP solves PCSP(A,B)⟺(2) Pol(A,B) has symmetric functions of every arity n≥1   ⟺  (3) Qconv→Pol(A,B)  ⟺  (4) (A,B) is pp-constructible from a finite reduct of Qconv.\iff\text{(3) }\mathcal Q_{\mathrm{conv}}\to\mathrm{Pol}(\mathbf A,\mathbf B)\iff\text{(4) }(\mathbf A,\mathbf B)\text{ is pp-constructible from a finite reduct of }\mathbf Q_{\mathrm{conv}}.⟺(3) Qconv​→Pol(A,B)⟺(4) (A,B) is pp-constructible from a finite reduct of Qconv​.

Milestones

The structure LP(A)\mathrm{LP}(\mathbf A)LP(A) has as elements the rational probability distributions on AAA; a tuple (ϕ1,…,ϕk)(\phi_1,\dots,\phi_k)(ϕ1​,…,ϕk​) lies in RLP(A)R^{\mathrm{LP}(\mathbf A)}RLP(A) when some rational distribution γ\gammaγ on RAR^{\mathbf A}RA has marginals ϕ1,…,ϕk\phi_1,\dots,\phi_kϕ1​,…,ϕk​. The milestones are:

  • §7.2, p. 47: BLPA(I)=1  ⟺  I→LP(A)\mathrm{BLP}_{\mathbf A}(\mathbf I)=1\iff\mathbf I\to\mathrm{LP}(\mathbf A)BLPA​(I)=1⟺I→LP(A);
  • Remark 7.13: a countable structure whose finite substructures all map to a finite B\mathbf BB maps to B\mathbf BB;
  • Remark 7.11: LP(A)≅FQ(A)\mathrm{LP}(\mathbf A)\cong\mathbf F_{\mathcal Q}(\mathbf A)LP(A)≅FQ​(A), the free structure of Qconv\mathcal Q_{\mathrm{conv}}Qconv​;
  • Lemma 7.12: (A,LP(A))(\mathbf A,\mathrm{LP}(\mathbf A))(A,LP(A)) is a relaxation of a pp-power of Qconv\mathbf Q_{\mathrm{conv}}Qconv​;
  • Lemma 4.8(1), (2) for possibly infinite templates: relaxations and pp-powers receive minion homomorphisms;
  • the step hℓh_\ellhℓ​ (p. 48): a symmetric polymorphism of arity ℓ\ellℓ gives LPℓ(A)→B\mathrm{LP}_\ell(\mathbf A)\to\mathbf BLPℓ​(A)→B, where LPℓ(A)\mathrm{LP}_\ell(\mathbf A)LPℓ​(A) uses distributions with denominators dividing ℓ\ellℓ.

Significance

The result. Theorem 7.9 gives a complete, checkable description of the templates on which the basic LP relaxation is a correct algorithm: one needs only to look for symmetric polymorphisms. Through item (3) it places BLP inside the paper's general theory, in which the complexity of PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) depends only on the minion Pol(A,B)\mathrm{Pol}(\mathbf A,\mathbf B)Pol(A,B); BLP corresponds to the single minion Qconv\mathcal Q_{\mathrm{conv}}Qconv​. The same pattern later gives the analogous characterisations for the affine relaxation (Theorem 7.19, minion Zaff\mathcal Z_{\mathrm{aff}}Zaff​) and the combined BLP+AIP algorithm of Brakensiek, Guruswami, Wrochna and Živný.

Formalizing it. The theorem is proved in the paper; no machine-checked version exists. A formalization adds minions and pp-constructions over infinite domains, the structure LP(A)\mathrm{LP}(\mathbf A)LP(A), and a compactness argument for countable structures, all reusable for other relaxation-based algorithms. On the platform, PCSPBLPAff.Symmetric.theorem_2 (symmetric polymorphisms of arbitrarily large arity make BLP+AIP correct) and PCSPBLPAff.Characterization.theorem_4 concern the different BLP+AIP algorithm.

Difficulty

Two steps resist the finite theory. First, Theorem 4.12 (minion homomorphisms correspond to pp-constructions) is proved only for finite templates and fails for infinite ones in general, while Qconv\mathcal Q_{\mathrm{conv}}Qconv​ and Qconv\mathbf Q_{\mathrm{conv}}Qconv​ live on Q\mathbb QQ; the link between (3) and (4) must be made by hand through LP(A)\mathrm{LP}(\mathbf A)LP(A). Second, (2) supplies one symmetric polymorphism per arity, with no compatibility required between different arities, while (1) is a statement about all instances at once. The natural intermediate object, LP(A)\mathrm{LP}(\mathbf A)LP(A), is infinite, and no single polymorphism of Pol(A,B)\mathrm{Pol}(\mathbf A,\mathbf B)Pol(A,B) acts on all of it; mapping it to B\mathbf BB is where finiteness of B\mathbf BB and countability of LP(A)\mathrm{LP}(\mathbf A)LP(A) enter.

Formalization scope

The development builds on the published definitions PCSPBLPAff.Symmetric (relational structures, homomorphisms, polymorphisms, symmetric functions, instances and the BLP polytope IsLPSol). Conventions: signatures are finite with arities ≥1\ge1≥1; AAA and BBB are finite and BBB is nonempty, which excludes only the degenerate template A=B=∅A=B=\emptysetA=B=∅, where items (1)–(3) hold and (4) fails. BLPA(I)=1\mathrm{BLP}_{\mathbf A}(\mathbf I)=1BLPA​(I)=1 is encoded as the feasibility over Q\mathbb QQ of the LP with the vanishing constraints, following the paper's remark after Definition 7.7; dropping those constraints would make item (1) a different, false statement, since the unrestricted LP is always feasible. Item (2) asks for every arity n≥1n\ge1n≥1, not only arbitrarily large ones. Qconv\mathcal Q_{\mathrm{conv}}Qconv​ is defined directly as the convex linear functions (coefficients in [0,1][0,1][0,1] summing to 111; affine coefficients would give a different theorem). Qconv\mathbf Q_{\mathrm{conv}}Qconv​ uses non-strict inequalities. The free structure, LP(A)\mathrm{LP}(\mathbf A)LP(A) and LPℓ(A)\mathrm{LP}_\ell(\mathbf A)LPℓ​(A) are stated with rational values, so LP(A)\mathrm{LP}(\mathbf A)LP(A) is countable.

Left out: the complexity consequences (polynomial-time solvability) and the identification of Qconv\mathcal Q_{\mathrm{conv}}Qconv​ with the polymorphisms of Qconv\mathbf Q_{\mathrm{conv}}Qconv​, which the proof does not need. The cited input [KOT+12, Proposition 12] is replaced by its use in the proof, the milestone on LP(A)\mathrm{LP}(\mathbf A)LP(A). The proof of Lemma 7.12 on p. 47 omits γ≥0\gamma\ge0γ≥0 from the pp-definition; nonnegativity is itself pp-definable in Qconv\mathbf Q_{\mathrm{conv}}Qconv​, so the lemma's statement is unaffected.

Contributions welcome: proofs of any milestone, in particular the compactness remark (or a derivation from PCSPBLPAff.Characterization.lemma_16) and Lemma 4.8 for infinite templates.

Selected references

  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, arXiv:1811.00970v3, 2019; J. ACM 68(4), 2021. https://arxiv.org/abs/1811.00970
  • G. Kun, R. O'Donnell, S. Tamaki, Y. Yoshida, Y. Zhou, Linear programming, width-1 CSPs, and robust satisfaction, ITCS 2012. https://doi.org/10.1145/2090236.2090274
  • M. Bodirsky, M. Mamino, Constraint satisfaction problems over numeric domains, Dagstuhl Follow-Ups 7, 2017. https://doi.org/10.4230/DFU.Vol7.15301.79
  • J. Brakensiek, V. Guruswami, M. Wrochna, S. Živný, The power of the combined basic LP and affine relaxation for promise CSPs, SIAM J. Comput. 49(6), 2020. https://arxiv.org/abs/1907.04383
16 thms1 active userReviewed
CombinatoricsDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 3: A Maximum h-Scattered Subspace of Dimension rn/(h + 1) Meets Every Hyperplane in Dimension Between rn/(h + 1) − n and rn/(h + 1) − n + hResearch Paper

Motivation

Scattered subspaces are a central object of finite geometry. An Fq\mathbb F_qFq​-subspace UUU of an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​ defines an Fq\mathbb F_qFq​-linear set of the projective space PG(r−1,qn)\mathrm{PG}(r-1,q^n)PG(r−1,qn), and when UUU is scattered this linear set has the largest possible number of points for its rank. Maximum scattered subspaces give rise to maximum rank distance (MRD) codes, to translation caps, and to two-intersection sets and the associated two-weight codes and strongly regular graphs (Polverino 2010; Sheekey–Van de Voorde 2020).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2, Combinatorica 41, 2021) generalised the notion to hhh-scattered subspaces, which meet every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace in dimension at most hhh, and proved that such a subspace has dimension at most rn/(h+1)rn/(h+1)rn/(h+1) unless it defines a subgeometry. This mission concerns the extremal case: subspaces attaining rn/(h+1)rn/(h+1)rn/(h+1), and the way they meet hyperplanes.

Timeline.

  • 2000: Blokhuis and Lavrauw (Geom. Dedicata 81, Theorem 4.2) prove the case h=1h=1h=1: a scattered subspace of dimension rn/2rn/2rn/2 meets each hyperplane in dimension rn/2−nrn/2-nrn/2−n or rn/2−n+1rn/2-n+1rn/2−n+1, and they count the hyperplanes of each kind.
  • 2020: Csajbók, Marino, Polverino and Zullo prove the general statement (Theorem 2.7) by a double count and qqq-series identities, and use it to build maximum hhh-scattered subspaces by Delsarte duality.
  • Later work by Zini and Zullo (Scattered subspaces and related codes, reference [29] of the paper) determines the number of hyperplanes of each intersection dimension for every hhh; the case h=2h=2h=2 is in Napolitano–Zullo.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, n=[Fqn:Fq]n = [\mathbb F_{q^n}:\mathbb F_q]n=[Fqn​:Fq​], and let V=V(r,qn)V = V(r,q^n)V=V(r,qn) be an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​, viewed also as an rnrnrn-dimensional vector space over Fq\mathbb F_qFq​. A hyperplane of VVV is an (r−1)(r-1)(r−1)-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace.

Fix an integer hhh with 0<h≤r−10<h\le r-10<h≤r−1. An Fq\mathbb F_qFq​-subspace UUU of VVV is hhh-scattered if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h. It is maximum hhh-scattered if no hhh-scattered subspace of VVV has larger Fq\mathbb F_qFq​-dimension.

Put s=h+1s=h+1s=h+1 and suppose s∣rns\mid rns∣rn. For an Fq\mathbb F_qFq​-subspace UUU of dimension rn/srn/srn/s, let hih_ihi​ be the number of hyperplanes WWW with dim⁡Fq(W∩U)=i\dim_{\mathbb F_q}(W\cap U)=idimFq​​(W∩U)=i. The proof works with the Gaussian binomial coefficients [nk]q\left[{n\atop k}\right]_q[kn​]q​, the qqq-Pochhammer symbols (a;q)k=(1−a)(1−aq)⋯(1−aqk−1)(a;q)_k=(1-a)(1-aq)\cdots(1-aq^{k-1})(a;q)k​=(1−a)(1−aq)⋯(1−aqk−1), the elementary symmetric values σk,l\sigma_{k,l}σk,l​ of 1,q,…,qk1,q,\dots,q^k1,q,…,qk, and the sums

αk=∑ihi(qn−1)qki,βk=∑ihi(qn−1)∏j=0k−1(qi−qj),\alpha_k=\sum_i h_i(q^n-1)q^{ki},\qquad \beta_k=\sum_i h_i(q^n-1)\prod_{j=0}^{k-1}(q^i-q^j),αk​=i∑​hi​(qn−1)qki,βk​=i∑​hi​(qn−1)j=0∏k−1​(qi−qj), A=∑ihi(qn−1)∏l=0s−1(qi−q n(r−s)/s+l).A=\sum_i h_i(q^n-1)\prod_{l=0}^{s-1}\bigl(q^i-q^{\,n(r-s)/s+l}\bigr).A=i∑​hi​(qn−1)l=0∏s−1​(qi−qn(r−s)/s+l).

Formalization targets

Goal: Theorem 2.7

If UUU is a maximum hhh-scattered Fq\mathbb F_qFq​-subspace of V(r,qn)V(r,q^n)V(r,qn) of dimension rn/(h+1)rn/(h+1)rn/(h+1), then for every hyperplane WWW of VVV

rnh+1−n  ≤  dim⁡Fq(U∩W)  ≤  rnh+1−n+h.\frac{rn}{h+1}-n\;\le\;\dim_{\mathbb F_q}(U\cap W)\;\le\;\frac{rn}{h+1}-n+h.h+1rn​−n≤dimFq​​(U∩W)≤h+1rn​−n+h.

Milestones, in the order of the proof (§5, pp. 20–24)

  1. hi=0h_i=0hi​=0 for i<rn/s−ni<rn/s-ni<rn/s−n (the lower bound), and (23): ∑ihi(qn−1)=qrn−1\sum_i h_i(q^n-1)=q^{rn}-1∑i​hi​(qn−1)=qrn−1.
  2. Lemma 5.7: for 0≤k≤s−10\le k\le s-10≤k≤s−1,
∑ihi(qn−1)∏j=0k(qi−qj)=∏j=0k(qrn/s−qj) (q(r−k−1)n−1).\sum_i h_i(q^n-1)\prod_{j=0}^{k}(q^i-q^j)=\prod_{j=0}^{k}(q^{rn/s}-q^j)\,(q^{(r-k-1)n}-1).i∑​hi​(qn−1)j=0∏k​(qi−qj)=j=0∏k​(qrn/s−qj)(q(r−k−1)n−1).
  1. The qqq-series tools: Lemma 5.5 (σk,l=ql(l−1)/2[k+1l]q\sigma_{k,l}=q^{l(l-1)/2}\left[{k+1\atop l}\right]_qσk,l​=ql(l−1)/2[lk+1​]q​), Carlitz's inversion (Theorem 5.6), the qqq-binomial theorem (Theorem 5.2) and its specialisation (Corollary 5.3).
  2. (24): αk=∑j≤k[kj]qβj\alpha_k=\sum_{j\le k}\left[{k\atop j}\right]_q\beta_jαk​=∑j≤k​[jk​]q​βj​. Identity (25), which expresses AAA through α0,…,αs\alpha_0,\dots,\alpha_sα0​,…,αs​, is included as a supporting item rather than a milestone.
  3. Propositions 5.8 and 5.9: two triple sums asa_sas​, bsb_sbs​ both equal qnr(−1)s(q−n;q)sq^{nr}(-1)^s(q^{-n};q)_sqnr(−1)s(q−n;q)s​.
  4. A=0A=0A=0, which forces hi=0h_i=0hi​=0 for i>n(r−s)/s+s−1i>n(r-s)/s+s-1i>n(r−s)/s+s−1.

Significance

The result. Theorem 2.7 says that a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) has only h+1h+1h+1 possible intersection dimensions with hyperplanes. Its linear set therefore meets hyperplanes in few sizes, which links these subspaces to sets of few intersection numbers and to codes with few weights. Inside the paper, the upper bound is the input to §3: it shows that the Delsarte dual of a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) is maximum (n−h−2)(n-h-2)(n−h−2)-scattered (Theorem 3.3). That theorem in turn gives maximum hhh-scattered subspaces when h+1h+1h+1 does not divide rrr.

Formalizing it. The theorem is proved in the paper, but no machine-checked version exists. Beyond the geometry, the mission produces a library of finite qqq-series facts: Gaussian binomials as rational functions of qqq, the qqq-binomial theorem in both forms, Carlitz's inversion formula, and the elementary symmetric evaluation σk,l\sigma_{k,l}σk,l​. Some of these are proved on the platform in a different Mathlib environment, but they are not available in this one. Counting statements about subspaces over finite fields (hyperplanes through a subspace, ordered independent tuples) are also needed and are reusable.

Difficulty

The lower bound is a dimension count. The upper bound is not: the obvious approach bounds dim⁡(U∩W)\dim(U\cap W)dim(U∩W) from the scattered property alone, but the hhh-scattered condition controls intersections with hhh-dimensional subspaces, and hyperplanes have dimension r−1r-1r−1, which is far larger. No pointwise argument is known; the paper determines the distribution (hi)(h_i)(hi​) only through its first s+1s+1s+1 moments, given by a double count, and then shows that a specific nonnegative combination of the hih_ihi​ vanishes. The moment identities hold only for k≤s−1k\le s-1k≤s−1 (Lemma 5.7 needs each k+1≤h+1k+1\le h+1k+1≤h+1 independent vectors of UUU to stay independent over Fqn\mathbb F_{q^n}Fqn​), and closing the argument requires exact evaluation of a triple qqq-series with signed Gaussian binomials and quadratic exponents.

Formalization scope

  • Fq\mathbb F_qFq​ is a finite field F, Fqn\mathbb F_{q^n}Fqn​ a finite field K with [Algebra F K], and VVV a finite-dimensional K-module with a compatible F-module structure (IsScalarTower F K V). We take r=r=r= finrank K V, n=n=n= finrank F K and q=q=q= Fintype.card F.
  • The range 0<h<r0<h<r0<h<r and the spanning condition are part of IsHScattered.
  • "Dimension rn/(h+1)rn/(h+1)rn/(h+1)" is the equation (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U = rn(h+1)dimFq​​U=rn. Both bounds of Theorem 2.7 are stated with nnn moved to the other side: dim⁡U≤dim⁡(U∩W)+n≤dim⁡U+h\dim U\le\dim(U\cap W)+n\le\dim U+hdimU≤dim(U∩W)+n≤dimU+h. A version written with natural-number subtraction would make the lower bound vacuous whenever rn/(h+1)<nrn/(h+1)<nrn/(h+1)<n, and dropping the dimension hypothesis would make the upper bound false. Both trivialisations are ruled out.
  • Gaussian binomials are defined by the product formula (15) for real qqq and vanish for k>nk>nk>n. The qqq-identities are stated for real q>1q>1q>1, which covers every prime power. Carlitz's formula is stated for complex sequences.
  • Every fraction in an exponent is an exact quotient: rn/srn/srn/s is passed as mmm with sm=nrsm=nrsm=nr, and halves l(l−1)/2l(l-1)/2l(l−1)/2 are binomial coefficients (l2)\binom l2(2l​). Possibly negative exponents use integer powers.
  • The milestones of §5 carry the full hhh-scattered hypothesis, spanning included. The printed setting of §5.2 omits spanning, but Lemma 5.7 uses Proposition 2.1, which needs it.
  • Cited inputs stated as milestones: Lemma 5.5 ([6]), Theorem 5.2 ([15]) and Theorem 5.6 ([7]). Identity (18) is used inside proofs and is not an item.

Proofs of any milestone, of standard counting facts for subspaces of finite vector spaces, and of the qqq-series lemmas are welcome.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, Combinatorica 41 (2021). arXiv:1906.10590v2. https://arxiv.org/abs/1906.10590v2
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. 310 (2010), 3096–3107. https://doi.org/10.1016/j.disc.2009.04.007
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets, and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://doi.org/10.1007/s10623-019-00703-z
  • G. Gasper, M. Rahman, Basic Hypergeometric Series, 2nd ed., Cambridge University Press, 2004. https://doi.org/10.1017/CBO9780511526251
  • L. Carlitz, Some inverse relations, Duke Math. J. 40 (1973), 893–901. https://doi.org/10.1215/S0012-7094-73-04083-0
  • V. Napolitano, F. Zullo, Codes with few weights arising from linear sets, arXiv:2002.07241. https://arxiv.org/abs/2002.07241
  • P. J. Cameron, Notes on Counting: An Introduction to Enumerative Combinatorics, Cambridge University Press, 2017. https://doi.org/10.1017/9781108277457
18 thms1 active userReviewed
CombinatoricsComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy 4: F = Pol(Γ) for a Finite Γ iff F Is Projection-Closed, Finitizable and Contains the IdentityResearch Paper

Motivation

A constraint satisfaction problem (CSP) asks whether variables ranging over a finite domain DDD can be assigned values so that every constraint from a fixed finite list of relations is satisfied. A central organizing principle of the algebraic theory of CSPs is that the complexity of CSP(Γ)\mathrm{CSP}(\Gamma)CSP(Γ) is governed by its polymorphisms, the functions f:DL→Df : D^L \to Df:DL→D that preserve every relation of Γ\GammaΓ when applied coordinate-wise. For this principle to be usable, one needs to know which sets of functions arise as polymorphism sets. For ordinary relations this goes back to the Galois theory of clones and relations. Pippenger (Galois theory for minors of finite functions, Discrete Mathematics, 2002) characterized the families of functions that are the polymorphism sets of pairs of relations, allowing infinitely many pairs.

Promise constraint satisfaction problems (PCSPs) relax CSPs: every constraint comes as a pair P⊆QP \subseteq QP⊆Q, and the task is to distinguish instances satisfiable with the strong relations PPP from those unsatisfiable even with the weak relations QQQ. Approximate graph colouring and (2+ε)(2+\varepsilon)(2+ε)-SAT are PCSPs. Brakensiek and Guruswami (arXiv:1704.01937v2, SIAM J. Comput. 2021) develop an algebraic theory of PCSPs based on polymorphisms. In §6.2 they prove a finite version of Pippenger's characterization: the families of the form Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) for a finite family Γ\GammaΓ of promise relations are exactly the families satisfying three explicit conditions. This mission formalizes that theorem and its CSP analogue (§6.3).

Setting

Fix a finite set DDD. A family of functions F\mathcal FF over DDD consists, for every arity L≥1L \ge 1L≥1, of a set of functions DL→DD^L \to DDL→D.

A promise relation of arity kkk is a pair (P,Q)(P, Q)(P,Q) of subsets of DkD^kDk with P⊆QP \subseteq QP⊆Q. A finite family Γ={(Pi,Qi)}\Gamma = \{(P_i, Q_i)\}Γ={(Pi​,Qi​)} of promise relations is indexed by a finite set of relation symbols, each with its own arity kik_iki​. A function f:DL→Df : D^L \to Df:DL→D is a polymorphism of Γ\GammaΓ if for every iii and all x(1),…,x(L)∈Pix^{(1)}, \dots, x^{(L)} \in P_ix(1),…,x(L)∈Pi​, applying fff coordinate by coordinate gives a tuple in QiQ_iQi​:

(f(x1(1),…,x1(L)),…,f(xki(1),…,xki(L)))∈Qi.\bigl(f(x^{(1)}_1, \dots, x^{(L)}_1), \dots, f(x^{(1)}_{k_i}, \dots, x^{(L)}_{k_i})\bigr) \in Q_i.(f(x1(1)​,…,x1(L)​),…,f(xki​(1)​,…,xki​(L)​))∈Qi​.

Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) is the family of all polymorphisms of Γ\GammaΓ.

For f:DL→Df : D^L \to Df:DL→D and a map π:[L]→[R]\pi : [L] \to [R]π:[L]→[R], the projection (or minor) fπ:DR→Df^\pi : D^R \to Dfπ:DR→D is

fπ(y)=f(yπ(1),…,yπ(L)).f^\pi(y) = f(y_{\pi(1)}, \dots, y_{\pi(L)}).fπ(y)=f(yπ(1)​,…,yπ(L)​).

A family F\mathcal FF is projection-closed if fπ∈Ff^\pi \in \mathcal Ffπ∈F whenever f∈Ff \in \mathcal Ff∈F has arity LLL and π:[L]→[R]\pi : [L] \to [R]π:[L]→[R]. It is finitizable if there is a finitized arity RRR such that for every arity LLL and every f:DL→Df : D^L \to Df:DL→D,

f∈F  ⟺  fπ∈F for all π:[L]→[R].f \in \mathcal F \iff f^\pi \in \mathcal F \text{ for all } \pi : [L] \to [R].f∈F⟺fπ∈F for all π:[L]→[R].

Finally idD:D→D\mathrm{id}_D : D \to DidD​:D→D is the identity, a function of arity 111.

Formalization targets

Goal: Theorem 6.5

∃ Γ finite with F=Pol(Γ)  ⟺  F is projection-closed and finitizable, and idD∈F.\exists\, \Gamma \text{ finite with } \mathcal F = \mathrm{Pol}(\Gamma) \iff \mathcal F \text{ is projection-closed and finitizable, and } \mathrm{id}_D \in \mathcal F.∃Γ finite with F=Pol(Γ)⟺F is projection-closed and finitizable, and idD​∈F.

The finite family is existential together with its signature and arities; nothing about its shape is fixed in the statement.

Milestones

  • Lemma 6.7. If F\mathcal FF is projection-closed, finitizable and contains idD\mathrm{id}_DidD​, then F=Pol(Γ)\mathcal F = \mathrm{Pol}(\Gamma)F=Pol(Γ) for some finite Γ\GammaΓ.

Further items for the other direction

  • Claim 6.6. For every finite family Γ\GammaΓ of promise relations, Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) is projection-closed and finitizable.
  • §6.2, p. 29. Since P⊆QP \subseteq QP⊆Q for every (P,Q)∈Γ(P, Q) \in \Gamma(P,Q)∈Γ, idD∈Pol(Γ)\mathrm{id}_D \in \mathrm{Pol}(\Gamma)idD​∈Pol(Γ).

Further item: Lemma 6.8

A CSP is a finite family with P=QP = QP=Q for every pair. With F\mathcal FF a clone (for f∈Ff \in \mathcal Ff∈F of arity L1L_1L1​ and g1,…,gL1∈Fg_1, \dots, g_{L_1} \in \mathcal Fg1​,…,gL1​​∈F of arity L2L_2L2​, the function h(x(1),…,x(L1))=f(g1(x(1)),…,gL1(x(L1)))h(x^{(1)}, \dots, x^{(L_1)}) = f(g_1(x^{(1)}), \dots, g_{L_1}(x^{(L_1)}))h(x(1),…,x(L1​))=f(g1​(x(1)),…,gL1​​(x(L1​))) of arity L1L2L_1L_2L1​L2​ is in F\mathcal FF):

∃ Λ CSP with F=Pol(Λ)  ⟺  F is finitizable, a clone, and idD∈F.\exists\, \Lambda \text{ CSP with } \mathcal F = \mathrm{Pol}(\Lambda) \iff \mathcal F \text{ is finitizable, a clone, and } \mathrm{id}_D \in \mathcal F.∃Λ CSP with F=Pol(Λ)⟺F is finitizable, a clone, and idD​∈F.

Significance

Theorem 6.5 identifies the polymorphism families of finite promise templates intrinsically, without reference to relations. Together with the Galois correspondence of §6.1 (if Pol(Γ)⊆Pol(Γ′)\mathrm{Pol}(\Gamma) \subseteq \mathrm{Pol}(\Gamma')Pol(Γ)⊆Pol(Γ′) then Γ′\Gamma'Γ′ is definable from Γ\GammaΓ, so PCSP(Γ′)\mathrm{PCSP}(\Gamma')PCSP(Γ′) reduces to PCSP(Γ)\mathrm{PCSP}(\Gamma)PCSP(Γ)), it justifies studying PCSPs entirely through families of functions closed under minors, the viewpoint later systematized by the theory of minions (Barto, Bulín, Krokhin, Opršal, arXiv:1811.00970). Lemma 6.8 recovers, in the same language, the description of polymorphism clones of finite CSP templates as the finitely related clones.

The results are proved in the paper; to our knowledge none of them has a machine-checked proof. The mission produces a Lean formalization of both directions, built on the published definitions of relational structures and polymorphisms already used by other PCSP missions on the platform, and reusable definitions of projections (minors), projection-closed and finitizable families, and clones.

Difficulty

The arguments are elementary, and the difficulty lies in uniformity and finiteness. For Claim 6.6, a single arity RRR must detect every failure of the polymorphism condition for functions of every arity LLL, so RRR has to be bounded independently of LLL; an argument that handles each arity separately does not give finitizability. For Lemma 6.7, a finite family of promise relations has to be produced from F\mathcal FF alone. The general Galois connection between functions and relations produces infinitely many relations (one for each arity and each witness of non-membership), and the content of the lemma is that the three conditions allow a finite family instead. In both directions the encoding matters: functions of arity RRR must be compared with tuples of a relation, and coordinates, projections and the identity must be matched exactly, with no degenerate arity left over.

Formalization scope

A family of functions is FunFamily D := (L : ℕ) → Set ((Fin L → D) → D), with DDD a finite type with decidable equality. Coordinates are 0-based (Fin L), and fπf^\pifπ is fun y => f (y ∘ π) with π : Fin L → Fin R. A finite family of promise relations is a finite type τ of symbols with arities ar : τ → ℕ and two structures 𝔸 𝔹 : RelStruct τ ar D with 𝔸.rel R ⊆ 𝔹.rel R; polymorphisms are the published IsPolymorphism (definition PCSPBLPAff_Symmetric_Setting), and a CSP uses one structure on both sides.

All function arities are positive. The paper's "L,R∈NL, R \in \mathbb NL,R∈N" is read as positive integers: "F=Pol(Γ)\mathcal F = \mathrm{Pol}(\Gamma)F=Pol(Γ)" is compared at every arity L≥1L \ge 1L≥1, projection-closure and finitizability quantify over L,R≥1L, R \ge 1L,R≥1, and the finitized arity is at least 111. Including arity 000 would make the necessity direction false as stated (with every PiP_iPi​ empty the paper's finitized arity is 000).

The clone condition of Lemma 6.8 is the paper's displayed one (p. 30): g1,…,gL1g_1, \dots, g_{L_1}g1​,…,gL1​​ act on disjoint blocks of inputs, and the composed function has arity L1L2L_1 L_2L1​L2​.

A trivializing formalization is ruled out by the statement's shape: the finite family, its signature and its arities are all existentially quantified (fixing a single relation would turn the necessity direction into a special case), P⊆QP \subseteq QP⊆Q is part of every family (without it idD∈Pol(Γ)\mathrm{id}_D \in \mathrm{Pol}(\Gamma)idD​∈Pol(Γ) fails), and finitizability is an equivalence for every function, members and non-members alike.

The development needs only finite types and functions; no complexity theory is involved. Proofs of the milestones, and reusable lemmas about projections (composition of projections, projections along injective maps), are welcome.

Selected references

  • J. Brakensiek, V. Guruswami, Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy, SIAM J. Comput. 50(6), 2021; arXiv:1704.01937v2. https://arxiv.org/abs/1704.01937
  • N. Pippenger, Galois theory for minors of finite functions, Discrete Mathematics 254 (1–3), 2002 (cited as [48] in the paper).
  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, J. ACM 68(4), 2021; arXiv:1811.00970. https://arxiv.org/abs/1811.00970
4 thms1 active userReviewed
PreviousPage 1 of 3Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me