Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Algebra

92 missions · 41 completed

The study of algebraic structures — groups, rings, and fields — and, through algebraic geometry, the geometry of the solution sets of polynomial equations. Using commutative algebra to describe these varieties, the field provides a common language of symmetry and structure that underlies much of modern mathematics.

Missions

Open51Completed41All92
Theoretical Computer Science·Captain: mikedeng1

Fast Polynomial Factorization and Modular Composition 3: The Frobenius Lift φ and Projection π Recover f(α) from the Kronecker Substitution f*(Y) = f(Y, Y^h, …, Y^{h^{m−1}})Research Paper

Motivation

Multivariate multipoint evaluation asks for the values f(α0),…,f(αN−1)f(\alpha_0), \dots, f(\alpha_{N-1})f(α0​),…,f(αN−1​) of one polynomial f∈Fq[X0,…,Xm−1]f \in \mathbb F_q[X_0, \dots, X_{m-1}]f∈Fq​[X0​,…,Xm−1​] at NNN points of Fqm\mathbb F_q^mFqm​. Kedlaya and Umans showed that this problem is equivalent to modular composition, the computation of f(g(X)) mod h(X)f(g(X)) \bmod h(X)f(g(X))modh(X) for univariate polynomials, and that fast algorithms for it yield the fastest known algorithms for factoring univariate polynomials over finite fields (Kedlaya–Umans, Dagstuhl Seminar Proceedings 08381, 2008; journal version SIAM J. Comput. 40(6), 2011, doi:10.1137/08073408X). Modular composition is the bottleneck of the factoring algorithms of von zur Gathen and Shoup (1992) and Kaltofen and Shoup (1998), so a near-linear multipoint evaluation algorithm translates directly into a faster factoring algorithm.

The paper gives two such algorithms. Section 4 works over any ring Z/rZ\mathbb Z/r\mathbb ZZ/rZ and is not algebraic: it lifts the problem to the integers and reduces modulo many small primes. Section 6, the subject of this mission, gives an algebraic algorithm, using only ring operations, for fields of small characteristic. Its correctness rests on one identity, Lemma 6.1, which lets the evaluation of the mmm-variate fff at a point be read off from the evaluation of a single univariate polynomial f∗f^*f∗ at a related point of an extension ring.

Setting

Let ppp be a prime and Fq\mathbb F_qFq​ a finite field of characteristic ppp. Fix integers m≥0m \ge 0m≥0 and d≥1d \ge 1d≥1. Let h=pch = p^ch=pc be a power of ppp with h>m2dh > m^2 dh>m2d (the paper takes the least such power), and let P(W)∈Fp[W]P(W) \in \mathbb F_p[W]P(W)∈Fp​[W] be a polynomial of degree ccc that is irreducible over Fp\mathbb F_pFp​. Then:

  • K=Fp[W]/(P(W))K = \mathbb F_p[W]/(P(W))K=Fp​[W]/(P(W)) is a field with hhh elements. Let η\etaη be a primitive element of KKK, a generator of its multiplicative group, so η\etaη has multiplicative order h−1h-1h−1.
  • R=Fq[W]/(P(W))R = \mathbb F_q[W]/(P(W))R=Fq​[W]/(P(W)), with PPP viewed over Fq\mathbb F_qFq​. PPP need not remain irreducible over Fq\mathbb F_qFq​, so RRR is a ring containing Fq\mathbb F_qFq​ and KKK but in general not a field.
  • σ:R→R\sigma : R \to Rσ:R→R, x↦xhx \mapsto x^hx↦xh, is a power of the Frobenius endomorphism; σi\sigma^iσi is x↦xhix \mapsto x^{h^i}x↦xhi. On Fq\mathbb F_qFq​ it is an automorphism, with inverse σ−i\sigma^{-i}σ−i.
  • E(Z)=Zh−1−η∈R[Z]E(Z) = Z^{h-1} - \eta \in R[Z]E(Z)=Zh−1−η∈R[Z] and S=R[Z]/(E(Z))S = R[Z]/(E(Z))S=R[Z]/(E(Z)). Every element of SSS has a canonical representative, its remainder modulo the monic EEE, of degree less than h−1h-1h−1.

Three maps connect the problem to SSS:

  • the lift φ:Fqm→S\varphi : \mathbb F_q^m \to Sφ:Fqm​→S sends α=(α0,…,αm−1)\alpha = (\alpha_0, \dots, \alpha_{m-1})α=(α0​,…,αm−1​) to the class of the polynomial gα(Z)∈R[Z]g_\alpha(Z) \in R[Z]gα​(Z)∈R[Z] of degree at most m−1m-1m−1 with gα(ηi)=σ−i(αi)g_\alpha(\eta^i) = \sigma^{-i}(\alpha_i)gα​(ηi)=σ−i(αi​) for i=0,…,m−1i = 0, \dots, m-1i=0,…,m−1 (Eq. (6.1));
  • the projection π:S→R\pi : S \to Rπ:S→R sends an element with canonical representative g(Z)g(Z)g(Z) to g(1)g(1)g(1);
  • the Kronecker substitution sends f∈Fq[X0,…,Xm−1]f \in \mathbb F_q[X_0, \dots, X_{m-1}]f∈Fq​[X0​,…,Xm−1​] to the univariate
f∗(Y)=f(Y,Yh,Yh2,…,Yhm−1)∈S[Y].f^*(Y) = f\big(Y, Y^h, Y^{h^2}, \dots, Y^{h^{m-1}}\big) \in S[Y].f∗(Y)=f(Y,Yh,Yh2,…,Yhm−1)∈S[Y].

In the Lean development these are K, R, h, ι (the inclusion K⊆RK \subseteq RK⊆R), sigma i (=σi=\sigma^i=σi), E, S, sigmaInv i (=σ−i=\sigma^{-i}=σ−i on Fq\mathbb F_qFq​), gAlpha, phi, pi, gIter (gα(i)g_\alpha^{(i)}gα(i)​) and fStar, in the namespace KedlayaUmans.FrobeniusLift.

Formalization targets

Goal: Lemma 6.1 (p. 19)

For every f∈Fq[X0,…,Xm−1]f \in \mathbb F_q[X_0, \dots, X_{m-1}]f∈Fq​[X0​,…,Xm−1​] with degree at most d−1d-1d−1 in each variable and every α∈Fqm⊆Rm\alpha \in \mathbb F_q^m \subseteq R^mα∈Fqm​⊆Rm,

π(f∗(φ(α)))=f(α).\pi\big(f^*(\varphi(\alpha))\big) = f(\alpha).π(f∗(φ(α)))=f(α).

Milestones, in the order the proof uses them

  1. Properties of η\etaη (p. 18): η\etaη has order h−1h-1h−1 in RRR, and ηi−ηj\eta^i - \eta^jηi−ηj is a unit of RRR for i≠ji \ne ji=j in {0,…,m−1}\{0, \dots, m-1\}{0,…,m−1}.
  2. Eq. (6.1) (p. 19): σi(σ−i(a))=a\sigma^i(\sigma^{-i}(a)) = aσi(σ−i(a))=a for a∈Fqa \in \mathbb F_qa∈Fq​; deg⁡gα≤m−1\deg g_\alpha \le m-1deggα​≤m−1; gα(ηi)=σ−i(αi)g_\alpha(\eta^i) = \sigma^{-i}(\alpha_i)gα​(ηi)=σ−i(αi​).
  3. The Frobenius congruence (p. 19): η\etaη is fixed by σ\sigmaσ, and (g(Z))hi≡σi(g)(ηiZ)(modE(Z))(g(Z))^{h^i} \equiv \sigma^i(g)(\eta^i Z) \pmod{E(Z)}(g(Z))hi≡σi(g)(ηiZ)(modE(Z)) for every g∈R[Z]g \in R[Z]g∈R[Z].
  4. Eq. (6.2) (p. 19): with gα(i)=gαhi mod Eg_\alpha^{(i)} = g_\alpha^{h^i} \bmod Egα(i)​=gαhi​modE, deg⁡gα(i)=deg⁡gα\deg g_\alpha^{(i)} = \deg g_\alphadeggα(i)​=deggα​ and gα(i)(1)=αig_\alpha^{(i)}(1) = \alpha_igα(i)​(1)=αi​ for i<mi < mi<m.
  5. No reduction (pp. 19–20): the canonical representative of f∗(φ(α))f^*(\varphi(\alpha))f∗(φ(α)) is f(gα(0),…,gα(m−1)) mod Ef(g_\alpha^{(0)}, \dots, g_\alpha^{(m-1)}) \bmod Ef(gα(0)​,…,gα(m−1)​)modE, and this remainder equals f(gα(0),…,gα(m−1))f(g_\alpha^{(0)}, \dots, g_\alpha^{(m-1)})f(gα(0)​,…,gα(m−1)​) itself.

Significance

The result. Lemma 6.1 is the correctness half of Theorem 6.2: to evaluate fff at NNN points one computes the NNN lifts φ(αk)\varphi(\alpha_k)φ(αk​), evaluates the one univariate polynomial f∗f^*f∗ at all of them by fast univariate multipoint evaluation, and projects back with π\piπ. Since univariate multipoint evaluation runs in nearly linear time, the identity turns a multivariate problem into a univariate one at the cost of the degree growth deg⁡f∗≤dm hm\deg f^* \le dm\,h^mdegf∗≤dmhm. Corollary 6.3 turns this into an operation count of (dm+N)1+δ(dm+N)^{1+\delta}(dm+N)1+δ for every δ>0\delta>0δ>0, provided m≤do(1)m \le d^{o(1)}m≤do(1) and the characteristic satisfies p≤do(1)p \le d^{o(1)}p≤do(1).

Formalizing it. The lemma is proved in the paper; no machine-checked version is known to exist. This mission states it for the objects exactly as constructed in Section 6 (an explicit interpolant for φ\varphiφ, the canonical-representative projection for π\piπ) and splits its proof into the five steps above. The definitions of the rings RRR and SSS, the Frobenius powers on a ring that is not a field, and the Kronecker substitution into a quotient ring are reusable for formalizing other uses of the Frobenius-lift technique, such as the Parvaresh–Vardy codes and their Guruswami–Rudra instantiation, which the paper names as the inspiration for this algorithm (§1.5, p. 6).

Difficulty

The obvious attempt is to treat π\piπ as evaluation at Z=1Z = 1Z=1 and push it through f∗f^*f∗. This fails: E(1)=1−ηE(1) = 1 - \etaE(1)=1−η is a unit, not zero, so evaluation at 111 does not factor through S=R[Z]/(E)S = R[Z]/(E)S=R[Z]/(E), and π\piπ is not a ring homomorphism. The identity holds only because the polynomial f(gα(0),…,gα(m−1))f(g_\alpha^{(0)}, \dots, g_\alpha^{(m-1)})f(gα(0)​,…,gα(m−1)​) is already reduced modulo EEE, which requires both the degree bound h−1≥m2dh - 1 \ge m^2 dh−1≥m2d and the fact that raising to the power hih^ihi does not raise the degree of gαg_\alphagα​ modulo EEE. The second fact depends on η\etaη being fixed by σ\sigmaσ and on η(hi−1)/(h−1)=ηi\eta^{(h^i-1)/(h-1)} = \eta^iη(hi−1)/(h−1)=ηi. The equality deg⁡gα(i)=deg⁡gα\deg g_\alpha^{(i)} = \deg g_\alphadeggα(i)​=deggα​ further needs that σi\sigma^iσi does not kill the leading coefficient in RRR, a ring with possible zero divisors. Finally, interpolation must happen in RRR, not a field, which is possible only because the nodes ηi\eta^iηi lie in the subfield KKK.

Formalization scope

  • Fq\mathbb F_qFq​ is a type F with [Field F] [Fintype F] [CharP F p], ppp a prime ([Fact p.Prime]). PPP is a polynomial over ZMod p with [Fact (Irreducible P)]; ccc is P.natDegree and hhh is p ^ P.natDegree. RRR is AdjoinRoot of PPP mapped to F; RRR is never assumed to be a field and PPP is never assumed irreducible over F.
  • The paper's hhh is the least power of ppp above m2dm^2 dm2d; the statements assume only m ^ 2 * d < h, which contains the paper's case. d≥1d \ge 1d≥1 is a hypothesis.
  • "Primitive element" is IsPrimitiveRoot η (h - 1), equivalent to generating K×K^\timesK× since ∣K∣=h|K| = h∣K∣=h.
  • "Individual degrees d−1d-1d−1" means at most d−1d-1d−1: ∀ i, f.degreeOf i ≤ d - 1.
  • Variables and points are indexed by Fin m, starting at 000; f∗f^*f∗ substitutes YhiY^{h^i}Yhi for XiX_iXi​.
  • gαg_\alphagα​ is the explicit Lagrange interpolant: Mathlib's Lagrange.basis over the field KKK at the nodes η0,…,ηm−1\eta^0, \dots, \eta^{m-1}η0,…,ηm−1, mapped into R[Z]R[Z]R[Z], with coefficients σ−i(αi)\sigma^{-i}(\alpha_i)σ−i(αi​). π\piπ is the remainder modulo EEE (AdjoinRoot.modByMonicHom) evaluated at 111.
  • Only correctness is formalized. The operation counts of Theorem 6.2 and Corollary 6.3, and the cost of finding PPP and η\etaη, are out of scope.

A formalization that takes φ(α)\varphi(\alpha)φ(α) to be any element satisfying (6.2), or defines π\piπ as a ring homomorphism, would make the goal trivial or false; both are ruled out because φ\varphiφ and π\piπ are explicit definitions with no hypotheses attached, and (6.1) and (6.2) are milestones to be proved.

Infrastructure a full proof needs: the Frobenius on polynomial rings in characteristic ppp (gp=σ(g)(Zp)g^{p} = \sigma(g)(Z^{p})gp=σ(g)(Zp), cf. Mathlib's expand and map_frobenius_expand), Lagrange interpolation transported along a ring homomorphism from a field, degree bounds for MvPolynomial.eval₂, and reducedness of RRR (from separability of PPP over the perfect field Fp\mathbb F_pFp​). Proofs of any milestone, and alternative arguments, are welcome.

Selected references

  • K. S. Kedlaya, C. Umans, Fast polynomial factorization and modular composition, Dagstuhl Seminar Proceedings 08381, version of Aug. 31, 2008. http://drops.dagstuhl.de/opus/volltexte/2008/1777
  • K. S. Kedlaya, C. Umans, Fast polynomial factorization and modular composition, SIAM J. Comput. 40(6), 2011. https://doi.org/10.1137/08073408X
  • F. Parvaresh, A. Vardy, Correcting errors beyond the Guruswami–Sudan radius in polynomial time, FOCS 2005, pp. 285–294. https://doi.org/10.1109/SFCS.2005.29
  • V. Guruswami, A. Rudra, Explicit capacity-achieving list-decodable codes, STOC 2006, pp. 1–10. https://doi.org/10.1145/1132516.1132518
8 thms1 active userReviewed
Number TheoryTheoretical Computer Science·Captain: mikedeng1

Fast Polynomial Factorization and Modular Composition 2: Multimodular Reduction with Primes up to 16 log N and Kronecker Lifting Correctly Evaluate Multivariate Polynomials over (ℤ/rℤ)[Z]/(E(Z))Research Paper

Motivation

Multivariate multipoint evaluation asks for the values f(α0),…,f(αN−1)f(\alpha_0),\dots,f(\alpha_{N-1})f(α0​),…,f(αN−1​) of a polynomial f(X0,…,Xm−1)f(X_0,\dots,X_{m-1})f(X0​,…,Xm−1​) over a ring RRR, with individual degrees at most d−1d-1d−1, at NNN given points of RmR^mRm. Kedlaya and Umans showed that, over finite fields and rings (Z/rZ)[Z]/(E(Z))(\mathbb Z/r\mathbb Z)[Z]/(E(Z))(Z/rZ)[Z]/(E(Z)), this problem can be solved in time nearly linear in the input size dm+mNd^m + mNdm+mN, for m≤do(1)m \le d^{o(1)}m≤do(1) (Kedlaya–Umans 2008, §4). Through their reduction of modular composition, the computation of f(g(X)) mod h(X)f(g(X)) \bmod h(X)f(g(X))modh(X), to multipoint evaluation (§3 of the same paper), this gives the first nearly-linear-time algorithm for modular composition over finite fields. That in turn gives the fastest known algorithms for factoring univariate polynomials over Fq\mathbb F_qFq​, with O(n1.5+o(1)log⁡1+o(1)q+n1+o(1)log⁡2+o(1)q)O(n^{1.5+o(1)}\log^{1+o(1)} q + n^{1+o(1)}\log^{2+o(1)} q)O(n1.5+o(1)log1+o(1)q+n1+o(1)log2+o(1)q) bit operations for a randomized algorithm on degree-nnn polynomials (abstract and §8).

Timeline. Brent and Kung (1978) gave the O(n(ω+1)/2)O(n^{(\omega+1)/2})O(n(ω+1)/2) baby-step/giant-step algorithm for modular composition (J. ACM 25). Huang and Pan (1997) improved the exponent using fast rectangular matrix multiplication. Kaltofen and Shoup (1998) introduced the factoring framework that the factoring application builds on (Math. Comp. 67). Kedlaya and Umans (2008, SIAM J. Comput. 2011) gave the multimodular algorithm formalized here, together with an algebraic algorithm for small characteristic.

Setting

Let r≥1r \ge 1r≥1 and write Z/rZ\mathbb Z/r\mathbb ZZ/rZ for the integers modulo rrr. Every element of Z/rZ\mathbb Z/r\mathbb ZZ/rZ has a lift, its representative in {0,…,r−1}\{0,\dots,r-1\}{0,…,r−1}. For f∈(Z/rZ)[X0,…,Xm−1]f \in (\mathbb Z/r\mathbb Z)[X_0,\dots,X_{m-1}]f∈(Z/rZ)[X0​,…,Xm−1​], f~∈Z[X0,…,Xm−1]\tilde f \in \mathbb Z[X_0,\dots,X_{m-1}]f~​∈Z[X0​,…,Xm−1​] replaces each coefficient by its lift; α~∈Zm\tilde\alpha \in \mathbb Z^mα~∈Zm lifts a point coordinatewise.

Algorithm MULTIMODULAR with degree parameter ddd and t≥1t \ge 1t≥1 rounds takes fff (degree at most d−1d-1d−1 in each variable) and a point α\alphaα. It lists the primes p1,…,pkp_1,\dots,p_kp1​,…,pk​ at most ℓ=16log⁡(dm(r−1)md)\ell = 16\log(d^m(r-1)^{md})ℓ=16log(dm(r−1)md), reduces f~\tilde ff~​ and α~\tilde\alphaα~ modulo each php_hph​, and evaluates the reductions fh(αh)∈Fphf_h(\alpha_h) \in \mathbb F_{p_h}fh​(αh​)∈Fph​​. It does this directly when t=1t = 1t=1, and by recursion with t−1t-1t−1 rounds otherwise. It then returns, reduced modulo rrr, the unique integer in {0,…,p1⋯pk−1}\{0,\dots,p_1\cdots p_k - 1\}{0,…,p1​⋯pk​−1} congruent to fh(αh)f_h(\alpha_h)fh​(αh​) modulo every php_hph​.

Let E(Z)∈(Z/rZ)[Z]E(Z) \in (\mathbb Z/r\mathbb Z)[Z]E(Z)∈(Z/rZ)[Z] be monic of degree eee and R=(Z/rZ)[Z]/(E(Z))R = (\mathbb Z/r\mathbb Z)[Z]/(E(Z))R=(Z/rZ)[Z]/(E(Z)). The lift of x∈Rx \in Rx∈R is its representative of degree at most e−1e-1e−1, with coefficients lifted to {0,…,r−1}\{0,\dots,r-1\}{0,…,r−1}, an element of Z[Z]\mathbb Z[Z]Z[Z]. Put

M=dm(e(r−1))(d−1)m+1+1,r′=M(e−1)dm+1.M = d^m\bigl(e(r-1)\bigr)^{(d-1)m+1} + 1,\qquad r' = M^{(e-1)dm+1}.M=dm(e(r−1))(d−1)m+1+1,r′=M(e−1)dm+1.

Algorithm MULTIMODULAR-FOR-EXTENSION-RING runs in four steps.

  1. Lift f∈R[X0,…,Xm−1]f \in R[X_0,\dots,X_{m-1}]f∈R[X0​,…,Xm−1​] and α∈Rm\alpha \in R^mα∈Rm to Z[Z]\mathbb Z[Z]Z[Z].
  2. Substitute Z=MZ = MZ=M and reduce modulo r′r'r′.
  3. Run MULTIMODULAR over Z/r′Z\mathbb Z/r'\mathbb ZZ/r′Z, obtaining β\betaβ.
  4. Form the polynomial Q(Z)Q(Z)Q(Z) whose coefficients are the base-MMM digits of β\betaβ, and return QQQ reduced modulo rrr and E(Z)E(Z)E(Z).

Formalization targets

Goal: Theorem 4.4 (correctness)

For EEE monic of degree e≥1e \ge 1e≥1, m≥1m \ge 1m≥1, d≥2d \ge 2d≥2, t≥1t \ge 1t≥1, every f∈R[X0,…,Xm−1]f \in R[X_0,\dots,X_{m-1}]f∈R[X0​,…,Xm−1​] of degree at most d−1d-1d−1 in each variable, and every α∈Rm\alpha \in R^mα∈Rm:

MULTIMODULAR-FOR-EXTENSION-RINGd(f,α,t)=f(α).\mathrm{MULTIMODULAR\text{-}FOR\text{-}EXTENSION\text{-}RING}_d(f,\alpha,t) = f(\alpha).MULTIMODULAR-FOR-EXTENSION-RINGd​(f,α,t)=f(α).

Milestones

In the order the paper's proofs use them:

  1. Lemma 2.4. For every integer N≥2N \ge 2N≥2, ∏p≤16log⁡Np>N\displaystyle\prod_{p \le 16\log N} p > Np≤16logN∏​p>N.
  2. Magnitude bound (proof of Theorem 4.2). 0≤f~(α~)≤dm(r−1)md<p1⋯pk0 \le \tilde f(\tilde\alpha) \le d^m(r-1)^{md} < p_1\cdots p_k0≤f~​(α~)≤dm(r−1)md<p1​⋯pk​.
  3. Theorem 4.2 (correctness). MULTIMODULARd(f,α,r,t)=f(α)\mathrm{MULTIMODULAR}_d(f,\alpha,r,t) = f(\alpha)MULTIMODULARd​(f,α,r,t)=f(α) over Z/rZ\mathbb Z/r\mathbb ZZ/rZ.
  4. Coefficient bound (proof of Theorem 4.4). f~(α~)∈Z[Z]\tilde f(\tilde\alpha) \in \mathbb Z[Z]f~​(α~)∈Z[Z] has degree at most (e−1)dm(e-1)dm(e−1)dm and coefficients in {0,…,M−1}\{0,\dots,M-1\}{0,…,M−1}.
  5. Coincidence (proof of Theorem 4.4). The digit polynomial QQQ of fˉ(αˉ)\bar f(\bar\alpha)fˉ​(αˉ) equals f~(α~)\tilde f(\tilde\alpha)f~​(α~), and the reduction of f~(α~)\tilde f(\tilde\alpha)f~​(α~) modulo rrr and E(Z)E(Z)E(Z) is f(α)f(\alpha)f(α).

Significance

The result makes multivariate multipoint evaluation exact and fast over every finite ring of the form (Z/rZ)[Z]/(E(Z))(\mathbb Z/r\mathbb Z)[Z]/(E(Z))(Z/rZ)[Z]/(E(Z)), which includes every finite field Fq\mathbb F_qFq​. Combined with the paper's reduction from modular composition (Theorem 3.1) it yields modular composition of degree-nnn polynomials over Fq\mathbb F_qFq​ in n1+o(1)log⁡1+o(1)qn^{1+o(1)}\log^{1+o(1)} qn1+o(1)log1+o(1)q bit operations (§7). That is the step on which the paper's improvements to univariate polynomial factorization, irreducibility testing and minimal-polynomial computation rest (§§7–8). The same algorithm gives a data structure answering polynomial-evaluation queries in time polylogarithmic in the degree (§5).

The theorem is proved in the paper; nothing in it is open. As far as is known, no part of it has been machine-checked. This mission formalizes the correctness of both algorithms exactly as the paper defines them, step for step, including the Chinese-remainder recombination, the explicit prime threshold 16log⁡N16\log N16logN, and the base-MMM digit recovery. Lemma 2.4 is an explicit Chebyshev-type lower bound on the primorial, valid for all N≥2N \ge 2N≥2, and is reusable independently of this mission.

Difficulty

The recursion itself is routine. Two points carry the content. The first is the explicit prime threshold: the algorithm uses only primes up to 16log⁡N16\log N16logN, so its correctness depends on the explicit inequality of Lemma 2.4 for every N≥2N \ge 2N≥2, not on an asymptotic prime-number estimate. The small cases are part of the claim. The second is the extension-ring step: the integer β\betaβ produced over Z/r′Z\mathbb Z/r'\mathbb ZZ/r′Z must determine the polynomial f~(α~)∈Z[Z]\tilde f(\tilde\alpha) \in \mathbb Z[Z]f~​(α~)∈Z[Z] exactly. That needs simultaneous control of its degree and of every coefficient, against the specific constants MMM and r′r'r′. A bound on f~(α~)\tilde f(\tilde\alpha)f~​(α~) evaluated at a point does not by itself suffice.

Formalization scope

Lean represents Z/rZ\mathbb Z/r\mathbb ZZ/rZ as ZMod r with r≥1r \ge 1r≥1 (NeZero r, excluding ZMod 0 = ℤ), polynomials as MvPolynomial (Fin m) _ with variables indexed 0,…,m−10,\dots,m-10,…,m−1, and RRR as AdjoinRoot E for a monic E with 1≤1 \le1≤ E.natDegree. "Degree at most d−1d-1d−1 in each variable" is ∀ i, f.degreeOf i ≤ d - 1. log⁡\loglog is the natural logarithm; the paper does not fix a base, and the natural log is the strongest reading of Lemma 2.4. The primes p≤xp \le xp≤x for real xxx are the primes p≤⌊x⌋p \le \lfloor x\rfloorp≤⌊x⌋. Each algorithm is defined for a single evaluation point, since the paper processes the NNN points independently. The leaf t=1t = 1t=1 evaluates fhf_hfh​ at αh\alpha_hαh​ directly; that value is what Theorem 4.1's FFT algorithm outputs. r′r'r′ is M(e−1)dm+1M^{(e-1)dm+1}M(e−1)dm+1 as printed on p. 15; p. 16 prints M(e−1)(d−1)m+1M^{(e-1)(d-1)m+1}M(e−1)(d−1)m+1.

The hypotheses d≥2d \ge 2d≥2 and m≥1m \ge 1m≥1 are not written in the paper but are needed. For r=2r = 2r=2, d=1d = 1d=1, f=1f = 1f=1 the threshold ℓ\ellℓ is 000, no prime is used, and MULTIMODULAR returns 000. For m=0m = 0m=0 the inequality dm(r−1)(d−1)m+1≤dm(r−1)mdd^m(r-1)^{(d-1)m+1} \le d^m(r-1)^{md}dm(r−1)(d−1)m+1≤dm(r−1)md and the degree bound (e−1)dm(e-1)dm(e−1)dm both fail.

Only correctness is formalized. Every running-time bound in Theorems 4.1, 4.2, 4.4 and Corollaries 4.3, 4.5 is out of scope. The Chinese-remainder step and the digit step are defined from the residues and from β\betaβ alone: an algorithm that evaluates f~(α~)\tilde f(\tilde\alpha)f~​(α~) in Z\mathbb ZZ and reduces it, or that computes f(α)f(\alpha)f(α) in RRR directly, would make the theorems trivial and is not the algorithm stated here.

Needed infrastructure: explicit primorial lower bounds (Mathlib has primorial and Chebyshev's θ\thetaθ), the Chinese remainder theorem for several moduli (ZMod.prodEquivPi), bounds on evaluations of polynomials with nonnegative coefficients, and uniqueness of base-MMM representations of polynomials. Lemma 2.4 and the base-MMM uniqueness are reusable beyond this mission. Proofs of any milestone are welcome, as are alternative proofs of Lemma 2.4.

Selected references

  • K. S. Kedlaya, C. Umans, Fast polynomial factorization and modular composition, Dagstuhl Seminar Proceedings 08381 (version of Aug. 31, 2008). http://drops.dagstuhl.de/opus/volltexte/2008/1777 — published in SIAM J. Comput. 40(6), 2011, https://doi.org/10.1137/08073408X.
  • R. P. Brent, H. T. Kung, Fast algorithms for manipulating formal power series, J. ACM 25(4), 1978. https://doi.org/10.1145/322092.322099
  • E. Kaltofen, V. Shoup, Subquadratic-time factoring of polynomials over finite fields, Math. Comp. 67, 1998. https://doi.org/10.1090/S0025-5718-98-00944-2
  • J. von zur Gathen, J. Gerhard, Modern Computer Algebra, Cambridge University Press, 1999. https://doi.org/10.1017/CBO9781139856065
8 thms1 active userReviewed
Theoretical Computer Science·Captain: mikedeng1

Fast Polynomial Factorization and Modular Composition 1: The Inverse Kronecker Map ψ Reduces Modular Composition f(g₀, …, g_{m−1}) mod h to One Multivariate Multipoint EvaluationResearch Paper

Motivation

Modular composition asks, given univariate polynomials f,g,hf, g, hf,g,h over a ring, for f(g(X)) mod h(X)f(g(X)) \bmod h(X)f(g(X))modh(X). It is the bottleneck step in the classical algorithms for factoring univariate polynomials over finite fields (Cantor–Zassenhaus, von zur Gathen–Shoup, Kaltofen–Shoup), for irreducibility testing and for computing minimal polynomials. Brent and Kung (1978) gave an algorithm using O(n(ω+1)/2)O(n^{(\omega+1)/2})O(n(ω+1)/2) operations for degree nnn, and for three decades no algorithm with a near-linear operation count was known in general.

Kedlaya and Umans (Dagstuhl Seminar Proceedings 08381, 2008; journal version SIAM J. Comput. 40(6), 2011, doi:10.1137/08073408X) obtained near-linear modular composition over finite fields, and with it asymptotically faster algorithms for factoring polynomials over finite fields. Their route has two halves: a reduction of modular composition to multivariate multipoint evaluation (Section 3), and new fast algorithms for the latter (Sections 4 and 6). This mission formalizes the correctness of the first half, Theorem 3.1. The paper notes that Shoup and Smolensky used essentially the same transformation in an unpublished 1992 manuscript.

Setting

Throughout, RRR is an arbitrary commutative ring. Variables are indexed from 000.

MULTIVARIATE MULTIPOINT EVALUATION (Problem 2.1): given f∈R[X0,…,Xm−1]f \in R[X_0, \dots, X_{m-1}]f∈R[X0​,…,Xm−1​] with individual degrees at most d−1d-1d−1 and points α0,…,αN−1∈Rm\alpha_0, \dots, \alpha_{N-1} \in R^mα0​,…,αN−1​∈Rm, output f(α0),…,f(αN−1)f(\alpha_0), \dots, f(\alpha_{N-1})f(α0​),…,f(αN−1​).

MODULAR COMPOSITION (Problem 2.2): given f∈R[X0,…,Xm−1]f \in R[X_0, \dots, X_{m-1}]f∈R[X0​,…,Xm−1​] with individual degrees at most d−1d-1d−1, and g0,…,gm−1,h∈R[X]g_0, \dots, g_{m-1}, h \in R[X]g0​,…,gm−1​,h∈R[X] of degree at most N−1N-1N−1 with the leading coefficient of hhh a unit, output f(g0(X),…,gm−1(X)) mod h(X)f(g_0(X), \dots, g_{m-1}(X)) \bmod h(X)f(g0​(X),…,gm−1​(X))modh(X), the unique rrr with deg⁡r<deg⁡h\deg r < \deg hdegr<degh and h∣f(g0,…,gm−1)−rh \mid f(g_0, \dots, g_{m-1}) - rh∣f(g0​,…,gm−1​)−r.

The inverse Kronecker map (Definition 2.3) ψh,ℓ:R[X0,…,Xm−1]→R[Y0,0,…,Ym−1,ℓ−1]\psi_{h,\ell} : R[X_0, \dots, X_{m-1}] \to R[Y_{0,0}, \dots, Y_{m-1,\ell-1}]ψh,ℓ​:R[X0​,…,Xm−1​]→R[Y0,0​,…,Ym−1,ℓ−1​] is the RRR-linear map that sends the monomial ∏iXiei\prod_i X_i^{e_i}∏i​Xiei​​ to ∏i∏j<ℓYi,jai,j\prod_i \prod_{j<\ell} Y_{i,j}^{a_{i,j}}∏i​∏j<ℓ​Yi,jai,j​​, where ei=∑j≥0ai,jhje_i = \sum_{j \ge 0} a_{i,j} h^jei​=∑j≥0​ai,j​hj is the base-hhh expansion. It trades individual degree for number of variables: every individual degree of ψh,ℓ(f)\psi_{h,\ell}(f)ψh,ℓ​(f) is below hhh.

The algorithm of Theorem 3.1 takes 2≤d0<d2 \le d_0 < d2≤d0​<d, sets ℓ=⌈log⁡d0d⌉\ell = \lceil \log_{d_0} d \rceilℓ=⌈logd0​​d⌉ and N′=Nmℓd0N' = N m \ell d_0N′=Nmℓd0​, receives points β0,…,βN′−1∈R\beta_0, \dots, \beta_{N'-1} \in Rβ0​,…,βN′−1​∈R whose differences are units, and

  1. computes f′=ψd0,ℓ(f)f' = \psi_{d_0,\ell}(f)f′=ψd0​,ℓ​(f);
  2. computes gi,j=gid0 j mod hg_{i,j} = g_i^{d_0^{\,j}} \bmod hgi,j​=gid0j​​modh for all iii and j<ℓj < \ellj<ℓ;
  3. computes αi,j,k=gi,j(βk)\alpha_{i,j,k} = g_{i,j}(\beta_k)αi,j,k​=gi,j​(βk​);
  4. computes f′(α0,0,k,…,αm−1,ℓ−1,k)f'(\alpha_{0,0,k}, \dots, \alpha_{m-1,\ell-1,k})f′(α0,0,k​,…,αm−1,ℓ−1,k​) for k<N′k < N'k<N′ (one multivariate multipoint evaluation);
  5. interpolates these N′N'N′ values at the nodes βk\beta_kβk​;
  6. outputs the result modulo hhh.

Formalization targets

Goal: Theorem 3.1, correctness

algorithm(d0,d,f,g,h,β)  =  f(g0(X),…,gm−1(X)) mod h(X),\mathrm{algorithm}(d_0, d, f, g, h, \beta) \;=\; f\bigl(g_0(X), \dots, g_{m-1}(X)\bigr) \bmod h(X),algorithm(d0​,d,f,g,h,β)=f(g0​(X),…,gm−1​(X))modh(X),

for all m,N≥1m, N \ge 1m,N≥1, 2≤d0<d2 \le d_0 < d2≤d0​<d, fff with individual degrees ≤d−1\le d-1≤d−1, gi,hg_i, hgi​,h of degree ≤N−1\le N-1≤N−1 with lc(h)\mathrm{lc}(h)lc(h) a unit, and β0,…,βN′−1\beta_0, \dots, \beta_{N'-1}β0​,…,βN′−1​ distinct with unit differences. The right-hand side is stated through the characterization of the remainder (divisibility by hhh and degree below deg⁡h\deg hdegh).

Milestones (in the order the proof uses them)

  • Definition 2.3, remark: if every individual degree of fff is at most hℓ−1h^\ell - 1hℓ−1, then ψh,ℓ(f)(X0h0,…,Xm−1hℓ−1)=f\psi_{h,\ell}(f)\bigl(X_0^{h^0}, \dots, X_{m-1}^{h^{\ell-1}}\bigr) = fψh,ℓ​(f)(X0h0​,…,Xm−1hℓ−1​)=f.
  • Definition 2.3, remark: ψh,ℓ\psi_{h,\ell}ψh,ℓ​ is injective on such polynomials (not used by the goal).
  • Proof of Theorem 3.1: f′(g0,0,…,gm−1,ℓ−1)≡f(g0,…,gm−1)(modh)f'(g_{0,0}, \dots, g_{m-1,\ell-1}) \equiv f(g_0, \dots, g_{m-1}) \pmod{h}f′(g0,0​,…,gm−1,ℓ−1​)≡f(g0​,…,gm−1​)(modh).
  • Proof of Theorem 3.1, Step 5: deg⁡f′(g0,0(X),…,gm−1,ℓ−1(X))<N′\deg f'(g_{0,0}(X), \dots, g_{m-1,\ell-1}(X)) < N'degf′(g0,0​(X),…,gm−1,ℓ−1​(X))<N′.

A supporting theorem states that the interpolation formula over a commutative ring (Figure 1) recovers every polynomial of degree <n< n<n from its values at nnn nodes with unit differences.

Significance

Theorem 3.1 says that modular composition is no harder than one multivariate multipoint evaluation with mℓm\ellmℓ variables, individual degrees below d0d_0d0​, and N′N'N′ points, up to quasi-linear univariate work. Combined with the paper's fast multipoint evaluation algorithms this gives modular composition over Fq\mathbb F_qFq​ in n1+o(1)log⁡1+o(1)qn^{1+o(1)}\log^{1+o(1)} qn1+o(1)log1+o(1)q bit operations, and from there the paper's improved bounds for polynomial factorization, irreducibility testing, minimal polynomials and modular power projection (Sections 7–8). The converse reduction (Theorem 3.3) shows the two problems are essentially equivalent.

The paper's proof of correctness is a short paragraph; the operation counts are the paper's main concern. This mission makes the correctness exact: the algorithm is defined step for step, and its output is proved equal to the specification. As far as the platform's corpus shows, neither the inverse Kronecker map nor this reduction has a machine-checked statement; the running-time half is not part of this mission.

Difficulty

The obvious argument substitutes gid0jg_i^{d_0^j}gid0j​​ for Yi,jY_{i,j}Yi,j​ and invokes the inverse Kronecker identity. Two points keep this from being immediate. First, ψh,ℓ\psi_{h,\ell}ψh,ℓ​ is linear but not multiplicative, and it discards base-hhh digits beyond position ℓ−1\ell-1ℓ−1; the identity holds only for individual degrees at most hℓ−1h^\ell - 1hℓ−1, which here requires d≤d0⌈log⁡d0d⌉d \le d_0^{\lceil \log_{d_0} d\rceil}d≤d0⌈logd0​​d⌉​. Second, the algorithm never sees f′(g0,0,… )f'(g_{0,0}, \dots)f′(g0,0​,…) itself, only its values at N′N'N′ points: interpolation recovers it only if its degree is below N′N'N′, which is why Step 2 reduces modulo hhh before substituting, and interpolation over a ring (not a field) needs the unit-difference hypothesis throughout. Mathlib's Lagrange interpolation is stated over fields, so the ring version must be handled directly.

Formalization scope

  • RRR is any commutative ring (CommRing R); there is no field or nontriviality assumption.
  • Variables are Fin m; the new variables Yi,jY_{i,j}Yi,j​ are Fin m × Fin ℓ; points are Fin N'.
  • Individual degrees are MvPolynomial.degreeOf; "degree at most N−1N-1N−1" is natDegree ≤ N - 1.
  • ℓ\ellℓ is Nat.clog d₀ d and N′=Nmℓd0N' = N m \ell d_0N′=Nmℓd0​; ℓ\ellℓ is not a free parameter.
  • "mod hhh" for hhh with unit leading coefficient is the remainder on division by the monic associate h⋅lc(h)−1h \cdot \mathrm{lc}(h)^{-1}h⋅lc(h)−1; interpolation is the Lagrange formula with Ring.inverse of the node differences.
  • Step 4 is MvPolynomial.eval, which is exactly the output of Problem 2.1.
  • Added hypotheses: m≥1m \ge 1m≥1 and N≥1N \ge 1N≥1 (the paper does not consider m=0m = 0m=0, where N′=0N' = 0N′=0, or N=0N = 0N=0, where "degree at most N−1N - 1N−1" would collapse in natural-number arithmetic).
  • In the goal, "deg⁡r<deg⁡h\deg r < \deg hdegr<degh" is weakened to "deg⁡r<deg⁡h\deg r < \deg hdegr<degh or r=0r = 0r=0" only to cover the zero ring; in any nontrivial ring the two agree.
  • Only correctness is formalized. Operation counts, the O(⋅)O(\cdot)O(⋅) and polylog⁡\mathrm{poly}\logpolylog bounds, and the count of invocations are out of scope.

Step 5 is the interpolation formula applied to the N′N'N′ computed values and nodes alone; it is not defined as the polynomial f′(g0,0,…,gm−1,ℓ−1)f'(g_{0,0}, \dots, g_{m-1,\ell-1})f′(g0,0​,…,gm−1,ℓ−1​), and the goal is the six-step output, not the congruence alone, so the statement cannot be closed by unfolding definitions.

Useful infrastructure, reusable beyond this mission: base-hhh digit manipulation of exponent vectors, Lagrange interpolation over commutative rings with unit node differences, and remainders modulo polynomials with unit leading coefficient. Proofs of any milestone, and of the supporting interpolation theorem, are welcome independently.

Selected references

  • K. S. Kedlaya, C. Umans, Fast polynomial factorization and modular composition, Dagstuhl Seminar Proceedings 08381, 2008. http://drops.dagstuhl.de/opus/volltexte/2008/1777
  • K. S. Kedlaya, C. Umans, Fast polynomial factorization and modular composition, SIAM J. Comput. 40(6):1767–1802, 2011. https://doi.org/10.1137/08073408X
  • R. P. Brent, H. T. Kung, Fast algorithms for manipulating formal power series, J. ACM 25(4):581–595, 1978. https://doi.org/10.1145/322092.322099
  • J. von zur Gathen, J. Gerhard, Modern Computer Algebra, Cambridge University Press, 1999. https://doi.org/10.1017/CBO9781139856065
8 thms1 active userReviewed
CombinatoricsDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 5: For h ≥ 2, Two h-Scattered Linear Sets Are PΓL(r, qⁿ)-Equivalent iff Their Subspaces Are ΓL(r, qⁿ)-EquivalentResearch Paper

Motivation

Linear sets are point sets of a finite projective space defined by a subspace over a subfield. They appear throughout finite geometry, for instance in the study of semifields and, through the correspondence studied by Sheekey and Van de Voorde (arXiv:1806.05929), maximum rank distance (MRD) codes; see Polverino's survey (doi:10.1016/j.disc.2009.04.007). In these applications one needs to decide when two linear sets are the same up to a collineation, which can be difficult (Csajbók–Zanella, arXiv:1501.03441; Csajbók–Marino–Polverino, arXiv:1607.06962). The natural candidate answer, "when their defining subspaces are in the same orbit of the semilinear group", is only a sufficient condition: on the projective line PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn) there are maximum scattered subspaces in different ΓL(2,qn)\Gamma\mathrm L(2,q^n)ΓL(2,qn)-orbits defining equivalent linear sets (the two papers just cited).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590, Combinatorica 41 (2021)) introduced hhh-scattered subspaces, a generalisation of scattered subspaces, and showed in their §4 that for h≥2h \ge 2h≥2 the sufficient condition is also necessary. This mission formalizes that result, Theorem 4.5.

Setting

Let Fq⊆Fqn\mathbb F_q \subseteq \mathbb F_{q^n}Fq​⊆Fqn​ be finite fields and let VVV be an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​; it is also a vector space over Fq\mathbb F_qFq​. The projective space PG(V,Fqn)=PG(r−1,qn)\mathrm{PG}(V,\mathbb F_{q^n}) = \mathrm{PG}(r-1,q^n)PG(V,Fqn​)=PG(r−1,qn) has as points the one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces ⟨u⟩Fqn\langle u\rangle_{\mathbb F_{q^n}}⟨u⟩Fqn​​, u≠0u \ne 0u=0.

For an Fq\mathbb F_qFq​-subspace UUU of VVV, the Fq\mathbb F_qFq​-linear set of UUU is

LU={⟨u⟩Fqn:u∈U∖{0}},L_U = \{\langle u\rangle_{\mathbb F_{q^n}} : u \in U\setminus\{0\}\},LU​={⟨u⟩Fqn​​:u∈U∖{0}},

of rank dim⁡FqU\dim_{\mathbb F_q} UdimFq​​U.

For 0<h≤r−10 < h \le r-10<h≤r−1, the subspace UUU is hhh-scattered (Definition 1.1) if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U) \le hdimFq​​(S∩U)≤h. The linear set LUL_ULU​ of an hhh-scattered UUU is called hhh-scattered (Definition 4.1); for h=2h = 2h=2 it is scattered with respect to lines.

The group ΓL(r,qn)\Gamma\mathrm L(r,q^n)ΓL(r,qn) consists of the bijective additive maps fff of VVV that are semilinear: f(av)=aσf(v)f(av) = a^\sigma f(v)f(av)=aσf(v) for some field automorphism σ\sigmaσ of Fqn\mathbb F_{q^n}Fqn​. Each fff induces a collineation φf\varphi_fφf​ of PG(V,Fqn)\mathrm{PG}(V,\mathbb F_{q^n})PG(V,Fqn​), ⟨u⟩↦⟨f(u)⟩\langle u\rangle \mapsto \langle f(u)\rangle⟨u⟩↦⟨f(u)⟩, and these collineations form PΓL(r,qn)\mathrm P\Gamma\mathrm L(r,q^n)PΓL(r,qn). Two linear sets are PΓL\mathrm P\Gamma\mathrm LPΓL-equivalent if φf(LU)=LW\varphi_f(L_U) = L_Wφf​(LU​)=LW​ for some fff; two subspaces are ΓL\Gamma\mathrm LΓL-equivalent if f(U)=Wf(U) = Wf(U)=W for some fff.

Formalization targets

Goal: Theorem 4.5 (p. 14)

For h≥2h \ge 2h≥2 and hhh-scattered Fq\mathbb F_qFq​-subspaces UUU, WWW of V(r,qn)V(r,q^n)V(r,qn),

LU∼PΓL(r,qn)LW  ⟺  U∼ΓL(r,qn)W.L_U \sim_{\mathrm P\Gamma\mathrm L(r,q^n)} L_W \iff U \sim_{\Gamma\mathrm L(r,q^n)} W .LU​∼PΓL(r,qn)​LW​⟺U∼ΓL(r,qn)​W.

Milestones (in the order of the proof)

  1. Proposition 2.1 (p. 3): an hhh-scattered subspace is iii-scattered for every 0<i<h0 < i < h0<i<h.
  2. Proposition 4.2 (p. 13, quoted from Bonoli–Polverino [5]): on a projective line PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn), (1) a linear set with q+1q+1q+1 points has rank 222; (2) two subspaces defining the same linear set of size q+1q+1q+1 and sharing a nonzero vector coincide.
  3. Proposition 4.3 (p. 13): if UUU is 222-scattered and LW=LUL_W = L_ULW​=LU​, then dim⁡FqW=dim⁡FqU\dim_{\mathbb F_q} W = \dim_{\mathbb F_q} UdimFq​​W=dimFq​​U.
  4. Lemma 4.4 (p. 13): if UUU is 222-scattered and LU=LWL_U = L_WLU​=LW​, then U=λWU = \lambda WU=λW for some λ∈Fqn∗\lambda\in\mathbb F_{q^n}^*λ∈Fqn∗​.

Significance

The result. Theorem 4.5 says that, for h≥2h\ge2h≥2, an hhh-scattered linear set remembers its defining subspace up to a scalar and up to the semilinear group. The equivalence problem for such linear sets, a geometric question about point sets, becomes the equivalence problem for subspaces, which is algebraic and can be attacked with linearized polynomials. Through the correspondence of Sheekey and Van de Voorde between maximum (r−1)(r-1)(r−1)-scattered subspaces and MRD codes, the paper derives from it (Theorem 4.10, not part of this mission) that two Fq\mathbb F_qFq​-linear MRD codes with minimum distance n−r+1n-r+1n−r+1, r>2r>2r>2, and left idealiser isomorphic to Fqn\mathbb F_{q^n}Fqn​ are equivalent if and only if their associated linear sets in PG(r−1,qn)\mathrm{PG}(r-1,q^n)PG(r−1,qn) are PΓL\mathrm P\Gamma\mathrm LPΓL-equivalent. Lemma 4.4 and Proposition 4.3 are of independent use: they say that the rank and, up to scalars, the subspace of any linear set scattered with respect to lines are invariants of the point set.

The formalization. The theorem is proved in the paper; no part of it, nor any statement about linear sets over a field extension, is machine-checked in Mathlib. The mission produces a formal model of linear sets, of the semilinear group and of its induced collineations that later finite-geometry missions can reuse, together with formal proofs of the four milestones. Proposition 4.2 is quoted from [5] without proof in the paper, so formalizing it means formalizing Bonoli and Polverino's argument.

Difficulty

The "if" direction is a direct computation, LUf=LUφfL_{U^f} = L_U^{\varphi_f}LUf​=LUφf​​. The obvious approach to the converse, reconstructing UUU from LUL_ULU​ point by point, fails because a point ⟨u⟩\langle u\rangle⟨u⟩ of LUL_ULU​ determines U∩⟨u⟩U\cap\langle u\rangleU∩⟨u⟩ only up to a scalar of Fqn∗\mathbb F_{q^n}^*Fqn∗​, and these scalars can a priori differ from point to point. Without the condition h≥2h \ge 2h≥2 they really do differ: for h=1h = 1h=1 the theorem is false. The step that needs h≥2h\ge2h≥2 is the rigidity of the intersections of UUU with two-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces, which is where the quoted result on linear sets of size q+1q+1q+1 on a projective line enters. Proposition 4.2 itself is a counting statement about point weights on PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn) and is not available in any library.

Formalization scope

  • Fq\mathbb F_qFq​ and Fqn\mathbb F_{q^n}Fqn​ are arbitrary finite fields F, K with [Algebra F K]; qqq is Fintype.card F. VVV is a finite-dimensional K-module with a compatible F-module structure ([IsScalarTower F K V]), and rrr is Module.finrank K V.
  • IsHScattered F K h U includes the range 0<h<r0 < h < r0<h<r and the spanning condition ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V, as in Definition 1.1. With h≥2h\ge2h≥2 this forces r≥3r\ge3r≥3.
  • A point is the K-submodule K ∙ u; linearSet F K U is a Set (Submodule K V) and ∣LU∣|L_U|∣LU​∣ is its Set.ncard.
  • ΓL\Gamma\mathrm LΓL is the set of f : V ≃+ V for which some σ : K ≃+* K gives f (a • v) = σ a • f v. The collineation φf\varphi_fφf​ sends a subspace PPP to Submodule.span K (f '' P). The image UfU^fUf is the set f '' U, and λW\lambda WλW is (λ • ·) '' W with λ≠0\lambda\ne0λ=0.
  • Two trivializing readings are excluded. Restricting to linear maps (GL, PGL) would prove a different, weaker statement; taking PΓL\mathrm{P}\Gamma\mathrm{L}PΓL-equivalence to mean "some bijection of points maps LUL_ULU​ to LWL_WLW​" would make the "only if" direction false. Both equivalences quantify over the full semilinear group, and the collineation is the one induced by the same fff.
  • Proposition 4.2 is a result the paper numbers but quotes from [5] (Bonoli–Polverino, Fq\mathbb F_qFq​-linear blocking sets in PG(2,q4)\mathrm{PG}(2,q^4)PG(2,q4)). It is a milestone with its own proof obligation and is not assumed. The two parts are separate items.
  • Proposition 2.1's "for any i<hi < hi<h" is read as 0<i<h0 < i < h0<i<h, the range on which Definition 1.1 defines iii-scattered.

Welcome contributions: the general theory of linear sets (point weights, ∣LU∣≤(qk−1)/(q−1)|L_U| \le (q^k-1)/(q-1)∣LU​∣≤(qk−1)/(q−1) with equality iff UUU is scattered), the fact that a semilinear map of VVV maps Fq\mathbb F_qFq​-subspaces to Fq\mathbb F_qFq​-subspaces, and the counting argument behind Proposition 4.2. These are reusable for every linear-set mission.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, Combinatorica 41 (2021); arXiv:1906.10590v2 (2020). https://arxiv.org/abs/1906.10590
  • G. Bonoli, O. Polverino, Fq\mathbb F_qFq​-linear blocking sets in PG(2,q4)\mathrm{PG}(2,q^4)PG(2,q4), Innov. Incidence Geom. 2 (2005), 35–56. https://doi.org/10.2140/iig.2005.2.35
  • B. Csajbók, G. Marino, O. Polverino, Classes and equivalence of linear sets in PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn), J. Combin. Theory Ser. A 157 (2018), 402–426. https://arxiv.org/abs/1607.06962
  • B. Csajbók, C. Zanella, On the equivalence of linear sets, Des. Codes Cryptogr. 81 (2016), 269–281. https://arxiv.org/abs/1501.03441
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. 310 (2010), 3096–3107. https://doi.org/10.1016/j.disc.2009.04.007
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://arxiv.org/abs/1806.05929
9 thms1 active userReviewed
CombinatoricsDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 4: For n ≥ h + 3, the Delsarte Dual of a Maximum h-Scattered Subspace of Dimension rn/(h + 1) Is Maximum (n − h − 2)-ScatteredResearch Paper

Motivation

Scattered subspaces are a central object of finite geometry. An Fq\mathbb F_qFq​-subspace UUU of an Fqn\mathbb F_{q^n}Fqn​-vector space is scattered when every one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace meets it in Fq\mathbb F_qFq​-dimension at most one. They give the largest scattered linear sets of projective spaces, and through them constructions of two-intersection sets, two-weight codes, strongly regular graphs and, most prominently, maximum rank distance (MRD) codes. Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2) generalise the notion to hhh-scattered subspaces, which meet every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace in Fq\mathbb F_qFq​-dimension at most hhh, prove the dimension bound rn/(h+1)rn/(h+1)rn/(h+1), and ask when it is attained.

When h+1h+1h+1 divides rrr, direct sums of known examples reach the bound (Theorem 2.6 of the paper). For other values of rrr the paper introduces a duality, the Delsarte dual, which turns a maximum hhh-scattered subspace of one space into a maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspace of a space of another dimension. The name comes from Delsarte's duality on MRD codes, which the paper shows corresponds to it (Theorem 4.12). This mission is about that duality: Theorem 3.3 of the paper.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, with n=dim⁡FqFqnn=\dim_{\mathbb F_q}\mathbb F_{q^n}n=dimFq​​Fqn​. Write V(r,qn)V(r,q^n)V(r,qn) for an rrr-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space; it is also an Fq\mathbb F_qFq​-space of dimension rnrnrn.

Definition 1.1. For 0<h≤r−10<h\le r-10<h≤r−1, an Fq\mathbb F_qFq​-subspace UUU of V=V(r,qn)V=V(r,q^n)V=V(r,qn) is hhh-scattered if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}}=V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h. It is maximum hhh-scattered if no hhh-scattered subspace of VVV has larger Fq\mathbb F_qFq​-dimension. The paper's Theorem 2.3 shows that an hhh-scattered subspace either has dimension rrr and defines a subgeometry, or has dimension at most rn/(h+1)rn/(h+1)rn/(h+1).

The setting of §3. Let V\mathbb VV be a kkk-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space, written as a direct sum V=Λ⊕Γ\mathbb V=\Lambda\oplus\GammaV=Λ⊕Γ of Fqn\mathbb F_{q^n}Fqn​-subspaces with dim⁡Λ=r\dim\Lambda=rdimΛ=r and dim⁡Γ=k−r\dim\Gamma=k-rdimΓ=k−r. Let WWW be a kkk-dimensional Fq\mathbb F_qFq​-subspace of V\mathbb VV with ⟨W⟩Fqn=V\langle W\rangle_{\mathbb F_{q^n}}=\mathbb V⟨W⟩Fqn​​=V and W∩Γ={0}W\cap\Gamma=\{0\}W∩Γ={0}, and put

U=⟨W,Γ⟩Fq∩Λ,U=\langle W,\Gamma\rangle_{\mathbb F_q}\cap\Lambda ,U=⟨W,Γ⟩Fq​​∩Λ,

an Fq\mathbb F_qFq​-subspace of Λ\LambdaΛ. Every kkk-dimensional Fq\mathbb F_qFq​-subspace of Λ\LambdaΛ with k>rk>rk>r arises in this way (Lunardon and Polverino, cited as [21, Theorems 1, 2] in the paper). Let β:V×V→Fqn\beta:\mathbb V\times\mathbb V\to\mathbb F_{q^n}β:V×V→Fqn​ be a non-degenerate reflexive sesquilinear form with companion automorphism σ\sigmaσ (linear in the first argument, β(v,aw)=aσβ(v,w)\beta(v,aw)=a^\sigma\beta(v,w)β(v,aw)=aσβ(v,w)) which takes values in Fq\mathbb F_qFq​ on W×WW\times WW×W; equivalently, β\betaβ extends a non-degenerate reflexive form β′:W×W→Fq\beta':W\times W\to\mathbb F_qβ′:W×W→Fq​. Write Γ⊥={v:β(v,g)=0 ∀g∈Γ}\Gamma^\perp=\{v:\beta(v,g)=0\ \forall g\in\Gamma\}Γ⊥={v:β(v,g)=0 ∀g∈Γ}, an rrr-dimensional subspace. The Delsarte dual of UUU (Definition 3.2) is the Fq\mathbb F_qFq​-subspace

Uˉ=W+Γ⊥={w+Γ⊥:w∈W}⊆V/Γ⊥,\bar U=W+\Gamma^\perp=\{w+\Gamma^\perp:w\in W\}\subseteq\mathbb V/\Gamma^\perp ,Uˉ=W+Γ⊥={w+Γ⊥:w∈W}⊆V/Γ⊥,

a subspace of a (k−r)(k-r)(k−r)-dimensional Fqn\mathbb F_{q^n}Fqn​-space.

Formalization targets

Goal: Theorem 3.3

Suppose UUU is a maximum hhh-scattered Fq\mathbb F_qFq​-subspace of Λ=V(r,qn)\Lambda=V(r,q^n)Λ=V(r,qn) of dimension k=rn/(h+1)k=rn/(h+1)k=rn/(h+1), and n≥h+3n\ge h+3n≥h+3. Then

Uˉ is a maximum (n−h−2)-scattered Fq-subspace of V/Γ⊥=V ⁣(rnh+1−r, qn),dim⁡FqUˉ=k.\bar U \text{ is a maximum } (n-h-2)\text{-scattered } \mathbb F_q\text{-subspace of } \mathbb V/\Gamma^\perp=V\!\left(\tfrac{rn}{h+1}-r,\ q^n\right),\qquad \dim_{\mathbb F_q}\bar U=k .Uˉ is a maximum (n−h−2)-scattered Fq​-subspace of V/Γ⊥=V(h+1rn​−r, qn),dimFq​​Uˉ=k.

The statement holds for every admissible choice of the embedding and of β\betaβ.

Milestones

  1. Theorem 2.7 (p. 8): a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) meets every hyperplane HHH in dimension between rn/(h+1)−nrn/(h+1)-nrn/(h+1)−n and rn/(h+1)−n+hrn/(h+1)-n+hrn/(h+1)−n+h.
  2. The identity (S∗)⊥=(S⊥′)∗(S^*)^\perp=(S^{\perp'})^*(S∗)⊥=(S⊥′)∗ (p. 9) for Fq\mathbb F_qFq​-subspaces SSS of WWW, where S∗=⟨S⟩FqnS^*=\langle S\rangle_{\mathbb F_{q^n}}S∗=⟨S⟩Fqn​​ and ⊥′\perp'⊥′ is orthogonality for β′\beta'β′.
  3. Proposition 3.1 (p. 9): if k>rk>rk>r and every hyperplane MMM of Λ\LambdaΛ satisfies dim⁡Fq(M∩U)<k−1\dim_{\mathbb F_q}(M\cap U)<k-1dimFq​​(M∩U)<k−1 (condition (⋄)(\diamond)(⋄)), then dim⁡FqUˉ=k\dim_{\mathbb F_q}\bar U=kdimFq​​Uˉ=k.
  4. Theorem 2.3 (p. 4): the dimension bound rn/(h+1)rn/(h+1)rn/(h+1) for hhh-scattered subspaces.

Significance

The result. Theorem 3.3 converts a maximum hhh-scattered subspace of V(r,qn)V(r,q^n)V(r,qn) of dimension rn/(h+1)rn/(h+1)rn/(h+1) into a maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspace of V(rn/(h+1)−r,qn)V(rn/(h+1)-r,q^n)V(rn/(h+1)−r,qn). For h=r−1h=r-1h=r−1 it was known through MRD codes; the paper proves it for every hhh. Its consequences in the paper are Corollaries 3.4 and 3.5 and Theorem 3.6: when n≥4n\ge4n≥4 is even and r≥3r\ge3r≥3 is odd, maximum (n−3)(n-3)(n−3)-scattered subspaces of V(r(n−2)/2,qn)V(r(n-2)/2,q^n)V(r(n−2)/2,qn) exist which the direct sum construction of Theorem 2.6 cannot produce, because n−2n-2n−2 does not divide r(n−2)/2r(n-2)/2r(n−2)/2. Theorem 3.3 is also the geometric counterpart of Delsarte duality of MRD codes (Theorem 4.12 of the paper).

Formalizing it. The theorem is proved in the paper; no machine-checked version exists. A formalization would provide a reusable treatment of sesquilinear forms whose restriction to an Fq\mathbb F_qFq​-form is controlled, of orthogonal complements across the field extension Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​, and of the passage between Λ\LambdaΛ, V/Γ\mathbb V/\GammaV/Γ and V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥. Theorems 2.3 and 2.7 are also the goals of companion missions in this series; here they enter as milestones.

Difficulty

The definition of Uˉ\bar UUˉ is easy; the content is in two dimension statements. First, W+Γ⊥W+\Gamma^\perpW+Γ⊥ must not collapse: W∩Γ⊥={0}W\cap\Gamma^\perp=\{0\}W∩Γ⊥={0} is not automatic and depends on the hyperplane condition (⋄)(\diamond)(⋄) on UUU, which in turn needs the upper bound of Theorem 2.7, whose proof in the paper is a long counting argument with Gaussian binomials (Section 5). Second, the scattered property must be transported through the duality: a large intersection of Uˉ\bar UUˉ with an (n−h−2)(n-h-2)(n−h−2)-dimensional subspace of V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥ must be converted into a large intersection of UUU with a hyperplane of Λ\LambdaΛ. This conversion runs through three different spaces and two different orthogonalities, ⊥\perp⊥ over Fqn\mathbb F_{q^n}Fqn​ and ⊥′\perp'⊥′ over Fq\mathbb F_qFq​, and the identification (S∗)⊥=(S⊥′)∗(S^*)^\perp=(S^{\perp'})^*(S∗)⊥=(S⊥′)∗ between them requires that WWW have an Fq\mathbb F_qFq​-basis which is an Fqn\mathbb F_{q^n}Fqn​-basis of V\mathbb VV. Maximality is a further step that uses the bound of Theorem 2.3 in V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥.

Formalization scope

Fq\mathbb F_qFq​ and Fqn\mathbb F_{q^n}Fqn​ are finite fields F, K with Algebra F K; V\mathbb VV is a finite-dimensional K-module with a compatible F-structure (IsScalarTower F K 𝕍). The setting of §3 is a structure DelsarteSetting F K 𝕍 holding Λ,Γ\Lambda,\GammaΛ,Γ (complementary), WWW (with dim⁡FqW=dim⁡FqnV\dim_{\mathbb F_q}W=\dim_{\mathbb F_{q^n}}\mathbb VdimFq​​W=dimFqn​​V, spanning, W∩Γ=0W\cap\Gamma=0W∩Γ=0), σ:Fqn≃Fqn\sigma:\mathbb F_{q^n}\simeq\mathbb F_{q^n}σ:Fqn​≃Fqn​ and β:V→FqnV→σFqn\beta:\mathbb V\to_{\mathbb F_{q^n}}\mathbb V\to_{\sigma}\mathbb F_{q^n}β:V→Fqn​​V→σ​Fqn​ with non-degeneracy, reflexivity and β(W,W)⊆Fq\beta(W,W)\subseteq\mathbb F_qβ(W,W)⊆Fq​. The embedding of Λ\LambdaΛ into V\mathbb VV is data, not a theorem; its existence is cited by the paper and is not an item. The paper's β′\beta'β′ is the restriction of β\betaβ to WWW.

Conventions pinned:

  • UUU is an F-subspace of the type ↥Λ, and "h-scattered in Λ\LambdaΛ" is Definition 1.1 with ambient space Λ\LambdaΛ, including 0<h<r0<h<r0<h<r and ⟨U⟩Fqn=Λ\langle U\rangle_{\mathbb F_{q^n}}=\Lambda⟨U⟩Fqn​​=Λ. The dual is (n − h − 2)-scattered in the quotient 𝕍 ⧸ Γ^⊥, whose dimension is k−rk-rk−r.
  • Every rn/(h+1)rn/(h+1)rn/(h+1) is multiplied out: (h+1)dim⁡U=rn(h+1)\dim U=rn(h+1)dimU=rn. Hyperplanes are subspaces with dim⁡+1=dim⁡\dim+1=\dimdim+1=dim of the ambient space; dim⁡<k−1\dim<k-1dim<k−1 is written dim⁡+1<k\dim+1<kdim+1<k. The only natural-number subtraction is the index n−h−2n-h-2n−h−2, exact because n≥h+3n\ge h+3n≥h+3.
  • The paper's k>rk>rk>r is a hypothesis of Proposition 3.1, as on the page, and is derived (not assumed) in Theorem 3.3.

The form must be non-degenerate and Fq\mathbb F_qFq​-valued on WWW: with β=0\beta=0β=0 one would get Γ⊥=V\Gamma^\perp=\mathbb VΓ⊥=V and a zero quotient, and without β(W,W)⊆Fq\beta(W,W)\subseteq\mathbb F_qβ(W,W)⊆Fq​ the subspace W+Γ⊥W+\Gamma^\perpW+Γ⊥ is not the paper's Delsarte dual; both conditions are fields of the setting and may not be dropped.

Cited inputs: none of the milestones is proved elsewhere; Theorems 2.3 and 2.7 duplicate the goals of companion missions 1 and 3 and may be closed by importing their proofs once published. Contributions welcome: the sesquilinear-form infrastructure (dimension of orthogonal complements, the extension of β′\beta'β′ from WWW to V\mathbb VV), Proposition 3.1, and the transport argument of Theorem 3.3.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, arXiv:1906.10590v2, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/1906.10590v2
  • G. Lunardon, O. Polverino, Translation ovoids of orthogonal polar spaces, Forum Math. 16 (2004), 663–669 (the embedding used in §3).
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243 (the case h = 1 of the bound).
  • P. Delsarte, Bilinear forms over a finite field, with applications to coding theory, J. Combin. Theory Ser. A 25 (1978), 226–241 (Delsarte duality of rank-metric codes).
8 thms1 active userReviewed
CombinatoricsComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy 1: Folded Symmetric PCSPs Avoiding Parity, Majority and Alternating-Threshold Have Only C-Fixing PolymorphismsResearch Paper

Why promise constraint satisfaction

A constraint satisfaction problem (CSP) asks whether variables can be assigned values so that every constraint, drawn from a fixed finite set of relations, holds. The algebraic approach to CSPs explains their complexity through polymorphisms, the operations that preserve all constraint relations; this programme culminated in the CSP dichotomy theorem of Bulatov and Zhuk (2017). A promise CSP (PCSP) pairs each relation PPP with a weaker relation Q⊇PQ \supseteq PQ⊇P: given an instance that is promised to be satisfiable with the PPP-constraints, one must distinguish it from instances that are not even satisfiable with the QQQ-constraints. Approximate graph colouring (is a 3-colourable graph 100-colourable?) and (2+ε)(2+\varepsilon)(2+ε)-SAT are PCSPs, and their complexity is not captured by the classical theory.

Brakensiek and Guruswami (arXiv:1704.01937) developed the polymorphism theory of PCSPs and classified the Boolean, symmetric, folded case.

Timeline.

  • 1978: Schaefer classifies Boolean CSPs into polynomial-time and NP-complete.
  • 2014: Austrin, Guruswami and Håstad prove (2+ε)(2+\varepsilon)(2+ε)-SAT NP-hard with an argument based on polymorphisms (SIAM J. Comput. 46(5), 2017).
  • 2016–2018: Brakensiek and Guruswami introduce the general PCSP framework and prove a dichotomy for folded symmetric Boolean PCSPs (SODA 2018; arXiv:1704.01937v2, 2021; SIAM J. Comput. 50(6), 2021).
  • 2019–2021: Barto, Bulín, Krokhin and Opršal recast the theory in terms of minions (J. ACM 68(4), 2021). Ficak, Kozik, Olšák and Stankiewicz extend the Boolean symmetric dichotomy beyond the folded case (ICALP 2019).

Setting

Fix the Boolean domain {0,1}\{0,1\}{0,1}. A promise relation of arity kkk is a pair (P,Q)(P, Q)(P,Q) with P⊆Q⊆{0,1}kP \subseteq Q \subseteq \{0,1\}^kP⊆Q⊆{0,1}k, and a family Γ\GammaΓ is a finite set of promise relations, possibly of different arities. A function f:{0,1}L→{0,1}f : \{0,1\}^L \to \{0,1\}f:{0,1}L→{0,1} is a polymorphism of (P,Q)(P,Q)(P,Q) if, whenever x(1),…,x(L)∈Px^{(1)}, \dots, x^{(L)} \in Px(1),…,x(L)∈P, applying fff coordinate-wise gives a tuple in QQQ; Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) is the set of functions that are polymorphisms of every member of Γ\GammaΓ.

A relation is symmetric if it is closed under permuting coordinates. Every symmetric relation has the form Hamk(S)={x:∣x∣∈S}\mathrm{Ham}_k(S) = \{x : |x| \in S\}Hamk​(S)={x:∣x∣∈S}, where ∣x∣|x|∣x∣ is the Hamming weight. A function is folded if f(xˉ)=¬f(x)f(\bar x) = \neg f(x)f(xˉ)=¬f(x), and idempotent if f(0,…,0)=0f(0,\dots,0) = 0f(0,…,0)=0 and f(1,…,1)=1f(1,\dots,1) = 1f(1,…,1)=1; a family is folded (idempotent) if all its polymorphisms are. For odd LLL the paper singles out three function families:

ParL(x)=⨁i=1Lxi,MajL(x)=[∑ixi>L2],ATL(x)=[∑i=1L(−1)i−1xi>0],\mathrm{Par}_L(x) = \bigoplus_{i=1}^L x_i, \qquad \mathrm{Maj}_L(x) = \Big[\sum_{i} x_i > \tfrac L2\Big], \qquad \mathrm{AT}_L(x) = \Big[\sum_{i=1}^L (-1)^{i-1} x_i > 0\Big],ParL​(x)=i=1⨁L​xi​,MajL​(x)=[i∑​xi​>2L​],ATL​(x)=[i=1∑L​(−1)i−1xi​>0],

and their negations Par‾L,Maj‾L,AT‾L\overline{\mathrm{Par}}_L, \overline{\mathrm{Maj}}_L, \overline{\mathrm{AT}}_LParL​,Maj​L​,ATL​. Finally, fff is CCC-fixing if some set SSS of at most CCC coordinates satisfies f(x)=f(0,…,0)f(x) = f(0,\dots,0)f(x)=f(0,…,0) whenever xxx vanishes on SSS.

Formalization targets

Goal: Theorem 4.13

Let Γ\GammaΓ be a finite, folded, symmetric family. If there are odd L1,…,L6L_1, \dots, L_6L1​,…,L6​ with

ParL1, ATL2, MajL3, Par‾L4, AT‾L5, Maj‾L6∉Pol(Γ),\mathrm{Par}_{L_1},\ \mathrm{AT}_{L_2},\ \mathrm{Maj}_{L_3},\ \overline{\mathrm{Par}}_{L_4},\ \overline{\mathrm{AT}}_{L_5},\ \overline{\mathrm{Maj}}_{L_6} \notin \mathrm{Pol}(\Gamma),ParL1​​, ATL2​​, MajL3​​, ParL4​​, ATL5​​, Maj​L6​​∈/Pol(Γ),

then

∃ C(Γ)  ∀L  ∀f∈Pol(Γ)∩{0,1}{0,1}L: f is C(Γ)-fixing.\exists\, C(\Gamma)\ \ \forall L\ \ \forall f \in \mathrm{Pol}(\Gamma) \cap \{0,1\}^{\{0,1\}^L}:\ f \text{ is } C(\Gamma)\text{-fixing}.∃C(Γ)  ∀L  ∀f∈Pol(Γ)∩{0,1}{0,1}L: f is C(Γ)-fixing.

No value of CCC is fixed: the goal asserts only that one bound works for all arities.

Milestones

The milestones follow the paper's proof:

  • the tools of §2: Propositions 2.10, 2.12 and 2.15 and Lemma 2.13(1), which split polymorphisms into idempotent and negated idempotent ones;
  • the arity-reduction Claims 4.2, 4.3 and 4.4;
  • the closure computations Claim 4.6 (AT\mathrm{AT}AT) and Claim 4.8 (Maj\mathrm{Maj}Maj);
  • the relaxation Lemmas 4.5 and 4.7, which replace Γ\GammaΓ by a single canonical symmetric promise relation;
  • the additive-combinatorics Lemma 4.9 and its bounded Remark;
  • Lemma 4.10 and Corollary 4.11, which bound the coordinates iii with f(ei)=1f(e_i) = 1f(ei​)=1;
  • Lemma 4.12, the idempotent case of the goal.

Significance

Theorem 4.13 is the structural half of the paper's main dichotomy (Theorem 2.16): a folded symmetric Boolean PCSP is polynomial-time solvable if it has one of the six families as polymorphisms for every odd arity, and NP-hard otherwise. Hardness follows by feeding the CCC-fixing structure into a Label Cover reduction (Theorem 5.3). Bounded "fixing" or junta-like structure of all polymorphisms is the standard route from algebra to NP-hardness for PCSPs. This theorem is the cleanest Boolean instance of it, and it underlies later classifications of symmetric Boolean PCSPs.

The result has been proved and published since 2018. To our knowledge none of it has been formalized. A formalization supplies a checked Boolean polymorphism toolkit (Hamming-weight relations, folding, idempotence, relaxations), checked closure computations under alternating-threshold and majority operations, and a uniform-constant Frobenius-type lemma. All of these can be reused by other Boolean PCSP missions.

Difficulty

The obvious argument fixes a polymorphism fff and bounds its relevant coordinates directly from a constraint that Par\mathrm{Par}Par, AT\mathrm{AT}AT or Maj\mathrm{Maj}Maj violates. This gives a bound that depends on the arity LLL, and an LLL-dependent bound is trivial (C=LC = LC=L always works). The work is in making the constant uniform. The proof has to replace Γ\GammaΓ by a single canonical promise relation that does not depend on fff, classify exactly which symmetric relations exclude ATL\mathrm{AT}_LATL​ and MajL\mathrm{Maj}_LMajL​, and use an additive-combinatorics lemma whose constants depend only on that relation's arity. Its bounded version must hold with the same constants. The non-idempotent polymorphisms need a separate reduction through the negated family ¬Γ\neg\Gamma¬Γ.

Formalization scope

The domain {0,1}\{0,1\}{0,1} is Bool (false =0= 0=0). A family Γ\GammaΓ is a pair of relational structures 𝔸 𝔹 : RelStruct τ ar Bool from the published definition PCSPBLPAff_Symmetric_Setting, with [Fintype τ] (finitely many relations) and 𝔸.rel R ⊆ 𝔹.rel R (promise). IsPolymorphism 𝔸 𝔹 f from that file is Definition 2.4. Coordinates are Fin L, so the 1-based sign (−1)i−1(-1)^{i-1}(−1)i−1 of ATL\mathrm{AT}_LATL​ becomes (−1)i(-1)^{i}(−1)i. Anti-functions negate the output. Family properties (folded, idempotent, non-degenerate) quantify over polymorphisms of every arity L≥0L \ge 0L≥0. A folded or idempotent family has no nullary polymorphisms, so admitting L=0L = 0L=0 changes nothing. The constants C(Γ)C(\Gamma)C(Γ), c(Γ)c(\Gamma)c(Γ), A(n)A(n)A(n) and d(n)d(n)d(n) are quantified before the arity and the function (respectively before S0,S1S_0, S_1S0​,S1​). A statement that lets the constant depend on fff or LLL is trivially true and is not the goal.

Out of scope are the complexity conclusions: "PCSP(Γ\GammaΓ) is NP-hard" (Theorems 2.16 and 5.3) and item 2 of Lemma 2.13 (transfer of tractability). The cited inputs for those conclusions are also out of scope: the PCP theorem with parallel repetition (Proposition 5.2) and Schaefer's theorem. No complexity predicate appears in any statement.

A complete development needs the following, with Mathlib's Nat.frobeniusNumber as a starting point for Lemma 4.9:

  • explicit matrix constructions for Claims 4.6 and 4.8;
  • closure of polymorphisms under projections (minors), used in Lemma 4.10 and Corollary 4.11;
  • a Frobenius-coin argument with constants uniform in the sets S0,S1S_0, S_1S0​,S1​.

Contributions are welcome at any milestone, including separate proofs of the closure computations and of Lemma 4.9.

Selected references

  • J. Brakensiek, V. Guruswami, Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy, arXiv:1704.01937v2, 2021; SIAM J. Comput. 50(6), 2021. https://arxiv.org/abs/1704.01937
  • P. Austrin, V. Guruswami, J. Håstad, (2+ε)-SAT is NP-hard, SIAM J. Comput. 46(5), 2017. https://doi.org/10.1137/15M1006507
  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, J. ACM 68(4), 2021. https://doi.org/10.1145/3457606
  • M. Ficak, M. Kozik, M. Olšák, S. Stankiewicz, Dichotomy for symmetric Boolean PCSPs, ICALP 2019. https://doi.org/10.4230/LIPIcs.ICALP.2019.57
  • T. J. Schaefer, The complexity of satisfiability problems, STOC 1978. https://doi.org/10.1145/800133.804350
19 thms1 active userReviewed
CombinatoricsDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 2: If h + 1 Divides r and n ≥ h + 1, Maximum h-Scattered 𝔽_q-Subspaces of V(r, qⁿ) of Dimension rn/(h + 1) ExistResearch Paper

Motivation

A scattered subspace is an Fq\mathbb F_qFq​-subspace UUU of an Fqn\mathbb F_{q^n}Fqn​-vector space VVV that meets every one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace of VVV in an Fq\mathbb F_qFq​-subspace of dimension at most one. Scattered subspaces produce scattered linear sets in projective spaces over finite fields, and through them two-intersection sets, two-weight codes, translation caps and maximum rank distance (MRD) codes. Blokhuis and Lavrauw (Geom. Dedicata 2000) proved that a scattered subspace of V(r,qn)V(r,q^n)V(r,qn) has dimension at most rn/2rn/2rn/2, and constructions of that dimension are known whenever rnrnrn is even (see Bartoli, Giulietti, Marino, Polverino 2018 and the references there).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2, Combinatorica 41, 2021) replace "one-dimensional" by "hhh-dimensional". The resulting hhh-scattered subspaces interpolate between scattered subspaces (h=1h=1h=1) and subspaces meeting every hyperplane in small dimension (h=r−1h=r-1h=r−1), which Sheekey and Van de Voorde (Des. Codes Cryptogr. 2020) showed to be equivalent to MRD codes with an idealiser isomorphic to Fqn\mathbb F_{q^n}Fqn​. For the new notion the paper proves an upper bound on the dimension (Theorem 2.3) and shows that the bound is attained when h+1h+1h+1 divides rrr (Theorem 2.6). This mission is the attainment half.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, so n=[Fqn:Fq]n=[\mathbb F_{q^n}:\mathbb F_q]n=[Fqn​:Fq​], and let V=V(r,qn)V=V(r,q^n)V=V(r,qn) be an rrr-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space with r≥1r\ge1r≥1. Every Fqn\mathbb F_{q^n}Fqn​-space is also an Fq\mathbb F_qFq​-space of dimension rnrnrn. For an integer hhh with 0<h≤r−10<h\le r-10<h≤r−1, an Fq\mathbb F_qFq​-subspace U≤VU\le VU≤V is hhh-scattered (Definition 1.1) if

  1. UUU spans VVV over Fqn\mathbb F_{q^n}Fqn​, ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}}=V⟨U⟩Fqn​​=V, and
  2. dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h for every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV.

An hhh-scattered subspace of largest possible Fq\mathbb F_qFq​-dimension is maximum hhh-scattered. Theorem 2.3 of the paper says that an hhh-scattered UUU either has dimension rrr and defines a subgeometry (an Fq\mathbb F_qFq​-basis of UUU is an Fqn\mathbb F_{q^n}Fqn​-basis of VVV), or satisfies

dim⁡FqU≤rnh+1.(1)\dim_{\mathbb F_q}U\le\frac{rn}{h+1}.\tag{1}dimFq​​U≤h+1rn​.(1)

Two building blocks appear in the statements. If V=V1⊕⋯⊕VtV=V_1\oplus\dots\oplus V_tV=V1​⊕⋯⊕Vt​ with Vi=V(ri,qn)V_i=V(r_i,q^n)Vi​=V(ri​,qn) and Ui≤ViU_i\le V_iUi​≤Vi​ are Fq\mathbb F_qFq​-subspaces, then U=U1⊕⋯⊕UtU=U_1\oplus\dots\oplus U_tU=U1​⊕⋯⊕Ut​ is the direct sum of the UiU_iUi​. For r≤nr\le nr≤n the Gabidulin-type subspace of Fqn r\mathbb F_{q^n}^{\,r}Fqnr​ is

Gr={(x,xq,xq2,…,xqr−1):x∈Fqn},G_r=\{(x,x^{q},x^{q^2},\dots,x^{q^{r-1}}) : x\in\mathbb F_{q^n}\},Gr​={(x,xq,xq2,…,xqr−1):x∈Fqn​},

the image of an Fq\mathbb F_qFq​-linear map, since x↦xqjx\mapsto x^{q^j}x↦xqj fixes Fq\mathbb F_qFq​.

Formalization targets

Goal: Theorem 2.6 (p. 7)

If h≥1h\ge1h≥1, h+1h+1h+1 divides rrr and n≥h+1n\ge h+1n≥h+1, then V(r,qn)V(r,q^n)V(r,qn) contains an Fq\mathbb F_qFq​-subspace UUU that is maximum hhh-scattered and satisfies

dim⁡FqU=rnh+1.\dim_{\mathbb F_q}U=\frac{rn}{h+1}.dimFq​​U=h+1rn​.

Milestones, in the order the paper uses them

  • Proposition 2.1 (p. 3): for h>1h>1h>1, every hhh-scattered subspace is iii-scattered for all 0<i<h0<i<h0<i<h.
  • Theorem 2.3 (p. 4): the dichotomy above, subgeometry or bound (1).
  • Theorem 2.4 (p. 6): if UiU_iUi​ is hih_ihi​-scattered in ViV_iVi​, then U1⊕⋯⊕UtU_1\oplus\dots\oplus U_tU1​⊕⋯⊕Ut​ is min⁡ihi\min_i h_imini​hi​-scattered in V1⊕⋯⊕VtV_1\oplus\dots\oplus V_tV1​⊕⋯⊕Vt​.
  • Theorem 2.4, second sentence (p. 6): if every UiU_iUi​ is hhh-scattered with dim⁡FqUi=rin/(h+1)\dim_{\mathbb F_q}U_i=r_in/(h+1)dimFq​​Ui​=ri​n/(h+1), then the direct sum is hhh-scattered of dimension rn/(h+1)rn/(h+1)rn/(h+1).
  • Example 2.5 (p. 7): for 2≤r≤n2\le r\le n2≤r≤n, GrG_rGr​ is maximum (r−1)(r-1)(r−1)-scattered of dimension nnn.

Significance

Together with Theorem 2.3, the goal settles the largest dimension of an hhh-scattered subspace of V(r,qn)V(r,q^n)V(r,qn) whenever h+1∣rh+1\mid rh+1∣r and n≥h+1n\ge h+1n≥h+1: it is exactly rn/(h+1)rn/(h+1)rn/(h+1). The subspaces it produces are the input of the paper's Delsarte duality (Theorem 3.3), which turns maximum hhh-scattered subspaces of V(r,qn)V(r,q^n)V(r,qn) reaching bound (1) into maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspaces of V(rn/(h+1)−r,qn)V(rn/(h+1)-r,q^n)V(rn/(h+1)−r,qn) and so gives constructions also when h+1∤rh+1\nmid rh+1∤r. The direct-sum theorem is also of independent use: it extends the direct-sum construction for scattered linear sets of Bartoli, Giulietti, Marino and Polverino to every hhh, and Example 2.5 gives the subspace counterpart of Gabidulin codes.

All results in this mission are proved in the paper. To our knowledge none of them has a machine-checked proof; no formal library contains scattered subspaces, linear sets or Gabidulin-type subspaces. The remaining work is formalizing the paper's arguments: the counting of roots of linearized polynomials behind Example 2.5, the Grassmann-formula and quotient-space argument of Theorem 2.4, and the bound (1) of Theorem 2.3, which the companion mission on the dimension bound states as its goal.

Difficulty

The construction itself is short; the work lies in the three ingredients. The obvious approach to Theorem 2.4 fails: an hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace WWW of V1⊕V2V_1\oplus V_2V1​⊕V2​ need not be the sum of its intersections with V1V_1V1​ and V2V_2V2​, so the intersection W∩UW\cap UW∩U cannot be bounded summand by summand. Example 2.5 needs that a nonzero qqq-polynomial ∑j<rajxqj\sum_{j<r}a_jx^{q^j}∑j<r​aj​xqj has at most qr−1q^{r-1}qr−1 roots in Fqn\mathbb F_{q^n}Fqn​, and the root set is an Fq\mathbb F_qFq​-subspace. Maximality is not a property of a single subspace: it quantifies over every hhh-scattered subspace of VVV and so needs the full upper bound of Theorem 2.3, including the case n<h+1n<h+1n<h+1 handled there by Proposition 2.1.

Formalization scope

Fq\mathbb F_qFq​ is a finite field F, Fqn\mathbb F_{q^n}Fqn​ a finite field K with Algebra F K, so q=q=q= Fintype.card F and n=n=n= Module.finrank F K. VVV is a finite-dimensional K-module with a compatible F-module structure (IsScalarTower F K V), and r=r=r= Module.finrank K V. An Fq\mathbb F_qFq​-subspace is a Submodule F V; its intersection with an Fqn\mathbb F_{q^n}Fqn​-subspace S is S.restrictScalars F ⊓ U.

Conventions the statements commit to:

  • The range 0<h<r0<h<r0<h<r and the spanning condition are part of IsHScattered; without the range every spanning subspace would be hhh-scattered for h≥rh\ge rh≥r.
  • Every quotient rn/(h+1)rn/(h+1)rn/(h+1) is multiplied out, as (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U=rn(h+1)dimFq​​U=rn or ≤rn\le rn≤rn; no natural-number division is used.
  • The direct sum in Theorem 2.4 is external: V=∏i<tViV=\prod_{i<t}V_iV=∏i<t​Vi​ ((i : Fin t) → V i) and U=U=U= Submodule.pi Set.univ U. The minimum h=min⁡ihih=\min_i h_ih=mini​hi​ is given by h≤hih\le h_ih≤hi​ for all iii and h=hih=h_ih=hi​ for some iii. The second part of Theorem 2.4 assumes t≥1t\ge1t≥1.
  • Example 2.5 is stated on Fin r → K, with GrG_rGr​ the range of the F-linear map x↦(xqj)j<rx\mapsto(x^{q^j})_{j<r}x↦(xqj)j<r​, and assumes r≥2r\ge2r≥2 so that (r−1)(r-1)(r−1)-scattered is within Definition 1.1's range.
  • The goal assumes r≥1r\ge1r≥1: h+1h+1h+1 divides 000, but the zero space has no hhh-scattered subspace. The upper end h<rh<rh<r follows from h+1∣rh+1\mid rh+1∣r.
  • "Defines a subgeometry" in Theorem 2.3 is: some subset of UUU spans UUU over Fq\mathbb F_qFq​ and is an Fqn\mathbb F_{q^n}Fqn​-basis of VVV.

The goal is not satisfied by a small subspace: both the dimension equality (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U=rn(h+1)dimFq​​U=rn and maximality among all hhh-scattered subspaces of VVV are part of its conclusion.

Results the paper cites without a number (the Blokhuis–Lavrauw bound for h=1h=1h=1, the direct-sum theorem for scattered linear sets) are not items. Theorem 2.3 is restated here because the maximality in Theorem 2.6 rests on it; it duplicates the goal of the companion mission. Useful infrastructure beyond this mission: roots of linearized polynomials over finite fields, dimension formulas for subspaces under restriction of scalars, and direct sums of hhh-scattered subspaces. Contributions on any milestone are welcome, and the goal can be closed from the milestones alone.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, arXiv:1906.10590v2, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/1906.10590, https://doi.org/10.1007/s00493-020-4347-y
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • D. Bartoli, M. Giulietti, G. Marino, O. Polverino, Maximum scattered linear sets and complete caps in Galois spaces, Combinatorica 38 (2018), 255–278. https://doi.org/10.1007/s00493-016-3531-6
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets, and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://doi.org/10.1007/s10623-019-00703-z
10 thms1 active userReviewed
Complexity TheoryLinear OptimizationTheoretical Computer Science·Captain: mikedeng1

Algebraic Approach to Promise Constraint Satisfaction 3: BLP Solves PCSP(A, B) iff Pol(A, B) Has Symmetric Functions of All Arities iff Q_conv Maps to Pol(A, B)Research Paper

Motivation

A promise constraint satisfaction problem PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) is given by two finite relational structures with a homomorphism A→B\mathbf A\to\mathbf BA→B. An instance is a finite structure I\mathbf II over the same signature, promised to map to A\mathbf AA; the task is to find a homomorphism to the weaker structure B\mathbf BB (or, in the decision version, to tell I→A\mathbf I\to\mathbf AI→A apart from I↛B\mathbf I\not\to\mathbf BI→B). Approximate graph colouring (A=Kk\mathbf A=K_kA=Kk​, B=Kℓ\mathbf B=K_\ellB=Kℓ​) is the standard example.

The most direct polynomial-time algorithm one can try is linear programming. The basic LP relaxation (BLP) of an instance replaces the 0–1 program "assign one value to each variable, one allowed tuple to each constraint" by probability distributions on values and on tuples, with consistent marginals. Barto, Bulín, Krokhin and Opršal (arXiv:1811.00970v3, Theorem 7.9) characterise exactly when this relaxation decides PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B), in terms of the polymorphisms of the template. The result extends the CSP case of Kun, O'Donnell, Tamaki, Yoshida and Zhou (KOT+12, Theorem 2(5)&(6)) to promise problems.

Setting

A relational structure A\mathbf AA on a set AAA assigns to each symbol RRR of a finite signature a relation RA⊆Aar(R)R^{\mathbf A}\subseteq A^{\mathrm{ar}(R)}RA⊆Aar(R), with ar(R)≥1\mathrm{ar}(R)\ge 1ar(R)≥1. A polymorphism from A\mathbf AA to B\mathbf BB is a function f:An→Bf:A^n\to Bf:An→B, n≥1n\ge1n≥1, that maps every nnn tuples of RAR^{\mathbf A}RA, applied coordinatewise, to a tuple of RBR^{\mathbf B}RB; these form Pol(A,B)\mathrm{Pol}(\mathbf A,\mathbf B)Pol(A,B). A function is symmetric if f(xπ(1),…,xπ(n))=f(x1,…,xn)f(x_{\pi(1)},\dots,x_{\pi(n)})=f(x_1,\dots,x_n)f(xπ(1)​,…,xπ(n)​)=f(x1​,…,xn​) for every permutation π\piπ.

A minion on (A,B)(A,B)(A,B) is a nonempty family of functions An→BA^n\to BAn→B, n≥1n\ge 1n≥1, closed under minors g↦g(xπ(1),…,xπ(m))g\mapsto g(x_{\pi(1)},\dots,x_{\pi(m)})g↦g(xπ(1)​,…,xπ(m)​) for maps π:[m]→[n]\pi:[m]\to[n]π:[m]→[n]; a minion homomorphism preserves arities and minors. The minion Qconv\mathcal Q_{\mathrm{conv}}Qconv​ on (Q,Q)(\mathbb Q,\mathbb Q)(Q,Q) consists of the convex linear functions f(x1,…,xn)=∑iαixif(x_1,\dots,x_n)=\sum_i\alpha_ix_if(x1​,…,xn​)=∑i​αi​xi​ with αi∈[0,1]\alpha_i\in[0,1]αi​∈[0,1] and ∑iαi=1\sum_i\alpha_i=1∑i​αi​=1. The structure Qconv\mathbf Q_{\mathrm{conv}}Qconv​ has domain Q\mathbb QQ and one relation {x∈Qk∣∑icixi≤d}\{x\in\mathbb Q^k\mid\sum_i c_ix_i\le d\}{x∈Qk∣∑i​ci​xi​≤d} for every rational linear inequality; a finite reduct keeps finitely many of them.

For an instance I\mathbf II, the basic LP has variables μv(a)∈[0,1]\mu_v(a)\in[0,1]μv​(a)∈[0,1] for elements vvv and μv,R(a)∈[0,1]\mu_{\mathbf v,R}(\mathbf a)\in[0,1]μv,R​(a)∈[0,1] for constraints v∈RI\mathbf v\in R^{\mathbf I}v∈RI, constrained by ∑aμv(a)=1\sum_a\mu_v(a)=1∑a​μv​(a)=1 and the marginal equations ∑a(i)=aμv,R(a)=μv(i)(a)\sum_{\mathbf a(i)=a}\mu_{\mathbf v,R}(\mathbf a)=\mu_{\mathbf v(i)}(a)∑a(i)=a​μv,R​(a)=μv(i)​(a). BLPA(I)=1\mathrm{BLP}_{\mathbf A}(\mathbf I)=1BLPA​(I)=1 means that a solution exists in which every μv,R\mu_{\mathbf v,R}μv,R​ is supported on RAR^{\mathbf A}RA. BLP solves PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) if every I\mathbf II with BLPA(I)=1\mathrm{BLP}_{\mathbf A}(\mathbf I)=1BLPA​(I)=1 maps to B\mathbf BB.

pp-constructions combine two operations on templates: an nnn-th pp-power (domains AnA^nAn, BnB^nBn, relations defined by one primitive positive formula in both structures) and a homomorphic relaxation (A′,B′)(\mathbf A',\mathbf B')(A′,B′) of (A,B)(\mathbf A,\mathbf B)(A,B) (homomorphisms A′→A\mathbf A'\to\mathbf AA′→A and B→B′\mathbf B\to\mathbf B'B→B′).

Formalization targets

Goal: Theorem 7.9

For a PCSP template (A,B)(\mathbf A,\mathbf B)(A,B), the following are equivalent:

(1) BLP solves PCSP(A,B)  ⟺  (2) Pol(A,B) has symmetric functions of every arity n≥1\text{(1) BLP solves }\mathrm{PCSP}(\mathbf A,\mathbf B)\iff\text{(2) }\mathrm{Pol}(\mathbf A,\mathbf B)\text{ has symmetric functions of every arity }n\ge1(1) BLP solves PCSP(A,B)⟺(2) Pol(A,B) has symmetric functions of every arity n≥1   ⟺  (3) Qconv→Pol(A,B)  ⟺  (4) (A,B) is pp-constructible from a finite reduct of Qconv.\iff\text{(3) }\mathcal Q_{\mathrm{conv}}\to\mathrm{Pol}(\mathbf A,\mathbf B)\iff\text{(4) }(\mathbf A,\mathbf B)\text{ is pp-constructible from a finite reduct of }\mathbf Q_{\mathrm{conv}}.⟺(3) Qconv​→Pol(A,B)⟺(4) (A,B) is pp-constructible from a finite reduct of Qconv​.

Milestones

The structure LP(A)\mathrm{LP}(\mathbf A)LP(A) has as elements the rational probability distributions on AAA; a tuple (ϕ1,…,ϕk)(\phi_1,\dots,\phi_k)(ϕ1​,…,ϕk​) lies in RLP(A)R^{\mathrm{LP}(\mathbf A)}RLP(A) when some rational distribution γ\gammaγ on RAR^{\mathbf A}RA has marginals ϕ1,…,ϕk\phi_1,\dots,\phi_kϕ1​,…,ϕk​. The milestones are:

  • §7.2, p. 47: BLPA(I)=1  ⟺  I→LP(A)\mathrm{BLP}_{\mathbf A}(\mathbf I)=1\iff\mathbf I\to\mathrm{LP}(\mathbf A)BLPA​(I)=1⟺I→LP(A);
  • Remark 7.13: a countable structure whose finite substructures all map to a finite B\mathbf BB maps to B\mathbf BB;
  • Remark 7.11: LP(A)≅FQ(A)\mathrm{LP}(\mathbf A)\cong\mathbf F_{\mathcal Q}(\mathbf A)LP(A)≅FQ​(A), the free structure of Qconv\mathcal Q_{\mathrm{conv}}Qconv​;
  • Lemma 7.12: (A,LP(A))(\mathbf A,\mathrm{LP}(\mathbf A))(A,LP(A)) is a relaxation of a pp-power of Qconv\mathbf Q_{\mathrm{conv}}Qconv​;
  • Lemma 4.8(1), (2) for possibly infinite templates: relaxations and pp-powers receive minion homomorphisms;
  • the step hℓh_\ellhℓ​ (p. 48): a symmetric polymorphism of arity ℓ\ellℓ gives LPℓ(A)→B\mathrm{LP}_\ell(\mathbf A)\to\mathbf BLPℓ​(A)→B, where LPℓ(A)\mathrm{LP}_\ell(\mathbf A)LPℓ​(A) uses distributions with denominators dividing ℓ\ellℓ.

Significance

The result. Theorem 7.9 gives a complete, checkable description of the templates on which the basic LP relaxation is a correct algorithm: one needs only to look for symmetric polymorphisms. Through item (3) it places BLP inside the paper's general theory, in which the complexity of PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) depends only on the minion Pol(A,B)\mathrm{Pol}(\mathbf A,\mathbf B)Pol(A,B); BLP corresponds to the single minion Qconv\mathcal Q_{\mathrm{conv}}Qconv​. The same pattern later gives the analogous characterisations for the affine relaxation (Theorem 7.19, minion Zaff\mathcal Z_{\mathrm{aff}}Zaff​) and the combined BLP+AIP algorithm of Brakensiek, Guruswami, Wrochna and Živný.

Formalizing it. The theorem is proved in the paper; no machine-checked version exists. A formalization adds minions and pp-constructions over infinite domains, the structure LP(A)\mathrm{LP}(\mathbf A)LP(A), and a compactness argument for countable structures, all reusable for other relaxation-based algorithms. On the platform, PCSPBLPAff.Symmetric.theorem_2 (symmetric polymorphisms of arbitrarily large arity make BLP+AIP correct) and PCSPBLPAff.Characterization.theorem_4 concern the different BLP+AIP algorithm.

Difficulty

Two steps resist the finite theory. First, Theorem 4.12 (minion homomorphisms correspond to pp-constructions) is proved only for finite templates and fails for infinite ones in general, while Qconv\mathcal Q_{\mathrm{conv}}Qconv​ and Qconv\mathbf Q_{\mathrm{conv}}Qconv​ live on Q\mathbb QQ; the link between (3) and (4) must be made by hand through LP(A)\mathrm{LP}(\mathbf A)LP(A). Second, (2) supplies one symmetric polymorphism per arity, with no compatibility required between different arities, while (1) is a statement about all instances at once. The natural intermediate object, LP(A)\mathrm{LP}(\mathbf A)LP(A), is infinite, and no single polymorphism of Pol(A,B)\mathrm{Pol}(\mathbf A,\mathbf B)Pol(A,B) acts on all of it; mapping it to B\mathbf BB is where finiteness of B\mathbf BB and countability of LP(A)\mathrm{LP}(\mathbf A)LP(A) enter.

Formalization scope

The development builds on the published definitions PCSPBLPAff.Symmetric (relational structures, homomorphisms, polymorphisms, symmetric functions, instances and the BLP polytope IsLPSol). Conventions: signatures are finite with arities ≥1\ge1≥1; AAA and BBB are finite and BBB is nonempty, which excludes only the degenerate template A=B=∅A=B=\emptysetA=B=∅, where items (1)–(3) hold and (4) fails. BLPA(I)=1\mathrm{BLP}_{\mathbf A}(\mathbf I)=1BLPA​(I)=1 is encoded as the feasibility over Q\mathbb QQ of the LP with the vanishing constraints, following the paper's remark after Definition 7.7; dropping those constraints would make item (1) a different, false statement, since the unrestricted LP is always feasible. Item (2) asks for every arity n≥1n\ge1n≥1, not only arbitrarily large ones. Qconv\mathcal Q_{\mathrm{conv}}Qconv​ is defined directly as the convex linear functions (coefficients in [0,1][0,1][0,1] summing to 111; affine coefficients would give a different theorem). Qconv\mathbf Q_{\mathrm{conv}}Qconv​ uses non-strict inequalities. The free structure, LP(A)\mathrm{LP}(\mathbf A)LP(A) and LPℓ(A)\mathrm{LP}_\ell(\mathbf A)LPℓ​(A) are stated with rational values, so LP(A)\mathrm{LP}(\mathbf A)LP(A) is countable.

Left out: the complexity consequences (polynomial-time solvability) and the identification of Qconv\mathcal Q_{\mathrm{conv}}Qconv​ with the polymorphisms of Qconv\mathbf Q_{\mathrm{conv}}Qconv​, which the proof does not need. The cited input [KOT+12, Proposition 12] is replaced by its use in the proof, the milestone on LP(A)\mathrm{LP}(\mathbf A)LP(A). The proof of Lemma 7.12 on p. 47 omits γ≥0\gamma\ge0γ≥0 from the pp-definition; nonnegativity is itself pp-definable in Qconv\mathbf Q_{\mathrm{conv}}Qconv​, so the lemma's statement is unaffected.

Contributions welcome: proofs of any milestone, in particular the compactness remark (or a derivation from PCSPBLPAff.Characterization.lemma_16) and Lemma 4.8 for infinite templates.

Selected references

  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, arXiv:1811.00970v3, 2019; J. ACM 68(4), 2021. https://arxiv.org/abs/1811.00970
  • G. Kun, R. O'Donnell, S. Tamaki, Y. Yoshida, Y. Zhou, Linear programming, width-1 CSPs, and robust satisfaction, ITCS 2012. https://doi.org/10.1145/2090236.2090274
  • M. Bodirsky, M. Mamino, Constraint satisfaction problems over numeric domains, Dagstuhl Follow-Ups 7, 2017. https://doi.org/10.4230/DFU.Vol7.15301.79
  • J. Brakensiek, V. Guruswami, M. Wrochna, S. Živný, The power of the combined basic LP and affine relaxation for promise CSPs, SIAM J. Comput. 49(6), 2020. https://arxiv.org/abs/1907.04383
16 thms1 active userReviewed
CombinatoricsDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 3: A Maximum h-Scattered Subspace of Dimension rn/(h + 1) Meets Every Hyperplane in Dimension Between rn/(h + 1) − n and rn/(h + 1) − n + hResearch Paper

Motivation

Scattered subspaces are a central object of finite geometry. An Fq\mathbb F_qFq​-subspace UUU of an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​ defines an Fq\mathbb F_qFq​-linear set of the projective space PG(r−1,qn)\mathrm{PG}(r-1,q^n)PG(r−1,qn), and when UUU is scattered this linear set has the largest possible number of points for its rank. Maximum scattered subspaces give rise to maximum rank distance (MRD) codes, to translation caps, and to two-intersection sets and the associated two-weight codes and strongly regular graphs (Polverino 2010; Sheekey–Van de Voorde 2020).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2, Combinatorica 41, 2021) generalised the notion to hhh-scattered subspaces, which meet every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace in dimension at most hhh, and proved that such a subspace has dimension at most rn/(h+1)rn/(h+1)rn/(h+1) unless it defines a subgeometry. This mission concerns the extremal case: subspaces attaining rn/(h+1)rn/(h+1)rn/(h+1), and the way they meet hyperplanes.

Timeline.

  • 2000: Blokhuis and Lavrauw (Geom. Dedicata 81, Theorem 4.2) prove the case h=1h=1h=1: a scattered subspace of dimension rn/2rn/2rn/2 meets each hyperplane in dimension rn/2−nrn/2-nrn/2−n or rn/2−n+1rn/2-n+1rn/2−n+1, and they count the hyperplanes of each kind.
  • 2020: Csajbók, Marino, Polverino and Zullo prove the general statement (Theorem 2.7) by a double count and qqq-series identities, and use it to build maximum hhh-scattered subspaces by Delsarte duality.
  • Later work by Zini and Zullo (Scattered subspaces and related codes, reference [29] of the paper) determines the number of hyperplanes of each intersection dimension for every hhh; the case h=2h=2h=2 is in Napolitano–Zullo.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, n=[Fqn:Fq]n = [\mathbb F_{q^n}:\mathbb F_q]n=[Fqn​:Fq​], and let V=V(r,qn)V = V(r,q^n)V=V(r,qn) be an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​, viewed also as an rnrnrn-dimensional vector space over Fq\mathbb F_qFq​. A hyperplane of VVV is an (r−1)(r-1)(r−1)-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace.

Fix an integer hhh with 0<h≤r−10<h\le r-10<h≤r−1. An Fq\mathbb F_qFq​-subspace UUU of VVV is hhh-scattered if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h. It is maximum hhh-scattered if no hhh-scattered subspace of VVV has larger Fq\mathbb F_qFq​-dimension.

Put s=h+1s=h+1s=h+1 and suppose s∣rns\mid rns∣rn. For an Fq\mathbb F_qFq​-subspace UUU of dimension rn/srn/srn/s, let hih_ihi​ be the number of hyperplanes WWW with dim⁡Fq(W∩U)=i\dim_{\mathbb F_q}(W\cap U)=idimFq​​(W∩U)=i. The proof works with the Gaussian binomial coefficients [nk]q\left[{n\atop k}\right]_q[kn​]q​, the qqq-Pochhammer symbols (a;q)k=(1−a)(1−aq)⋯(1−aqk−1)(a;q)_k=(1-a)(1-aq)\cdots(1-aq^{k-1})(a;q)k​=(1−a)(1−aq)⋯(1−aqk−1), the elementary symmetric values σk,l\sigma_{k,l}σk,l​ of 1,q,…,qk1,q,\dots,q^k1,q,…,qk, and the sums

αk=∑ihi(qn−1)qki,βk=∑ihi(qn−1)∏j=0k−1(qi−qj),\alpha_k=\sum_i h_i(q^n-1)q^{ki},\qquad \beta_k=\sum_i h_i(q^n-1)\prod_{j=0}^{k-1}(q^i-q^j),αk​=i∑​hi​(qn−1)qki,βk​=i∑​hi​(qn−1)j=0∏k−1​(qi−qj), A=∑ihi(qn−1)∏l=0s−1(qi−q n(r−s)/s+l).A=\sum_i h_i(q^n-1)\prod_{l=0}^{s-1}\bigl(q^i-q^{\,n(r-s)/s+l}\bigr).A=i∑​hi​(qn−1)l=0∏s−1​(qi−qn(r−s)/s+l).

Formalization targets

Goal: Theorem 2.7

If UUU is a maximum hhh-scattered Fq\mathbb F_qFq​-subspace of V(r,qn)V(r,q^n)V(r,qn) of dimension rn/(h+1)rn/(h+1)rn/(h+1), then for every hyperplane WWW of VVV

rnh+1−n  ≤  dim⁡Fq(U∩W)  ≤  rnh+1−n+h.\frac{rn}{h+1}-n\;\le\;\dim_{\mathbb F_q}(U\cap W)\;\le\;\frac{rn}{h+1}-n+h.h+1rn​−n≤dimFq​​(U∩W)≤h+1rn​−n+h.

Milestones, in the order of the proof (§5, pp. 20–24)

  1. hi=0h_i=0hi​=0 for i<rn/s−ni<rn/s-ni<rn/s−n (the lower bound), and (23): ∑ihi(qn−1)=qrn−1\sum_i h_i(q^n-1)=q^{rn}-1∑i​hi​(qn−1)=qrn−1.
  2. Lemma 5.7: for 0≤k≤s−10\le k\le s-10≤k≤s−1,
∑ihi(qn−1)∏j=0k(qi−qj)=∏j=0k(qrn/s−qj) (q(r−k−1)n−1).\sum_i h_i(q^n-1)\prod_{j=0}^{k}(q^i-q^j)=\prod_{j=0}^{k}(q^{rn/s}-q^j)\,(q^{(r-k-1)n}-1).i∑​hi​(qn−1)j=0∏k​(qi−qj)=j=0∏k​(qrn/s−qj)(q(r−k−1)n−1).
  1. The qqq-series tools: Lemma 5.5 (σk,l=ql(l−1)/2[k+1l]q\sigma_{k,l}=q^{l(l-1)/2}\left[{k+1\atop l}\right]_qσk,l​=ql(l−1)/2[lk+1​]q​), Carlitz's inversion (Theorem 5.6), the qqq-binomial theorem (Theorem 5.2) and its specialisation (Corollary 5.3).
  2. (24): αk=∑j≤k[kj]qβj\alpha_k=\sum_{j\le k}\left[{k\atop j}\right]_q\beta_jαk​=∑j≤k​[jk​]q​βj​. Identity (25), which expresses AAA through α0,…,αs\alpha_0,\dots,\alpha_sα0​,…,αs​, is included as a supporting item rather than a milestone.
  3. Propositions 5.8 and 5.9: two triple sums asa_sas​, bsb_sbs​ both equal qnr(−1)s(q−n;q)sq^{nr}(-1)^s(q^{-n};q)_sqnr(−1)s(q−n;q)s​.
  4. A=0A=0A=0, which forces hi=0h_i=0hi​=0 for i>n(r−s)/s+s−1i>n(r-s)/s+s-1i>n(r−s)/s+s−1.

Significance

The result. Theorem 2.7 says that a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) has only h+1h+1h+1 possible intersection dimensions with hyperplanes. Its linear set therefore meets hyperplanes in few sizes, which links these subspaces to sets of few intersection numbers and to codes with few weights. Inside the paper, the upper bound is the input to §3: it shows that the Delsarte dual of a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) is maximum (n−h−2)(n-h-2)(n−h−2)-scattered (Theorem 3.3). That theorem in turn gives maximum hhh-scattered subspaces when h+1h+1h+1 does not divide rrr.

Formalizing it. The theorem is proved in the paper, but no machine-checked version exists. Beyond the geometry, the mission produces a library of finite qqq-series facts: Gaussian binomials as rational functions of qqq, the qqq-binomial theorem in both forms, Carlitz's inversion formula, and the elementary symmetric evaluation σk,l\sigma_{k,l}σk,l​. Some of these are proved on the platform in a different Mathlib environment, but they are not available in this one. Counting statements about subspaces over finite fields (hyperplanes through a subspace, ordered independent tuples) are also needed and are reusable.

Difficulty

The lower bound is a dimension count. The upper bound is not: the obvious approach bounds dim⁡(U∩W)\dim(U\cap W)dim(U∩W) from the scattered property alone, but the hhh-scattered condition controls intersections with hhh-dimensional subspaces, and hyperplanes have dimension r−1r-1r−1, which is far larger. No pointwise argument is known; the paper determines the distribution (hi)(h_i)(hi​) only through its first s+1s+1s+1 moments, given by a double count, and then shows that a specific nonnegative combination of the hih_ihi​ vanishes. The moment identities hold only for k≤s−1k\le s-1k≤s−1 (Lemma 5.7 needs each k+1≤h+1k+1\le h+1k+1≤h+1 independent vectors of UUU to stay independent over Fqn\mathbb F_{q^n}Fqn​), and closing the argument requires exact evaluation of a triple qqq-series with signed Gaussian binomials and quadratic exponents.

Formalization scope

  • Fq\mathbb F_qFq​ is a finite field F, Fqn\mathbb F_{q^n}Fqn​ a finite field K with [Algebra F K], and VVV a finite-dimensional K-module with a compatible F-module structure (IsScalarTower F K V). We take r=r=r= finrank K V, n=n=n= finrank F K and q=q=q= Fintype.card F.
  • The range 0<h<r0<h<r0<h<r and the spanning condition are part of IsHScattered.
  • "Dimension rn/(h+1)rn/(h+1)rn/(h+1)" is the equation (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U = rn(h+1)dimFq​​U=rn. Both bounds of Theorem 2.7 are stated with nnn moved to the other side: dim⁡U≤dim⁡(U∩W)+n≤dim⁡U+h\dim U\le\dim(U\cap W)+n\le\dim U+hdimU≤dim(U∩W)+n≤dimU+h. A version written with natural-number subtraction would make the lower bound vacuous whenever rn/(h+1)<nrn/(h+1)<nrn/(h+1)<n, and dropping the dimension hypothesis would make the upper bound false. Both trivialisations are ruled out.
  • Gaussian binomials are defined by the product formula (15) for real qqq and vanish for k>nk>nk>n. The qqq-identities are stated for real q>1q>1q>1, which covers every prime power. Carlitz's formula is stated for complex sequences.
  • Every fraction in an exponent is an exact quotient: rn/srn/srn/s is passed as mmm with sm=nrsm=nrsm=nr, and halves l(l−1)/2l(l-1)/2l(l−1)/2 are binomial coefficients (l2)\binom l2(2l​). Possibly negative exponents use integer powers.
  • The milestones of §5 carry the full hhh-scattered hypothesis, spanning included. The printed setting of §5.2 omits spanning, but Lemma 5.7 uses Proposition 2.1, which needs it.
  • Cited inputs stated as milestones: Lemma 5.5 ([6]), Theorem 5.2 ([15]) and Theorem 5.6 ([7]). Identity (18) is used inside proofs and is not an item.

Proofs of any milestone, of standard counting facts for subspaces of finite vector spaces, and of the qqq-series lemmas are welcome.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, Combinatorica 41 (2021). arXiv:1906.10590v2. https://arxiv.org/abs/1906.10590v2
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. 310 (2010), 3096–3107. https://doi.org/10.1016/j.disc.2009.04.007
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets, and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://doi.org/10.1007/s10623-019-00703-z
  • G. Gasper, M. Rahman, Basic Hypergeometric Series, 2nd ed., Cambridge University Press, 2004. https://doi.org/10.1017/CBO9780511526251
  • L. Carlitz, Some inverse relations, Duke Math. J. 40 (1973), 893–901. https://doi.org/10.1215/S0012-7094-73-04083-0
  • V. Napolitano, F. Zullo, Codes with few weights arising from linear sets, arXiv:2002.07241. https://arxiv.org/abs/2002.07241
  • P. J. Cameron, Notes on Counting: An Introduction to Enumerative Combinatorics, Cambridge University Press, 2017. https://doi.org/10.1017/9781108277457
18 thms1 active userReviewed
CombinatoricsComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy 4: F = Pol(Γ) for a Finite Γ iff F Is Projection-Closed, Finitizable and Contains the IdentityResearch Paper

Motivation

A constraint satisfaction problem (CSP) asks whether variables ranging over a finite domain DDD can be assigned values so that every constraint from a fixed finite list of relations is satisfied. A central organizing principle of the algebraic theory of CSPs is that the complexity of CSP(Γ)\mathrm{CSP}(\Gamma)CSP(Γ) is governed by its polymorphisms, the functions f:DL→Df : D^L \to Df:DL→D that preserve every relation of Γ\GammaΓ when applied coordinate-wise. For this principle to be usable, one needs to know which sets of functions arise as polymorphism sets. For ordinary relations this goes back to the Galois theory of clones and relations. Pippenger (Galois theory for minors of finite functions, Discrete Mathematics, 2002) characterized the families of functions that are the polymorphism sets of pairs of relations, allowing infinitely many pairs.

Promise constraint satisfaction problems (PCSPs) relax CSPs: every constraint comes as a pair P⊆QP \subseteq QP⊆Q, and the task is to distinguish instances satisfiable with the strong relations PPP from those unsatisfiable even with the weak relations QQQ. Approximate graph colouring and (2+ε)(2+\varepsilon)(2+ε)-SAT are PCSPs. Brakensiek and Guruswami (arXiv:1704.01937v2, SIAM J. Comput. 2021) develop an algebraic theory of PCSPs based on polymorphisms. In §6.2 they prove a finite version of Pippenger's characterization: the families of the form Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) for a finite family Γ\GammaΓ of promise relations are exactly the families satisfying three explicit conditions. This mission formalizes that theorem and its CSP analogue (§6.3).

Setting

Fix a finite set DDD. A family of functions F\mathcal FF over DDD consists, for every arity L≥1L \ge 1L≥1, of a set of functions DL→DD^L \to DDL→D.

A promise relation of arity kkk is a pair (P,Q)(P, Q)(P,Q) of subsets of DkD^kDk with P⊆QP \subseteq QP⊆Q. A finite family Γ={(Pi,Qi)}\Gamma = \{(P_i, Q_i)\}Γ={(Pi​,Qi​)} of promise relations is indexed by a finite set of relation symbols, each with its own arity kik_iki​. A function f:DL→Df : D^L \to Df:DL→D is a polymorphism of Γ\GammaΓ if for every iii and all x(1),…,x(L)∈Pix^{(1)}, \dots, x^{(L)} \in P_ix(1),…,x(L)∈Pi​, applying fff coordinate by coordinate gives a tuple in QiQ_iQi​:

(f(x1(1),…,x1(L)),…,f(xki(1),…,xki(L)))∈Qi.\bigl(f(x^{(1)}_1, \dots, x^{(L)}_1), \dots, f(x^{(1)}_{k_i}, \dots, x^{(L)}_{k_i})\bigr) \in Q_i.(f(x1(1)​,…,x1(L)​),…,f(xki​(1)​,…,xki​(L)​))∈Qi​.

Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) is the family of all polymorphisms of Γ\GammaΓ.

For f:DL→Df : D^L \to Df:DL→D and a map π:[L]→[R]\pi : [L] \to [R]π:[L]→[R], the projection (or minor) fπ:DR→Df^\pi : D^R \to Dfπ:DR→D is

fπ(y)=f(yπ(1),…,yπ(L)).f^\pi(y) = f(y_{\pi(1)}, \dots, y_{\pi(L)}).fπ(y)=f(yπ(1)​,…,yπ(L)​).

A family F\mathcal FF is projection-closed if fπ∈Ff^\pi \in \mathcal Ffπ∈F whenever f∈Ff \in \mathcal Ff∈F has arity LLL and π:[L]→[R]\pi : [L] \to [R]π:[L]→[R]. It is finitizable if there is a finitized arity RRR such that for every arity LLL and every f:DL→Df : D^L \to Df:DL→D,

f∈F  ⟺  fπ∈F for all π:[L]→[R].f \in \mathcal F \iff f^\pi \in \mathcal F \text{ for all } \pi : [L] \to [R].f∈F⟺fπ∈F for all π:[L]→[R].

Finally idD:D→D\mathrm{id}_D : D \to DidD​:D→D is the identity, a function of arity 111.

Formalization targets

Goal: Theorem 6.5

∃ Γ finite with F=Pol(Γ)  ⟺  F is projection-closed and finitizable, and idD∈F.\exists\, \Gamma \text{ finite with } \mathcal F = \mathrm{Pol}(\Gamma) \iff \mathcal F \text{ is projection-closed and finitizable, and } \mathrm{id}_D \in \mathcal F.∃Γ finite with F=Pol(Γ)⟺F is projection-closed and finitizable, and idD​∈F.

The finite family is existential together with its signature and arities; nothing about its shape is fixed in the statement.

Milestones

  • Lemma 6.7. If F\mathcal FF is projection-closed, finitizable and contains idD\mathrm{id}_DidD​, then F=Pol(Γ)\mathcal F = \mathrm{Pol}(\Gamma)F=Pol(Γ) for some finite Γ\GammaΓ.

Further items for the other direction

  • Claim 6.6. For every finite family Γ\GammaΓ of promise relations, Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) is projection-closed and finitizable.
  • §6.2, p. 29. Since P⊆QP \subseteq QP⊆Q for every (P,Q)∈Γ(P, Q) \in \Gamma(P,Q)∈Γ, idD∈Pol(Γ)\mathrm{id}_D \in \mathrm{Pol}(\Gamma)idD​∈Pol(Γ).

Further item: Lemma 6.8

A CSP is a finite family with P=QP = QP=Q for every pair. With F\mathcal FF a clone (for f∈Ff \in \mathcal Ff∈F of arity L1L_1L1​ and g1,…,gL1∈Fg_1, \dots, g_{L_1} \in \mathcal Fg1​,…,gL1​​∈F of arity L2L_2L2​, the function h(x(1),…,x(L1))=f(g1(x(1)),…,gL1(x(L1)))h(x^{(1)}, \dots, x^{(L_1)}) = f(g_1(x^{(1)}), \dots, g_{L_1}(x^{(L_1)}))h(x(1),…,x(L1​))=f(g1​(x(1)),…,gL1​​(x(L1​))) of arity L1L2L_1L_2L1​L2​ is in F\mathcal FF):

∃ Λ CSP with F=Pol(Λ)  ⟺  F is finitizable, a clone, and idD∈F.\exists\, \Lambda \text{ CSP with } \mathcal F = \mathrm{Pol}(\Lambda) \iff \mathcal F \text{ is finitizable, a clone, and } \mathrm{id}_D \in \mathcal F.∃Λ CSP with F=Pol(Λ)⟺F is finitizable, a clone, and idD​∈F.

Significance

Theorem 6.5 identifies the polymorphism families of finite promise templates intrinsically, without reference to relations. Together with the Galois correspondence of §6.1 (if Pol(Γ)⊆Pol(Γ′)\mathrm{Pol}(\Gamma) \subseteq \mathrm{Pol}(\Gamma')Pol(Γ)⊆Pol(Γ′) then Γ′\Gamma'Γ′ is definable from Γ\GammaΓ, so PCSP(Γ′)\mathrm{PCSP}(\Gamma')PCSP(Γ′) reduces to PCSP(Γ)\mathrm{PCSP}(\Gamma)PCSP(Γ)), it justifies studying PCSPs entirely through families of functions closed under minors, the viewpoint later systematized by the theory of minions (Barto, Bulín, Krokhin, Opršal, arXiv:1811.00970). Lemma 6.8 recovers, in the same language, the description of polymorphism clones of finite CSP templates as the finitely related clones.

The results are proved in the paper; to our knowledge none of them has a machine-checked proof. The mission produces a Lean formalization of both directions, built on the published definitions of relational structures and polymorphisms already used by other PCSP missions on the platform, and reusable definitions of projections (minors), projection-closed and finitizable families, and clones.

Difficulty

The arguments are elementary, and the difficulty lies in uniformity and finiteness. For Claim 6.6, a single arity RRR must detect every failure of the polymorphism condition for functions of every arity LLL, so RRR has to be bounded independently of LLL; an argument that handles each arity separately does not give finitizability. For Lemma 6.7, a finite family of promise relations has to be produced from F\mathcal FF alone. The general Galois connection between functions and relations produces infinitely many relations (one for each arity and each witness of non-membership), and the content of the lemma is that the three conditions allow a finite family instead. In both directions the encoding matters: functions of arity RRR must be compared with tuples of a relation, and coordinates, projections and the identity must be matched exactly, with no degenerate arity left over.

Formalization scope

A family of functions is FunFamily D := (L : ℕ) → Set ((Fin L → D) → D), with DDD a finite type with decidable equality. Coordinates are 0-based (Fin L), and fπf^\pifπ is fun y => f (y ∘ π) with π : Fin L → Fin R. A finite family of promise relations is a finite type τ of symbols with arities ar : τ → ℕ and two structures 𝔸 𝔹 : RelStruct τ ar D with 𝔸.rel R ⊆ 𝔹.rel R; polymorphisms are the published IsPolymorphism (definition PCSPBLPAff_Symmetric_Setting), and a CSP uses one structure on both sides.

All function arities are positive. The paper's "L,R∈NL, R \in \mathbb NL,R∈N" is read as positive integers: "F=Pol(Γ)\mathcal F = \mathrm{Pol}(\Gamma)F=Pol(Γ)" is compared at every arity L≥1L \ge 1L≥1, projection-closure and finitizability quantify over L,R≥1L, R \ge 1L,R≥1, and the finitized arity is at least 111. Including arity 000 would make the necessity direction false as stated (with every PiP_iPi​ empty the paper's finitized arity is 000).

The clone condition of Lemma 6.8 is the paper's displayed one (p. 30): g1,…,gL1g_1, \dots, g_{L_1}g1​,…,gL1​​ act on disjoint blocks of inputs, and the composed function has arity L1L2L_1 L_2L1​L2​.

A trivializing formalization is ruled out by the statement's shape: the finite family, its signature and its arities are all existentially quantified (fixing a single relation would turn the necessity direction into a special case), P⊆QP \subseteq QP⊆Q is part of every family (without it idD∈Pol(Γ)\mathrm{id}_D \in \mathrm{Pol}(\Gamma)idD​∈Pol(Γ) fails), and finitizability is an equivalence for every function, members and non-members alike.

The development needs only finite types and functions; no complexity theory is involved. Proofs of the milestones, and reusable lemmas about projections (composition of projections, projections along injective maps), are welcome.

Selected references

  • J. Brakensiek, V. Guruswami, Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy, SIAM J. Comput. 50(6), 2021; arXiv:1704.01937v2. https://arxiv.org/abs/1704.01937
  • N. Pippenger, Galois theory for minors of finite functions, Discrete Mathematics 254 (1–3), 2002 (cited as [48] in the paper).
  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, J. ACM 68(4), 2021; arXiv:1811.00970. https://arxiv.org/abs/1811.00970
4 thms1 active userReviewed
CombinatoricsComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy 3: Pol(Γ) ⊆ Pol(Γ′) Implies Γ′ Is ppp-Definable from ΓResearch Paper

Motivation

A constraint satisfaction problem (CSP) asks for an assignment of values from a finite domain DDD to variables so that every constraint, a tuple of variables required to lie in a fixed relation, is satisfied. The algebraic theory of CSPs rests on a Galois correspondence: the complexity of CSP(Γ)\mathrm{CSP}(\Gamma)CSP(Γ) is determined by the set Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) of its polymorphisms, because Pol(Γ)⊆Pol(Γ′)\mathrm{Pol}(\Gamma) \subseteq \mathrm{Pol}(\Gamma')Pol(Γ)⊆Pol(Γ′) holds exactly when every relation of Γ′\Gamma'Γ′ is definable from Γ\GammaΓ by a primitive positive formula (Geiger 1968; Bodnarčuk, Kalužnin, Kotov and Romov 1969), and such definitions translate into reductions (Jeavons 1998). This correspondence underlies the CSP dichotomy theorem.

Promise CSPs (PCSPs) relax a CSP by a promise: every constraint comes as a pair (P,Q)(P, Q)(P,Q) with P⊆QP \subseteq QP⊆Q, and the task is to tell instances satisfiable with the PPP-relations from instances not even satisfiable with the QQQ-relations. Approximate graph colouring and (2+ε)(2+\varepsilon)(2+ε)-SAT are examples. Brakensiek and Guruswami (arXiv:1704.01937v2, §6.1) showed that the Galois correspondence survives this generalisation, with pp-definitions replaced by positive primitive promise definitions (ppp-definitions). This is the starting point of the algebraic approach to PCSPs later systematised by Barto, Bulín, Krokhin and Opršal (arXiv:1811.00970). Pippenger (2002) had earlier proved a variant of the correspondence for pairs of relations, not in this complexity-theoretic form.

Setting

Fix a finite domain DDD. A relation of arity kkk is a set P⊆DkP \subseteq D^kP⊆Dk, and a promise relation is a pair (P,Q)(P, Q)(P,Q) of relations of arity kkk with P⊆QP \subseteq QP⊆Q. A family Γ={(PR,QR):R∈τ}\Gamma = \{(P_R, Q_R) : R \in \tau\}Γ={(PR​,QR​):R∈τ} is indexed by a set τ\tauτ of symbols with arities kRk_RkR​. In Lean it is a pair of relational structures 𝔸 𝔹 : RelStruct τ ar D, with PRP_RPR​ = 𝔸.rel R, QRQ_RQR​ = 𝔹.rel R and PR⊆QRP_R \subseteq Q_RPR​⊆QR​ (IsPromiseFamily).

A function f:DL→Df : D^L \to Df:DL→D is a polymorphism of Γ\GammaΓ if for every RRR and all x(1),…,x(L)∈PRx^{(1)}, \dots, x^{(L)} \in P_Rx(1),…,x(L)∈PR​ the tuple obtained by applying fff coordinate-wise, (f(x1(1),…,x1(L)),…,f(xkR(1),…,xkR(L)))\big(f(x^{(1)}_1, \dots, x^{(L)}_1), \dots, f(x^{(1)}_{k_R}, \dots, x^{(L)}_{k_R})\big)(f(x1(1)​,…,x1(L)​),…,f(xkR​(1)​,…,xkR​(L)​)), lies in QRQ_RQR​. Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ) is the set of polymorphisms of all arities L≥0L \ge 0L≥0.

A Γ\GammaΓ-PCSP Ψ\PsiΨ is a finite list of clauses, each a symbol RRR applied to a tuple of variables, with repetition allowed. It is read twice: as ΨP\Psi_PΨP​, with each clause asking its tuple to lie in PRP_RPR​, and as ΨQ\Psi_QΨQ​, with QRQ_RQR​ in place of PRP_RPR​. Let EQUAL={(i,i):i∈D}\mathrm{EQUAL} = \{(i, i) : i \in D\}EQUAL={(i,i):i∈D}.

Definition (ppp-definability). A promise relation (P′,Q′)⊆Dk×Dk(P', Q') \subseteq D^k \times D^k(P′,Q′)⊆Dk×Dk is ppp-definable from a finite family Γ\GammaΓ if there are ℓ≥0\ell \ge 0ℓ≥0 and a Γ∪{EQUAL}\Gamma \cup \{\mathrm{EQUAL}\}Γ∪{EQUAL}-PCSP Ψ\PsiΨ on k+ℓk + \ellk+ℓ variables such that

  1. every x∈P′x \in P'x∈P′ extends by some y∈Dℓy \in D^\elly∈Dℓ to an assignment (x,y)(x, y)(x,y) satisfying ΨP\Psi_PΨP​;
  2. every assignment zzz satisfying ΨQ\Psi_QΨQ​ has (z1,…,zk)∈Q′(z_1, \dots, z_k) \in Q'(z1​,…,zk​)∈Q′.

A family Γ′\Gamma'Γ′ is ppp-definable from Γ\GammaΓ if each of its promise relations is.

Formalization targets

Goal: Theorem 6.1, algebraic core

For a finite family Γ\GammaΓ and a family Γ′\Gamma'Γ′ over the same finite domain,

Pol(Γ)⊆Pol(Γ′)  ⟹  every (P′,Q′)∈Γ′ is ppp-definable from Γ.\mathrm{Pol}(\Gamma) \subseteq \mathrm{Pol}(\Gamma') \;\Longrightarrow\; \text{every } (P', Q') \in \Gamma' \text{ is ppp-definable from } \Gamma.Pol(Γ)⊆Pol(Γ′)⟹every (P′,Q′)∈Γ′ is ppp-definable from Γ.

The printed Theorem 6.1 concludes a polynomial-time reduction from PCSP(Γ′)\mathrm{PCSP}(\Gamma')PCSP(Γ′) to PCSP(Γ)\mathrm{PCSP}(\Gamma)PCSP(Γ). Its proof opens by reducing to the displayed statement, and the reduction follows from it by substituting gadgets.

Milestones

  1. Sandwich remark (p. 27). If P′⊆P⊆Q⊆Q′P' \subseteq P \subseteq Q \subseteq Q'P′⊆P⊆Q⊆Q′ (same arity), then (P′,Q′)(P', Q')(P′,Q′) is ppp-definable from {(P,Q)}\{(P, Q)\}{(P,Q)}.
  2. Transitivity (p. 27). If Γ′\Gamma'Γ′ is ppp-definable from Γ\GammaΓ and (P′′,Q′′)(P'', Q'')(P′′,Q′′) from Γ′\Gamma'Γ′, then (P′′,Q′′)(P'', Q'')(P′′,Q′′) is ppp-definable from Γ\GammaΓ.
  3. Proposition 6.3 (p. 28). For L≥1L \ge 1L≥1, the promise relation (SL,TL)(S_L, T_L)(SL​,TL​) is ppp-definable from Γ\GammaΓ, where SL={f:DL→D:f∈Pol(P,P) ∀(P,Q)∈Γ}S_L = \{f : D^L \to D : f \in \mathrm{Pol}(P, P)\ \forall (P,Q) \in \Gamma\}SL​={f:DL→D:f∈Pol(P,P) ∀(P,Q)∈Γ}, TL={f:f∈Pol(P,Q) ∀(P,Q)∈Γ}T_L = \{f : f \in \mathrm{Pol}(P, Q)\ \forall (P,Q) \in \Gamma\}TL​={f:f∈Pol(P,Q) ∀(P,Q)∈Γ}, and each fff is read as the vector of its ∣D∣L|D|^L∣D∣L values.
  4. (Sm′,Tm′)(S'_m, T'_m)(Sm′​,Tm′​) from (Sm,Tm)(S_m, T_m)(Sm​,Tm​) (p. 28). For y1,…,yk∈Dmy^1, \dots, y^k \in D^my1,…,yk∈Dm, the projections Sm′={(f(y1),…,f(yk)):f∈Sm}S'_m = \{(f(y^1), \dots, f(y^k)) : f \in S_m\}Sm′​={(f(y1),…,f(yk)):f∈Sm​} and Tm′T'_mTm′​ (likewise) are ppp-definable from {(Sm,Tm)}\{(S_m, T_m)\}{(Sm​,Tm​)}.
  5. The chain (p. 28). If Pol(Γ)⊆Pol(Γ′)\mathrm{Pol}(\Gamma) \subseteq \mathrm{Pol}(\Gamma')Pol(Γ)⊆Pol(Γ′), (P′,Q′)∈Γ′(P', Q') \in \Gamma'(P′,Q′)∈Γ′, m=∣P′∣m = |P'|m=∣P′∣, x1,…,xmx^1, \dots, x^mx1,…,xm enumerate P′P'P′ and yji=xijy^i_j = x^j_iyji​=xij​, then P′⊆Sm′⊆Tm′⊆Q′P' \subseteq S'_m \subseteq T'_m \subseteq Q'P′⊆Sm′​⊆Tm′​⊆Q′.

Significance

The result. Theorem 6.1 shows that the complexity of PCSP(Γ)\mathrm{PCSP}(\Gamma)PCSP(Γ) depends only on Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ): two finite families with the same polymorphisms have polynomial-time equivalent PCSPs. Hardness can then be read off from the absence of structured polymorphisms, and tractability from their presence. The paper's Boolean symmetric dichotomy (its Theorem 2.16) is organised in exactly this way, and the theorem justifies studying families of polymorphisms instead of families of relations. Section 6.2 of the paper, which characterises the sets of functions of the form Pol(Γ)\mathrm{Pol}(\Gamma)Pol(Γ), is its companion.

Formalizing it. The result and its proof are published, and no machine-checked version is known to exist. This mission produces a reusable definition of ppp-definability for promise families over arbitrary finite domains, built on the published relational-structure vocabulary PCSPBLPAff_Symmetric_Setting. It also produces the closure properties (weakening, transitivity) any later work on gadget reductions between PCSPs will need, and the encoding of the polymorphism relation (SL,TL)(S_L, T_L)(SL​,TL​) as a gadget. The complexity-theoretic conclusion, a polynomial-time reduction, is not part of the mission.

Difficulty

The printed proofs are short, but each hides a construction. Transitivity requires substituting a gadget for every clause of an intermediate PCSP: the auxiliary variables of all gadgets are renamed apart, and EQUAL clauses are carried through unchanged. Proposition 6.3 requires one clause for every symbol RRR and every LLL-tuple of elements of PRP_RPR​, indexed by the finite set of such tuples and laid out on the ∣D∣L|D|^L∣D∣L coordinates of fff. The goal must handle P′=∅P' = \emptysetP′=∅ (so m=0m = 0m=0, nullary functions, and D0D^0D0 with one point), where Proposition 6.3 as printed (L≥1L \ge 1L≥1) does not apply. A tempting shortcut is to read the hypothesis Pol(Γ)⊆Pol(Γ′)\mathrm{Pol}(\Gamma) \subseteq \mathrm{Pol}(\Gamma')Pol(Γ)⊆Pol(Γ′) only for arities L≥1L \ge 1L≥1. With that reading the theorem is false: for Γ={(D,D)}\Gamma = \{(D, D)\}Γ={(D,D)} and Γ′={(∅,∅)}\Gamma' = \{(\emptyset, \emptyset)\}Γ′={(∅,∅)}, both unary, every function of positive arity is a polymorphism of both families, yet constant assignments satisfy every ΨQ\Psi_QΨQ​, so (∅,∅)(\emptyset, \emptyset)(∅,∅) is not ppp-definable.

Formalization scope

  • Domain and families. DDD is a finite type with decidable equality, and Γ\GammaΓ is 𝔸 𝔹 : RelStruct τ ar D with [Fintype τ] and IsPromiseFamily 𝔸 𝔹. Γ′\Gamma'Γ′ is a promise family over any signature τ', possibly infinite; the conclusion is stated relation by relation.
  • Polymorphisms. IsPolymorphism from the published setting file. PolSubset quantifies over every arity L : ℕ, including L=0L = 0L=0. This convention makes the goal true, and no hypothesis P′≠∅P' \neq \emptysetP′=∅ is added.
  • PCSPs with EQUAL. A Γ∪{EQUAL}\Gamma \cup \{\mathrm{EQUAL}\}Γ∪{EQUAL}-PCSP is an Instance over the signature τ ⊕ Unit, whose new symbol has arity 2 and is EQUAL in both readings. The same clause list is read in withEqual 𝔸 (as ΨP\Psi_PΨP​) and in withEqual 𝔹 (as ΨQ\Psi_QΨQ​). PPPDefinable requires Ψ.n = k + ℓ. The first kkk variables are Fin.castAdd ℓ, and (x,y)(x, y)(x,y) is Fin.append x y. The two clauses of the definition keep the paper's quantifiers: existence of an extension on the PPP side, and every satisfying assignment on the QQQ side. A formalization with two independent instances, or with both readings in PPP, would trivialise the notion and is excluded.
  • Functions as tuples. A set of functions DL→DD^L \to DDL→D becomes a relation of arity Fintype.card (Fin L → D) through any bijection e. The statements hold for every such ordering.
  • Out of scope. The polynomial-time (and log-space) reduction of the printed Theorem 6.1, its constant-factor blow-up, and all complexity classes. No PolyTime predicate or placeholder is introduced.
  • Welcome contributions. Proofs of the milestones. Reflexivity of ppp-definability, which is not stated here. The L=0L = 0L=0 case of Proposition 6.3. The converse direction of the correspondence (ppp-definability implies polymorphism inclusion). Reconciliation with the pp-definability of Barto–Bulín–Krokhin–Opršal (their Definition 2.24), where the two relations are defined by one pp-formula read in two structures.

Selected references

  • J. Brakensiek, V. Guruswami, Promise Constraint Satisfaction: Algebraic Structure and a Symmetric Boolean Dichotomy, SIAM J. Comput. 50(6), 2021; cited here from arXiv:1704.01937v2. https://arxiv.org/abs/1704.01937
  • P. Jeavons, On the algebraic structure of combinatorial problems, Theoretical Computer Science 200, 1998. https://doi.org/10.1016/S0304-3975(97)00230-2
  • D. Geiger, Closed systems of functions and predicates, Pacific J. Math. 27(1), 1968. https://doi.org/10.2140/pjm.1968.27.95
  • N. Pippenger, Galois theory for minors of finite functions, Discrete Mathematics 254, 2002. https://doi.org/10.1016/S0012-365X(01)00297-7
  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, J. ACM 68(4), 2021. https://arxiv.org/abs/1811.00970
8 thms1 active userReviewed
CombinatoricsDiscrete GeometryLinear algebra·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 1: An h-Scattered 𝔽_q-Subspace of V(r, qⁿ) Either Defines a Subgeometry or Has Dimension at Most rn/(h + 1)Research Paper

Motivation

Let VVV be an rrr-dimensional vector space over the finite field Fqn\mathbb F_{q^n}Fqn​. Viewed over the subfield Fq\mathbb F_qFq​, VVV has dimension rnrnrn, and its one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces form the Desarguesian spread. An Fq\mathbb F_qFq​-subspace UUU of VVV is scattered if it meets every element of this spread in an Fq\mathbb F_qFq​-subspace of dimension at most one. Scattered subspaces define scattered Fq\mathbb F_qFq​-linear sets in PG(r−1,qn)\mathrm{PG}(r-1,q^n)PG(r−1,qn). Through these linear sets they are connected to projective two-weight codes, strongly regular graphs and maximum rank distance (MRD) codes. In 2000 Blokhuis and Lavrauw proved that a scattered subspace has dimension at most rn/2rn/2rn/2, and a sequence of papers showed that this bound is attained whenever 2∣rn2 \mid rn2∣rn.

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2; Combinatorica 41, 2021) replace the one-dimensional spread elements by all hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces. This gives a hierarchy of conditions, the hhh-scattered subspaces, that refines the scattered case. For h=r−1h = r-1h=r−1 and dimension nnn these subspaces had already been identified with Fqn\mathbb F_{q^n}Fqn​-linear MRD codes by Sheekey and Van de Voorde. This mission formalizes the paper's main theorem, the dimension bound for hhh-scattered subspaces.

Timeline.

  • 2000: Blokhuis and Lavrauw, Scattered spaces with respect to a spread in PG(n, q), prove dim⁡FqU≤rn/2\dim_{\mathbb F_q} U \le rn/2dimFq​​U≤rn/2 for scattered UUU (the case h=1h = 1h=1).
  • 2000–2018: Ball–Blokhuis–Lavrauw (2000), Blokhuis–Lavrauw (2000), Csajbók–Marino–Polverino–Zullo (2017) and Bartoli–Giulietti–Marino–Polverino (2018) together show that scattered subspaces of dimension rn/2rn/2rn/2 exist whenever rnrnrn is even.
  • 2020: Sheekey and Van de Voorde study subspaces scattered with respect to hyperplanes (h=r−1h = r-1h=r−1) and relate them to MRD codes.
  • 2019–2021: Csajbók, Marino, Polverino and Zullo introduce hhh-scattered subspaces and prove the bound rn/(h+1)rn/(h+1)rn/(h+1) for every hhh (Theorem 2.3).

Setting

Let Fq⊆Fqn\mathbb F_q \subseteq \mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, so n=dim⁡FqFqnn = \dim_{\mathbb F_q}\mathbb F_{q^n}n=dimFq​​Fqn​, and let VVV be a vector space over Fqn\mathbb F_{q^n}Fqn​ of dimension rrr. Every Fqn\mathbb F_{q^n}Fqn​-subspace of VVV is also an Fq\mathbb F_qFq​-subspace. For an Fq\mathbb F_qFq​-subspace UUU of VVV, ⟨U⟩Fqn\langle U\rangle_{\mathbb F_{q^n}}⟨U⟩Fqn​​ denotes its Fqn\mathbb F_{q^n}Fqn​-span.

Definition 1.1. Let 0<h≤r−10 < h \le r-10<h≤r−1. An Fq\mathbb F_qFq​-subspace UUU of VVV is hhh-scattered if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U) \le hdimFq​​(S∩U)≤h. In Lean this is HScattered.Bound.IsHScattered F K h U, with F =Fq=\mathbb F_q=Fq​, K =Fqn=\mathbb F_{q^n}=Fqn​, and rrr = Module.finrank K V.

An Fq\mathbb F_qFq​-subspace UUU defines a subgeometry of PG(V,Fqn)\mathrm{PG}(V,\mathbb F_{q^n})PG(V,Fqn​) if some Fq\mathbb F_qFq​-basis of UUU is also an Fqn\mathbb F_{q^n}Fqn​-basis of VVV (HScattered.Construction.DefinesSubgeometry F K U, a definition shared with the other missions of this series). In coordinates, UUU is then Fq r\mathbb F_q^{\,r}Fqr​ inside Fqn r\mathbb F_{q^n}^{\,r}Fqnr​.

A rank distance code of Fqn×m\mathbb F_q^{n\times m}Fqn×m​, n≤mn \le mn≤m, is a set C\mathcal CC of Fq\mathbb F_qFq​-linear maps from an mmm-dimensional to an nnn-dimensional Fq\mathbb F_qFq​-space, with distance d(f,g)=rk⁡(f−g)d(f,g) = \operatorname{rk}(f-g)d(f,g)=rk(f−g).

Formalization targets

Goal: Theorem 2.3

If UUU is an hhh-scattered Fq\mathbb F_qFq​-subspace of VVV, then either dim⁡FqU=r\dim_{\mathbb F_q}U = rdimFq​​U=r, UUU defines a subgeometry and UUU is (r−1)(r-1)(r−1)-scattered, or

dim⁡FqU≤rnh+1.\dim_{\mathbb F_q} U \le \frac{rn}{h+1}.dimFq​​U≤h+1rn​.

The disjunction is inclusive. The statement holds for every hhh in the range 0<h≤r−10 < h \le r-10<h≤r−1, including h=1h = 1h=1.

Milestones

  • Proposition 2.1. For h>1h > 1h>1, an hhh-scattered subspace is iii-scattered for every 0<i<h0 < i < h0<i<h.
  • Lemma 2.2. If r≥2r \ge 2r≥2 and r≤i≤nr \le i \le nr≤i≤n, then VVV contains an (r−1)(r-1)(r−1)-scattered Fq\mathbb F_qFq​-subspace of dimension iii.
  • Result 4.6 (Delsarte). A rank distance code of Fqn×m\mathbb F_q^{n\times m}Fqn×m​, n≤mn\le mn≤m, with minimum distance ddd has ∣C∣≤qm(n−d+1)|\mathcal C| \le q^{m(n-d+1)}∣C∣≤qm(n−d+1).

Significance

The result. Theorem 2.3 is the upper end of the theory of hhh-scattered subspaces. It shows that the bound rn/(h+1)rn/(h+1)rn/(h+1) decreases with hhh: a stronger intersection condition forces a smaller subspace. Every subspace reaching the bound is a maximum hhh-scattered subspace. The rest of the paper builds on such subspaces. Its constructions show the bound is sharp when h+1∣rh+1 \mid rh+1∣r. Its intersection numbers with hyperplanes lie in [rn/(h+1)−n, rn/(h+1)−n+h][rn/(h+1)-n,\ rn/(h+1)-n+h][rn/(h+1)−n, rn/(h+1)−n+h]. Its Delsarte-type duality sends maximum hhh-scattered subspaces to maximum (n−h−2)(n-h-2)(n−h−2)-scattered ones. Each of these statements presupposes the bound. For h=r−1h = r-1h=r−1, the bound dim⁡U≤n\dim U \le ndimU≤n is the geometric counterpart of the Singleton bound for MRD codes.

Formalizing it. The theorem is proved in the paper; it has no machine-checked proof. A formalization would provide a Lean model of hhh-scattered subspaces over a field tower and a rank-metric Singleton bound, and the bound itself as a reusable lemma for the companion missions on constructions, hyperplane intersections and duality. The case h=1h = 1h=1 is attributed in the paper to Blokhuis–Lavrauw and is not reproved there, so a complete formal proof must also supply that case.

Difficulty

The obvious approach is to count. Every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace meets UUU in at most qhq^hqh vectors. But these subspaces overlap heavily, and a double count of incidences between vectors of UUU and hhh-dimensional subspaces does not produce a bound of the form rn/(h+1)rn/(h+1)rn/(h+1). The hhh-scattered condition must be used on subspaces of every dimension t<ht < ht<h at once, which is the content of Proposition 2.1. The argument for h=1h = 1h=1 does not carry over directly either: the paper treats h=r−1h = r-1h=r−1, 1<h<r−11 < h < r-11<h<r−1 with n≥h+1n \ge h+1n≥h+1, and n<h+1n < h+1n<h+1 as separate cases. The case h=r−1h = r-1h=r−1 rests on a coding-theoretic input (Result 4.6), and the middle case needs auxiliary subspaces whose existence (Lemma 2.2) holds only when n≥h+1n \ge h+1n≥h+1.

Formalization scope

  • Field tower. Fq\mathbb F_qFq​ and Fqn\mathbb F_{q^n}Fqn​ are finite fields F, K with [Algebra F K]. VVV is a finite-dimensional K-module with a compatible F-module structure ([IsScalarTower F K V]). The parameters are qqq = Fintype.card F, nnn = Module.finrank F K and rrr = Module.finrank K V.
  • Subspaces. Fq\mathbb F_qFq​-subspaces are Submodule F V and Fqn\mathbb F_{q^n}Fqn​-subspaces are Submodule K V. The intersection S∩US\cap US∩U is S.restrictScalars F ⊓ U.
  • The definition. The range 0<h<r0 < h < r0<h<r and the spanning condition ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V are clauses of IsHScattered.
  • No division. rn/(h+1)rn/(h+1)rn/(h+1) never appears with division: "dim⁡U≤rn/(h+1)\dim U \le rn/(h+1)dimU≤rn/(h+1)" is (h+1)dim⁡U≤rn(h+1)\dim U \le rn(h+1)dimU≤rn in N\mathbb NN.
  • Result 4.6. The code is a Finset of linear maps. The minimum distance ddd enters as a lower bound on all pairwise rank distances, with 1≤d≤n1 \le d \le n1≤d≤n.
  • Lemma 2.2. It carries r≥2r \ge 2r≥2, which Definition 1.1 forces for (r−1)(r-1)(r−1)-scattered subspaces.

Ruling out trivial readings. Without the range h<rh < rh<r, every spanning subspace would be "hhh-scattered" for h≥rh \ge rh≥r, and U=VU = VU=V of dimension rnrnrn would refute the goal. Without the spanning condition, U=0U = 0U=0 would satisfy the bound vacuously. Both conditions are part of the definition, and the goal is the inclusive disjunction for every hhh-scattered UUU.

Cited inputs. Result 4.6 is Delsarte's theorem [13], numbered in this paper and posed here with sorry. The case h=1h = 1h=1 of the goal is the Blokhuis–Lavrauw bound [4], which the paper cites without proof and says can be obtained by adapting its argument (Zullo's thesis [30]). It is not an item: a complete proof of the goal must cover it.

Infrastructure. A proof needs: dimension arithmetic for restriction of scalars in a tower; the rank–nullity theorem for Fq\mathbb F_qFq​-linear maps; the count of roots of a qqq-polynomial ∑jajxqj\sum_j a_j x^{q^j}∑j​aj​xqj, for Lemma 2.2; and a rank-metric Singleton bound. The Singleton bound and Lemma 2.2 are reusable beyond this mission. Contributions are welcome on any milestone, on the h=1h = 1h=1 case, and on the reduction for n<h+1n < h+1n<h+1.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, arXiv:1906.10590v2 (2020); Combinatorica 41 (2021). https://arxiv.org/abs/1906.10590v2
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geometriae Dedicata 81 (2000) 231–243. https://doi.org/10.1023/A:1005283806897
  • P. Delsarte, Bilinear forms over a finite field, with applications to coding theory, J. Combin. Theory Ser. A 25 (1978) 226–241. https://doi.org/10.1016/0097-3165(78)90015-8
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets, and their duality, Designs, Codes and Cryptography 88 (2020) 655–675. https://doi.org/10.1007/s10623-019-00703-z
6 thms1 active userReviewed
CombinatoricsComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Algebraic Approach to Promise Constraint Satisfaction 1: A Minion Homomorphism Pol(A₁, B₁) → Pol(A₂, B₂) Exists iff (A₂, B₂) Is pp-Constructible from (A₁, B₁)Research Paper

Motivation

A promise constraint satisfaction problem PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) is given by two finite relational structures with a homomorphism A→B\mathbf A\to\mathbf BA→B. An instance is a third structure I\mathbf II, and the task is to answer yes if I→A\mathbf I\to\mathbf AI→A and no if I↛B\mathbf I\not\to\mathbf BI→B; the promise is that one of the two holds. Approximate graph colouring (colour a kkk-colourable graph with c≥kc\ge kc≥k colours) and the search for a not-all-equal assignment of a 1-in-3-satisfiable formula are of this form, and their complexity has been open since the 1970s and 2010s respectively.

For ordinary CSPs (A=B\mathbf A=\mathbf BA=B) the algebraic approach, in which the complexity is governed by the polymorphisms of the template, led to the classification of all finite-template CSPs (Bulatov 2017, Zhuk 2017). Barto, Bulín, Krokhin and Opršal (arXiv:1811.00970, J. ACM 2021) extend that approach to promise problems. Their central structural result is Theorem 4.12: the existence of a minion homomorphism between polymorphism minions, which by their Theorem 3.1 yields a log-space reduction between the PCSPs, is characterized in five other ways, two of them purely relational.

Timeline:

  • 1998: Jeavons shows that polymorphisms determine the complexity of CSP(A)\mathrm{CSP}(\mathbf A)CSP(A), through a Galois correspondence between pp-definable relations and polymorphisms.
  • 2002: Pippenger develops the Galois correspondence for pairs of sets that underlies the promise setting.
  • 2016–2018: Brakensiek and Guruswami (arXiv:1704.01937) prove that Pol(A,B)⊆Pol(A′,B′)\mathrm{Pol}(\mathbf A,\mathbf B)\subseteq\mathrm{Pol}(\mathbf A',\mathbf B')Pol(A,B)⊆Pol(A′,B′) yields a reduction for templates over the same domains.
  • 2018: Barto, Opršal and Pinsker (arXiv:1510.04521) characterize pp-constructibility of CSP templates by minor-preserving maps of polymorphism clones.
  • 2019: the present paper defines minion homomorphisms between polymorphism minions of promise templates and proves Theorem 4.12.

Setting

A signature is a finite set τ\tauτ of relation symbols RRR with arities ar(R)≥1\mathrm{ar}(R)\ge1ar(R)≥1. A structure A\mathbf AA on a finite set AAA gives a relation RA⊆Aar(R)R^{\mathbf A}\subseteq A^{\mathrm{ar}(R)}RA⊆Aar(R) for each RRR; a homomorphism h:A→Bh:\mathbf A\to\mathbf Bh:A→B maps every tuple of RAR^{\mathbf A}RA into RBR^{\mathbf B}RB. A PCSP template is a pair (A,B)(\mathbf A,\mathbf B)(A,B) of structures with the same signature and A→B\mathbf A\to\mathbf BA→B.

An nnn-ary polymorphism f:An→Bf:A^n\to Bf:An→B, n≥1n\ge1n≥1, applied coordinatewise to any nnn tuples of RAR^{\mathbf A}RA, gives a tuple of RBR^{\mathbf B}RB. The minor of an mmm-ary ggg given by π:[m]→[n]\pi:[m]\to[n]π:[m]→[n] is f(x1,…,xn)=g(xπ(1),…,xπ(m))f(x_1,\dots,x_n)=g(x_{\pi(1)},\dots,x_{\pi(m)})f(x1​,…,xn​)=g(xπ(1)​,…,xπ(m)​). A minion is a nonempty set of functions of positive arity closed under minors; Pol(A,B)\mathrm{Pol}(\mathbf A,\mathbf B)Pol(A,B) is one. A minion homomorphism ξ:M→N\xi:\mathcal M\to\mathcal Nξ:M→N preserves arities and satisfies ξ(g(xπ(1),…,xπ(m)))=ξ(g)(xπ(1),…,xπ(m))\xi(g(x_{\pi(1)},\dots,x_{\pi(m)}))=\xi(g)(x_{\pi(1)},\dots,x_{\pi(m)})ξ(g(xπ(1)​,…,xπ(m)​))=ξ(g)(xπ(1)​,…,xπ(m)​).

A bipartite minor condition is a finite set of identities f(x1,…,xn)≈g(xπ(1),…,xπ(m))f(x_1,\dots,x_n)\approx g(x_{\pi(1)},\dots,x_{\pi(m)})f(x1​,…,xn​)≈g(xπ(1)​,…,xπ(m)​) between symbols from two disjoint sets; a minion satisfies it if the symbols can be assigned members of matching arity that make every identity true. For a structure A\mathbf AA with A={a1,…,an}A=\{a_1,\dots,a_n\}A={a1​,…,an​} and an instance I\mathbf II, the condition Σ(A,I)\Sigma(\mathbf A,\mathbf I)Σ(A,I) has an nnn-ary symbol fvf_vfv​ per element vvv of I\mathbf II, an ∣RA∣|R^{\mathbf A}|∣RA∣-ary symbol gCg_CgC​ per constraint CCC, and one identity per position of each constraint, read off the list of tuples of RAR^{\mathbf A}RA. The free structure FM(A)F_{\mathcal M}(\mathbf A)FM​(A) has universe M(n)\mathcal M^{(n)}M(n), and a tuple (f1,…,fk)(f_1,\dots,f_k)(f1​,…,fk​) lies in its relation RRR when all fif_ifi​ are minors of one ∣RA∣|R^{\mathbf A}|∣RA∣-ary member of M\mathcal MM in the pattern given by RAR^{\mathbf A}RA.

A pp-power (A′,B′)(\mathbf A',\mathbf B')(A′,B′) of (A,B)(\mathbf A,\mathbf B)(A,B) lives on ANA^NAN, BNB^NBN, each relation being defined in A\mathbf AA and in B\mathbf BB by one and the same primitive positive formula. A homomorphic relaxation (A′,B′)(\mathbf A',\mathbf B')(A′,B′) of (A,B)(\mathbf A,\mathbf B)(A,B) has homomorphisms A′→A\mathbf A'\to\mathbf AA′→A and B→B′\mathbf B\to\mathbf B'B→B′. pp-constructibility is the closure under finitely many such steps.

Formalization targets

Goal: Theorem 4.12

For PCSP templates (Ai,Bi)(\mathbf A_i,\mathbf B_i)(Ai​,Bi​) of finite structures and Mi=Pol(Ai,Bi)\mathcal M_i=\mathrm{Pol}(\mathbf A_i,\mathbf B_i)Mi​=Pol(Ai​,Bi​), the following are equivalent:

(1) ∃ ξ:M1→M2(4) FM1(A2)→B2(2) M1⊨Σ⇒M2⊨Σ for every bipartite Σ(5) (A2,B2) relaxes a pp-power of (A1,B1)(3) M2⊨Σ(A2,FM1(A2))(6) (A2,B2) is pp-constructible from (A1,B1).\begin{aligned} &(1)\ \exists\,\xi:\mathcal M_1\to\mathcal M_2 &&(4)\ F_{\mathcal M_1}(\mathbf A_2)\to\mathbf B_2\\ &(2)\ \mathcal M_1\models\Sigma\Rightarrow\mathcal M_2\models\Sigma\text{ for every bipartite }\Sigma &&(5)\ (\mathbf A_2,\mathbf B_2)\text{ relaxes a pp-power of }(\mathbf A_1,\mathbf B_1)\\ &(3)\ \mathcal M_2\models\Sigma(\mathbf A_2,F_{\mathcal M_1}(\mathbf A_2)) &&(6)\ (\mathbf A_2,\mathbf B_2)\text{ is pp-constructible from }(\mathbf A_1,\mathbf B_1). \end{aligned}​(1) ∃ξ:M1​→M2​(2) M1​⊨Σ⇒M2​⊨Σ for every bipartite Σ(3) M2​⊨Σ(A2​,FM1​​(A2​))​​(4) FM1​​(A2​)→B2​(5) (A2​,B2​) relaxes a pp-power of (A1​,B1​)(6) (A2​,B2​) is pp-constructible from (A1​,B1​).​

Milestones

In the order of the proof on p. 27: Lemma 4.8 (relaxations and pp-powers give minion homomorphisms) and Corollary 4.10 for (6) ⇒ (1); Lemma 4.3 (M⊨Σ(A,FM(A))\mathcal M\models\Sigma(\mathbf A,F_{\mathcal M}(\mathbf A))M⊨Σ(A,FM​(A))) for (2) ⇒ (3); Lemma 3.14 for (3) ⇒ (4); Lemma 4.11 ((A2,FM1(A2))(\mathbf A_2,F_{\mathcal M_1}(\mathbf A_2))(A2​,FM1​​(A2​)) relaxes a pp-power of (A1,B1)(\mathbf A_1,\mathbf B_1)(A1​,B1​)) for (4) ⇒ (5). Lemma 4.4, the bijection between homomorphisms FM(A)→BF_{\mathcal M}(\mathbf A)\to\mathbf BFM​(A)→B and minion homomorphisms M→Pol(A,B)\mathcal M\to\mathrm{Pol}(\mathbf A,\mathbf B)M→Pol(A,B), is included as an extra item.

Significance

Theorem 4.12 replaces a property of infinitely many functions, the existence of a minion homomorphism, by a homomorphism between two finite structures (item 4), which is decidable, and by a relational construction (items 5–6). The free-structure criterion is what bounds the arity of polymorphisms that a hardness proof must inspect, and the paper uses it to prove NP-hardness of PCSP(Kk,K2k−1)\mathrm{PCSP}(\mathbf K_k,\mathbf K_{2k-1})PCSP(Kk​,K2k−1​) and to analyse the 1-in-3 versus not-all-equal problem. Later work on approximate graph and hypergraph colouring states its reductions in these terms.

The result is proved in the paper. As far as is known it has not been machine-checked: Mathlib has no minions, minor conditions, pp-formulas or pp-constructions. The mission produces a reusable Lean vocabulary for the algebraic theory of promise CSPs, together with a formal proof of the equivalence. The complexity consequences are not formalized.

Difficulty

Four of the implications are short once the definitions are fixed. The substantial step is (4) ⇒ (5), Lemma 4.11: a statement about the polymorphism minion, an object defined by infinitely many conditions, must be turned into a finite relational construction, and the relations of the pp-power have to be defined by one formula that is correct in A1\mathbf A_1A1​ and in B1\mathbf B_1B1​ at the same time. The indices involved, tuples over a power of A1A_1A1​, coordinates indexed by A2A_2A2​, and the enumeration of each RA2R^{\mathbf A_2}RA2​, are where an informal reading leaves the most to check. Lemma 4.8(2) needs that polymorphisms preserve every pp-definable relation, a statement about arbitrary formulas, not only about the relations of the template. Corollary 4.10 is an induction over a sequence of templates whose signatures and domains change from step to step, which a formal statement cannot treat as a sequence in one fixed type.

Formalization scope

Structures, homomorphisms, templates and polymorphisms are the published PCSPBLPAff.Symmetric definitions (RelStruct, IsHom, IsPromiseTemplate, IsPolymorphism). All structures are finite with nonempty domains: domains carry Fintype, DecidableEq and Nonempty (nonemptiness is the field's standing convention, which the paper uses when it identifies a domain with [n][n][n]; without it items (4) and (5) of the goal are not equivalent). The goal and Lemma 4.11 also assume that every relation of A2\mathbf A_2A2​ is nonempty; the paper does not say so, but if RA2=∅R^{\mathbf A_2}=\emptysetRA2​=∅ then RFM1(A2)=∅R^{F_{\mathcal M_1}(\mathbf A_2)}=\emptysetRFM1​​(A2​)=∅, and when B1\mathbf B_1B1​ has an element on which every relation holds constantly no pp-power can have an empty relation, so (4) ⇒ (5) fails, signatures are Fintype, arities are positive, minions in Lemmas 4.3–4.4 live on finite sets. Theorem 4.12 is stated only for finite templates, as in the paper (p. 46 notes that it fails for infinite ones). Minions have no nullary members. A minion homomorphism is a family of maps on the members M(n)→N(n)\mathcal M^{(n)}\to\mathcal N^{(n)}M(n)→N(n), so it cannot be made trivial by values outside the minion. Bipartite minor conditions have finite symbol and identity types in Type; item (2) quantifies over all of them. Σ(A,I)\Sigma(\mathbf A,\mathbf I)Σ(A,I) and FM(A)F_{\mathcal M}(\mathbf A)FM​(A) take the enumeration of AAA and of each RAR^{\mathbf A}RA as explicit equivalences; the paper's identification A=[n]A=[n]A=[n] is one such choice. A pp-power uses one formula for both structures, with free variables indexed by [k]×[N][k]\times[N][k]×[N]. Templates are bundled for pp-constructibility, which is an inductive predicate.

The goal is the six-way equivalence (List.TFAE) and not any of its trivial fragments; the goal cannot be closed by choosing degenerate enumerations, because every statement quantifies over all of them.

Not formalized: the log-space reductions of Theorems 3.1 and 3.12, Remark 3.11's reduction between promise minor-condition problems, and the cited Theorem 2.25 [Pip02, BG16b]. Contributions are welcome on general facts that are reusable beyond this mission: polymorphisms preserve pp-definable relations, composition of minion homomorphisms, and the natural minion homomorphism M→Pol(A,FM(A))\mathcal M\to\mathrm{Pol}(\mathbf A,F_{\mathcal M}(\mathbf A))M→Pol(A,FM​(A)).

Selected references

  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, J. ACM 68(4), 2021; arXiv:1811.00970v3. https://arxiv.org/abs/1811.00970
  • L. Barto, J. Opršal, M. Pinsker, The wonderland of reflections, Israel J. Math. 223, 2018. https://arxiv.org/abs/1510.04521
  • J. Brakensiek, V. Guruswami, Promise constraint satisfaction: structure theory and a symmetric Boolean dichotomy, SODA 2018. https://arxiv.org/abs/1704.01937
  • N. Pippenger, Galois theory for minors of finite functions, Discrete Math. 254, 2002. https://doi.org/10.1016/S0012-365X(01)00297-7
  • P. Jeavons, On the algebraic structure of combinatorial problems, Theoret. Comput. Sci. 200, 1998. https://doi.org/10.1016/S0304-3975(97)00230-2
11 thms1 active userReviewed
CombinatoricsComplexity TheoryTheoretical Computer Science·Captain: mikedeng1

Algebraic Approach to Promise Constraint Satisfaction 4: No Finite D with 1-in-3 → D → NAE Has a Cyclic Polymorphism of Prime Arity p > 60|D|Research Paper

Motivation

A promise constraint satisfaction problem (PCSP) is given by a pair of relational structures (A,B)(\mathbf A,\mathbf B)(A,B) with a homomorphism A→B\mathbf A\to\mathbf BA→B: an instance is promised to be satisfiable in A\mathbf AA, and it suffices to satisfy it in B\mathbf BB. The paper of Barto, Bulín, Krokhin and Opršal (arXiv:1811.00970v3) develops the algebraic theory of PCSPs, in which the complexity of PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) is governed by its polymorphisms.

The most prominent example is 1-in-3 versus Not-All-Equal-SAT: given a system of ternary constraints that has an assignment making exactly one variable in each constraint true, find an assignment making the variables in each constraint not all equal. Brakensiek and Guruswami (arXiv:1704.01937) showed that this problem is solvable in polynomial time, although both 1-in-3-SAT and NAE-SAT are NP-complete on their own. Their algorithm, like every tractability result for PCSPs known when the paper was written, works by finding a tractable CSP template C\mathbf CC with T→C→H2\mathbf T\to\mathbf C\to\mathbf H_2T→C→H2​ (a "sandwich") and solving the CSP over C\mathbf CC. For 1-in-3 vs NAE the template used is infinite: the integers with the relation x+y+z=1x+y+z=1x+y+z=1.

Section 8 of the paper shows that this is unavoidable: no finite tractable template can be sandwiched, or more generally pp-constructed, in this way. This separates PCSPs from CSPs: infinite domains are necessary in the sandwich method.

Timeline: Feder and Vardi conjectured the CSP dichotomy (1998); Barto and Kozik characterised the borderline by cyclic polymorphisms (BK12, 2012); Bulatov and Zhuk proved the dichotomy (arXiv:1703.03021, arXiv:1704.01914, 2017); Brakensiek and Guruswami proved 1-in-3 vs NAE tractable (2018); Barto, Bulín, Krokhin and Opršal proved Theorem 8.1 (2019).

Setting

All structures here have one ternary relation. For a set DDD and R⊆D3R\subseteq D^3R⊆D3, (D;R)(D;R)(D;R) is the structure with domain DDD and relation RRR. The 1-in-3 structure is T=({0,1};{(1,0,0),(0,1,0),(0,0,1)})\mathbf T=(\{0,1\};\{(1,0,0),(0,1,0),(0,0,1)\})T=({0,1};{(1,0,0),(0,1,0),(0,0,1)}) and the not-all-equal structure is H2=({0,1};{0,1}3∖{(0,0,0),(1,1,1)})\mathbf H_2=(\{0,1\};\{0,1\}^3\setminus\{(0,0,0),(1,1,1)\})H2​=({0,1};{0,1}3∖{(0,0,0),(1,1,1)}).

A homomorphism h:(A;RA)→(B;RB)h:(A;R_A)\to(B;R_B)h:(A;RA​)→(B;RB​) is a map with (h(a),h(b),h(c))∈RB(h(a),h(b),h(c))\in R_B(h(a),h(b),h(c))∈RB​ whenever (a,b,c)∈RA(a,b,c)\in R_A(a,b,c)∈RA​. A polymorphism of (D;R)(D;R)(D;R) of arity ppp is a map s:Dp→Ds:D^p\to Ds:Dp→D such that, applied coordinatewise to any ppp triples from RRR, it yields a triple in RRR. An operation s:Dp→Ds:D^p\to Ds:Dp→D is cyclic if s(a1,a2,…,ap)=s(a2,…,ap,a1)s(a_1,a_2,\dots,a_p)=s(a_2,\dots,a_p,a_1)s(a1​,a2​,…,ap​)=s(a2​,…,ap​,a1​) for all a∈Dpa\in D^pa∈Dp (Definition 8.2).

The proof of Theorem 8.1 works in the following situation: DDD is finite, f:T→(D;R)f:\mathbf T\to(D;R)f:T→(D;R) and g:(D;R)→H2g:(D;R)\to\mathbf H_2g:(D;R)→H2​ are homomorphisms, p>60∣D∣p>60|D|p>60∣D∣ is a prime and sss is a cyclic polymorphism of (D;R)(D;R)(D;R) of arity ppp. From sss it builds the p2p^2p2-ary operation

t(X)=s(s(x11,…,xp1),…,s(x1p,…,xpp))t(X)=s\big(s(x_{11},\dots,x_{p1}),\dots,s(x_{1p},\dots,x_{pp})\big)t(X)=s(s(x11​,…,xp1​),…,s(x1p​,…,xpp​))

on p×pp\times pp×p matrices X=(xij)X=(x_{ij})X=(xij​), and studies zero-one matrices, evaluated in DDD through fff: their area λ(X)\lambda(X)λ(X) (the fraction of ones), ggg-equivalence X∼Y  ⟺  g(t(X))=g(t(Y))X\sim Y\iff g(t(X))=g(t(Y))X∼Y⟺g(t(X))=g(t(Y)), tameness (X∼0p×pX\sim 0_{p\times p}X∼0p×p​ with λ(X)<1/3\lambda(X)<1/3λ(X)<1/3, or X∼1p×pX\sim 1_{p\times p}X∼1p×p​ with λ(X)>1/3\lambda(X)>1/3λ(X)>1/3), covers (three matrices with exactly one 111 in each position), the line segments ⟨i⟩\langle i\rangle⟨i⟩ (ones in the first iii positions in row-major order), and almost rectangles [k,…,k,l,…,l][k,\dots,k,l,\dots,l][k,…,k,l,…,l] (columns of heights kkk then lll, with step 0≤k−l≤5∣D∣0\le k-l\le 5|D|0≤k−l≤5∣D∣).

Formalization targets

Goal: the algebraic core of Theorem 8.1

T→f(D;R)→gH2,  D finite,  p prime, p>60∣D∣ ⟹ (D;R) has no cyclic polymorphism of arity p.\mathbf T\xrightarrow{f}(D;R)\xrightarrow{g}\mathbf H_2,\ \ D\text{ finite},\ \ p\text{ prime},\ p>60|D|\ \Longrightarrow\ (D;R)\text{ has no cyclic polymorphism of arity }p.Tf​(D;R)g​H2​,  D finite,  p prime, p>60∣D∣ ⟹ (D;R) has no cyclic polymorphism of arity p.

Milestones, in proof order

  1. Lemma 8.7: the three matrices of a cover are not all ggg-equivalent.
  2. Lemma 8.8: ttt is cyclic in its p2p^2p2 row-major arguments.
  3. Lemma 8.9: with p2=3q+1p^2=3q+1p2=3q+1, ⟨0⟩∼⋯∼⟨q⟩≁⟨q+1⟩∼⋯∼⟨2q+1⟩\langle 0\rangle\sim\cdots\sim\langle q\rangle\not\sim\langle q+1\rangle\sim\cdots\sim\langle 2q+1\rangle⟨0⟩∼⋯∼⟨q⟩∼⟨q+1⟩∼⋯∼⟨2q+1⟩.
  4. Lemma 8.10: every ⟨i⟩\langle i\rangle⟨i⟩, 0≤i≤p20\le i\le p^20≤i≤p2, is tame, and 0p×p≁1p×p0_{p\times p}\not\sim 1_{p\times p}0p×p​∼1p×p​.
  5. Proposition 8.12: every almost rectangle is tame.
  6. §8.4: there are l1<l2l_1<l_2l1​<l2​ in (p/3−2∣D∣, p/3)(p/3-2|D|,\,p/3)(p/3−2∣D∣,p/3) with s(1l10p−l1)=s(1l20p−l2)s(1^{l_1}0^{p-l_1})=s(1^{l_2}0^{p-l_2})s(1l1​0p−l1​)=s(1l2​0p−l2​).

Significance

Combined with the theorem of Barto and Kozik (a finite CSP template whose CSP is not NP-complete has cyclic polymorphisms of every prime arity p>∣D∣p>|D|p>∣D∣) and with the paper's Theorem 4.12, the core yields Theorem 8.1: if (T,H2)(\mathbf T,\mathbf H_2)(T,H2​) is pp-constructible from a finite D\mathbf DD, then CSP(D)\mathrm{CSP}(\mathbf D)CSP(D) is NP-complete. Hence the polynomial-time algorithm for 1-in-3 vs NAE cannot come from any finite tractable CSP, and the infinite template of Brakensiek and Guruswami is necessary. It is a concrete separation between PCSPs and CSPs: a tractable PCSP that is not explained by any finite tractable CSP.

The theorem is proved in the paper; nothing in this section has a machine-checked proof. The mission produces a formal proof of the combinatorial core, a reusable definition of cyclic operations on top of the platform's polymorphism library, and the matrix calculus of §8 (areas, covers, ttt), which is the part of the argument where index conventions are easiest to get wrong.

Difficulty

Polymorphisms of (D;R)(D;R)(D;R) are not determined by their values on zero-one inputs, and nothing beyond cyclicity is known about sss. The obvious attempt, to show directly that sss restricted to {f(0),f(1)}\{f(0),f(1)\}{f(0),f(1)} depends only on the number of ones, fails: this property does not follow from cyclicity (Remark 8.15 asks whether polymorphisms of that kind always exist, and it is open). The only information available about sss is the coarse two-valued invariant g(t(⋅))g(t(\cdot))g(t(⋅)) on zero-one matrices, and the contradiction has to be produced from that invariant alone, uniformly over all finite DDD; the margin p>60∣D∣p>60|D|p>60∣D∣ is what keeps the areas involved away from 1/31/31/3.

Formalization scope

Structures are instances of the published PCSPBLPAff.Symmetric.RelStruct with the single-symbol signature Unit of arity 333; homomorphisms and polymorphisms are the published IsHom and IsPolymorphism. The domain {0,1}\{0,1\}{0,1} is Fin 2; DDD is a Fintype with decidable equality. Matrices are functions Fin p → Fin p → Fin 2, row index first; the p2p^2p2 arguments of ttt are read row-major via finProdFinEquiv; areas are rationals. Cyclicity is s a = s (a ∘ finRotate p), the paper's (a2,…,ap,a1)(a_2,\dots,a_p,a_1)(a2​,…,ap​,a1​). The paper renames DDD so that f(0)=0f(0)=0f(0)=0, f(1)=1f(1)=1f(1)=1; the formalization keeps fff and evaluates zero-one matrices through it. Definition 8.11 prints column heights 1≤ki≤p1\le k_i\le p1≤ki​≤p, but its proofs use height 000, so heights range over 0≤ki≤p0\le k_i\le p0≤ki​≤p.

Lemmas 8.7–8.10 are stated with only the hypotheses their proofs use (Lemma 8.8 needs only cyclicity; Lemmas 8.9–8.10 need p>3p>3p>3 prime rather than p>60∣D∣p>60|D|p>60∣D∣). Lemmas 8.13 and 8.14 concern a minimal counterexample inside the proof of Proposition 8.12 and are not separate items.

Left out: the NP-completeness conclusion of Theorem 8.1; the reduction from pp-constructibility to a homomorphic relaxation (Theorem 4.12, mission 1 of this series); the fact that a pp-power of a finite tractable CSP template is a finite tractable CSP template; and the cited Theorem 8.3 [BK12], which is never assumed or stated.

The goal ends in False, so it would be trivial if its hypotheses were contradictory for a reason unrelated to sss. They are not: D={0,1}D=\{0,1\}D={0,1}, RRR the 1-in-3 relation, f=g=idf=g=\mathrm{id}f=g=id satisfies every hypothesis except the existence of sss. No restriction is placed on sss beyond being a cyclic polymorphism; assuming idempotence or dependence on counts only would assume away the content (Remark 8.15).

Contributions welcome: proofs of the milestones, a general library of cyclic operations and their compositions, and a formalization of Theorem 8.3 or of the pp-power step, which would turn the core into Theorem 8.1 itself.

Selected references

  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, arXiv:1811.00970v3, 2019; J. ACM 68(4), 2021. https://arxiv.org/abs/1811.00970
  • L. Barto, M. Kozik, Absorbing subalgebras, cyclic terms, and the constraint satisfaction problem, Logical Methods in Computer Science 8(1:07), 2012. https://doi.org/10.2168/LMCS-8(1:7)2012
  • J. Brakensiek, V. Guruswami, Promise constraint satisfaction: structure theory and a symmetric Boolean dichotomy, SODA 2018. https://arxiv.org/abs/1704.01937
  • A. Bulatov, A dichotomy theorem for nonuniform CSPs, FOCS 2017. https://arxiv.org/abs/1703.03021
  • D. Zhuk, A proof of the CSP dichotomy conjecture, FOCS 2017; J. ACM 67(5), 2020. https://arxiv.org/abs/1704.01914
10 thms1 active userReviewed
CombinatoricsDiscrete Geometry·Captain: mikedeng1

Maximum Scattered Linear Sets and Complete Caps in Galois Spaces 2: For q = 2^t, t Even, and n ≥ 4 Even, AG(n, q) Has a Complete Cap of Size 2√(q^(n−1))Research Paper

Small complete caps in Galois spaces

A cap in an affine or projective space over a finite field is a set of points no three of which are collinear; a cap is complete when it is maximal with respect to inclusion, so that every point outside it lies on a line through two of its points. Caps are closely connected with error-correcting codes: projective caps can serve as parity-check columns for linear codes with minimum distance at least 4. Constructing small complete caps explicitly is a long-standing question in finite geometry; Giulietti's survey collects the known families.

Counting the lines through pairs of points gives the trivial lower bound

2⋅qn−1(1)\sqrt{2} \cdot \sqrt{q^{n-1}} \qquad (1)2​⋅qn−1​(1)

for the size of a complete cap in a Galois space of dimension nnn and order qqq. A short timeline:

  • Segre (1959) constructed complete caps of size 3q+23q + 23q+2 in PG(3,q)PG(3, q)PG(3,q), qqq even.
  • Pambianco and Storme (1996) generalized this to complete caps of size 2qs2q^s2qs in AG(2s+1,q)AG(2s+1, q)AG(2s+1,q), qqq even: bound (1) is sharp up to a constant in odd dimension, for even qqq.
  • Giulietti (2007) studied translation caps in AG(r,2t)AG(r, 2^t)AG(r,2t) and the doubling construction, which turns a translation cap of the largest possible size into a complete cap one dimension higher.
  • Bartoli, Giulietti, Marino and Polverino (arXiv 2015, Combinatorica 2017) proved that (1) is sharp up to a constant also in even dimension n≥4n \ge 4n≥4, when qqq is an even square. This mission formalizes that result.

Setting

Let q=2tq = 2^tq=2t and let Fq\mathbb F_qFq​ be the field with qqq elements. The affine space AG(r,q)AG(r, q)AG(r,q) has as points the vectors (a1,…,ar)∈Fqr(a_1, \dots, a_r) \in \mathbb F_q^r(a1​,…,ar​)∈Fqr​; three points are collinear when they lie on a common affine line over Fq\mathbb F_qFq​.

For an additive subgroup GGG of Fqr\mathbb F_q^rFqr​, KG\mathcal K_GKG​ is the set of points whose coordinate vectors lie in GGG. A translation cap is a cap of the form KG\mathcal K_GKG​. By Giulietti, Proposition 2.5, for t>1t > 1t>1 a translation cap has at most qr/2q^{r/2}qr/2 points; one attaining this bound is a maximal translation cap.

On the projective side, let V=F2trV = \mathbb F_{2^t}^rV=F2tr​, so that PG(V,F2t)=PG(r−1,2t)PG(V, \mathbb F_{2^t}) = PG(r-1, 2^t)PG(V,F2t​)=PG(r−1,2t). An F2\mathbb F_2F2​-subspace UUU of VVV (an additive subgroup) of F2\mathbb F_2F2​-dimension kkk, the rank, defines the F2\mathbb F_2F2​-linear set LU={⟨u⟩F2t:u∈U∖{0}}L_U = \{\langle u \rangle_{\mathbb F_{2^t}} : u \in U \setminus \{0\}\}LU​={⟨u⟩F2t​​:u∈U∖{0}}. It is scattered when every point ⟨u⟩\langle u\rangle⟨u⟩ meets UUU in exactly {0,u}\{0, u\}{0,u}, i.e. has weight one. A scattered linear set has rank at most rt/2rt/2rt/2 (Blokhuis–Lavrauw); one of rank 3t/23t/23t/2 in the plane PG(2,2t)PG(2, 2^t)PG(2,2t) is called maximum.

Formalization targets

Goal: Theorem 1.3

For q=2tq = 2^tq=2t, ttt even, and n≥4n \ge 4n≥4 even, there is a complete cap SSS in AG(n,q)AG(n, q)AG(n,q) with

∣S∣=2qn−1.|S| = 2\sqrt{q^{n-1}}.∣S∣=2qn−1​.

The exponent t(n−1)/2t(n-1)/2t(n−1)/2 is an integer because ttt is even.

Milestones

  1. Theorem 4.2 ([6, Lemma 2.1]): for qqq even, KG\mathcal K_GKG​ is a translation cap iff any two distinct non-zero vectors of GGG are Fq\mathbb F_qFq​-linearly independent.
  2. Proposition 4.3: for t>1t > 1t>1, LUL_ULU​ is a scattered F2\mathbb F_2F2​-linear set of PG(r−1,2t)PG(r-1, 2^t)PG(r−1,2t) iff KU\mathcal K_UKU​ is a translation cap of AG(r,2t)AG(r, 2^t)AG(r,2t).
  3. The bound of [6, Prop. 2.5]: a translation cap in AG(r,2t)AG(r, 2^t)AG(r,2t), t>1t > 1t>1, has at most qr/2q^{r/2}qr/2 points.
  4. Lemma 4.5 ([6, Prop. 2.8]): the product of maximal translation caps in AG(r,2t)AG(r, 2^t)AG(r,2t) and AG(rˉ,2t)AG(\bar r, 2^t)AG(rˉ,2t) is a maximal translation cap in AG(r+rˉ,2t)AG(r + \bar r, 2^t)AG(r+rˉ,2t).
  5. The parabola {(x,x2):x∈F2t}\{(x, x^2) : x \in \mathbb F_{2^t}\}{(x,x2):x∈F2t​} is a translation cap in AG(2,2t)AG(2, 2^t)AG(2,2t).
  6. Lemma 4.6 (doubling, [6, Cor. 2.12]): if KG\mathcal K_GKG​ is a maximal translation cap in AG(r,2t)AG(r, 2^t)AG(r,2t), then KG×{0,1}\mathcal K_{G \times \{0,1\}}KG×{0,1}​ is a complete cap in AG(r+1,2t)AG(r+1, 2^t)AG(r+1,2t).
  7. Proposition 4.7: a maximum scattered linear set in PG(2,q)PG(2, q)PG(2,q) yields a complete cap in AG(n,q)AG(n, q)AG(n,q) of size 2q(n−1)/22q^{(n-1)/2}2q(n−1)/2.
  8. The existence input, restated from Section 2: Lemma 2.8 and Proposition 2.9 (a suitable coefficient bbb), Theorem 2.10 (the scattered F2\mathbb F_2F2​-linear set {x2+bx22n+1+xω}\{x^2 + bx^{2^{2n+1}} + x\omega\}{x2+bx22n+1+xω} of rank 3n3n3n in PG(2,22n)PG(2, 2^{2n})PG(2,22n), covering t=2n≥4t = 2n \ge 4t=2n≥4), and the Baer-subplane case r=3r = 3r=3, t=2t = 2t=2 (covering q=4q = 4q=4).

Significance

Theorem 1.3 shows that the trivial bound (1) is sharp up to the factor 2\sqrt 22​ in even dimension n≥4n \ge 4n≥4 for every even square qqq, extending to even dimension what the constructions of Segre and Pambianco–Storme give in odd dimension. The construction supplies caps near the elementary size lower bound in a parameter range where the paper reports no comparably small infinite family. Remark 4.8 of the paper extends the construction to complete caps of comparable size in PG(n,q)PG(n, q)PG(n,q). The proof also establishes Proposition 4.3, a dictionary between scattered F2\mathbb F_2F2​-linear sets and translation caps, so that any new maximum scattered linear set yields new small complete caps.

The result is proved on paper; no machine-checked proof of it or of the cited results of [6] (Lemmas 4.5, 4.6 and the bound of Prop. 2.5, whose proofs are not in this paper) is known to exist. The mission produces a formal statement of Theorem 1.3, the cap–linear set correspondence, and formal statements of the three results the paper imports from [6].

Difficulty

Assembling Proposition 4.7 from the milestones is short. The difficulty lies in the inputs. The doubling construction requires showing that every point of AG(r+1,q)AG(r+1, q)AG(r+1,q) outside KG×{0,1}\mathcal K_{G\times\{0,1\}}KG×{0,1}​ lies on a secant, which uses the maximality ∣G∣=qr/2|G| = q^{r/2}∣G∣=qr/2 in a counting argument; it is cited from [6], not proved in the paper. The existence of a maximum scattered linear set in PG(2,2t)PG(2, 2^t)PG(2,2t) is the deep input: Lemma 2.8 needs a bound on the value set of a non-permutation polynomial (Turnwald) and a point count on a plane curve over F23n\mathbb F_{2^{3n}}F23n​. A tempting shortcut, taking any maximal cap obtained by greedy extension, gives a complete cap of unknown and generally much larger size; the content of the theorem is the exact size.

Formalization scope

  • AG(r,q)AG(r, q)AG(r,q) is Fin r → K for a finite field KKK with ∣K∣=2t|K| = 2^t∣K∣=2t; collinearity is Mathlib's affine Collinear K, over KKK itself. A complete cap is quantified against every point of AG(r,q)AG(r, q)AG(r,q).
  • Sizes are Set.ncard. The goal's size 2qn−12\sqrt{q^{n-1}}2qn−1​ is written 2⋅2t(n−1)/22\cdot 2^{t(n-1)/2}2⋅2t(n−1)/2 with natural-number division, exact because ttt is even; maximality of a translation cap is the squared form ∣S∣2=qr|S|^2 = q^r∣S∣2=qr, and the [6] bound is ∣S∣2≤qr|S|^2 \le q^r∣S∣2≤qr.
  • Scattered-ness is the weight-one condition "c u∈Uc\,u \in Ucu∈U, c∈F2tc \in \mathbb F_{2^t}c∈F2t​, u≠0u \ne 0u=0 imply c∈F2c \in \mathbb F_2c∈F2​"; rank kkk means ∣U∣=2k|U| = 2^k∣U∣=2k. "Maximum" in Proposition 4.7 is read as rank 3t/23t/23t/2, as in the first line of its proof.
  • In Section 2, F2m\mathbb F_{2^m}F2m​ is the fixed field of x↦x2mx \mapsto x^{2^m}x↦x2m inside EEE with ∣E∣=26n|E| = 2^{6n}∣E∣=26n; norms are explicit Frobenius products. ω\omegaω ranges over all of F22n∖F2n\mathbb F_{2^{2n}} \setminus \mathbb F_{2^n}F22n​∖F2n​ (the paper's standing ω\omegaω). Proposition 2.9 carries the standing assumption n≥2n \ge 2n≥2 of Section 2.
  • Lemmas 4.5, 4.6 and the [6] bound carry t>1t > 1t>1; for t=1t = 1t=1 every subset of AG(r,2)AG(r, 2)AG(r,2) is a cap and Lemma 4.6 fails.
  • Ruled out: stating the goal with ≤\le≤ or ≥\ge≥ in place of the exact size, or measuring collinearity over F2\mathbb F_2F2​ (over which every set is a cap), would make it trivial.
  • Citation basis: arXiv:1512.07467v1; all theorem numbers and pages refer to that version.

Welcome contributions: a general library of caps and translation caps in AG(r,q)AG(r, q)AG(r,q); the scattered-linear-set/translation-cap dictionary; a formalization of the doubling construction of [6]; transport of the F26n\mathbb F_{2^{6n}}F26n​-model of Theorem 2.10 to coordinates F22n3\mathbb F_{2^{2n}}^3F22n3​. The linear-set definitions mirror those of the companion mission on scattered linear sets and are reusable there.

Selected references

  • D. Bartoli, M. Giulietti, G. Marino, O. Polverino, Maximum scattered linear sets and complete caps in Galois spaces, arXiv:1512.07467v1, 2015; Combinatorica 37 (2017). arXiv:1512.07467v1
  • [3] A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • [6] M. Giulietti, Small complete caps in PG(N, q), q even, J. Combin. Des. 15(5) (2007), 420–436. https://doi.org/10.1002/jcd.20131
  • [7] M. Giulietti, The geometry of covering codes: small complete caps and saturating sets in Galois spaces, in Surveys in Combinatorics 2013, LMS Lecture Note Series 409, Cambridge University Press, 2013, pp. 51–90. https://doi.org/10.1017/CBO9781139506748.003
  • [17] F. Pambianco, L. Storme, Small complete caps in spaces of even characteristic, J. Combin. Theory Ser. A 75(1) (1996), 70–84. https://doi.org/10.1006/jcta.1996.0064
  • [19] B. Segre, On complete caps and ovaloids in three-dimensional Galois spaces of characteristic two, Acta Arith. 5 (1959), 315–332. https://doi.org/10.4064/aa-5-3-315-332
  • [20] G. Turnwald, A new criterion for permutation polynomials, Finite Fields Appl. 1 (1995), 64–82. https://doi.org/10.1006/ffta.1995.1005
14 thms1 active userReviewed
CombinatoricsDiscrete GeometryLinear algebra·Captain: mikedeng1

Maximum Scattered Linear Sets and Complete Caps in Galois Spaces 1: Scattered 𝔽_q-Linear Sets of Rank rt/2 Exist in PG(r − 1, q^t) for t Even, in Three Families of (q, t)Research Paper

Motivation

Linear sets are the main tool for building point sets with few intersection sizes in finite projective spaces: sets meeting every hyperplane, two-intersection sets, translation ovoids, and the geometric side of finite semifields and rank-metric codes (Polverino, 2010). Among them, scattered linear sets are those whose points all carry the smallest possible weight, and a scattered linear set of the largest possible rank is called maximum scattered. By Blokhuis and Lavrauw (2000), a maximum scattered linear set of PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) of rank rt/2rt/2rt/2 is a two-intersection set with respect to hyperplanes, so each one yields a two-weight code and a strongly regular graph.

Timeline.

  • 2000, Blokhuis–Lavrauw: the rank of a scattered Fq\mathbb F_qFq​-linear set of PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) is at most rt/2rt/2rt/2, and for rrr even this bound is attained.
  • 2000, Ball–Blokhuis–Lavrauw: examples of rank 666 in PG(2,q4)\mathrm{PG}(2,q^4)PG(2,q4).
  • Classical: for r=3r=3r=3, t=2t=2t=2 the bound 333 is attained by Baer subplanes.
  • 2000, Blokhuis–Lavrauw, Thm 4.4: existence (without explicit examples) for r>3r>3r>3, t=2t=2t=2, q=2q=2q=2 and for r≥3r\ge3r≥3, (t−1)∣r(t-1)\mid r(t−1)∣r, ttt even, q>2q>2q>2.
  • 2015, Bartoli, Giulietti, Marino and Polverino (arXiv:1512.07467v1, Combinatorica 37 (2017)): three explicit families in PG(2,q2n)\mathrm{PG}(2,q^{2n})PG(2,q2n) and, by direct sums, maximum scattered linear sets in PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) for ttt even in three families of (q,t)(q,t)(q,t). This mission formalizes that result; the companion mission formalizes the paper's application to complete caps.

Setting

Let qqq be a prime power, t≥1t\ge1t≥1, and let VVV be an rrr-dimensional vector space over Fqt\mathbb F_{q^t}Fqt​; PG(V,Fqt)=PG(r−1,qt)\mathrm{PG}(V,\mathbb F_{q^t})=\mathrm{PG}(r-1,q^t)PG(V,Fqt​)=PG(r−1,qt) has as points the spans ⟨v⟩Fqt\langle v\rangle_{\mathbb F_{q^t}}⟨v⟩Fqt​​ of nonzero v∈Vv\in Vv∈V. An Fq\mathbb F_qFq​-subspace U⊆VU\subseteq VU⊆V is a subset closed under addition and under multiplication by Fq\mathbb F_qFq​. It defines the Fq\mathbb F_qFq​-linear set

LU={⟨u⟩Fqt:u∈U∖{0}},L_U=\{\langle u\rangle_{\mathbb F_{q^t}} : u\in U\setminus\{0\}\},LU​={⟨u⟩Fqt​​:u∈U∖{0}},

whose rank is dim⁡FqU\dim_{\mathbb F_q}UdimFq​​U. A linear set comes paired with UUU, so every statement here is about UUU. The weight of a point ⟨v⟩\langle v\rangle⟨v⟩ is dim⁡Fq(⟨v⟩Fqt∩U)\dim_{\mathbb F_q}(\langle v\rangle_{\mathbb F_{q^t}}\cap U)dimFq​​(⟨v⟩Fqt​​∩U), and LUL_ULU​ is scattered when every point of LUL_ULU​ has weight 111; equivalently, for every nonzero u∈Uu\in Uu∈U,

λ∈Fqt, λu∈U ⟹ λ∈Fq.\lambda\in\mathbb F_{q^t},\ \lambda u\in U\ \Longrightarrow\ \lambda\in\mathbb F_q .λ∈Fqt​, λu∈U ⟹ λ∈Fq​.

The plane construction (§2). Fix n≥2n\ge2n≥2 and the field E=Fq6nE=\mathbb F_{q^{6n}}E=Fq6n​ with its subfields Fq⊆Fqn⊆Fq2n\mathbb F_q\subseteq\mathbb F_{q^n}\subseteq\mathbb F_{q^{2n}}Fq​⊆Fqn​⊆Fq2n​ and Fq3n\mathbb F_{q^{3n}}Fq3n​. As an Fq2n\mathbb F_{q^{2n}}Fq2n​-space EEE has dimension 333, so PG(E,Fq2n)=PG(2,q2n)\mathrm{PG}(E,\mathbb F_{q^{2n}})=\mathrm{PG}(2,q^{2n})PG(E,Fq2n​)=PG(2,q2n). For ω∈Fq2n∖Fqn\omega\in\mathbb F_{q^{2n}}\setminus\mathbb F_{q^n}ω∈Fq2n​∖Fqn​ and an Fq\mathbb F_qFq​-linear f:Fq3n→Fq3nf:\mathbb F_{q^{3n}}\to\mathbb F_{q^{3n}}f:Fq3n​→Fq3n​ the paper studies

Uf={f(x)+xω:x∈Fq3n},U_f=\{f(x)+x\omega : x\in\mathbb F_{q^{3n}}\},Uf​={f(x)+xω:x∈Fq3n​},

with fff a monomial axqiax^{q^i}axqi or a binomial fi,a,b(x)=axqi+bxq2n+if_{i,a,b}(x)=ax^{q^i}+bx^{q^{2n+i}}fi,a,b​(x)=axqi+bxq2n+i. The relative norms Nqm/qd(x)=∏j<m/dxqdjN_{q^m/q^d}(x)=\prod_{j<m/d}x^{q^{dj}}Nqm/qd​(x)=∏j<m/d​xqdj enter the hypotheses.

Formalization targets

Goal: Theorem 1.2 (p. 3)

For ttt even and r≥2r\ge2r≥2, in each of the cases (a) q=2q=2q=2, t≥4t\ge4t≥4; (b) t≢0(mod3)t\not\equiv0\pmod3t≡0(mod3); (c) q≡1(mod3)q\equiv1\pmod3q≡1(mod3), t≡0(mod3)t\equiv0\pmod3t≡0(mod3),

∃ U⊆Fqt r  Fq-subspace:dim⁡FqU=rt2,LU scattered.\exists\,U\subseteq\mathbb F_{q^t}^{\,r}\ \ \mathbb F_q\text{-subspace}:\qquad \dim_{\mathbb F_q}U=\frac{rt}{2},\quad L_U\ \text{scattered}.∃U⊆Fqtr​  Fq​-subspace:dimFq​​U=2rt​,LU​ scattered.

Milestones, in proof order

  • Proposition 2.1 (p. 5): UfU_fUf​ has rank 3n3n3n, and LUfL_{U_f}LUf​​ is scattered iff Qf∩Fq2n=FqQ_f\cap\mathbb F_{q^{2n}}=\mathbb F_qQf​∩Fq2n​=Fq​, where QfQ_fQf​ is the set of quotients f(x)+xωf(y)+yω\frac{f(x)+x\omega}{f(y)+y\omega}f(y)+yωf(x)+xω​, y≠0y\ne0y=0.
  • Proposition 2.2 (p. 6): the same criterion through the polynomial system (5)–(6).
  • Theorems 2.3, 2.4 (pp. 7, 9): the monomial families, for n≢0(mod3)n\not\equiv0\pmod 3n≡0(mod3) and for q≡1(mod3)q\equiv1\pmod3q≡1(mod3).
  • Theorem 2.5 (p. 10): existence in PG(2,q2n)\mathrm{PG}(2,q^{2n})PG(2,q2n) in those two regimes.
  • Lemma 2.6 (p. 11): φ(x)/x\varphi(x)/xφ(x)/x and φˉ(x)/x\bar\varphi(x)/xφˉ​(x)/x have the same image, where φˉ\bar\varphiφˉ​ is the trace adjoint.
  • Proposition 2.7, Lemma 2.8, Proposition 2.9, Theorem 2.10 (pp. 12–16): the binomial family for q=2q=2q=2.
  • Theorem 3.1 (p. 16): direct sums of scattered linear sets are scattered, of rank rt/2rt/2rt/2 iff each summand has rank sit/2s_it/2si​t/2.
  • The line example (p. 2, cited from Lavrauw's thesis) and the Baer-subplane case r=3r=3r=3, t=2t=2t=2 (p. 3).

Significance

Theorem 1.2 gives maximum scattered linear sets, and hence two-intersection sets, two-weight codes and strongly regular graphs, for infinitely many (q,t)(q,t)(q,t) with rrr odd, a regime where earlier existence results covered only a few values of ttt. The q=2q=2q=2 case feeds the paper's second main result: scattered F2\mathbb F_2F2​-linear sets of PG(2,2t)\mathrm{PG}(2,2^t)PG(2,2t) of rank 3t/23t/23t/2 are translation caps, from which complete caps of size 2q n−12\sqrt{q^{\,n-1}}2qn−1​ in AG(n,q)\mathrm{AG}(n,q)AG(n,q) are built.

All statements are proved in the preprint; none has a machine-checked proof. Formalizing them requires a usable theory of subfields of a finite field as Frobenius fixed fields, relative norms and their images, linearized polynomials and their trace adjoints, and the passage between Fq\mathbb F_qFq​-dimension, cardinality and weight. Each of these is reusable for later work on linear sets, MRD codes and semifields.

Difficulty

The criterion of Proposition 2.2 reduces scatteredness to a polynomial system, but the system has to be solved for a specific fff. For the monomials this rests on the solvability of zqi−1=cz^{q^i-1}=czqi−1=c in Fq3n\mathbb F_{q^{3n}}Fq3n​, a norm condition interacting with the gcd hypotheses. For the binomial with q=2q=2q=2, the existence of a suitable bbb (Lemma 2.8) needs a value-set bound for non-permutation polynomials (Turnwald, 1995) and a point count on a plane curve. The higher-dimensional statement then needs the elementary bound dim⁡U≤st/2\dim U\le st/2dimU≤st/2 for scattered UUU to obtain the rank equivalence in Theorem 3.1. A tempting shortcut, taking U=Fq rU=\mathbb F_q^{\,r}U=Fqr​ or any small subspace, is scattered but has the wrong rank; the content is in the rank rt/2rt/2rt/2.

Formalization scope

  • Citation basis. arXiv:1512.07467v1; page numbers equal PDF pages.
  • Fields. Fqm⊆E\mathbb F_{q^m}\subseteq EFqm​⊆E is the fixed field of x↦xqmx\mapsto x^{q^m}x↦xqm in a finite field EEE of characteristic ppp with ∣E∣=q6n|E|=q^{6n}∣E∣=q6n, q=phq=p^hq=ph. Norms and traces are explicit Frobenius products and sums.
  • Subspaces and rank. An Fq\mathbb F_qFq​-subspace is a carrier set with closure conditions. Rank kkk is ∣U∣=qk|U|=q^k∣U∣=qk; in Theorem 3.1 rank rt/2rt/2rt/2 is ∣W∣2=qrt|W|^2=q^{rt}∣W∣2=qrt.
  • Points. Scatteredness takes the spanning field as an argument: Fq2n\mathbb F_{q^{2n}}Fq2n​ in §2, the whole Fqt\mathbb F_{q^t}Fqt​ in Theorem 1.2 and §3. PG(r−1,qt)\mathrm{PG}(r-1,q^t)PG(r−1,qt) is modelled on Fin r → K; the plane of §2 on EEE itself.
  • Pinned readings.
    • Theorem 1.2 prints no range for rrr. The preceding sentence and the proof (p. 17) say r≥5r\ge5r≥5, and r=1r=1r=1 is false. The goal assumes r≥2r\ge2r≥2, covered by the line example (r=2r=2r=2), §2 with the Baer case (r=3r=3r=3) and Theorem 3.1 (r≥4r\ge4r≥4).
    • ω\omegaω is quantified over all of Fq2n∖Fqn\mathbb F_{q^{2n}}\setminus\mathbb F_{q^n}Fq2n​∖Fqn​.
    • The index ranges 1≤i≤3n−11\le i\le3n-11≤i≤3n−1 (monomial) and 2n+i≤3n−12n+i\le3n-12n+i≤3n−1 (binomial) come from the case headings on pp. 7 and 10.
    • Proposition 2.7's printed "wxwxwx" is ωx\omega xωx.
    • Theorem 2.10 keeps its printed hypothesis N23n/2n(b)≠1N_{2^{3n}/2^n}(b)\ne1N23n/2n​(b)=1.
    • Theorem 3.1's rank clause assumes t≥2t\ge2t≥2; for t=1t=1t=1 it is false.
  • Ruled out. Taking the span over EEE or over Fq\mathbb F_qFq​, or dropping the rank, would make the statements false or trivial; every existence statement fixes the rank, and the span field is explicit.
  • Contributions welcome. Frobenius-fixed-field cardinalities, norm surjectivity, the criteria of Propositions 2.1–2.2, the monomial and binomial families, and the direct-sum rank computation.

Selected references

  • D. Bartoli, M. Giulietti, G. Marino, O. Polverino, Maximum scattered linear sets and complete caps in Galois spaces, arXiv:1512.07467v1 (2015); Combinatorica 37 (2017). https://arxiv.org/abs/1512.07467, https://doi.org/10.1007/s00493-016-3531-6
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. 310 (2010), 3096–3107. https://doi.org/10.1016/j.disc.2010.04.007
  • S. Ball, A. Blokhuis, M. Lavrauw, Linear (q + 1)-fold blocking sets in PG(2, q⁴), Finite Fields Appl. 6 (2000), 294–301.
  • M. Lavrauw, Scattered Spaces with respect to Spreads and Eggs in Finite Projective Spaces, Ph.D. thesis, TU Eindhoven, 2001.
  • G. Turnwald, A new criterion for permutation polynomials, Finite Fields Appl. 1 (1995), 64–82.
15 thms1 active userReviewed
Complexity TheoryTheoretical Computer Science·Captain: mikedeng1

The Power of the Combined Basic LP and Affine Relaxation for Promise CSPs II: BLP+Affine Solves PCSP(A, B) Exactly When Pol(A, B) Has Block-Symmetric Polymorphisms of Arbitrarily High WidthResearch Paper

Motivation

A promise constraint satisfaction problem PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) asks to distinguish instances that are satisfiable in a structure A\mathbf AA from instances that are not even satisfiable in a weaker structure B\mathbf BB. Approximate graph colouring (tell 3-colourable graphs from graphs that are not 5-colourable) and (1-in-3-SAT, NAE-SAT)(1\text{-in-}3\text{-SAT},\ \mathrm{NAE\text{-}SAT})(1-in-3-SAT, NAE-SAT) are standard examples. The algebraic approach to CSPs explains the complexity of such problems through polymorphisms, the multi-argument maps AL→BA^L\to BAL→B that preserve every relation.

Two polynomial-time relaxations dominate the algorithmic side: the Basic LP relaxation, solved over Q≥0\mathbb Q_{\ge0}Q≥0​, and the affine relaxation, the same linear system solved over Z\mathbb ZZ. Barto, Bulín, Krokhin and Opršal (BBKO19) characterized each one separately: BLP solves PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) exactly when Pol(A,B)\mathrm{Pol}(\mathbf A,\mathbf B)Pol(A,B) has symmetric polymorphisms of all arities, and the affine relaxation exactly when it has alternating polymorphisms of all odd arities. Brakensiek and Guruswami (BG19) used ad hoc combinations of the two. Brakensiek, Guruswami, Wrochna and Živný (arXiv:1907.04383) combine them into a single algorithm, BLP+Affine, and characterize its power exactly. This mission formalizes that characterization, Theorem 4 of the paper.

Setting

A signature assigns to each symbol RRR an arity ar(R)\mathrm{ar}(R)ar(R). A relational structure A\mathbf AA on a finite domain AAA fixes relations RA⊆Aar(R)R^{\mathbf A}\subseteq A^{\mathrm{ar}(R)}RA⊆Aar(R). A homomorphism A→B\mathbf A\to\mathbf BA→B is a map σ:A→B\sigma:A\to Bσ:A→B sending every tuple of RAR^{\mathbf A}RA into RBR^{\mathbf B}RB, and (A,B)(\mathbf A,\mathbf B)(A,B) is a promise template if one exists. An instance XXX has variables x1,…,xnx_1,\dots,x_nx1​,…,xn​ and constraints (Rj,xˉj)(R_j,\bar x_j)(Rj​,xˉj​); it is satisfiable in C\mathbf CC (written X→CX\to\mathbf CX→C) if some assignment sends each xˉj\bar x_jxˉj​ into RjCR_j^{\mathbf C}RjC​.

A map f:AL→Bf:A^L\to Bf:AL→B is a polymorphism if applying fff column-wise to any L×ar(R)L\times\mathrm{ar}(R)L×ar(R) matrix whose rows are in RAR^{\mathbf A}RA gives a tuple of RBR^{\mathbf B}RB. It is block-symmetric for a partition [L]=B1⊔⋯⊔Bκ[L]=B_1\sqcup\dots\sqcup B_\kappa[L]=B1​⊔⋯⊔Bκ​ if it is invariant under permutations of its arguments that preserve every block, and its width is the largest minimum block size over such partitions.

The Basic LP LPQ(X,A)\mathrm{LP}_{\mathbb Q}(X,\mathbf A)LPQ​(X,A) has a probability distribution wiw_iwi​ on AAA for each variable and pjp_jpj​ on RjAR_j^{\mathbf A}RjA​ for each constraint, with the marginal of pjp_jpj​ at each position of xˉj\bar x_jxˉj​ equal to the distribution of the variable in that position. The affine relaxation AffZ(X,A)\mathrm{Aff}_{\mathbb Z}(X,\mathbf A)AffZ​(X,A) is the same system over Z\mathbb ZZ with unknowns rir_iri​, qjq_jqj​ and no sign constraints. BLP+Affine (Figure 1) takes a relative interior point (w,p)(w,p)(w,p) of the LP, keeps only the integer solutions (r,q)(r,q)(r,q) that vanish wherever (w,p)(w,p)(w,p) does, and accepts iff one remains. It correctly solves PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) if it accepts every X→AX\to\mathbf AX→A and rejects every X↛BX\not\to\mathbf BX→B.

The minor of f:AL→Bf:A^L\to Bf:AL→B along π:[L]→[L′]\pi:[L]\to[L']π:[L]→[L′] is f/π(x1,…,xL′)=f(xπ(1),…,xπ(L))f_{/\pi}(x_1,\dots,x_{L'})=f(x_{\pi(1)},\dots,x_{\pi(L)})f/π​(x1​,…,xL′​)=f(xπ(1)​,…,xπ(L)​). The minion MBLP+Aff\mathcal M_{\mathrm{BLP+Aff}}MBLP+Aff​ has as LLL-ary objects the pairs (w,r)(w,r)(w,r) with w:[L]→Q≥0w:[L]\to\mathbb Q_{\ge0}w:[L]→Q≥0​, r:[L]→Zr:[L]\to\mathbb Zr:[L]→Z, both summing to 111, and w(i)=0⇒r(i)=0w(i)=0\Rightarrow r(i)=0w(i)=0⇒r(i)=0; the minor along π\piπ sums both over fibres of π\piπ. A minion homomorphism ξ:MBLP+Aff→Pol(A,B)\xi:\mathcal M_{\mathrm{BLP+Aff}}\to\mathrm{Pol}(\mathbf A,\mathbf B)ξ:MBLP+Aff​→Pol(A,B) sends LLL-ary objects to LLL-ary polymorphisms and commutes with minors. The free structure FMBLP+Aff(A)F_{\mathcal M_{\mathrm{BLP+Aff}}}(\mathbf A)FMBLP+Aff​​(A) has the ∣A∣|A|∣A∣-ary objects as its domain, and a tuple is in RFR^FRF iff it is the family of coordinate minors of one ∣RA∣|R^{\mathbf A}|∣RA∣-ary object.

Formalization targets

Goal: Theorem 4

For a promise template (A,B)(\mathbf A,\mathbf B)(A,B) on finite domains, the following are equivalent:

BLP+Affine correctly solves PCSP(A,B)  ⟺  ∀N ∃f∈Pol(A,B): width(f)≥N  ⟺  ∀L ∃f∈Pol(2L+1) symmetric on blocks of sizes L, L+1.\text{BLP+Affine correctly solves } \mathrm{PCSP}(\mathbf A,\mathbf B) \iff \forall N\ \exists f\in\mathrm{Pol}(\mathbf A,\mathbf B):\ \mathrm{width}(f)\ge N \iff \forall L\ \exists f\in\mathrm{Pol}^{(2L+1)}\ \text{symmetric on blocks of sizes } L,\ L+1.BLP+Affine correctly solves PCSP(A,B)⟺∀N ∃f∈Pol(A,B): width(f)≥N⟺∀L ∃f∈Pol(2L+1) symmetric on blocks of sizes L, L+1.

Milestones

The paper proves Theorem 4 through Lemmas 7, 8 and 9. The milestones follow that proof:

  • MBLP+Aff\mathcal M_{\mathrm{BLP+Aff}}MBLP+Aff​ is a minion (p. 10);
  • Lemma 8: a minion homomorphism MBLP+Aff→Pol(A,B)\mathcal M_{\mathrm{BLP+Aff}}\to\mathrm{Pol}(\mathbf A,\mathbf B)MBLP+Aff​→Pol(A,B) yields the (2L+1)(2L+1)(2L+1)-ary two-block polymorphisms;
  • the finite-subset construction in the proof of Lemma 9: a symmetric polymorphism of arity L∗≥Mℓ2L^*\ge M\ell^2L∗≥Mℓ2, L∗=uℓ+vL^*=u\ell+vL∗=uℓ+v, gives a minion homomorphism on the finite set Mℓ,M\mathcal M_{\ell,M}Mℓ,M​ by repeating coordinate iii exactly Wi=uℓw(i)+vr(i)W_i=u\ell w(i)+v r(i)Wi​=uℓw(i)+vr(i) times;
  • Lemma 9: block-symmetric polymorphisms of arbitrarily high width yield a minion homomorphism;
  • Observation 15, Lemma 16 (compactness for structures) and Lemma 17 (free structures versus minion homomorphisms, for MBLP+Aff\mathcal M_{\mathrm{BLP+Aff}}MBLP+Aff​), which together give
  • Lemma 7: BLP+Affine correctly solves PCSP(A,B)\mathrm{PCSP}(\mathbf A,\mathbf B)PCSP(A,B) iff MBLP+Aff→Pol(A,B)\mathcal M_{\mathrm{BLP+Aff}}\to\mathrm{Pol}(\mathbf A,\mathbf B)MBLP+Aff​→Pol(A,B).

A companion item, Example 10, records that the disjoint union of a directed 2-cycle and a directed 3-cycle has no block-symmetric polymorphism of width at least 222.

Significance

Theorem 4 is an exact criterion: the power of an algorithm is read off from the polymorphisms of the template. Its sufficiency direction (Theorem 3, the subject of the companion mission) says that one fixed algorithm decides every PCSP with block-symmetric polymorphisms of unbounded width, which covers nearly all tractable Boolean PCSPs known at the time, including those with threshold and alternating-threshold polymorphisms. The necessity direction, new in Theorem 4, gives a method for proving that BLP+Affine fails on a template: exhibit, for some LLL, the absence of a (2L+1)(2L+1)(2L+1)-ary polymorphism with blocks of sizes LLL and L+1L+1L+1. Example 10 is an instance: a tractable template that the algorithm does not solve. The minion MBLP+Aff\mathcal M_{\mathrm{BLP+Aff}}MBLP+Aff​ and its free structure are the template for later characterizations of relaxation hierarchies.

The result is proved in the paper. As far as is known it has not been machine-checked. A formalization adds a checked development of minions, minion homomorphisms and free structures for PCSPs, a compactness theorem for relational structures, and a checked version of the one-block argument whose many-block extension the paper only asserts.

Difficulty

The equivalence passes through three different kinds of object: an algorithm, an infinite algebraic object (a homomorphism defined on all of MBLP+Aff\mathcal M_{\mathrm{BLP+Aff}}MBLP+Aff​), and finite families of polymorphisms. From polymorphisms one obtains homomorphisms only on finite pieces Mℓ,M\mathcal M_{\ell,M}Mℓ,M​, each from a different polymorphism, and these do not agree with one another; a single homomorphism on the whole minion needs a compactness argument over the finitely many restrictions, which uses the finiteness of AAA and BBB. The passage from "every instance satisfiable in the free structure is satisfiable in B\mathbf BB" to a homomorphism from the infinite free structure is a second compactness step. The relative interior point of Figure 1 must be kept: accepting whenever both relaxations are merely feasible is a different, weaker algorithm.

Formalization scope

All objects are in the definitions file PCSPBLPAff.Characterization.Setting, built on Mathlib only.

  • Signatures are (τ : Type) (ar : τ → ℕ), with no finiteness of τ\tauτ; the paper's requirement that arities be positive is dropped, and no statement needs it. Domains are finite types; instance variables are Fin n and arities Fin L.
  • The LP is over Q\mathbb QQ and the affine system over Z\mathbb ZZ. Constraint distributions are functions on all tuples that vanish outside RAR^{\mathbf A}RA, and marginal conditions are imposed per position of a constraint's scope.
  • The relative interior point is encoded by the only property the algorithm uses: a solution whose zero coordinates are exactly those that vanish on the whole polytope. The algorithm is formalized by its acceptance condition; the polynomial-time claims are out of scope.
  • Width requires at least one block, so a nullary function does not have every width.
  • There is no abstract minion structure. A minion homomorphism MBLP+Aff→Pol(A,B)\mathcal M_{\mathrm{BLP+Aff}}\to\mathrm{Pol}(\mathbf A,\mathbf B)MBLP+Aff​→Pol(A,B) is spelled out as a family of maps from objects of each arity to polymorphisms of that arity, commuting with minors. Lemma 17 is stated for M=MBLP+Aff\mathcal M=\mathcal M_{\mathrm{BLP+Aff}}M=MBLP+Aff​. Free-structure objects are indexed by AAA and by tuples, identifying AAA with [∣A∣][|A|][∣A∣].
  • Lemma 16 drops the hypothesis that F\mathbf FF is infinite, which is unnecessary.

Two trivializing formalizations are ruled out: the acceptance condition keeps the maximal-support requirement, and the free structure's relation requires the witnessing pair to be an object of MBLP+Aff\mathcal M_{\mathrm{BLP+Aff}}MBLP+Aff​ supported in RAR^{\mathbf A}RA.

A complete development needs finite sums over fibres, transport of objects along Fintype.equivFin, Tychonoff or König's lemma (Mathlib.Order.KonigLemma, Mathlib.Combinatorics.Compactness), and the existence of a maximal-support point of a rational polytope. The compactness theorem for relational structures and the free-structure lemma are reusable beyond this mission. Proofs of any milestone, and of the general Lemma 17 for an abstract minion, are welcome.

Selected references

  • J. Brakensiek, V. Guruswami, M. Wrochna, S. Živný, The Power of the Combined Basic LP and Affine Relaxation for Promise CSPs, arXiv:1907.04383v3, 2020 (also SIAM J. Comput., 2020, https://doi.org/10.1137/20M1312745). https://arxiv.org/abs/1907.04383
  • L. Barto, J. Bulín, A. Krokhin, J. Opršal, Algebraic approach to promise constraint satisfaction, arXiv:1811.00970, 2019; J. ACM 68(4), 2021. https://arxiv.org/abs/1811.00970
  • J. Brakensiek, V. Guruswami, An Algorithmic Blend of LPs and Ring Equations for Promise CSPs, SODA 2019, pp. 436–455. https://arxiv.org/abs/1807.05194
  • R. Diestel, Graph Theory, 5th ed., Springer, 2016, Theorem 8.1.3 (de Bruijn–Erdős compactness). https://doi.org/10.1007/978-3-662-53622-3
12 thms1 active userReviewed
Group TheoryTheoretical Computer Science·Captain: mikedeng1

New Techniques for Noninteractive Zero-Knowledge 4: The Decisional-Linear Commitment Is Perfectly Binding and Extractable, with a Perfectly Sound, Witness-Indistinguishable 0/1 ProofResearch Paper

Motivation

A non-interactive zero-knowledge (NIZK) proof lets a prover convince a verifier that a statement is true by sending a single message, without revealing why it is true. Groth, Ostrovsky and Sahai (J. ACM 59(3), 2012) gave NIZK proofs for Circuit SAT of size O(∣C∣k)O(|C|k)O(∣C∣k) for a circuit CCC and security parameter kkk, the first perfect NIZK arguments for all of NP, and the first non-interactive zaps based on a standard cryptographic assumption. These constructions use a single algebraic primitive, the homomorphic proof commitment: a commitment scheme with two kinds of keys, together with a short proof that a committed value is 000 or 111.

The paper gives two instances of this primitive. One rests on the subgroup decision assumption in composite-order groups. The other, the subject of this mission, rests on the decisional linear assumption of Boneh, Boyen and Shacham (CRYPTO 2004) in prime-order bilinear groups. Prime-order groups are the setting of most later pairing-based proof systems, including the Groth–Sahai proofs (EUROCRYPT 2008), and their decisional-linear instantiation uses commitment keys of the same linear-tuple form as this mission.

Setting

A DLIN bilinear group is a tuple (p,G,GT,e,g)(p, \mathbb G, \mathbb G_T, e, g)(p,G,GT​,e,g): ppp is a prime, G\mathbb GG and GT\mathbb G_TGT​ are groups of order ppp, e:G×G→GTe : \mathbb G \times \mathbb G \to \mathbb G_Te:G×G→GT​ is bilinear (e(ua,vb)=e(u,v)abe(u^a, v^b) = e(u, v)^{ab}e(ua,vb)=e(u,v)ab for all u,v∈Gu, v \in \mathbb Gu,v∈G, a,b∈Za, b \in \mathbb Za,b∈Z), ggg generates G\mathbb GG, and e(g,g)e(g, g)e(g,g) generates GT\mathbb G_TGT​. A triple (fr,hs,gr+s)(f^r, h^s, g^{r+s})(fr,hs,gr+s) is a linear tuple with respect to (f,h,g)(f, h, g)(f,h,g).

The scheme (Figure 2 of the paper) works as follows.

  • Keys. Pick x,y∈Zp∗x, y \in \mathbb Z_p^*x,y∈Zp∗​, ru,sv∈Zpr_u, s_v \in \mathbb Z_pru​,sv​∈Zp​, and put f=gxf = g^xf=gx, h=gyh = g^yh=gy. A perfectly binding key is ck=(f,h,u,v,w)=(f,h,fru,hsv,gru+sv+z)ck = (f, h, u, v, w) = (f, h, f^{r_u}, h^{s_v}, g^{r_u+s_v+z})ck=(f,h,u,v,w)=(f,h,fru​,hsv​,gru​+sv​+z) with z∈Zp∗z \in \mathbb Z_p^*z∈Zp∗​; its extraction key is xk=(x,y,z)xk = (x, y, z)xk=(x,y,z). A perfectly hiding key is (f,h,fru,hsv,gru+sv)(f, h, f^{r_u}, h^{s_v}, g^{r_u+s_v})(f,h,fru​,hsv​,gru​+sv​), a linear tuple; its trapdoor key is tk=(ru,sv)tk = (r_u, s_v)tk=(ru​,sv​).
  • Commitment. com(m;r,s)=(umfr,vmhs,wmgr+s)∈G3\mathrm{com}(m; r, s) = (u^m f^r, v^m h^s, w^m g^{r+s}) \in \mathbb G^3com(m;r,s)=(umfr,vmhs,wmgr+s)∈G3 for m∈Zpm \in \mathbb Z_pm∈Zp​, (r,s)∈Zp2(r, s) \in \mathbb Z_p^2(r,s)∈Zp2​.
  • Extraction and trapdoor opening. Extxk\mathrm{Ext}_{xk}Extxk​ recovers a short mmm from c3c1−1/xc2−1/y=(gz)mc_3 c_1^{-1/x} c_2^{-1/y} = (g^z)^mc3​c1−1/x​c2−1/y​=(gz)m. Topentk(m,(r,s),m′)=(r−(m′−m)ru, s−(m′−m)sv)\mathrm{Topen}_{tk}(m, (r, s), m') = (r - (m'-m)r_u,\ s - (m'-m)s_v)Topentk​(m,(r,s),m′)=(r−(m′−m)ru​, s−(m′−m)sv​).
  • 0/1 proof. On an opening (m,r,s)(m, r, s)(m,r,s) with m∈{0,1}m \in \{0, 1\}m∈{0,1} and randomness t∈Zpt \in \mathbb Z_pt∈Zp​, the prover P01P_{01}P01​ outputs six group elements π11,…,π23\pi_{11}, \dots, \pi_{23}π11​,…,π23​. The verifier V01V_{01}V01​ checks six pairing-product equations in GT\mathbb G_TGT​.

The perfect properties of Section 3 are: homomorphism, perfect binding, perfect extractability, perfect trapdoor opening and its indistinguishability, perfect completeness, perfect soundness, perfect witness indistinguishability (WI), and perfect non-erasure WI. Non-erasure WI asks that a simulator turn the randomness of a proof made with one witness into randomness that explains the same proof under the other witness.

Formalization targets

Goal: Theorem 4, exact part

For every DLIN bilinear group, the scheme of Figure 2 is homomorphic on both kinds of key and perfectly binding and extractable on binding keys. On hiding keys it has perfect trapdoor opening and perfect trapdoor-opening indistinguishability. Its 0/1 proof is perfectly complete on both kinds of key, perfectly sound on binding keys, and perfectly WI and perfectly non-erasure WI on hiding keys. Soundness, for example, reads

V01(ck,c,π) accepts  ⟹  ∃ m∈{0,1}, r,s∈Zp: c=com(m;r,s).V_{01}(ck, c, \pi) \text{ accepts} \implies \exists\, m \in \{0,1\},\ r, s \in \mathbb Z_p:\ c = \mathrm{com}(m; r, s).V01​(ck,c,π) accepts⟹∃m∈{0,1}, r,s∈Zp​: c=com(m;r,s).

Milestones

The milestones follow the paper's proof:

  1. the homomorphism display (p. 11);
  2. the trapdoor-opening identity and the extraction display (Figure 2);
  3. the unique opening (m,r,s)(m, r, s)(m,r,s) of every c∈G3c \in \mathbb G^3c∈G3 on a binding key;
  4. completeness;
  5. the six exponent equations obtained from an accepted proof;
  6. the product identity (r0+s0−t0)(r1+s1−t1)=0(r_0+s_0-t_0)(r_1+s_1-t_1) = 0(r0​+s0​−t0​)(r1​+s1​−t1​)=0;
  7. "c or c⋅com(−1;0,0)c \cdot \mathrm{com}(-1; 0, 0)c⋅com(−1;0,0) is a commitment to 0";
  8. the identity P01(ck,0,(r0,s0);t)=P01(ck,1,(r1,s1);t+r0s1−s0r1)P_{01}(ck, 0, (r_0, s_0); t) = P_{01}(ck, 1, (r_1, s_1); t + r_0 s_1 - s_0 r_1)P01​(ck,0,(r0​,s0​);t)=P01​(ck,1,(r1​,s1​);t+r0​s1​−s0​r1​) on hiding keys.

Significance

The perfect properties are what the paper's later results consume. Perfect soundness and extractability on binding keys give the perfectly sound NIZK proof of knowledge for Circuit SAT (Theorem 6). Perfect WI, trapdoor opening and non-erasure WI on hiding keys give perfect zero-knowledge (Lemma 8 and Theorem 11) and the adaptive and UC-secure variants of Sections 7 and 8. Theorem 4 transfers all of this to prime-order bilinear groups under the decisional linear assumption.

The theorem is published and its proof is short, but the printed construction contains an error. With the signs of ttt in π12\pi_{12}π12​ and π21\pi_{21}π21​ as printed in Figure 2, an honest proof fails the fourth and sixth verification equations whenever 2t≠02t \ne 02t=0. A machine-checked proof fixes the corrected construction, under which the paper's own witness-indistinguishability argument goes through. No formalization of this scheme, or of the decisional linear setting, exists on the platform or in Mathlib.

Difficulty

The algebra is modest. The work lies in carrying exponents in Zp\mathbb Z_pZp​ through powers in groups of order ppp, and in getting the soundness argument right. An accepted proof only constrains discrete logarithms of the proof elements, so the six pairing equations must first be turned into six equations between exponents. That step is valid only because fff, hhh and e(g,g)e(g, g)e(g,g) are nondegenerate. Soundness then needs the observation that the product of two specific linear forms vanishes, and it fails outright on a hiding key (z=0z = 0z=0). Witness indistinguishability is an exact identity between proofs, which holds only for the corrected prover.

Formalization scope

  • Groups. G\mathbb GG and GT\mathbb G_TGT​ are finite commutative groups of cardinality ppp, ppp prime. The pairing is a monoid homomorphism G →* G →* GT, which is equivalent to bilinearity. ggg generates G\mathbb GG and e(g,g)e(g, g)e(g,g) generates GT\mathbb G_TGT​.
  • Exponents. Exponents are elements of ZMod p, acting through their representative in {0,…,p−1}\{0, \dots, p-1\}{0,…,p−1}.
  • Keys. The key generators are represented by their supports. A binding key requires x,y,z≠0x, y, z \ne 0x,y,z=0 and a hiding key requires x,y≠0x, y \ne 0x,y=0. Without z≠0z \ne 0z=0 a "binding" key is hiding and soundness is false. Without x,y≠0x, y \ne 0x,y=0 the verification equations degenerate.
  • Prover. P01P_{01}P01​ is the corrected prover; the erratum is recorded on every item it affects.
  • Probabilities. "For all adversaries, probability 1" is stated for every key in the support and every adversarial choice. "Equal probabilities for all adversaries" is stated as equality of probability mass functions over the uniform proof randomness. For perfect properties both readings are equivalent.
  • Dropped. The computational content is out of scope: the efficiency of the algorithms, key indistinguishability, and the decisional linear assumption itself (Definition 3).
  • Simulator. The non-erasure simulator is the explicit map t↦t+r0s1−s0r1t \mapsto t + r_0 s_1 - s_0 r_1t↦t+r0​s1​−s0​r1​ that the proof constructs, so the statement cannot be met by an arbitrary unbounded function.
  • No trivial readings. A trivializing formalization is ruled out. The verifier's equations are not vacuous (e(g,g)≠1e(g, g) \ne 1e(g,g)=1, f,h≠1f, h \ne 1f,h=1), binding keys have z≠0z \ne 0z=0, and the definitions are instantiated on a concrete group of order 5 in a local check: the corrected proof is accepted there and the printed one is rejected.
  • Contributions. Contributions welcome: proofs of the milestones, and a reusable development of discrete logarithms in groups of prime order.

Selected references

  • J. Groth, R. Ostrovsky, A. Sahai, New Techniques for Noninteractive Zero-Knowledge, Journal of the ACM 59(3), Article 11, 2012. https://doi.org/10.1145/2220357.2220358
  • D. Boneh, X. Boyen, H. Shacham, Short Group Signatures, CRYPTO 2004, LNCS 3152. https://doi.org/10.1007/978-3-540-28628-8_3
  • J. Groth, A. Sahai, Efficient Non-interactive Proof Systems for Bilinear Groups, EUROCRYPT 2008, LNCS 4965. https://doi.org/10.1007/978-3-540-78967-3_24
  • D. Boneh, E.-J. Goh, K. Nissim, Evaluating 2-DNF Formulas on Ciphertexts, TCC 2005, LNCS 3378. https://doi.org/10.1007/978-3-540-30576-7_18
13 thms1 active userReviewed
Functional Analysis·Captain: marwahaha

Vanishing of higher bounded Hochschild cohomologyOpen Problem

Motivation

Hochschild cohomology measures whether a cocycle equation admits a primitive. In an operator algebra the boundedness requirement is part of the mathematical problem. The pinned manuscript supplies the research context.

Setting

Cochains are continuous complex multilinear maps into the von Neumann algebra itself, with its natural left and right multiplication actions.

Formalization target

The selected goal is OAI.BoundedHochschild.KadisonRingrose.main_result. Its central assertion is

df=0⟹∃g: dg=f,deg⁡(f)=n+2.df=0\quad\Longrightarrow\quad\exists g:\ dg=f,\qquad\deg(f)=n+2.df=0⟹∃g: dg=f,deg(f)=n+2.

The theorem states that, for a complex von Neumann algebra M (a C*-algebra with a partial order making it star-ordered, equipped with the W*-algebra structure), and any natural number n, every bounded Hochschild cocycle of degree n+2 with values in M is a coboundary. Here a cochain of degree m is a continuous complex m-linear map from M^m to M. The Hochschild differential of a cochain f of degree m, evaluated at (v_0,...,v_m), is v_0 f(v_1,...,v_m) plus the sum over j from 0 to m-1 of (-1)^(j+1) f(v_0,...,v_j v_{j+1},...,v_m), where the j-th and (j+1)-th inputs are multiplied into one, plus (-1)^(m+1) f(v_0,...,v_{m-1}) v_m. The hypothesis is that f has degree n+2 and its differential vanishes at every (n+3)-tuple of elements of M. The conclusion is that there exists a continuous multilinear cochain g of degree n+1 whose differential equals f at every (n+2)-tuple of elements of M.

Significance and status

The goal covers every natural n, hence degrees at least two. It does not include a separately referenced degree-one inner-derivation theorem. The target is currently Open on Prove2Me. The manuscript's mathematical argument and a machine-checked proof of the selected statement are separate deliverables.

Difficulty

An algebraic primitive is insufficient: the lower-degree cochain must remain continuous and bounded in the encoded operator-norm sense.

Formalization scope

The exact published goal, its hypotheses and its referenced definition blocks specify the requested formalization. The explanatory formula above is a summary; all quantifiers and additional clauses in the linked statement remain required.

The available published material supplies this goal and its necessary definitions. Additional manuscript lemmas are not represented as attached milestones.

Selected references

  • OpenAI, Vanishing of higher bounded Hochschild cohomology, preprint, 2026. Manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Selected goal source.
2 thms1 active userReviewed
Group Theory·Captain: marwahaha

An infinite finitely presented periodic groupOpen Problem

Motivation

Periodic groups have only finite-order elements, but this local condition does not visibly bound the group’s size. The source asks whether an ordinary finite presentation forces such a group to be finite. The source is OpenAI's September 2026 manuscript.

Setting

A periodic group satisfies: for each element there is some positive power equal to the identity. A Steinberg group is generated by elementary root symbols subject to additive, commuting, and multiplicative commutator relations over a coefficient ring.

Formalization targets

∃R over F2: St⁡12(R) is infinite, finitely presented, and periodic.\exists R\text{ over }\mathbb F_2:\ \operatorname{St}_{12}(R)\text{ is infinite, finitely presented, and periodic}.∃R over F2​: St12​(R) is infinite, finitely presented, and periodic.

Two propositions hold together. For a natural number n and a ring R, a root is an ordered pair (i,j) of distinct indices in {0,…,n−1}, and the Steinberg group St(n,R) is the group generated by symbols x_{ij}(a), one for each root (i,j) and each a in R, subject to three families of relations: x_{ij}(a+b) = x_{ij}(a)x_{ij}(b); the commutator [x_{ij}(a), x_{kl}(b)] = x y x⁻¹ y⁻¹ is trivial whenever j≠k and i≠l; and for pairwise distinct i, j, k, the commutator [x_{ij}(a), x_{jk}(b)] equals x_{ik}(ab). A group is periodic if every element g has some positive integer m with gᵐ = 1. The first statement, MainStatement, asserts that there exist a ring R in the lowest universe, carrying an algebra structure over ZMod 2, such that St(12,R) is infinite, finitely presented, and periodic. The second statement, BurnsideStatement, asserts that there exists an infinite, finitely presented, periodic group G. The theorem asserts the conjunction of these two existence claims, with no bound on the orders of elements.

The goal is OAI.SourceBurnside.thm_main.

Significance

The formal goal includes both this ring-based construction and the general existence of an infinite finitely presented periodic group. It preserves the stronger concrete realization through a Steinberg group. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

A finite collection of torsion generators does not imply that every product has finite order. Conversely, infinitely many torsion relations do not supply an ordinary finite presentation. Both requirements must hold for the same infinite group.

Formalization scope

The orders of elements may vary; no common exponent is asserted. Finite presentation is Mathlib’s group property. The goal does not include the manuscript’s separate nil-algebra, radical-algebra, or unitization conclusions.

The shared definitions are supplied by PeriodicGroup. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, An infinite finitely presented periodic group, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
2 thms1 active userReviewed
Functional Analysis·Captain: marwahaha

A Counterexample to the Group-Ring Determinant ConjectureOpen Problem

Motivation

The determinant of a nonsingular integer matrix has absolute value at least one. The source examines the proposed counterpart for integer matrices over group rings, where the determinant is defined by an operator trace. The source is OpenAI's September 2026 manuscript.

Setting

The left regular operator associated to a group-ring matrix acts on ℓ2(G)n\ell^2(G)^nℓ2(G)n by finite convolution. Its Fuglede–Kadison determinant in the invertible case is the exponential of half the real trace of the logarithm of its positive square.

Formalization targets

∃A∈Mn(Z[G]),A invertible over Q[G],0<det⁡N(G)(TA)<1.\exists A\in M_n(\mathbb Z[G]),\quad A\text{ invertible over }\mathbb Q[G],\quad 0<\det_{\mathcal N(G)}(T_A)<1.∃A∈Mn​(Z[G]),A invertible over Q[G],0<N(G)det​(TA​)<1.

The defined proposition MainStatement holds, i.e. there exist a group G that is finitely generated, an integer n ≥ 1, an n×n matrix A with entries in the integral group ring ℤ[G], and a bounded ℂ-linear operator T on the Hilbert space l²(G)^n (square-summable complex functions on Fin n × G) such that four conditions hold. First, the image of A in the rational group ring ℚ[G] (obtained by applying the integer-to-rational map to every coefficient) is an invertible matrix over ℚ[G]. Second, T is exactly the left-regular operator of A, meaning (Tξ)(i,h) = Σ_j Σ_g a_{ij}(g) ξ(j, g⁻¹h), where a_{ij}(g) ∈ ℤ is the coefficient of g in the entry A_{ij}. Third, T is invertible as a bounded operator on l²(G)^n. Fourth, its Fuglede–Kadison determinant fkDet(T) = exp(Re tr(log(T*T))/2) satisfies 0 < fkDet(T) < 1, where tr(S) = Σ_i ⟨e_i, S e_i⟩ is the unnormalized trace summing over the basis vectors e_i supported at the identity element of G in component i, and log is the continuous functional calculus logarithm.

The goal is OAI.GroupRingDeterminant.main.

Significance

The goal gives a square-matrix obstruction with both a rational group-ring inverse and a bounded operator inverse. This keeps the logarithm in the invertible setting. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

The trace logarithm is not an ordinary finite-dimensional determinant polynomial. The algebraic matrix and bounded regular operator must be shown to match exactly before the determinant estimate is meaningful.

Formalization scope

The group is finitely generated and n≥1n\ge1n≥1. Lean uses complex square-summable functions on Fin n × G, the unnormalized matrix trace, and continuous functional calculus for the logarithm. Invertibility is explicit on both the rational matrix and the operator.

The shared definitions are supplied by GroupRingDeterminant. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, A Counterexample to the Group-Ring Determinant Conjecture, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
2 thms1 active userReviewed
Group Theory·Captain: marwahaha

A Counterexample to Kaplansky's Direct-Finiteness Conjecture in Characteristic TwoOpen Problem

Motivation

Finite-dimensional linear algebra makes a one-sided inverse two-sided. The source asks whether finite support in a group algebra can replace finite dimension and presents a characteristic-two counterexample. The source is OpenAI's September 2026 manuscript.

Setting

The group algebra K[G]K[G]K[G] consists of finitely supported functions on a group with convolution multiplication. A ring is directly finite if ab=1ab=1ab=1 always implies ba=1ba=1ba=1.

Formalization targets

∃K,G,a,b:char⁡K=2,∣K∣<∞,G finitely presented,ab=1≠ba.\exists K,G,a,b:\quad\operatorname{char}K=2,\quad |K|<\infty,\quad G\text{ finitely presented},\quad ab=1\ne ba.∃K,G,a,b:charK=2,∣K∣<∞,G finitely presented,ab=1=ba.

There exist a finite field K of characteristic 2 and a finitely presented group G such that G contains an element g of odd prime order ℓ (that is, orderOf g = ℓ with ℓ prime and odd), and the group algebra K[G] (the monoid algebra of G over K) contains elements a_out and b_out with a_out · b_out = 1 but b_out · a_out ≠ 1. Thus K[G] fails to be directly finite, giving a counterexample to direct finiteness. The statement is existential: it does not name a specific K, G, or prime ℓ, and the proof is admitted in the source.

The goal is OAI.KaplanskyCounterexample.finitelyPresented_counterexample. Supporting targets are listed below; they retain their individual hypotheses and are separate statements.

  • main theorem.

Significance

The selected statement includes finite presentation and an element of odd prime order in the group. The weaker finitely generated formulation is included as a separate supporting target. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

A matrix counterexample does not automatically provide scalar elements in a group algebra. The formal target requires genuine finitely supported scalar elements and verification of both products.

Formalization scope

The field and group are existentially quantified, with the finite-field, characteristic, and finite-presentation structures carried explicitly. No claim that the field is exactly the two-element field is made. Odd-prime torsion is part of the conclusion.

The shared definitions are supplied by KaplanskyDirectFiniteness. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, A Counterexample to Kaplansky's Direct-Finiteness Conjecture in Characteristic Two, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
3 thms1 active userReviewed
Captain: marwahaha

Lech's multiplicity conjectureOpen Problem

Motivation

Multiplicity measures the growth of infinitesimal neighborhoods in a local ring. The manuscript addresses Lech’s flat-local-map inequality; the available formal target isolates its complete-domain Frobenius-complex component. The source is OpenAI's September 2026 manuscript.

Setting

For a local domain DDD of dimension ddd, Hilbert–Samuel multiplicity is the limit of d! ℓ(D/mN)/Ndd!\,\ell(D/\mathfrak m^N)/N^dd!ℓ(D/mN)/Nd. A short complex has finite free terms in degrees −d-d−d through zero, finite-length homology, and nonzero zeroth homology. Its Frobenius scalar extensions define a normalized Euler-characteristic sequence.

Formalization targets

an=p−ndχ(Fn)⟶χ∞(F),e(D)≤χ∞(F).a_n=p^{-nd}\chi(F_n)\longrightarrow\chi_\infty(F),\qquad e(D)\le\chi_\infty(F).an​=p−ndχ(Fn​)⟶χ∞​(F),e(D)≤χ∞​(F).

The defined proposition DuttaDomainClaim holds, in universe u. That claim says: let D be a commutative Noetherian local domain (in universe u) that is complete in the adic topology of its maximal ideal, with prime characteristic p, and let F be a cochain complex of D-modules indexed by the integers that is a short complex. Short means every term F^i is free and finitely generated, F^i is zero whenever i < -dim D or i > 0, every homology module of F has finite length, and the homology of F in degree 0 is nonzero. Here dim is the Krull dimension (taken as 0 if it is the bottom value). Let F_n denote F after extending scalars along the n-fold iterate of the Frobenius map of D. The conclusion has three parts. First, every homology module of every F_n has finite length. Second, the sequence a_n = p^(-n dim D) * chi(F_n) converges as n tends to infinity, where chi(G) is the alternating sum, over i from 0 to dim D, of (-1)^i times the length of the homology of G in degree -i; this limit is the Dutta multiplicity of F. Third, the Hilbert-Samuel multiplicity of D, defined as the limit of (dim D)! times the length of D/m^N divided by N^(dim D) as N tends to infinity, is at most the Dutta multiplicity of F.

The goal is OAI.Lech.dutta_domain.

Significance

The goal formalizes the lower bound by Dutta multiplicity together with the convergence and finite-length statements needed to interpret it. This is a precise component of the paper’s multiplicity program. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

Lengths of homology after Frobenius extension must be controlled before normalized Euler characteristics can be used. A definition by a chosen limit does not by itself establish convergence.

Formalization scope

The ring is a complete Noetherian local domain in prime characteristic. The goal is DuttaDomainClaim, not the unrestricted flat local homomorphism inequality. Dimensions and lengths use the natural-number conversions in the supplied definitions, and convergence is an explicit conclusion.

The shared definitions are supplied by DuttaDomain. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, Lech's multiplicity conjecture, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
2 thms1 active userReviewed
Theoretical Computer Science·Captain: marwahaha

Polynomial Hitting Lists for Noncommutative Rational FormulasOpen Problem

Motivation

Inversion gates create domains of definition as well as nonzero-value conditions. A rational hitting list must find a point where every inverse exists and where the final value is invertible. The source manuscript presents the surrounding research claim.

Setting

A noncommutative rational formula over ℚ has variables, constants, sums, ordered products and inverse gates, with tree-node size. Evaluation is a relation requiring genuine two-sided inverses. Admissible means defined at some positive-dimensional rational matrix tuple; nonzero means one such defined value is nonzero.

Formalization target

Construct one deterministic finite-state Turing machine and positive integers C,k which, on unary n,s≥1, outputs a list H of common positive-dimensional rational tuples with

dim⁡H,∣encode⁡(H)∣,time⁡(H)≤C(n+s+1)k,\dim H,\quad|\operatorname{encode}(H)|,\quad\operatorname{time}(H)\le C(n+s+1)^k,dimH,∣encode(H)∣,time(H)≤C(n+s+1)k,

and every admissible nonzero size-s formula has a defined invertible value at some tuple in H.

The selected formal target is OAI.RationalHitting.main.

Significance and status

The output-length bound controls the full binary representation, including rational entries and all tuples. No separate inverse-depth or coefficient-height parameter is added. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

A tuple detecting one rational expression may encounter a singular inverse in another. Definedness and invertibility must be guaranteed at a list point for every eligible formula.

Formalization scope

Matrices and constants are rational; scalars use the algebra map. The fixed TM0 alphabet and state space, self-delimiting binary output and unary parameter input are explicit. The matrix dimension is shared across the entire list and required positive.

Selected references

  • OpenAI, Polynomial Hitting Lists for Noncommutative Rational Formulas, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
2 thms1 active userReviewed
Theoretical Computer Science·Captain: marwahaha

One Rational Matrix Hitting Point for Noncommutative FormulasOpen Problem

Motivation

Testing a noncommutative polynomial at scalar points can lose its ordered-word structure. Matrix evaluation preserves noncommutativity and permits a single prescribed tuple to test an entire bounded-size formula class. The source manuscript presents the surrounding research claim.

Setting

A division-free formula has scalar and variable leaves and addition or ordered multiplication gates. Its size counts every tree node. Nonzero means that at least one coefficient of its word series is nonzero. The published generator is an explicit tuple of rational matrices depending only on n and s.

Formalization target

For all n,s≥1, every characteristic-zero field F and every formula f of size at most s, prove

f≠0⟹f(T1,…,Tn)≠0,f\ne0\quad\Longrightarrow\quad f(T_1,\ldots,T_n)\ne0,f=0⟹f(T1​,…,Tn​)=0,

where the rational tuple T is coerced into F and has dimension 2ns², except for the specified one-variable size-one case.

The selected formal target is OAI.NCHitting.universal_hitting.

Significance and status

One tuple is universal for the whole size class and every characteristic-zero coefficient field. The formal goal establishes its hitting property. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

Nonzero word coefficients must survive the same matrix substitution uniformly across all formulas. Choosing a point separately for each f would reverse the required quantifiers.

Formalization scope

Formula coefficients are defined by word convolution; evaluation uses scalar matrices and the explicit rational generator. The theorem asserts nonzero matrix output, not invertibility. The manuscript’s deterministic construction-time claim is not a separate statement in this selected Lean target.

Selected references

  • OpenAI, One Rational Matrix Hitting Point for Noncommutative Formulas, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
2 thms1 active userReviewed
PreviousPage 3 of 4Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me