Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Theoretical Computer Science

464 missions · 238 completed

The mathematical foundations of computation: which problems can be solved, by what algorithms, and at what cost in time, space, or communication. Distinguished by its emphasis on rigor and unconditional lower bounds, it spans computational complexity, algorithm design, automata and computability, cryptography, and the analysis of Boolean functions.

Missions

Open226Completed238All464
🏆Completed
Captain: marwahaha

Sensitivity ConjectureResearch Paper

Nearly every measure of Boolean function complexity was known to be equivalent — except sensitivity. Proving the conjecture unified the whole picture.

44 thms3 active usersReviewed
🏆Completed
Analysis·Captain: Yuxuan Xu

Average sensitivity 3.762: refined coupling and a complete Lean proofResearch Paper

Motivation

A polynomial threshold function makes a Boolean decision by evaluating a real polynomial and keeping only its sign. Its average sensitivity measures how often that decision changes after one uniformly chosen input coordinate is reversed, summed over all coordinate choices. This is a basic quantitative question in the analysis of Boolean functions: how much can a low-degree decision rule vary across the edges of the Boolean cube?

The result collected here is a uniform bound with an explicit coefficient. The OpenAI weighted-grading development supplies a complete coefficient-eight construction. Lagdive, Aglave and Damre sharpen its probability estimate and obtain the sufficient coefficient 3.83. The present fixed-source development formalizes the refined estimate, extracts the coefficient 3.762, and connects it to the full polynomial-threshold statement.

This mission organizes that completed result and its reusable supporting theorems. Its goal and both milestones already have accepted Lean proofs. It does not present the coefficient as optimal, and it makes no claim of exhaustive historical priority.

Setting

Let n,dn,dn,d be positive integers, and let ppp be a real polynomial in nnn variables with total degree at most ddd. Choose an input xxx uniformly from the sign cube {−1,1}n\{-1,1\}^n{−1,1}n. For a coordinate iii, write x⊕ix^{\oplus i}x⊕i for the same input with coordinate iii negated. The threshold convention is

f(x)={1,p(x)≥0,−1,p(x)<0.f(x)=\begin{cases}1,&p(x)\ge0,\\-1,&p(x)<0.\end{cases}f(x)={1,−1,​p(x)≥0,p(x)<0.​

In particular, a zero of the polynomial is assigned the positive sign. The average sensitivity is

AS⁡(f)=∑i=1nPr⁡{f(x)≠f(x⊕i)}.\operatorname{AS}(f)=\sum_{i=1}^{n}\Pr\{f(x)\ne f(x^{\oplus i})\}.AS(f)=i=1∑n​Pr{f(x)=f(x⊕i)}.

For the scalar supporting statements, let BnB_nBn​ have the symmetric binomial distribution with parameters nnn and 1/21/21/2. Its mean absolute deviation is

bn=E∣Bn−n/2∣=2−n−1∑j=0n(nj)∣2j−n∣.b_n=\mathbb E|B_n-n/2|=2^{-n-1}\sum_{j=0}^{n}\binom nj|2j-n|.bn​=E∣Bn​−n/2∣=2−n−1j=0∑n​(jn​)∣2j−n∣.

The accompanying definition module fixes this finite sum and the normalized central coefficient ck=4−k(2kk)c_k=4^{-k}\binom{2k}{k}ck​=4−k(k2k​). These definitions contain no estimates or unproved hypotheses.

Formalization targets

Goal — the coefficient 3.762 for arbitrary real polynomials

For every n,d≥1n,d\ge1n,d≥1 and every real polynomial of total degree at most ddd, prove

AS⁡(sign⁡p)≤1881500 dn.\operatorname{AS}(\operatorname{sign}p)\le\frac{1881}{500}\,d\sqrt n.AS(signp)≤5001881​dn​.

The goal is the published theorem AverageSensitivity.polynomial_bound_3762_general. It has no multilinearity hypothesis and no requirement that d≤nd\le nd≤n. The narrower range 1≤d≤n1\le d\le n1≤d≤n used by the Big O board is therefore included. The goal's fixed coefficient records this particular verified result; a future sharper coefficient would be a separate statement.

Milestone 1 — the refined finite one-sided coupling estimate

Let a finite set carry nonnegative probability weights www, and let real functions U,VU,VU,V have identical weighted distributions. Let mmm be any real centre and let a≥0a\ge0a≥0. If V−U≤aV-U\le aV−U≤a on the support of the weights, prove

E(U−V)2≤4aE∣U−m∣+a2.\mathbb E(U-V)^2\le4a\mathbb E|U-m|+a^2.E(U−V)2≤4aE∣U−m∣+a2.

This is the finite form of the first estimate in Lemma 2 of Lagdive, Aglave and Damre. The centre is arbitrary; independence, exchangeability and a two-sided displacement bound are not hypotheses. Its published formalization is already proved.

Milestone 2 — exact extraction of the universal coefficient

For positive integers n,dn,dn,d and a real number AAA, prove the scalar implication

A≤n,A≤8dbn+2d2⟹A≤1881500dn.A\le n,\qquad A\le8db_n+2d^2\quad\Longrightarrow\quad A\le\frac{1881}{500}d\sqrt n.A≤n,A≤8dbn​+2d2⟹A≤5001881​dn​.

This is AverageSensitivity.extract_constant. Its statement is independent of the polynomial and matrix constructions. It records the coefficient extraction proved in this development, rather than attributing 3.762 to the earlier paper.

Significance and current status

The result gives one coefficient that works simultaneously for every positive dimension and degree. Such uniformity distinguishes it from estimates that hold only for a fixed degree or only as the dimension tends to infinity. It also preserves the stated convention at polynomial zeros, so the class of threshold functions is unchanged at the boundary.

The formal contribution is a complete connection from the polynomial and the actual finite cube to the numerical bound. The final theorem does not assume the existence of a grading, an energy bound, a coupling estimate or a small-dimension certificate. Those mathematical components are discharged inside the proof chain. The two supporting milestones are independently importable results, and the live dependency graph records both as actual prerequisites of the goal's accepted reduction.

All three theorem nodes are currently Proved. The closed repository proof was rebuilt with Lean 4.33.1 and the platform's Mathlib revision, and an independent Linux build also passed. The final theorem's axiom dependencies are exactly propext, Classical.choice and Quot.sound. These checks establish the formal result under the displayed definitions; they do not establish optimality of the coefficient or independent human peer review.

Difficulty

A one-sided bound on the difference of two variables does not by itself bound the difference in the opposite direction. The equal-distribution condition is therefore essential to the coupling milestone. Omitting it would change the problem into a false assertion. In the polynomial application, the relevant distributions also have to come from the actual block masses of the constructed grading; treating those masses or the grading properties as free assumptions would omit the central analytic work.

The constant extraction must cover all admissible dimension-degree pairs. A calculation for finitely many dimensions cannot establish the universal statement, while an asymptotic first-moment estimate can leave uncontrolled small dimensions or degree-dependent errors. The formal target includes both the infinite range and every exceptional finite case. Numerical optimization and floating-point experiments are not premises of the accepted result.

Formalization scope

Cube vertices are functions Fin n → Bool, interpreted coordinatewise as signs. A coordinate flip is an explicit function update, and each probability is a finite cardinality divided by 2n2^n2n. The polynomial is a Mathlib MvPolynomial (Fin n) ℝ; the degree bound refers to its total degree. General polynomial inputs are included through a proved value-preserving, degree-nonincreasing multilinearization. Positive dimensions ensure the normalizing denominator is nonzero. Degree zero and dimension zero are outside the displayed goal's quantifiers.

The two definition references provide the original cube/threshold interface and the exact scalar moment interface. The coupling milestone uses finite weighted sums, so equality of distributions is stated for every real test function without additional measurability assumptions. The scalar milestone quantifies over an arbitrary real AAA satisfying its two explicit upper bounds. The main goal has no analogous auxiliary assumptions.

This is a Research Paper mission for a completed fixed-source development, with the main theorem and both milestones linked by their existing identities. It creates no duplicate theorem statements. Alternative proofs and subsequent sharper bounds can reuse these interfaces, but they are not claimed as completed by this mission. The construction and earlier probability refinement remain attributed to their original sources. Proof development and source preparation used OpenAI Codex.

Selected references

  • OpenAI, Average sensitivity of polynomial threshold functions, preprint and Lean source, 2026. Fixed Lean development.
  • Prathmesh Lagdive, Vaibhav Aglave and Suraj Damre, An elementary improvement of the average sensitivity bound for polynomial threshold functions, 2026, Lemma 2 and the dimension-degree estimate. Fixed manuscript source.
  • Anchen0823, Average sensitivity: a Lean proof with coefficient 3.762, source development, 2026. Verified source revision. Prove2Me accepted main submission: 0f539328-c783-4509-a78e-a86ac777468c.
5 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Selection and Ordering Policies for Hiring Pipelines via Linear Programming 4: For Every τ ∈ (0, 1) Some τ-Bounded Instance Gives No Value-Ordered Policy More Than (β^τ_k + ε) Times the OptimumResearch Paper

Why offer sets with overbooking matter

A firm with kkk open positions often cannot interview and offer sequentially: hiring seasons are short, and offers go out in one batch. Some recipients decline, so the firm overbooks, sending more offers than it has positions, and pays for every hire beyond capacity. The same trade-off appears in airline and hotel overbooking and in university admissions. Epstein and Ma (arXiv:2210.04059v3, Operations Research 2024) study this Simultaneous Offering problem as one of three hiring-pipeline models, and analyse the natural class of value-ordered policies, which offer to the best candidates first. Their Theorem 3 shows that a value-ordered policy built from a linear-programming relaxation guarantees a fraction αkτ\alpha^\tau_kαkτ​ of the optimum when every value is at least τ\tauτ. This mission formalizes the converse, Theorem 4: no value-ordered policy can guarantee more than βkτ\beta^\tau_kβkτ​.

Setting

An instance has k≥1k \ge 1k≥1 positions and n≥kn \ge kn≥k candidates. Candidate iii accepts an offer with probability pi∈[0,1]p_i \in [0,1]pi​∈[0,1], independently of the others, and then adds value vi≥0v_i \ge 0vi​≥0. The firm chooses a set SSS of candidates and sends all offers at once. If A⊆SA \subseteq SA⊆S is the random set of acceptances, the reward is

∑i∈Avi−[ ∣A∣−k ]+,\sum_{i \in A} v_i - [\,|A| - k\,]^+,i∈A∑​vi​−[∣A∣−k]+,

so each hire beyond capacity costs 111 (the paper rescales values so that this cost is 111). Write R(I,S)R(I, S)R(I,S) for the expected reward of offering to SSS, and OPTsim(I)=max⁡SR(I,S)\mathrm{OPT}_{\mathrm{sim}}(I) = \max_S R(I, S)OPTsim​(I)=maxS​R(I,S) for the best expected reward; randomizing over offer sets cannot do better.

Candidates are labelled so that v1≥v2≥⋯≥vnv_1 \ge v_2 \ge \cdots \ge v_nv1​≥v2​≥⋯≥vn​. A value-ordered policy with parameter m∈[n]m \in [n]m∈[n] offers to {1,…,m}\{1, \dots, m\}{1,…,m}. An instance is τ\tauτ-bounded, I∈IsimτI \in \mathcal{I}^\tau_{\mathrm{sim}}I∈Isimτ​, if vi≥τv_i \ge \tauvi​≥τ for all iii. Without such a bound value-ordered policies can be arbitrarily poor (§6.1); τ\tauτ measures how soft the capacity is, from nearly hard (τ\tauτ close to 000) to nearly compensated by any hire (τ\tauτ close to 111), and both theorems take τ∈(0,1)\tau \in (0,1)τ∈(0,1).

For λ≥0\lambda \ge 0λ≥0 let E[min⁡{Pois(λ),k}]\mathbb{E}[\min\{\mathrm{Pois}(\lambda), k\}]E[min{Pois(λ),k}] be the mean of a Poisson variable truncated at kkk, and

fk,τ(s)=s−sτ+E[min⁡{Pois(sk),k}]τk,αkτ=sup⁡0≤s≤1fk,τ(s),βkτ=sup⁡s≥0fk,τ(s).f_{k,\tau}(s) = s - \frac{s}{\tau} + \frac{\mathbb{E}[\min\{\mathrm{Pois}(sk), k\}]}{\tau k}, \qquad \alpha^\tau_k = \sup_{0 \le s \le 1} f_{k,\tau}(s), \qquad \beta^\tau_k = \sup_{s \ge 0} f_{k,\tau}(s).fk,τ​(s)=s−τs​+τkE[min{Pois(sk),k}]​,αkτ​=0≤s≤1sup​fk,τ​(s),βkτ​=s≥0sup​fk,τ​(s).

In Lean these are SimInstance, reward, OPTsim, valueOrdered, TauBounded, expMinPois, ratioObj, alpha and beta in the namespace HiringLP.SimUpper.

Formalization targets

Goal: Theorem 4 (p. 30)

For every k≥1k \ge 1k≥1, ε>0\varepsilon > 0ε>0 and τ∈(0,1)\tau \in (0,1)τ∈(0,1) there is a valid, sorted instance I∈IsimτI \in \mathcal{I}^\tau_{\mathrm{sim}}I∈Isimτ​ with kkk positions such that

R(I,{1,…,m})≤(βkτ+ε) OPTsim(I)for every m∈[n].R(I, \{1, \dots, m\}) \le (\beta^\tau_k + \varepsilon)\,\mathrm{OPT}_{\mathrm{sim}}(I) \quad \text{for every } m \in [n].R(I,{1,…,m})≤(βkτ​+ε)OPTsim​(I)for every m∈[n].

Milestones on the hard instance (App. D.7)

The instance has j2j^2j2 type-1 candidates with pi=k/jp_i = k/jpi​=k/j, vi=τ+δv_i = \tau + \deltavi​=τ+δ, δ=ετ/j\delta = \varepsilon\tau/jδ=ετ/j, and kkk type-2 candidates with pi=1p_i = 1pi​=1, vi=τv_i = \tauvi​=τ. With B∼Bin(m,k/j)B \sim \mathrm{Bin}(m, k/j)B∼Bin(m,k/j) and 0≤m≤j20 \le m \le j^20≤m≤j2:

OPTsim(I)≥kτ,\mathrm{OPT}_{\mathrm{sim}}(I) \ge k\tau,OPTsim​(I)≥kτ, R(I,{1,…,m})=(τ+δ)kmj+E[min⁡{0,k−B}]≤k+kmj(τ+δ−Pr⁡[B>k])(EC.15),R(I, \{1,\dots,m\}) = (\tau + \delta)\frac{km}{j} + \mathbb{E}[\min\{0, k - B\}] \le k + \frac{km}{j}\bigl(\tau + \delta - \Pr[B > k]\bigr) \quad \text{(EC.15)},R(I,{1,…,m})=(τ+δ)jkm​+E[min{0,k−B}]≤k+jkm​(τ+δ−Pr[B>k])(EC.15), R(I,{1,…,m})≤εkτ+kmj(τ−1)+E[min⁡{k,B}](EC.18).R(I, \{1,\dots,m\}) \le \varepsilon k \tau + \frac{km}{j}(\tau - 1) + \mathbb{E}[\min\{k, B\}] \quad \text{(EC.18)}.R(I,{1,…,m})≤εkτ+jkm​(τ−1)+E[min{k,B}](EC.18).

Companions: the maximisers (App. D.8)

Proposition EC.5: optimal sα∗s^*_\alphasα∗​, sβ∗s^*_\betasβ∗​ exist, sα∗=min⁡{sβ∗,1}s^*_\alpha = \min\{s^*_\beta, 1\}sα∗​=min{sβ∗​,1}, and τ=1−e−sβ∗k∑j<k(sβ∗k)j/j!\tau = 1 - e^{-s^*_\beta k}\sum_{j<k} (s^*_\beta k)^j/j!τ=1−e−sβ∗​k∑j<k​(sβ∗​k)j/j!. Proposition EC.6: sα∗=sβ∗s^*_\alpha = s^*_\betasα∗​=sβ∗​ if and only if τ≤1−e−k∑j<kkj/j!\tau \le 1 - e^{-k}\sum_{j<k} k^j/j!τ≤1−e−k∑j<k​kj/j!, which holds whenever τ≤1/2\tau \le 1/2τ≤1/2.

Significance

Theorem 4 bounds what any value-ordered policy can guarantee on τ\tauτ-bounded instances, against the true optimum rather than an LP relaxation. With Theorem 3 it brackets the best guarantee of the class between αkτ\alpha^\tau_kαkτ​ and βkτ\beta^\tau_kβkτ​, and by Proposition EC.6 the two coincide when τ≤Pr⁡[Pois(k)≥k]\tau \le \Pr[\mathrm{Pois}(k) \ge k]τ≤Pr[Pois(k)≥k], in particular for all kkk when τ≤1/2\tau \le 1/2τ≤1/2. In that region the paper's truncated-LP policy is the best value-ordered policy in the worst case. The instance also shows why the restriction to value-ordered policies costs something: the optimum offers to the reliable type-2 candidates, while a value-ordered policy must first exhaust the slightly more valuable unreliable ones.

The results are proved in the paper. None of them has a machine-checked proof; this mission produces a formal version of Theorem 4 and the finite-jjj estimates on which its proof rests, together with a reusable finite-sum encoding of independent acceptances, truncated Poisson and Binomial expectations, and the constants αkτ\alpha^\tau_kαkτ​, βkτ\beta^\tau_kβkτ​.

Difficulty

The milestones are exact identities and inequalities at a fixed jjj; the hard part is the passage to the limit. The page's proof lets j→∞j \to \inftyj→∞ with mj/j→sm_j/j \to smj​/j→s and replaces Bin(mj,k/j)\mathrm{Bin}(m_j, k/j)Bin(mj​,k/j) by Pois(sk)\mathrm{Pois}(sk)Pois(sk). The goal, however, asks for one finite instance on which the bound holds for every mmm simultaneously, including mmm of order j2j^2j2 and the values m>j2m > j^2m>j2 that also offer to type-2 candidates. A pointwise limit for each fixed sss does not give this; the Binomial–Poisson error has to be controlled uniformly in mmm, and the error must fit inside the slack ε\varepsilonε, part of which the term δ\deltaδ already uses. Note also that the comparison runs the wrong way for the obvious argument: min⁡{⋅,k}\min\{\cdot, k\}min{⋅,k} is concave and the Binomial is less spread than the Poisson, so E[min⁡{k,B}]\mathbb{E}[\min\{k, B\}]E[min{k,B}] is at least its Poisson counterpart and a one-sided comparison cannot replace an approximation bound.

Formalization scope

All randomness is finite. The expected reward is an explicit sum over the 2n2^n2n accepting sets with product probabilities; the Binomial pmf, its truncated mean and its tail are finite sums written by hand. The truncated Poisson mean is the series with the Poisson pmf. All quantities are real. Candidates are Fin n, so the paper's candidate iii is index i−1i - 1i−1; sortedness is the hypothesis Antitone v in Valid, which also contains 1≤k≤n1 \le k \le n1≤k≤n, p∈[0,1]np \in [0,1]^np∈[0,1]n and v≥0v \ge 0v≥0. OPTsim\mathrm{OPT}_{\mathrm{sim}}OPTsim​ is the maximum over all offer sets, never over value-ordered ones. βkτ\beta^\tau_kβkτ​ is the supremum over [0,∞)[0, \infty)[0,∞) and αkτ\alpha^\tau_kαkτ​ over [0,1][0, 1][0,1]. The page leaves kkk implicit in βkτ\beta^\tau_kβkτ​; the goal quantifies over every k≥1k \ge 1k≥1 and requires the instance to have exactly kkk positions. The quantifiers are "for all k,ε,τk, \varepsilon, \tauk,ε,τ, there is an instance, for all mmm".

The goal does not fix the hard instance: any instance proves it. A formalization in which the comparison is with the best value-ordered policy, in which βkτ\beta^\tau_kβkτ​ is a free parameter, or in which the reward is defined by the proof's Binomial formula would be a different statement and is ruled out by the definitions above. The definitions are not specialized to the hard instance, which appears only as a separate definition used by the milestones.

A complete development needs: finite sums over subsets with product weights and the reduction to a Binomial count for identical candidates; summability and continuity of the truncated Poisson mean; a Binomial–Poisson approximation bound uniform in the number of trials; concavity of fk,τf_{k,\tau}fk,τ​ in sss. The Poisson and Binomial infrastructure is reusable well beyond this mission. Proofs of the milestones, of the companions, and of auxiliary approximation lemmas are all welcome.

Selected references

  • B. Epstein, W. Ma, Selection and Ordering Policies for Hiring Pipelines via Linear Programming, arXiv:2210.04059v3, 2023; Operations Research, 2024. https://arxiv.org/abs/2210.04059
  • M. Mitzenmacher, E. Upfal, Probability and Computing, 2nd ed., Cambridge University Press, 2017 (Exercise 5.14, cited for Pr⁡[Pois(k)≥k]≥1/2\Pr[\mathrm{Pois}(k) \ge k] \ge 1/2Pr[Pois(k)≥k]≥1/2). https://doi.org/10.1017/9781316651124
  • A. D. Barbour, P. Hall, On the rate of Poisson convergence, Mathematical Proceedings of the Cambridge Philosophical Society 95, 1984. https://doi.org/10.1017/S0305004100061402
11 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: Yuxuan Xu

Deterministic Integer 3SUM 1.960614: Quartic Switch and Complete Program ExtensionResearch Paper

Verified completion - 15 October 2026

The original exact goal EndStatement.ThreeSum.SolvedInTime 1.960614 is Proved on Prove2Me. All seven original milestones are complete. The complete machine extension has 481 accepted theorem proofs and reuses 110 proved theorem nodes; its accepted dependencies connect to the original main reduction. The independent fixed-model lower bound remains separate from the algorithm proof. Scientific priority and global optimality are not asserted by these formal verification results.

Why improve the deterministic integer 3SUM exponent?

3SUM asks whether three entries at distinct positions in an integer input sum to zero. Its familiar quadratic algorithm makes it a benchmark for studying how much arithmetic structure can reduce the cost of an exhaustive search. The relevant comparison is the exponent of input size in a precisely specified machine model. An improvement to that exponent is an asymptotic statement; it need not provide better measured running times at accessible input sizes.

Alman and Vassilevska Williams, 2026 developed a deterministic truly subquadratic framework for polynomially bounded integer 3SUM. The c0ldzy17 source snapshot, dated 11 October 2026, develops a subsequent deterministic construction with a formally stated 1.962 target. The author-supplied certificate package 3sum_certificate_1p960614_v3, dated 14 October 2026, studies a further parameter and switch refinement. It contains mathematical arguments and exact rational checks, and explicitly leaves the complete modified machine-program theorem unproved. This mission studies that remaining extension together with its supporting certificates.

Inputs, word instructions and analytic quantities

An input of size nnn is an integer-valued function on the positions 0,…,n−10,\ldots,n-10,…,n−1. For each fixed natural number κ\kappaκ, every value has absolute value at most nκn^\kappanκ. A YES instance has pairwise distinct positions i,j,ki,j,ki,j,k satisfying xi+xj+xk=0x_i+x_j+x_k=0xi​+xj​+xk​=0. Equal values at different positions are allowed. The problem asks for a decision, so a successful algorithm need not return the positions. Inputs of size less than three are NO instances.

The word RAM is the existing campaign foundation specification. A program is a finite list of instructions for constants, arithmetic, direct and indirect memory access, branching, acceptance and rejection. Words have a fixed width and a signed integer interpretation. For each fixed κ\kappaκ, one program, one word-width constant and one time function must work for every input size and every sufficiently large word width. The mission retains that specification without introducing an alternative computation model.

The supporting binary entropy is measured in bits:

H(t)=−tlog⁡t−(1−t)log⁡(1−t)log⁡2,H(0)=H(1)=0.H(t)=\frac{-t\log t-(1-t)\log(1-t)}{\log2},\qquad H(0)=H(1)=0.H(t)=log2−tlogt−(1−t)log(1−t)​,H(0)=H(1)=0.

For an integer expansion c≥3c\ge3c≥3, write

Ec=c2H(1/c),κc=2cH(1/(2c))−cH(1/c)−1,γc(t)=cH(1/c)−cH((1−t)/c).E_c=\frac c2H(1/c),\quad \kappa_c=2cH(1/(2c))-cH(1/c)-1,\quad \gamma_c(t)=cH(1/c)-cH((1-t)/c).Ec​=2c​H(1/c),κc​=2cH(1/(2c))−cH(1/c)−1,γc​(t)=cH(1/c)−cH((1−t)/c).

These are analytic quantities used to describe local encoding and reporting costs. The source's twelve charges also depend on a representation-scale parameter eee, a band shift bbb, a box saving SSS, an initial threshold θ\thetaθ, a terminal fraction τ\tauτ, and a uniform entropy coefficient ρ\rhoρ.

Formalization targets

The campaign goal is the exact proposition

EndStatement.ThreeSum.SolvedInTime  (1.960614).\texttt{EndStatement.ThreeSum.SolvedInTime}\;(1.960614).EndStatement.ThreeSum.SolvedInTime(1.960614).

For 1.960614=980307/5000001.960614=980307/5000001.960614=980307/500000, its time requirement is

∃K∈N  ∀n≥2,T(n)500000≤Kn980307.\exists K\in\mathbb N\;\forall n\ge2,\quad T(n)^{500000}\le K n^{980307}.∃K∈N∀n≥2,T(n)500000≤Kn980307.

Correctness and termination still cover all input sizes. The integer-size exponent includes κ=0\kappa=0κ=0, and the same program must be correct for every word width above its specified threshold.

The primary certificate uses c=232c=232c=232 and the rational quartic

P(t)=7.85174904t+0.72447023t2+0.24044466t3+0.12022459t4.P(t)=7.85174904t+0.72447023t^2+0.24044466t^3+0.12022459t^4.P(t)=7.85174904t+0.72447023t2+0.24044466t3+0.12022459t4.

Supporting targets establish its validity on [0,1/2][0,1/2][0,1/2], its derivative and tangent bounds, and the uniform inequality H(t)<0.27905030(1+P(t))H(t)<0.27905030(1+P(t))H(t)<0.27905030(1+P(t)). The fixed parameters are e=0.203889696e=0.203889696e=0.203889696, b=−0.062656016b=-0.062656016b=−0.062656016, S=0.193175570S=0.193175570S=0.193175570, θ=0.040409899\theta=0.040409899θ=0.040409899, and τ=13/20\tau=13/20τ=13/20. The parameter theorem bounds every one of the twelve costs strictly below 1.96061388<1.9606141.96061388<1.9606141.96061388<1.960614. Integer scheduling and general local-cover identities are separate milestones. A further independent milestone proves R>1.96061349120R>1.96061349120R>1.96061349120 for the explicitly defined relaxed fixed-expansion cost model. That model bound concerns its admissible parameter tuples; it is not a lower bound for 3SUM itself.

What these results establish

The supplied certificate demonstrates that a quartic switch already suffices for the proposed 1.960614 cost target. It also separates a uniform analytic inequality from a numerical experiment: the statement quantifies over the full closed interval. Its finite scheduling statement uses integer comparisons and accounts for the rounding error at every admissible level, rather than requiring executable logarithms.

Formalization adds checked statements about these continuous and finite objects and a reusable dependency structure. The full campaign goal requires an additional result: the actual modified program must obey the certified costs, and its operational correctness must reach the foundation specification. The upstream parameter certificate likewise distinguishes its exponent ledger from its separate implementation obligations. An exact rational checker passing is evidence for the numerical certificates; it does not establish the full new machine theorem.

Why the program extension remains substantive

Changing expansion from 256 to 232 changes the local universe and the vertex, output and degree counts together. The representation scale, band denominator and polynomial switch also change. Consequently, the original fixed-parameter runtime result cannot simply be invoked after replacing a few numerical constants. The new local construction, global encoding, sparse queries, reporting and arithmetic operations must share consistent parameters and a complete cost account.

The small gap between the principal cost cap and the target must absorb the proved subpolynomial overheads, including exceptional-size handling and the conversion to word instructions. The machine bridge has now been proved in this mission. Its accepted dependency tree connects the modified program and its runtime analysis to the unchanged campaign specification. Its statement has no assumed solver callback or unproved runtime contract. The fixed-model lower-bound milestone is an independent analytic root, and is not used to justify a faster algorithm.

Formalization scope and source boundaries

The campaign pins Lean 4.33.1 and Mathlib revision 0df444a360eaa60ab8c11dca51a86af692955474. Entropy and its derived quantities are real-valued; the final exponent is rational; finite subset counts and cleared switch comparisons use natural numbers. Theorems explicitly restrict logarithmic arguments and denominators to their intended domains. Natural-number subtraction in the switch is used only below the final level, with positive even microblock size.

The local-cover milestone covers every natural c≥3c\ge3c≥3 and positive half-block size. The cost-model milestone quantifies over all tuples satisfying its written assumptions and includes a whole-interval entropy constraint. Neither finite testing nor a floating-point optimizer substitutes for these universal statements. The initial package includes no Lean proof of the new machine goal, and the mission does not represent it as an established record.

The underlying algorithms and formal infrastructure retain their attribution to Alman and Vassilevska Williams; Björklund, Husfeldt, Kaski and Koivisto; Swapnil Jain; c0ldzy17; Anthropic; Jihoon Hyun; and Lean/Mathlib, as documented by the upstream source. The certificate development and this formalization use AI assistance. Scientific priority and global optimality are outside the mission's claims.

Selected references

  • Author-supplied 3SUM: Positive-Coefficient Entropy Switch, 1.960614 Cost Certificate and Fixed-Model Lower Bound, certificate package v3, 14 October 2026. Exact source: 3sum_certificate_1p960614_v3/3sum_certificate_v3/PROOF.md, Sections 0–8; certificates/c232_quartic.json; verify_certificate.py. This is a supplied research artifact, not a claimed public publication.
  • c0ldzy17, Deterministic 3SUM in O(n^1.962): method and proof, source documentation, 2026. Pinned METHOD.md, Parameters.lean, and LocalCoverBounds.lean.
  • Josh Alman and Virginia Vassilevska Williams, Truly Subquadratic 3SUM and Truly Subcubic APSP via Triangles in Sparse Lopsided Graphs, arXiv preprint, 2026. arXiv:2610.06783v1.
  • Anthropic, Truly Subquadratic 3SUM and Truly Subcubic APSP, Lean formalization, 2026. Pinned formal-math source. The campaign imports its shared word-RAM statement.

Source code and complete Lean formalization: GitHub repository. Fixed source revision: 8c25c0325de5.

84 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: Yuxuan Xu

Deterministic Integer 3SUM in O(n^1.999017): Sharp Binomial-Tail AnalysisResearch Paper

Why sharpen the integer 3SUM exponent?

3SUM asks whether an input sequence contains three entries at different positions whose sum is zero. The classical quadratic running time makes it a benchmark for fine-grained algorithm design: even a small fixed improvement in the exponent changes its asymptotic complexity. The setting here is polynomially bounded integers and a deterministic word RAM; the input-size exponent, rather than an experimental speedup, is the quantity being studied.

Alman and Vassilevska Williams (2026) give a deterministic truly subquadratic integer 3SUM algorithm through thin matrix products and reductions involving Exact Triangle. Xu's manuscript, Deterministic Integer 3SUM in O(n^1.999017) Time via a Sharper Binomial-Tail Analysis, dated 13 October 2026, refines the analysis of that framework. Its claimed bound is the formalization target here. The Hexagon link identifies the author's submission page, which may require authentication; it is not presented as a public article identifier or evidence of peer review.

Inputs, machine model, and analytic quantities

An input of size nnn is a function x:{0,…,n−1}→Zx:\{0,\ldots,n-1\}\to\mathbb Zx:{0,…,n−1}→Z. For a fixed natural number κ\kappaκ, every entry obeys ∣xi∣≤nκ|x_i|\le n^\kappa∣xi​∣≤nκ. Acceptance means that there are pairwise distinct indices i,j,ki,j,ki,j,k with xi+xj+xk=0x_i+x_j+x_k=0xi​+xj​+xk​=0. Repeated values at different positions are allowed. This is a decision problem, so the algorithm need not return a witness triple.

The word-RAM specification is the campaign's existing EndStatement definition, imported from its foundation mission. For each fixed κ\kappaκ, one finite deterministic program, one word-width threshold constant, and one time-bound function must work for all input sizes and all word widths above that threshold. Words have finite signed interpretations; arithmetic, indirect memory access, branching, acceptance, and rejection are defined operationally. The result concerns this exact model.

For the supporting analysis, let H(u)=−ulog⁡u−(1−u)log⁡(1−u)H(u)=-u\log u-(1-u)\log(1-u)H(u)=−ulogu−(1−u)log(1−u), with endpoint values H(0)=H(1)=0H(0)=H(1)=0H(0)=H(1)=0. All logarithms are natural. For an integer c>10c>10c>10, a positive integer mmm, and 0<θ<0.90<\theta<0.90<θ<0.9, set L=cmL=cmL=cm, D=4mD=4^mD=4m, t=⌈θm⌉t=\lceil\theta m\rceilt=⌈θm⌉, and

βd=(Lm−d)9L−m+d,M=β0.\beta_d=\binom L{m-d}9^{L-m+d},\qquad M=\beta_0.βd​=(m−dL​)9L−m+d,M=β0​.

The sharp preprocessing saving, query exponent, and encoding exponent are

γ∗(c,θ)=cH(1/c)−cH((1−θ)/c)−θlog⁡9log⁡4,\gamma_*(c,\theta)=\frac{cH(1/c)-cH((1-\theta)/c)-\theta\log9}{\log4},γ∗​(c,θ)=log4cH(1/c)−cH((1−θ)/c)−θlog9​, q(θ)=H(θ)+θlog⁡9log⁡4,A(c)=clog⁡10−cH(1/c)/2−(c−1)log⁡3log⁡4.q(\theta)=\frac{H(\theta)+\theta\log9}{\log4},\qquad A(c)=\frac{c\log10-cH(1/c)/2-(c-1)\log3}{\log4}.q(θ)=log4H(θ)+θlog9​,A(c)=log4clog10−cH(1/c)/2−(c−1)log3​.

These auxiliary definitions describe costs; they neither redefine 3SUM nor assume the existence of a fast algorithm.

Formalization targets

The campaign goal is the exact fixed bound

EndStatement.ThreeSum.SolvedInTime  1.999017.\texttt{EndStatement.ThreeSum.SolvedInTime}\;1.999017.EndStatement.ThreeSum.SolvedInTime1.999017.

The first supporting milestone is the two-sided binomial entropy estimate. The second is the manuscript's normalized tail bound

1M∑d=tmβd≤cm+11−9/(c−1)D−γ∗(c,θ).\frac1M\sum_{d=t}^m\beta_d\le\frac{cm+1}{1-9/(c-1)}D^{-\gamma_*(c,\theta)}.M1​d=t∑m​βd​≤1−9/(c−1)cm+1​D−γ∗​(c,θ).

A further milestone establishes strict improvement over the earlier preprocessing saving γ(c,θ)=θlog⁡((c−1)/9)/log⁡4\gamma(c,\theta)=\theta\log((c-1)/9)/\log4γ(c,θ)=θlog((c−1)/9)/log4 at fixed parameters. The algorithmic milestone combines the manuscript's Propositions 4.1 and 5.1: admissible sharp-tail parameters must yield a program satisfying the shared 3SUM specification, not merely a numerical inequality.

The final supporting milestone certifies the exact choice

c=21,θ=0.11202,a=0.05665,s=0.06945.c=21,\qquad\theta=0.11202,\qquad a=0.05665,\qquad s=0.06945.c=21,θ=0.11202,a=0.05665,s=0.06945.

It includes the preprocessing, query, encoding, prime-selection, and instance-construction inequalities, together with

2−as/4=1.999016414375,1.999017−(2−as/4)=0.000000585625>0.2-as/4=1.999016414375,\qquad1.999017-(2-as/4)=0.000000585625>0.2−as/4=1.999016414375,1.999017−(2−as/4)=0.000000585625>0.

Every terminating decimal denotes an exact rational number. The target is the fixed big-OOO exponent 1.999017; the smaller cutoff is accompanied by residual asymptotic losses in the manuscript and is not asserted as the same fixed bound.

What completing this mission would establish

A complete proof would certify the manuscript's improved integer 3SUM bound in the campaign's common machine model. The gain is an analysis refinement of the inherited algorithm and reductions. It does not claim a new algorithmic framework, optimal parameters, global optimality, or priority over all other work.

The manuscript also gives an auxiliary O(n1.999073)O(n^{1.999073})O(n1.999073) bound by retuning the previous estimate. That weaker result is background, not this mission's campaign value. The existing upstream formalization is prior work; it does not automatically certify either refinement. The supplied rational interval verifier checks the parameter inequalities, but those checks alone do not prove a word-RAM running-time theorem. The main goal and the newly drafted supporting statements remain open Lean proof obligations.

Where the difficulty lies

A better tail estimate is insufficient unless every other cost remains within the final budget. Shared encoding work, all queries, deterministic prime selection, witness scanning, and instance construction must be included. The word-size and address bounds must remain valid after changing parameters. Ceiling operations, restricting DDD to powers of four, and bounded-size exceptions must also be handled.

The central formalization burden is the connection between the analytic estimates and an actual deterministic program. Assuming an oracle with the desired running time would remove that burden and would not establish the stated target. Likewise, checking a finite range of sizes or a floating-point optimizer's output cannot establish the universal algorithmic statement.

Formalization scope and conventions

The environment is Lean 4.33.1 with Mathlib revision 0df444a360eaa60ab8c11dca51a86af692955474. The foundation reference and the campaign goal's import are retained. Supporting definitions use real logarithms, real powers, natural binomial coefficients, finite sums, and a natural ceiling. Domain hypotheses exclude invalid entropy-tail regimes; endpoint binomial cases are included explicitly.

For r=1999017/1000000r=1999017/1000000r=1999017/1000000, the shared time predicate means that there exists K∈NK\in\mathbb NK∈N such that T(n)1000000≤Kn1999017T(n)^{1000000}\le K n^{1999017}T(n)1000000≤Kn1999017 for every n≥2n\ge2n≥2. Correctness and termination still cover every input size, including n<3n<3n<3. The manuscript's κ≥1\kappa\ge1κ≥1 convention must be extended to the campaign's κ=0\kappa=0κ=0 case, and its word-size analysis must justify uniform correctness at every sufficiently large word width. Both are explicit interface obligations.

Reusable contributions include entropy and tail estimates, rigorous logarithm enclosures, and parameterized cost-to-program results. Existing compatible library results should be reused where available. The manuscript and metadata were prepared with AI assistance; this mission makes no claim of completed human review or completed formal verification of the improved bound.

Selected references

  • Yuxuan Xu, Deterministic Integer 3SUM in O(n^1.999017) Time via a Sharper Binomial-Tail Analysis, manuscript, 13 October 2026. Author-supplied Hexagon submission page. Target: Theorem 1.1; supporting analysis: Sections 3–6.
  • Josh Alman and Virginia Vassilevska Williams, Truly Subquadratic 3SUM and Truly Subcubic APSP via Triangles in Sparse Lopsided Graphs, arXiv preprint, 2026. arXiv:2610.06783v1. Inherited ingredients: Section 4, Lemma 29, Theorem 30, Corollary 31, and the deterministic reductions cited in Xu's Section 2.
  • Anthropic, Truly Subquadratic 3SUM and Truly Subcubic APSP: a Lean 4 formalization, source repository, 2026. Pinned source at commit e1a4e6508154ea59f030480661590a9fe3018011. Its EndStatement.lean supplies the shared specification, not a proof of this mission's new exponent.
8 thms2 active usersReviewed
🏆Completed
Number Theory·Captain: Lucas

General Number Field Sieve: Congruence of SquaresTextbook

Motivation

The general number field sieve (GNFS) is the most efficient classical algorithm known for factoring integers larger than about 1010010^{100}10100. Its heuristic running time for an integer nnn is

exp⁡ ⁣(((64/9)1/3+o(1))(log⁡n)1/3(log⁡log⁡n)2/3)=Ln[1/3, (64/9)1/3],\exp\!\Big(\big((64/9)^{1/3}+o(1)\big)(\log n)^{1/3}(\log\log n)^{2/3}\Big) = L_n\big[1/3,\,(64/9)^{1/3}\big],exp(((64/9)1/3+o(1))(logn)1/3(loglogn)2/3)=Ln​[1/3,(64/9)1/3],

super-polynomial but sub-exponential in the bit length of nnn. Every record factorization of a general RSA modulus of recent decades (RSA-768, RSA-240, RSA-250) was obtained with it, so the security margins of RSA key sizes are calibrated against it (Pomerance, A Tale of Two Sieves, 1996; Boudot et al., 2020).

Like the rational and quadratic sieves, GNFS works by producing a congruence of squares x2≡y2(modn)x^2 \equiv y^2 \pmod nx2≡y2(modn) and then taking gcd⁡(x−y,n)\gcd(x-y,n)gcd(x−y,n). Its gain comes from searching for smooth values that are sub-exponential in the size of nnn, which forces the algorithm to compute in algebraic number fields.

Setting

Let f∈Z[x]f \in \mathbb{Z}[x]f∈Z[x] be a polynomial of degree ddd and θ∈C\theta \in \mathbb{C}θ∈C a root of fff. The number field Q(θ)\mathbb{Q}(\theta)Q(θ) is the set of complex numbers ∑i<daiθi\sum_{i<d} a_i\theta^i∑i<d​ai​θi with ai∈Qa_i \in \mathbb{Q}ai​∈Q; it is ddd-dimensional over Q\mathbb{Q}Q when fff is irreducible over Q\mathbb{Q}Q. The ring Z[θ]\mathbb{Z}[\theta]Z[θ] is the subring of C\mathbb{C}C generated by θ\thetaθ; the ring of integers OQ(θ)\mathcal{O}_{\mathbb{Q}(\theta)}OQ(θ)​ consists of the elements of Q(θ)\mathbb{Q}(\theta)Q(θ) that are roots of monic integer polynomials. It contains Z[θ]\mathbb{Z}[\theta]Z[θ] when fff is monic, and the two can differ.

GNFS chooses two irreducible integer polynomials f1,f2f_1, f_2f1​,f2​ with a common root mmm modulo nnn, i.e. n∣f1(m)n \mid f_1(m)n∣f1​(m) and n∣f2(m)n \mid f_2(m)n∣f2​(m). A simple choice is the base-mmm polynomial: write n=admd+⋯+a1m+a0n = a_d m^d + \dots + a_1 m + a_0n=ad​md+⋯+a1​m+a0​ with digits 0≤ai<m0 \le a_i < m0≤ai​<m, put f1(x)=∑aixif_1(x) = \sum a_i x^if1​(x)=∑ai​xi and f2(x)=x−mf_2(x) = x - mf2​(x)=x−m. Pairs of integers (a,b)(a,b)(a,b) (relations) are sieved so that both homogenized values Fj(a,b)=bdeg⁡fjfj(a/b)F_j(a,b) = b^{\deg f_j} f_j(a/b)Fj​(a,b)=bdegfj​fj​(a/b) are smooth; up to the leading coefficient these are the norms N(a−bθj)N(a - b\theta_j)N(a−bθj​). Linear algebra over F2\mathbb{F}_2F2​ then selects a set SSS of relations for which

∏(a,b)∈S(a−bθ1)=γ12,γ1∈Z[θ1],∏(a,b)∈S(a−bθ2)=γ22,γ2∈Z[θ2].\prod_{(a,b)\in S}(a-b\theta_1) = \gamma_1^2,\quad \gamma_1 \in \mathbb{Z}[\theta_1], \qquad \prod_{(a,b)\in S}(a-b\theta_2) = \gamma_2^2,\quad \gamma_2 \in \mathbb{Z}[\theta_2].(a,b)∈S∏​(a−bθ1​)=γ12​,γ1​∈Z[θ1​],(a,b)∈S∏​(a−bθ2​)=γ22​,γ2​∈Z[θ2​].

Because mmm is a root of both polynomials mod nnn, there are ring homomorphisms φj:Z[θj]→Z/nZ\varphi_j : \mathbb{Z}[\theta_j] \to \mathbb{Z}/n\mathbb{Z}φj​:Z[θj​]→Z/nZ with φj(θj)=m\varphi_j(\theta_j) = mφj​(θj​)=m. Both send ∏S(a−bθj)\prod_S(a - b\theta_j)∏S​(a−bθj​) to ∏S(a−bm)\prod_S(a - bm)∏S​(a−bm).

Formalization targets

Goal: the congruence of squares

For f1,f2f_1, f_2f1​,f2​ irreducible in Z[x]\mathbb{Z}[x]Z[x] with complex roots θ1,θ2\theta_1,\theta_2θ1​,θ2​, a common root mmm mod nnn, and SSS, γ1\gamma_1γ1​, γ2\gamma_2γ2​ as above:

∃ φj:Z[θj]→Z/nZ, φj(θj)=m,and every such pair satisfiesφ1(γ1)2=φ2(γ2)2.\exists\,\varphi_j:\mathbb{Z}[\theta_j]\to\mathbb{Z}/n\mathbb{Z},\ \varphi_j(\theta_j)=m, \qquad\text{and every such pair satisfies}\qquad \varphi_1(\gamma_1)^2 = \varphi_2(\gamma_2)^2 .∃φj​:Z[θj​]→Z/nZ, φj​(θj​)=m,and every such pair satisfiesφ1​(γ1​)2=φ2​(γ2​)2.

This is the correctness statement of the algebraic part of GNFS: whatever relations the sieve and linear algebra produce, the square-root step yields x=φ1(γ1)x = \varphi_1(\gamma_1)x=φ1​(γ1​), y=φ2(γ2)y = \varphi_2(\gamma_2)y=φ2​(γ2​) with n∣x2−y2n \mid x^2 - y^2n∣x2−y2.

Supporting statements (milestones)

  1. [Q(θ):Q]=d[\mathbb{Q}(\theta):\mathbb{Q}] = d[Q(θ):Q]=d for fff irreducible over Q\mathbb{Q}Q.
  2. Z[θ]\mathbb{Z}[\theta]Z[θ] can be strictly smaller than the ring of integers.
  3. The base-mmm polynomial has digits 0≤ai<m0\le a_i<m0≤ai​<m as coefficients and f(m)=nf(m)=nf(m)=n, so mmm is a root mod nnn.
  4. Existence of the homomorphism Z[θ]→Z/nZ\mathbb{Z}[\theta]\to\mathbb{Z}/n\mathbb{Z}Z[θ]→Z/nZ, θ↦m\theta\mapsto mθ↦m.
  5. cd NQ(θ)/Q(a−bθ)=bdf(a/b)c_d\,N_{\mathbb{Q}(\theta)/\mathbb{Q}}(a-b\theta) = b^d f(a/b)cd​NQ(θ)/Q​(a−bθ)=bdf(a/b), where cdc_dcd​ is the leading coefficient.
  6. If n∣x2−y2n\mid x^2-y^2n∣x2−y2, n∤x−yn\nmid x-yn∤x−y, n∤x+yn\nmid x+yn∤x+y, then 1<gcd⁡(x−y,n)<n1<\gcd(x-y,n)<n1<gcd(x−y,n)<n.
  7. For odd nnn with at least two prime factors and a unit xxx, at least half of the square roots of x2x^2x2 mod nnn differ from ±x\pm x±x (the "probability at least 1/21/21/2" of the final step).

Significance

The goal and milestones together certify that every output of the GNFS pipeline that passes the square-root step is a genuine congruence of squares, and that such a congruence splits nnn with probability at least 1/21/21/2 over the choice of square root. This is the part of the algorithm whose correctness is unconditional; the running-time bound is heuristic and is not a target here.

These results are classical and appear in standard references (Lenstra–Lenstra 1993; Crandall–Pomerance 2005, §6.2). The mission's contribution is a machine-checked formal version connecting number fields in C\mathbb{C}C, integer polynomials, and residue rings, which current libraries do not package for this purpose.

Difficulty

The ring homomorphism Z[θ]→Z/nZ\mathbb{Z}[\theta] \to \mathbb{Z}/n\mathbb{Z}Z[θ]→Z/nZ is the delicate point. Z[θ]\mathbb{Z}[\theta]Z[θ] is a subring of C\mathbb{C}C, not a quotient ring, so a map defined by θ↦m\theta \mapsto mθ↦m is well defined only if every integer polynomial vanishing at θ\thetaθ is a multiple of fff in Z[x]\mathbb{Z}[x]Z[x]. This needs fff irreducible over Z\mathbb{Z}Z (in particular primitive), via Gauss's lemma; for f(x)=2xf(x) = 2xf(x)=2x and n=2n = 2n=2, every mmm is a root mod nnn, but θ=0\theta = 0θ=0 only admits θ↦0\theta \mapsto 0θ↦0. The norm identity requires identifying f/cdf/c_df/cd​ as the minimal polynomial of θ\thetaθ and expressing the norm as a product over conjugates. The probability milestone needs the Chinese remainder theorem and counting square roots of units modulo odd prime powers.

Formalization scope

All statements live in the namespace GNFS. Number fields are realized inside C\mathbb{C}C: Q(θ)\mathbb{Q}(\theta)Q(θ) is ℚ⟮θ⟯ and Z[θ]\mathbb{Z}[\theta]Z[θ] is Algebra.adjoin ℤ {θ}. Residues mod nnn are ZMod n with n∈Nn \in \mathbb{N}n∈N (n=0n = 0n=0 gives Z\mathbb{Z}Z, consistent with every statement). Two definitions are shared: GNFS.baseMPolynomial n m, the polynomial whose coefficients are the base-mmm digits of nnn (via Nat.digits), and GNFS.homogenize f a b =∑i≤dciaibd−i= \sum_{i\le d} c_i a^i b^{d-i}=∑i≤d​ci​aibd−i.

Irreducibility "over the rationals" with integer coefficients is encoded as irreducibility in Z[x]\mathbb{Z}[x]Z[x] (primitive and irreducible over Q\mathbb{Q}Q) where a homomorphism to Z/nZ\mathbb{Z}/n\mathbb{Z}Z/nZ is needed. Without primitivity the claimed homomorphism can fail to exist. The goal asserts both the existence of the homomorphisms and the equality for every such pair, so it cannot be satisfied by the trivial choice x=yx = yx=y. The sieving, smoothness, linear-algebra and complexity aspects of the article are out of scope.

Reusable by-products: norms of linear elements in simple extensions, homomorphisms out of Z[θ]\mathbb{Z}[\theta]Z[θ], and square-root counting in Z/nZ\mathbb{Z}/n\mathbb{Z}Z/nZ.

Selected references

  • Wikipedia, General number field sieve, revision 1377718368. https://en.wikipedia.org/w/index.php?title=General_number_field_sieve&oldid=1377718368
  • C. Pomerance, A Tale of Two Sieves, Notices of the AMS 43(12), 1996. https://www.ams.org/notices/199612/pomerance.pdf
  • A. K. Lenstra, H. W. Lenstra Jr. (eds.), The development of the number field sieve, Lecture Notes in Math. 1554, Springer, 1993. https://doi.org/10.1007/BFb0091534
  • R. Crandall, C. Pomerance, Prime Numbers: A Computational Perspective, 2nd ed., Springer, 2005, §6.2. https://doi.org/10.1007/0-387-28979-8
  • F. Boudot et al., Comparing the difficulty of factorization and discrete logarithm: a 240-digit experiment, CRYPTO 2020. https://eprint.iacr.org/2020/697
9 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: wurtle

3SUM in O(n^1.962) Time on a Word RAMResearch Paper

This entry records a deterministic O(n1.962)O(n^{1.962})O(n1.962) bound for 3SUM on polynomially bounded integers, using the campaign's shared word-RAM model with O(log⁡n)O(\log n)O(logn)-bit words. Three distinct input positions must sum to zero; repeated values are allowed. The exact exponent is 981/500981/500981/500.

References

  • Source repository: complete Lean proof and verification record
49 thms2 active usersReviewed
🏆Completed
CombinatoricsLinear algebraOptimization·Captain: mikedeng1

Optimal Approximation for Submodular and Supermodular Optimization with Bounded Curvature II: Column-Subset Selection Has Total Curvature at Most 1 − 1/κ(A)²Research Paper

Why column-subset selection and curvature

The column-subset selection problem (CSSP) asks for kkk columns of a real matrix AAA whose span approximates all of AAA as well as possible in squared Frobenius norm. It is a basic primitive of low-rank approximation, feature selection and numerical linear algebra, studied both for its exact complexity and for approximation algorithms (see Boutsidis, Drineas and Magdon-Ismail, doi:10.1137/12086755X, cited as [2] in the source paper).

Sviridenko, Vondrák and Ward study submodular maximization and supermodular minimization when the objective has bounded total curvature, a parameter c∈[0,1]c \in [0,1]c∈[0,1] introduced by Conforti and Cornuéjols that measures how far a monotone set function is from being linear. Their guarantees improve as ccc decreases. Section 8 of the paper applies this to CSSP: it bounds the curvature of the CSSP objective in terms of the condition number of AAA, so that a well-conditioned matrix has small curvature. This mission formalizes that bound (Lemma 8.2) and the steps of its proof.

Setting

Let AAA be a real m×nm \times nm×n matrix with columns c1,…,cn∈Rmc_1, \dots, c_n \in \mathbb{R}^mc1​,…,cn​∈Rm, so that Ax=∑ixiciAx = \sum_i x_i c_iAx=∑i​xi​ci​ for x∈Rnx \in \mathbb{R}^nx∈Rn, and let ∥⋅∥\|\cdot\|∥⋅∥ be the Euclidean norm. For S⊆[n]S \subseteq [n]S⊆[n] write projS(x)\mathrm{proj}_S(x)projS​(x) for the orthogonal projection of xxx onto span{ci:i∈S}\mathrm{span}\{c_i : i \in S\}span{ci​:i∈S}, the point of that subspace nearest to xxx (proj∅=0\mathrm{proj}_\emptyset = 0proj∅​=0). The CSSP objective is

fA(S)=∑i=1n∥ci−projS(ci)∥2,f^A(S) = \sum_{i=1}^n \|c_i - \mathrm{proj}_S(c_i)\|^2 ,fA(S)=i=1∑n​∥ci​−projS​(ci​)∥2,

the squared Frobenius distance from AAA to the nearest matrix whose columns lie in the span of the selected columns.

For a set function fff on a finite set XXX, the marginal value of iii at AAA is fA(i)=f(A+i)−f(A)f_A(i) = f(A+i) - f(A)fA​(i)=f(A+i)−f(A). The function fff is monotone decreasing if every fA(i)≤0f_A(i) \le 0fA​(i)≤0. Following (1.1) of the paper, a monotone decreasing fff has total curvature at most ccc when, for every j∈Xj \in Xj∈X,

fX−j(j)≤(1−c) f∅(j),f_{X-j}(j) \le (1-c)\, f_\emptyset(j),fX−j​(j)≤(1−c)f∅​(j),

i.e. the last marginal of jjj is at least a (1−c)(1-c)(1−c) fraction of its first marginal in absolute value.

When the columns of AAA are linearly independent, the condition number is

κ(A)=sup⁡∥x∥=1∥Ax∥inf⁡∥x∥=1∥Ax∥∈[1,∞).\kappa(A) = \frac{\sup_{\|x\|=1}\|Ax\|}{\inf_{\|x\|=1}\|Ax\|} \in [1, \infty).κ(A)=inf∥x∥=1​∥Ax∥sup∥x∥=1​∥Ax∥​∈[1,∞).

Formalization targets

Goal: Lemma 8.2 (p. 11)

For AAA with linearly independent columns,

f[n]−jA(j)≤1κ2(A) f∅A(j)for all j∈[n],i.e.c(fA)≤1−1κ2(A).f^A_{[n]-j}(j) \le \frac{1}{\kappa^2(A)}\, f^A_\emptyset(j) \quad \text{for all } j \in [n], \qquad \text{i.e.}\quad c(f^A) \le 1 - \frac{1}{\kappa^2(A)} .f[n]−jA​(j)≤κ2(A)1​f∅A​(j)for all j∈[n],i.e.c(fA)≤1−κ2(A)1​.

Milestones

  1. The identity fA(S)=∑i(∥ci∥2−∥projS(ci)∥2)f^A(S) = \sum_i (\|c_i\|^2 - \|\mathrm{proj}_S(c_i)\|^2)fA(S)=∑i​(∥ci​∥2−∥projS​(ci​)∥2) (p. 11).
  2. Lemma 8.1, monotone part: S↦∥projS(v)∥2S \mapsto \|\mathrm{proj}_S(v)\|^2S↦∥projS​(v)∥2 is monotone increasing (p. 11).
  3. fAf^AfA is monotone decreasing (p. 11).
  4. ∣f∅A(i)∣=∑j∥proj{i}(cj)∥2|f^A_\emptyset(i)| = \sum_j \|\mathrm{proj}_{\{i\}}(c_j)\|^2∣f∅A​(i)∣=∑j​∥proj{i}​(cj​)∥2 (p. 11).
  5. Some unit xxx has ∥Ax∥≥∣f∅A(i)∣\|Ax\| \ge \sqrt{|f^A_\emptyset(i)|}∥Ax∥≥∣f∅A​(i)∣​ (p. 12).
  6. ∣f[n]−iA(i)∣=∥ci−proj[n]−i(ci)∥2|f^A_{[n]-i}(i)| = \|c_i - \mathrm{proj}_{[n]-i}(c_i)\|^2∣f[n]−iA​(i)∣=∥ci​−proj[n]−i​(ci​)∥2 (p. 12).
  7. Some unit x′x'x′ has ∥Ax′∥≤∣f[n]−iA(i)∣\|Ax'\| \le \sqrt{|f^A_{[n]-i}(i)|}∥Ax′∥≤∣f[n]−iA​(i)∣​ (p. 12).
  8. κ2(A)≥f∅A(i)/f[n]−iA(i)\kappa^2(A) \ge f^A_\emptyset(i)/f^A_{[n]-i}(i)κ2(A)≥f∅A​(i)/f[n]−iA​(i) for each iii, under independence (p. 12).

Items 1–7 hold for arbitrary columns; only item 8 and the goal assume independence.

Significance

Lemma 8.2 turns a spectral quantity into a combinatorial one. With it, any curvature-dependent guarantee for monotone decreasing set functions can be stated for CSSP in terms of κ(A)\kappa(A)κ(A). The paper's Lemma 8.3 shows the bound is asymptotically tight, so 1−Θ(1/κ2)1 - \Theta(1/\kappa^2)1−Θ(1/κ2) is the right order of the curvature.

There is a caveat that the formalization makes explicit. The paper deduces from Lemma 8.1 that fAf^AfA is supermodular, and on that basis quotes its supermodular-minimization algorithm for CSSP with factor 1+(κ2−1)e−1+κ2O(ϵ)1 + (\kappa^2 - 1)e^{-1} + \kappa^2 O(\epsilon)1+(κ2−1)e−1+κ2O(ϵ) (p. 12). Both the submodularity half of Lemma 8.1 and the supermodularity of fAf^AfA are false as printed. With c1=e1c_1 = e_1c1​=e1​, c2=e1+e2c_2 = e_1 + e_2c2​=e1​+e2​ and v=e2v = e_2v=e2​ in R2\mathbb{R}^2R2, the function F(S)=∥projS(v)∥2F(S) = \|\mathrm{proj}_S(v)\|^2F(S)=∥projS​(v)∥2 has F({1,2})+F(∅)=1>12=F({1})+F({2})F(\{1,2\}) + F(\emptyset) = 1 > \tfrac12 = F(\{1\}) + F(\{2\})F({1,2})+F(∅)=1>21​=F({1})+F({2}). With columns e1,e1+e2,2e2e_1, e_1+e_2, 2e_2e1​,e1​+e2​,2e2​, fA({1})+fA({2})=152>7=fA({1,2})+fA(∅)f^A(\{1\}) + f^A(\{2\}) = \tfrac{15}{2} > 7 = f^A(\{1,2\}) + f^A(\emptyset)fA({1})+fA({2})=215​>7=fA({1,2})+fA(∅). A small perturbation gives a counterexample with independent columns. This is the "suppressor variable" phenomenon of regression. The curvature bound itself does not depend on supermodularity and is true, so it is the goal here. The approximation factor for CSSP is not posed, because it rests on the false claim and is stated with O(ϵ)O(\epsilon)O(ϵ).

As far as is known, none of these statements has a machine-checked proof. The results are proved on paper, except the two false claims above. The mission adds a formal proof of the curvature–conditioning bound, and makes explicit which parts of §8 survive.

Difficulty

The individual steps are short linear algebra, but they rest on infrastructure that has to be assembled: orthogonal projections onto spans of finite column families, the Pythagorean identities that relate fAf^AfA to projections, and the variational characterization of sup⁡\supsup and inf⁡\infinf of ∥Ax∥\|Ax\|∥Ax∥ over the unit sphere.

The paper's own route to the large unit vector (milestone 5) does not work as printed. It sets xj∝∥proj{i}(cj)∥x_j \propto \|\mathrm{proj}_{\{i\}}(c_j)\|xj​∝∥proj{i}​(cj​)∥ and uses ci⋅cj=∥ci∥ ∥proj{i}(cj)∥c_i \cdot c_j = \|c_i\|\,\|\mathrm{proj}_{\{i\}}(c_j)\|ci​⋅cj​=∥ci​∥∥proj{i}​(cj​)∥, which is false when ci⋅cj<0c_i \cdot c_j < 0ci​⋅cj​<0, so the signs of the inner products have to be accounted for. In the final step, the ratio f∅A(i)/f[n]−iA(i)f^A_\emptyset(i)/f^A_{[n]-i}(i)f∅A​(i)/f[n]−iA​(i) is a quotient of two negative numbers. Comparing it with κ2\kappa^2κ2 requires the supremum to be finite and the infimum to be strictly positive, which is exactly what independence of the columns provides.

Formalization scope

  • Columns are a family c : Fin n → EuclideanSpace ℝ (Fin m), and AxAxAx is ∑ j, x j • c j. Subsets of [n][n][n] are Finset (Fin n). [n]−i[n] - i[n]−i is Finset.univ.erase i and S+iS + iS+i is insert i S.
  • projS\mathrm{proj}_SprojS​ is Mathlib's Submodule.starProjection onto Submodule.span ℝ (c '' S), which is finite-dimensional, so the argmin of the page exists and is unique.
  • κ(A)\kappa(A)κ(A) is a real quotient of ⨆ and ⨅ of ∥Ax∥\|Ax\|∥Ax∥ over the unit-sphere subtype of Rn\mathbb{R}^nRn. It is used only under LinearIndependent ℝ c, the page's "non-singular", where both are finite and positive. The page's κ=∞\kappa = \inftyκ=∞ for dependent columns is not encoded.
  • Monotonicity is the marginal form of §2.1. Curvature is the product form above, which agrees with the ratio of (1.1) whenever f∅(j)≠0f_\emptyset(j) \ne 0f∅​(j)=0 and avoids Lean's x/0=0x/0 = 0x/0=0.
  • For n=0n = 0n=0 the goal has no jjj and is empty, as on the page.
  • A trivializing reading is ruled out by the encoding: had κ\kappaκ evaluated to a junk value 000, the goal would reduce to monotonicity. Under independence the supremum and infimum are genuine, so the bound 1−1/κ21 - 1/\kappa^21−1/κ2 is the paper's.
  • Not in scope: Lemma 8.3 (stated with O(⋅)O(\cdot)O(⋅)), the CSSP approximation factor, and the false submodularity and supermodularity claims.

Useful infrastructure that would be reusable beyond this mission includes Pythagoras for starProjection, monotonicity of projection norms under inclusion of subspaces, and extremal characterizations of sup⁡∥x∥=1∥Ax∥\sup_{\|x\|=1}\|Ax\|sup∥x∥=1​∥Ax∥ and inf⁡∥x∥=1∥Ax∥\inf_{\|x\|=1}\|Ax\|inf∥x∥=1​∥Ax∥. Contributions of any of the milestones, or of these general lemmas, are welcome.

Selected references

  • M. Sviridenko, J. Vondrák, J. Ward, Optimal approximation for submodular and supermodular optimization with bounded curvature, SODA 2015 (version of Oct. 9, 2014); journal version Math. Oper. Res. 42(4), 2017. https://doi.org/10.1287/moor.2016.0842
  • M. Conforti, G. Cornuéjols, Submodular set functions, matroids and the greedy algorithm: tight worst-case bounds and some generalizations of the Rado–Edmonds theorem, Discrete Appl. Math. 7(3), 1984. https://doi.org/10.1016/0166-218X(84)90003-9
  • C. Boutsidis, P. Drineas, M. Magdon-Ismail, Near-optimal column-based matrix reconstruction, SIAM J. Comput. 43(2), 2014. https://doi.org/10.1137/12086755X
  • A. Das, D. Kempe, Submodular meets spectral: greedy algorithms for subset selection, sparse approximation and dictionary selection, ICML 2011. https://arxiv.org/abs/1102.3975
11 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Joint Assortment Optimization and Customization under a Mixture of Multinomial Logit Models 1: Augmented Greedy Earns a (1 − 1/e) Fraction of the Optimal Revenue from the Complete Customer TypesResearch Paper

Motivation

Retailers that carry a limited range of products often know something about a customer before choosing which of those products to display. The customized assortment problem asks which products to carry when the displayed assortment may be tailored to the arriving customer's type. This separates the first-stage capacity decision from the later offer decision. El Housni and Topaloglu study the problem under a mixture of multinomial logit choice models and develop an approximation framework for it in their SSRN paper. This mission isolates their structural guarantee for Augmented Greedy, Theorem 4.2 of the PDF version dated 7 December 2021. The theorem identifies the revenue recovered from customer types whose optimal personalized offers agree with a chosen product subset.

The paper contrasts this setting with ordinary assortment optimization, where every type sees the same products. Its later approximation results use the structural guarantee here as a component. The classical comparison is the cardinality-constrained greedy bound for monotone submodular functions, associated with Nemhauser, Wolsey and Fisher (1978). The paper's Appendix B gives an instance in which the customized revenue function lacks global submodularity, so that classical result does not apply directly. El Housni and Topaloglu, §§4 and App. B.

Setting

Let N={1,…,n}N=\{1,\ldots,n\}N={1,…,n} be a finite product set. Product iii has positive revenue rir_iri​, and products are indexed with r1≥⋯≥rn>0r_1\ge\cdots\ge r_n>0r1​≥⋯≥rn​>0. Let M={1,…,m}M=\{1,\ldots,m\}M={1,…,m} be customer types. A type-jjj customer arrives with probability θj≥0\theta_j\ge0θj​≥0, with ∑j∈Mθj=1\sum_{j\in M}\theta_j=1∑j∈M​θj​=1, and assigns each product iii a nonnegative preference weight vijv_{ij}vij​. The no-purchase option has weight one. Offering an assortment T⊆NT\subseteq NT⊆N to that customer gives MNL expected revenue

Rev⁡j(T)=∑i∈Trivij1+∑i∈Tvij.\operatorname{Rev}_j(T)= \frac{\sum_{i\in T}r_i v_{ij}}{1+\sum_{i\in T}v_{ij}}.Revj​(T)=1+∑i∈T​vij​∑i∈T​ri​vij​​.

If the retailer initially carries only S⊆NS\subseteq NS⊆N, it can still choose the best offer to each customer type. Thus fj(S)=max⁡T⊆SRev⁡j(T)f_j(S)=\max_{T\subseteq S}\operatorname{Rev}_j(T)fj​(S)=maxT⊆S​Revj​(T). For C⊆MC\subseteq MC⊆M, write fC(S)=∑j∈Cθjfj(S)f^C(S)=\sum_{j\in C}\theta_j f_j(S)fC(S)=∑j∈C​θj​fj​(S), and abbreviate f=fMf=f^Mf=fM. The first-stage capacity is KKK; an optimal solution S∗S^*S∗ of CAP maximizes f(S)f(S)f(S) among sets with at most KKK products. These definitions and the standing data assumptions are stated in §2 and §4 of the paper.

For each product iii, the prefix Vi={1,…,i}V_i=\{1,\ldots,i\}Vi​={1,…,i} contains products at least as early in the revenue ordering. Greedy starts at the empty set, repeatedly adds an available product that maximizes the new objective value, and stops at cardinality kkk or when the prefix is exhausted. Augmented Greedy runs Greedy on ViV_iVi​ for each iii, using S↦∑j∈Cθjmin⁡(fj(S),ri)S\mapsto\sum_{j\in C}\theta_j\min(f_j(S),r_i)S↦∑j∈C​θj​min(fj​(S),ri​), and returns whichever candidate has the greatest fCf^CfC value. Both stages may break ties arbitrarily. El Housni and Topaloglu, §4.1.

For type jjj, use the optimal personalized assortment Sj∗={i∈S∗:ri≥fj(S∗)}S_j^*=\{i\in S^*:r_i\ge f_j(S^*)\}Sj∗​={i∈S∗:ri​≥fj​(S∗)}, characterized by Lemma E.1. A type j∈Cj\in Cj∈C is complete with respect to P⊆NP\subseteq NP⊆N when P∩Sj∗=P∩S∗P\cap S_j^*=P\cap S^*P∩Sj∗​=P∩S∗; let CPC_PCP​ collect these types. The threshold choice matters because zero-weight products can be present in other optimal offers without helping a customer. El Housni and Topaloglu, Definition 4.1 and App. E.

Formalization targets

Theorem 4.2: complete-type revenue

For every C⊆MC\subseteq MC⊆M, P⊆NP\subseteq NP⊆N, kkk with ∣P∩S∗∣≤k|P\cap S^*|\le k∣P∩S∗∣≤k, and every output Δ\DeltaΔ of Augmented Greedy on C,kC,kC,k,

fC(Δ)≥(1−1/e) fCP(P∩S∗).f^C(\Delta)\ge(1-1/e)\,f^{C_P}(P\cap S^*).fC(Δ)≥(1−1/e)fCP​(P∩S∗).

This is the mission goal, the structural performance statement of Theorem 4.2, p. 11. It does not assert a constant-factor approximation to all of CAP: it identifies the contribution from complete customer types.

Supporting targets

The milestone list follows the results used with this bound: monotonicity of fjf_jfj​ from Appendix C; the MNL threshold assortment of Lemma E.1; submodularity of S↦min⁡(fj(S),ri)S\mapsto\min(f_j(S),r_i)S↦min(fj​(S),ri​) on ViV_iVi​ from Lemma 4.3; and the cited 1−1/e1-1/e1−1/e Greedy guarantee for a nonnegative monotone submodular objective. The greedy milestone compares its output against every feasible set of cardinality at most kkk.

Significance

The theorem says that one algorithmic output captures a fixed fraction of the benchmark supplied by complete types, despite the absence of global submodularity of fff. It connects the local behavior of truncated type revenues to the full customized assortment objective. The paper uses this result in the development of later algorithms; without it, the standard submodular greedy theorem gives no immediate conclusion for CAP. El Housni and Topaloglu, §§4–5.

The mathematical results are proved in the 2021 paper. The formalization work here is to give machine-checkable statements for the objective, the algorithm with all its legal tie choices, and the four supporting targets, then supply proofs. The MNL revenue formula is already available as a published platform definition; the local CAP and algorithm definitions specify the extra model needed by this theorem. A completed development could also support later CAP missions that use the same threshold and submodularity properties.

Difficulty

The tempting argument applies the classical greedy guarantee directly to fff, since fff increases when more products are carried. Appendix B of the paper shows that this fails: even for one customer type, fff need not be submodular. Restricting the ground set to a revenue prefix and truncating each fjf_jfj​ at that prefix's revenue level changes the submodularity question, but the final guarantee must still concern the untruncated fCf^CfC objective. The threshold condition in the definition of CPC_PCP​ is what makes that comparison meaningful. El Housni and Topaloglu, App. B, Lemma 4.3 and Theorem 4.2.

Formalization scope

Products and types are Fin n and Fin m; their zero-based Lean indices correspond to the paper's indices plus one. Assortments and type groups are finite sets. The model assumes ri>0r_i>0ri​>0, vij≥0v_{ij}\ge0vij​≥0, θj≥0\theta_j\ge0θj​≥0, ∑jθj=1\sum_j\theta_j=1∑j​θj​=1, and decreasing revenue order. The no-purchase weight is exactly one. CAP and personalized revenue use maxima over nonempty finite powersets, so empty input sets have their intended value rather than an arbitrary real supremum. The theorem keeps the source's optimality assumption on S∗S^*S∗, even though its particular inequality uses less.

The Greedy predicate describes each successive maximizer and the exact stopping rule. Augmented Greedy requires a Greedy output at every prefix and an fCf^CfC-maximizing choice among them. Thus the output is constrained by the printed algorithm, and the statement covers every tie-break. The type-jjj assortment is defined from S∗S^*S∗ by the Lemma E.1 threshold, rather than supplied as a free set. These choices rule out a size-only output condition, an arbitrarily chosen Sj∗S_j^*Sj∗​, a vacuous run predicate, and real supremum defaults. The target includes the corner cases k=0k=0k=0, C=∅C=\varnothingC=∅, and P∩S∗=∅P\cap S^*=\varnothingP∩S∗=∅, where its right side is zero. Arrival probabilities summing to one force m≥1m\ge1m≥1; Augmented Greedy has an output only when at least one product exists.

The reusable parts are the MNL threshold characterization, finite-set submodularity and the general Greedy bound. Contributions toward those lemmas, the paper's case analysis for Lemma 4.3, and the final structural theorem are in scope. Runtime claims, the paper's later logarithmic approximation theorems and its computational experiments are outside this mission.

Selected references

  • Omar El Housni and Huseyin Topaloglu, Joint Assortment Optimization and Customization under a Mixture of Multinomial Logit Models: Value of Personalized Assortments, SSRN 3830082, version of 7 December 2021; published as Operations Research 71(4), 2023. SSRN preprint. The mission's numbering and page citations use the pinned 2021 PDF.
  • George L. Nemhauser, Laurence A. Wolsey and Marshall L. Fisher, An Analysis of Approximations for Maximizing Submodular Set Functions—I, Mathematical Programming 14, 265–294, 1978. DOI.
9 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: mikedeng1

Fully-Functional Suffix Trees and Optimal Text Searching in BWT-runs Bounded Space 2: A Text Whose BWT Has r Runs Has at Most 2rs Distinct Substrings of Length sResearch Paper

Motivation

A text index answers questions about occurrences of a pattern without scanning the whole text. One reason to compress such an index is that many stored texts are repetitive: multiple versions of a document or genome often share long passages. The Burrows–Wheeler transform (BWT) rearranges a text's symbols in a way that groups related contexts. A small number of equal-symbol runs in the BWT is therefore a useful measure of repetition. Gagie, Navarro, and Prezza use the number of runs to state space bounds for text searching and suffix-tree operations in Fully-Functional Suffix Trees and Optimal Text Searching in BWT-runs Bounded Space.

This mission isolates one exact counting result underneath those data-structure bounds. A length-sss substring is called an sss-mer. The number of different sss-mers measures how many local patterns the text contains; repeated occurrences of the same string count once. Lemma 9 of the 2019 preprint bounds this number directly in terms of BWT runs. The result makes a relation between two notions of text repetition precise: clustering in the BWT and diversity of fixed-length substrings.

Setting

Let T[1..n]T[1..n]T[1..n] be a text over the ordered alphabet [1..σ][1..\sigma][1..σ]. Its final symbol is a unique terminator \=1,smallerthaneveryothersymbolinthetext.Foreach, smaller than every other symbol in the text. For each ,smallerthaneveryothersymbolinthetext.Foreachi\in[1..n],the∗∗suffix∗∗, the **suffix** ,the∗∗suffix∗∗T[i..n]startsatstarts atstartsatiandendsattheterminator.The∗∗suffixarray∗∗and ends at the terminator. The **suffix array**andendsattheterminator.The∗∗suffixarray∗∗SA[1..n]isthepermutationofis the permutation ofisthepermutationof[1..n]thatliststhesesuffixesinincreasinglexicographicorder.Thusthat lists these suffixes in increasing lexicographic order. Thusthatliststhesesuffixesinincreasinglexicographicorder.ThusSA[p]isthestartingpositionoftheis the starting position of theisthestartingpositionofthep$th suffix. This is the setup of §2 of the source preprint, pp. 7–9.

The BWT symbol at position ppp is the character just before the suffix at SA[p]SA[p]SA[p]. When that suffix is the whole text and has no preceding character, its predecessor is read cyclically as T[n]=\$$. The BWT partitions into maximal runs of equal symbols; rdenotestheirnumber.ThefirstandlastBWTpositionsineachruncorrespondto∗∗sampledtextpositions∗∗.Atextsubstringdenotes their number. The first and last BWT positions in each run correspond to **sampled text positions**. A text substringdenotestheirnumber.ThefirstandlastBWTpositionsineachruncorrespondto∗∗sampledtextpositions∗∗.AtextsubstringT[i..j]$ is primary when its interval contains a sampled text position, as in Definition 5, p. 16.

For 1≤s≤n1\le s\le n1≤s≤n, let Ss(T)\mathcal S_s(T)Ss​(T) be the set of length-sss strings occurring in TTT:

Ss(T)={T[a..a+s−1]:1≤a≤n−s+1}.\mathcal S_s(T)=\{T[a..a+s-1]:1\le a\le n-s+1\}.Ss​(T)={T[a..a+s−1]:1≤a≤n−s+1}.

The braces matter: two windows with identical contents give one element. The final allowed window includes the terminator. The text is not padded in this definition.

Formalization targets

Primary occurrences

Lemma 8, p. 17 states that every nonempty substring of TTT has an occurrence with the same contents that is primary. With Sampled⁡(T)\operatorname{Sampled}(T)Sampled(T) denoting sampled text positions, the assertion is

∀ 1≤i≤j≤n,∃ 1≤i′≤j′≤n:T[i′..j′]=T[i..j]and[i′..j′]∩Sampled⁡(T)≠∅.\forall\,1\le i\le j\le n,\quad\exists\,1\le i'\le j'\le n: T[i'..j']=T[i..j]\quad\text{and}\quad [i'..j']\cap\operatorname{Sampled}(T)\ne\varnothing.∀1≤i≤j≤n,∃1≤i′≤j′≤n:T[i′..j′]=T[i..j]and[i′..j′]∩Sampled(T)=∅.

The mission's milestones also capture the suffix-array interval of a pattern, the sampled occurrence of each individual character, and the bound ∣Sampled⁡(T)∣≤2r|\operatorname{Sampled}(T)|\le 2r∣Sampled(T)∣≤2r stated in the proof of Lemma 9. These give precise intermediate claims in the paper's route to the count.

Distinct sss-mers

The main goal is Lemma 9, p. 17:

∣Ss(T)∣≤2rsfor every 1≤s≤n.\boxed{\quad |\mathcal S_s(T)|\le 2rs\quad\text{for every }1\le s\le n.\quad}∣Ss​(T)∣≤2rsfor every 1≤s≤n.​

Here rrr is calculated from the BWT of the text's suffix array. Both inequalities on sss are part of the source statement. The bound concerns distinct strings of a fixed length, not the number n−s+1n-s+1n−s+1 of substring windows.

Significance

The theorem gives an explicit upper bound on the number of different length-sss strings that can appear when the BWT has few runs. In §4.2 the authors use it to bound the text area holding all distinct length-sss substrings; that area supports the alphabet-mapping component of their compressed index. This exact combinatorial assertion remains meaningful independently of a machine model or a choice of data structure. Its role in the broader construction is described around Lemmas 8 and 9, pp. 16–17.

The result is proved in the paper. The work here is to give its objects and claims machine-checkable statements and then close their proofs in Lean. The mission has not already supplied a machine-checked proof of these claims. A completed development would also provide reusable definitions of suffix arrays, BWT run boundaries, and finite sets of distinct substrings for later formalizations of compressed text indexes.

Difficulty

The count is immediate only after every substring can be represented by an occurrence containing a sampled position. A direct count of all starting positions cannot yield the claimed bound: nnn may be large even when rrr is small. The difficult step is therefore the primary-occurrence claim of Lemma 8. Its statement has to preserve both parts of “occurrence”: the replacement interval must have the same length and symbols, and it must stay inside the text. The suffix-array range used there depends on lexicographic order, while sampled positions are defined through changes between adjacent BWT symbols. Connecting those two views of the text is the central obstacle.

Formalization scope

The Lean representation uses N\mathbb NN for symbols and 1-based positions. The functions TTT and SASASA are read only on [1..n][1..n][1..n]. An IsText hypothesis enforces n≥1n\ge1n≥1, membership in [1..σ][1..\sigma][1..σ], and the unique final terminator \=1.An‘IsSuffixArray‘hypothesissaysthat. An `IsSuffixArray` hypothesis says that .An‘IsSuffixArray‘hypothesissaysthatSAmapsmapsmaps[1..n]injectivelyintoitselfandordersitssuffixesstrictly;itdoesnotpresupposeanyclaimaboutBWTsamples.Becausethatfinitedomainhasinjectively into itself and orders its suffixes strictly; it does not presuppose any claim about BWT samples. Because that finite domain hasinjectivelyintoitselfandordersitssuffixesstrictly;itdoesnotpresupposeanyclaimaboutBWTsamples.Becausethatfinitedomainhasnelements,theseconditionsdescribeapermutation.TheBWTiscomputedfromelements, these conditions describe a permutation. The BWT is computed fromelements,theseconditionsdescribeapermutation.TheBWTiscomputedfromTandandandSA,withthepredecessorofposition1readasposition, with the predecessor of position 1 read as position ,withthepredecessorofposition1readaspositionn$. Runs are counted by their starting cells; samples are the corresponding text positions from both ends of every run. The model follows the first sentence of Definition 1, including the last character of the final run. The source's following explanatory clause omits that endpoint.

The set of sss-mers is a finite set of lists formed from every valid window. It is not restricted to primary windows, which would make the goal a different and easier statement. A primary substring carries valid endpoints and a sampled position inside them. The formal statements do not assume that the desired primary occurrence exists; that is precisely the content of Lemma 8. The paper's O(⋅)O(\cdot)O(⋅) space and time results are outside this mission: the goal is their explicit substring-counting content.

A complete proof needs elementary facts about list prefixes and lexicographic order, finite interval images, the BWT's run partition, and cardinalities of substring windows near samples. The definitions and interval lemmas can be reused by other missions on suffix arrays and compressed strings. Contributions proving any of the listed milestones or strengthening the surrounding reusable string infrastructure are within scope.

Selected references

  • Travis Gagie, Gonzalo Navarro, and Nicola Prezza, Fully-Functional Suffix Trees and Optimal Text Searching in BWT-runs Bounded Space, arXiv:1809.02792v2, 2019. Preprint.
  • Travis Gagie, Gonzalo Navarro, and Nicola Prezza, Fully-Functional Suffix Trees and Optimal Text Searching in BWT-runs Bounded Space, Journal of the ACM 67(1), 2020. DOI:10.1145/3375890. The mission follows the preprint's numbering and wording.
7 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Prophet Inequalities Made Easy: Stochastic Optimization by Pricing Nonstochastic Inputs III: Under a Consistent Allocation Rule, (α, β)-Balanced Prices Are Closed Under Maxima of ValuationsResearch Paper

Motivation

Posted prices turn an offline allocation problem into a sequential choice process: each agent sees a menu of outcomes and prices, then chooses an outcome without revealing its full valuation. The balanced prices framework of Dütting, Feldman, Kesselheim, and Lucier gives welfare guarantees by comparing the revenue collected from an allocation with the welfare that remains feasible after it. Its appeal is that the comparison can be checked in a deterministic full-information setting before any probability distribution over valuations enters the analysis. Dütting et al., 2020

One valuation class at a time would make that framework difficult to reuse. Combinatorial auction valuations are often built by taking pointwise maxima of simpler valuations or by adding values from separate markets. Section 5 of the paper asks whether a price construction balanced for the simple class remains balanced after these operations. Theorem 5.3 gives the maximum closure result; Theorem 5.4 gives addition across markets. Appendix B extends both to the weaker balancing condition used elsewhere in the paper. Dütting et al., 2020, §5 and Appendix B

Setting

There are nnn agents in a fixed order. Agent iii receives an outcome xix_ixi​ from a space XiX_iXi​ containing a null outcome. A profile x=(xi)ix=(x_i)_ix=(xi​)i​ is feasible when it lies in F\mathcal FF. The model assumes downward closure: removing the outcomes of any group of agents from a feasible profile keeps it feasible. For a set of agents SSS, write xSx_SxS​ for the profile retaining xix_ixi​ on SSS and assigning the null outcome elsewhere. The prefix x[i−1]x_{[i-1]}x[i−1]​ retains only the agents before iii. Dütting et al., 2020, §2

A valuation profile vvv assigns each agent a function vi:Xi→Rv_i:X_i\to\mathbb Rvi​:Xi​→R. The welfare of xxx is v(x)=∑ivi(xi)v(x)=\sum_i v_i(x_i)v(x)=∑i​vi​(xi​). Every base valuation takes values in [0,1][0,1][0,1], the normalization stated in §2. For any set SSS of profiles, v(OPT⁡(v,S))v(\operatorname{OPT}(v,S))v(OPT(v,S)) denotes the best welfare achievable in SSS. An allocation rule ALG chooses a feasible profile from a valuation profile. A pricing rule assigns a nonnegative, possibly infinite price pi(xi∣y)p_i(x_i\mid y)pi​(xi​∣y) to outcome xix_ixi​ when the partial profile is yyy; an infeasible extension has infinite price. Dütting et al., 2020, pp. 547–548

An exchange-compatible family (Fx)x∈X(\mathcal F_x)_{x\in X}(Fx​)x∈X​ specifies a set of comparison profiles for each profile xxx. It is exchange compatible when replacing any one coordinate of xxx by the corresponding coordinate of any y∈Fxy\in\mathcal F_xy∈Fx​ gives a feasible profile. This property is required for every xxx in the full outcome space. A rule pvp^vpv is (α,β)(\alpha,\beta)(α,β)-balanced for valuation vvv, ALG, and that family, for constants α>0\alpha>0α>0 and β≥0\beta\ge0β≥0 (Definition 3.1), when both inequalities hold for every feasible xxx and every x′∈Fxx'\in\mathcal F_xx′∈Fx​:

v(ALG⁡(v))−v(OPT⁡(v,Fx))α≤∑ipiv(xi∣x[i−1]),∑ipiv(xi′∣x[i−1])≤βv(OPT⁡(v,Fx)).\frac{v(\operatorname{ALG}(v))-v(\operatorname{OPT}(v,\mathcal F_x))}{\alpha} \le \sum_i p_i^v(x_i\mid x_{[i-1]}), \qquad \sum_i p_i^v(x'_i\mid x_{[i-1]}) \le \beta v(\operatorname{OPT}(v,\mathcal F_x)).αv(ALG(v))−v(OPT(v,Fx​))​≤i∑​piv​(xi​∣x[i−1]​),i∑​piv​(xi′​∣x[i−1]​)≤βv(OPT(v,Fx​)).

The maximum extension Vimax⁡V_i^{\max}Vimax​ of a base valuation space ViV_iVi​ consists of nonempty finite pointwise maxima of elements of ViV_iVi​. A base profile v~\tilde vv~ supports an extended profile vvv at xxx if v~i≤vi\tilde v_i\le v_iv~i​≤vi​ at every outcome and v~i(xi)=vi(xi)\tilde v_i(x_i)=v_i(x_i)v~i​(xi​)=vi​(xi​) for every agent. ALG is consistent when v~(ALG⁡(v~))≥v~(ALG⁡(v))\tilde v(\operatorname{ALG}(\tilde v))\ge\tilde v(\operatorname{ALG}(v))v~(ALG(v~))≥v~(ALG(v)) whenever v~\tilde vv~ supports vvv at ALG⁡(v)\operatorname{ALG}(v)ALG(v). The optimal allocation rule has this property by Lemma 5.2. Dütting et al., 2020, p. 554

Formalization targets

Closure under maxima

The goal is Theorem 5.3. Given one exchange-compatible family and a collection (pw)w∈V(p^w)_{w\in V}(pw)w∈V​ balanced for every base profile, consistency of ALG preserves the same constants for every extended profile and every corresponding supporting base profile:

v∈Vmax⁡,v~∈V supports v at ALG⁡(v)⟹pv~ is (α,β)-balanced for v.v\in V^{\max},\quad \tilde v\in V\text{ supports }v\text{ at }\operatorname{ALG}(v) \quad\Longrightarrow\quad p^{\tilde v}\text{ is }(\alpha,\beta)\text{-balanced for }v.v∈Vmax,v~∈V supports v at ALG(v)⟹pv~ is (α,β)-balanced for v.

The milestone list records the welfare supremum comparison and the two price inequalities in the paper's proof. The family Fx\mathcal F_xFx​ remains the same for all base and extended profiles. Dütting et al., 2020, Theorem 5.3 and proof

Closure under addition and weak balancedness

Theorem 5.4 treats mmm separate allocation problems. The joint outcome and feasible set are products; values and prices add across components; ALG applies each component's rule. It asserts balancedness with the same α\alphaα and β\betaβ. Appendix B changes the second balancedness bound to β1v(OPT⁡(v,Fx))+β2v(ALG⁡(v))\beta_1v(\operatorname{OPT}(v,\mathcal F_x))+\beta_2v(\operatorname{ALG}(v))β1​v(OPT(v,Fx​))+β2​v(ALG(v)) and requires strong consistency for maximum closure. Theorems B.2 and B.3 preserve α,β1,β2\alpha,\beta_1,\beta_2α,β1​,β2​ under maxima and addition, respectively. Dütting et al., 2020, Theorems 5.4, B.2, B.3

Significance

The maximum closure theorem lets a balanced-price construction for a simple valuation class cover finite maxima of that class without worsening its balancing constants. The addition theorem lets separately priced markets be combined by summing prices. Together these two operations account for the XOS composition discussed immediately after Theorem 5.4; the paper uses the results to connect its general framework to combinatorial auctions and multidimensional matroid settings. Dütting et al., 2020, p. 555

These results have paper proofs. The work here is to state their exact deterministic content in Lean so later formalizations of the price constructions can import the closure theorems. The definitions of supporting valuations, exchange-compatible families, and extended-real prices are reusable beyond this mission. The companion statements keep the product-market and weak-balancedness variants alongside the central theorem, while their proofs remain to be formalized.

Difficulty

For maximum closure, the prices are indexed by a base profile v~\tilde vv~ but must be balanced for a different profile vvv that is pointwise larger. A supporting profile agrees with vvv only at ALG's outcome ALG⁡(v)\operatorname{ALG}(v)ALG(v), while condition (a) refers to ALG⁡(v~)\operatorname{ALG}(\tilde v)ALG(v~), an outcome ALG chooses for a different input, and both conditions refer to optimal welfare over Fx\mathcal F_xFx​, where v~\tilde vv~ and vvv can differ. Balancedness of pv~p^{\tilde v}pv~ for v~\tilde vv~ therefore says nothing about vvv on its own; without a hypothesis tying ALG's choices for vvv and v~\tilde vv~ together the statement is false, which is why consistency (Definition 5.1) is part of the theorem. The formal statement must keep the real-valued optimum meaningful for maxima of base valuations, so the [0,1][0,1][0,1] normalization of §2 is carried through to Vmax⁡V^{\max}Vmax. Dütting et al., 2020, Definition 5.1 and Theorem 5.3

For addition, a direct product of the component comparison families has an edge case: a component family can be empty while another is nonempty. The paper's displayed product family then makes the lower balancedness inequality too strong. The theorem statements ask for an exchange-compatible family to exist, as the printed theorems do; they do not require that failing product family. This discrepancy is recorded for review. Dütting et al., 2020, proof of Theorem 5.4

Formalization scope

Agents and markets use zero-based finite indices; the paper writes agent indices from one. A profile's prefix contains exactly the agents with smaller indices. Valuations are functions to R\mathbb RR with base values in [0,1][0,1][0,1]. The maximum extension uses a nonempty finite set of base functions, so its maximum is defined at every outcome. Optimal welfare is a real supremum; bounded valuations keep it finite, and the empty set has value zero. Prices are extended nonnegative reals so +∞+\infty+∞ is retained. The lower balancedness inequality embeds its real right side using ofReal, which handles a negative lower bound consistently with nonnegative prices. The upper inequality keeps the price sum in extended reals.

The maximum theorem quantifies over every extended profile and every supporting base profile, including genuinely new maxima. It keeps one exchange-compatible family for all valuations. The maximum-closure theorems require every base price to satisfy the pricing-rule condition and conclude it for the supporting price. ALG feasibility is assumed on Vmax⁡V^{\max}Vmax, which contains the base profiles. The product theorems construct joint outcomes, additive values, componentwise ALG, and summed prices from the component data; they do not admit an unrelated joint allocation rule. Downward closure and a zero price for the null outcome at feasible partial allocations are included for the product statements. The latter is a disclosed assumption satisfied by the paper's pricing examples and needed to handle empty component families. No distribution or posted-price run is part of this deterministic mission. Lemma 5.2 and the strong-consistency companion take an optimal rule to be one that attains the welfare supremum over F\mathcal FF on every profile in Vmax⁡V^{\max}Vmax, the profiles to which Definitions 5.1 and B.1 apply it; the product companions additionally conclude that the summed prices form a pricing rule (infinite off F\mathcal FF). Their ALG feasibility premise concerns the component profiles supplied in the theorem.

The development needs finite dependent products and sums, finite maxima, real suprema of bounded sets, and extended nonnegative arithmetic. Contributions proving the three maximum-closure milestones, the goal, or the product-market companions are all within scope. A proof that specializes the supporting profile to v~=v\tilde v=vv~=v would lose the intended maximum extension and does not satisfy the goal's universal quantification.

Selected references

  • P. Dütting, M. Feldman, T. Kesselheim, and B. Lucier, Prophet Inequalities Made Easy: Stochastic Optimization by Pricing Nonstochastic Inputs, SIAM Journal on Computing 49(3):540–582, 2020. DOI: 10.1137/20M1323850.
7 thms2 active usersReviewed
🏆Completed
Linear algebraNumerical AnalysisOptimization·Captain: mikedeng1

Low Rank Approximation and Regression in Input Sparsity Time 2: Sketched Multiple-Response Regression Is (1 + 4ε)-Optimal in Squared Error If the Sketch Embeds the Subspace and Approximates ProductsResearch Paper

Motivation

Least-squares regression, min⁡X∥AX−B∥F\min_X\|AX-B\|_FminX​∥AX−B∥F​ for a tall matrix A∈Rn×dA\in\mathbb R^{n\times d}A∈Rn×d with n≫dn\gg dn≫d, is among the most frequently solved problems in numerical computation. Direct methods (QR or SVD) cost O(nd2)O(nd^2)O(nd2) time, which is prohibitive when nnn is in the millions. Sketching replaces the problem by a much smaller one: choose a matrix S∈Rt×nS\in\mathbb R^{t\times n}S∈Rt×n with t≪nt\ll nt≪n, form SASASA and SBSBSB, and solve min⁡X∥S(AX−B)∥F\min_X\|S(AX-B)\|_FminX​∥S(AX−B)∥F​ instead. The question is when the solution of the small problem is nearly optimal for the original one.

Clarkson and Woodruff, Low Rank Approximation and Regression in Input Sparsity Time (STOC 2013; JACM 2017), showed that a very sparse random sketch (one non-zero per column, the CountSketch matrix) can be applied in time proportional to the number of non-zero entries of AAA and still yields (1+ε)(1+\varepsilon)(1+ε)-approximate regression and low-rank approximation. §7 of that paper isolates the deterministic part of the argument: two conditions on a fixed sketch SSS that guarantee a near-optimal solution, whatever distribution produced SSS.

Timeline. Sarlós (FOCS 2006) introduced sketch-and-solve regression with fast Johnson–Lindenstrauss transforms. Drineas, Mahoney, Muthukrishnan and Sarlós (Numer. Math. 2011) stated the structural conditions for single-response regression (their Lemma 1); Theorem 36 of Clarkson–Woodruff generalizes it to multiple responses. Clarkson and Woodruff then supplied the sparse sketches meeting the conditions in input-sparsity time.

Setting

All matrices are real. For a vector vvv let ∥v∥22=∑ivi2\|v\|_2^2=\sum_iv_i^2∥v∥22​=∑i​vi2​; for a matrix MMM let ∥M∥F2=∑i,jMij2\|M\|_F^2=\sum_{i,j}M_{ij}^2∥M∥F2​=∑i,j​Mij2​. Fix A∈Rn×dA\in\mathbb R^{n\times d}A∈Rn×d of rank at most rrr, a right-hand side B∈Rn×d′B\in\mathbb R^{n\times d'}B∈Rn×d′ and a sketch S∈Rt×nS\in\mathbb R^{t\times n}S∈Rt×n. Let C(A)={Ax}C(A)=\{Ax\}C(A)={Ax} be the column space and U∈Rn×kU\in\mathbb R^{n\times k}U∈Rn×k a matrix with orthonormal columns (U⊤U=IU^\top U=IU⊤U=I) spanning C(A)C(A)C(A).

  • Y∗Y^*Y∗ is a least-squares minimizer: it minimizes ∥AY−B∥F2\|AY-B\|_F^2∥AY−B∥F2​ (problem (8)).
  • Y~\tilde YY~ is a sketched minimizer: it minimizes ∥S(AY−B)∥F2\|S(AY-B)\|_F^2∥S(AY−B)∥F2​ (problem (7)).
  • SSS is a subspace embedding for AAA with parameter η\etaη if ∣∥SAx∥22−∥Ax∥22∣≤η∥Ax∥22\bigl|\|SAx\|_2^2-\|Ax\|_2^2\bigr|\le\eta\|Ax\|_2^2​∥SAx∥22​−∥Ax∥22​​≤η∥Ax∥22​ for every xxx.
  • SSS satisfies the approximate matrix multiplication event (Lemma 32) for a pair (U,W)(U,W)(U,W) with error parameter eee if ∥U⊤S⊤SW−U⊤W∥F2≤e2∥U∥F2∥W∥F2\|U^\top S^\top SW-U^\top W\|_F^2\le e^2\|U\|_F^2\|W\|_F^2∥U⊤S⊤SW−U⊤W∥F2​≤e2∥U∥F2​∥W∥F2​.

Formalization targets

Goal: Theorem 36 (p. 24)

If SSS is a subspace embedding for AAA with 0≤η≤1/20\le\eta\le1/20≤η≤1/2 and satisfies the event of Lemma 32 for (U,B−AY∗)(U,B-AY^*)(U,B−AY∗) with error parameter ε/r\sqrt{\varepsilon/r}ε/r​, then every sketched minimizer satisfies

∥AY~−B∥F2≤(1+4ε)∥AY∗−B∥F2.\|A\tilde Y-B\|_F^2\le(1+4\varepsilon)\|AY^*-B\|_F^2 .∥AY~−B∥F2​≤(1+4ε)∥AY∗−B∥F2​.

This is the explicit form the paper's proof establishes; the printed (1+ϵ)(1+\epsilon)(1+ϵ) bound on norms follows after rescaling ε\varepsilonε.

Milestones

  • Fact 34 (Pythagorean theorem): C⊤D=0⇒∥C+D∥F2=∥C∥F2+∥D∥F2C^\top D=0\Rightarrow\|C+D\|_F^2=\|C\|_F^2+\|D\|_F^2C⊤D=0⇒∥C+D∥F2​=∥C∥F2​+∥D∥F2​.
  • Fact 35 (normal equations): C−DC^-DC−D is a minimizer; every minimizer X∗X^*X∗ satisfies C⊤(CX∗−D)=0C^\top(CX^*-D)=0C⊤(CX∗−D)=0 and ∥CX−D∥F2=∥C(X−X∗)∥F2+∥CX∗−D∥F2\|CX-D\|_F^2=\|C(X-X^*)\|_F^2+\|CX^*-D\|_F^2∥CX−D∥F2​=∥C(X−X∗)∥F2​+∥CX∗−D∥F2​.
  • Lemma 37: for AAA with orthonormal columns, ∥A(Y~−Y∗)∥F≤2ε∥B−AY∗∥F\|A(\tilde Y-Y^*)\|_F\le2\sqrt\varepsilon\|B-AY^*\|_F∥A(Y~−Y∗)∥F​≤2ε​∥B−AY∗∥F​.
  • Theorem 39 (affine embeddings, an independent companion result of §7.5): under an embedding with parameter ε≤1/2\varepsilon\le1/2ε≤1/2 and the event of Lemma 32 with parameter ε/r\varepsilon/\sqrt rε/r​, ∥S(AX−B)∥F2−∥SB~∥F2\|S(AX-B)\|_F^2-\|S\tilde B\|_F^2∥S(AX−B)∥F2​−∥SB~∥F2​ equals ∥AX−B∥F2−∥B~∥F2\|AX-B\|_F^2-\|\tilde B\|_F^2∥AX−B∥F2​−∥B~∥F2​ up to ±2ε∥AX−B∥F2\pm2\varepsilon\|AX-B\|_F^2±2ε∥AX−B∥F2​ for all XXX, and ∥S(AX−B)∥F2=(1±3ε)∥AX−B∥F2\|S(AX-B)\|_F^2=(1\pm3\varepsilon)\|AX-B\|_F^2∥S(AX−B)∥F2​=(1±3ε)∥AX−B∥F2​ if SSS also preserves ∥B~∥F2\|\tilde B\|_F^2∥B~∥F2​ to 1±ε1\pm\varepsilon1±ε.

Significance

Theorem 36 separates the algorithm design for sketched regression from its correctness proof: any random construction (CountSketch, subsampled randomized Hadamard transforms, leverage-score sampling, Gaussian matrices) yields a (1+O(ε))(1+O(\varepsilon))(1+O(ε))-approximate regression solver once it is shown to satisfy the two conditions with constant probability. Clarkson and Woodruff use it for their input-sparsity-time regression algorithm (Theorem 38) and, through Theorem 39 and affine embeddings, for low-rank approximation. The same conditions recur throughout the randomized numerical linear algebra literature (see Woodruff's survey Sketching as a Tool for Numerical Linear Algebra, 2014).

The results are proved in the paper (§7.3, §7.5 and Appendix A, p. 37). To our knowledge none has a machine-checked proof. Formalizing them produces a reusable, distribution-free layer of sketching theory: the probabilistic statements about specific sketches can then be proved separately and composed with it.

Difficulty

The obvious argument applies the subspace embedding to the residual AY~−BA\tilde Y-BAY~−B, but that vector does not lie in C(A)C(A)C(A), so an embedding of C(A)C(A)C(A) alone says nothing about it; embedding C(A)C(A)C(A) augmented with the columns of BBB instead costs a sketch dimension that grows with d′d'd′. The hypotheses of Theorem 36 control the optimal residual B−AY∗B-AY^*B−AY∗ only through the approximate-product condition, which is far weaker than norm preservation, and the difficulty is to transfer that control to the sketched solution (Lemma 37) with the constants 2ε2\sqrt\varepsilon2ε​ and 1+4ε1+4\varepsilon1+4ε. A second obstacle is the passage from a general AAA of rank at most rrr to an orthonormal basis UUU of C(A)C(A)C(A): it changes ∥A∥F\|A\|_F∥A∥F​, which is why the approximate-product condition is stated for UUU.

Formalization scope

Matrices are Matrix (Fin m) (Fin n) ℝ; squared norms are explicit sums sqNorm and frobSq; the column space is the range of Matrix.mulVecLin; rank is Matrix.rank. Everything is deterministic: SSS is an arbitrary fixed matrix and no probability space appears. The committed conventions are:

  1. The subspace embedding is in squared form. In Theorem 36 and Lemma 37 its parameter η\etaη plays the paper's ϵ02\epsilon_0^2ϵ02​ (so ϵ0≤1/2\epsilon_0\le1/\sqrt2ϵ0​≤1/2​ becomes η≤1/2\eta\le1/2η≤1/2), which is how the proof of Lemma 37 (p. 37) uses it; in Theorem 39 the parameter is ε\varepsilonε itself, as that proof uses it.
  2. "SSS satisfies Lemma 32" is the event inside the probability, for the pair (U,B−AY∗)(U,B-AY^*)(U,B−AY∗) (resp. (U,B~)(U,\tilde B)(U,B~)) that the proofs use, with ≤\le≤ in place of the printed <<< (a weaker hypothesis).
  3. Y~\tilde YY~, Y∗Y^*Y∗, X∗X^*X∗ are arbitrary minimizers; "the solution" need not be unique. The Moore–Penrose inverse is specified by the four Penrose equations.
  4. r≥1r\ge1r≥1 guards ε/r\varepsilon/rε/r and ε/r\varepsilon/\sqrt rε/r​; "n>dn>dn>d" (§7) concerns running times and is not assumed.

A trivializing formalization is ruled out: Y~\tilde YY~ is never defined as Y∗Y^*Y∗, the approximate-product hypothesis is an inequality and not the exact identity U⊤S⊤S(B−AY∗)=0U^\top S^\top S(B-AY^*)=0U⊤S⊤S(B−AY∗)=0, η\etaη is non-negative, and the goal is stated for general AAA of rank at most rrr, not only for orthonormal AAA. The hypotheses are jointly satisfiable (for instance S=IS=IS=I).

A complete development needs the Frobenius inner product and its Pythagorean identity, the normal equations for matrix least squares, the existence of the Moore–Penrose inverse, and the spectral-norm bound for a symmetric matrix from its quadratic form; all are reusable beyond this mission. Proofs of any milestone, and alternative arguments for Theorem 36, are welcome.

Selected references

  • K. L. Clarkson and D. P. Woodruff, Low Rank Approximation and Regression in Input Sparsity Time, arXiv:1207.6365v4, 2013; J. ACM 64(6), 2017. https://arxiv.org/abs/1207.6365
  • P. Drineas, M. W. Mahoney, S. Muthukrishnan and T. Sarlós, Faster Least Squares Approximation, Numerische Mathematik 117(2), 2011. https://arxiv.org/abs/0710.1435
  • T. Sarlós, Improved Approximation Algorithms for Large Matrices via Random Projections, FOCS 2006. https://doi.org/10.1109/FOCS.2006.37
  • D. P. Woodruff, Sketching as a Tool for Numerical Linear Algebra, Foundations and Trends in Theoretical Computer Science 10(1–2), 2014. https://arxiv.org/abs/1411.4357
7 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

A c^k n 5-Approximation Algorithm for Treewidth 2: X Is a Balanced S-Separator iff V(G)∖X Splits into Three Mutually Non-Adjacent Parts Each Holding at Most |S|/2 Vertices of SResearch Paper

Motivation

The paper of Bodlaender, Drange, Dregi, Fomin, Lokshtanov and Pilipczuk (2016) has an algorithmic headline. This mission concerns one of its finite graph lemmas, Lemma 2.9. The lemma translates a condition phrased separately for every connected component into a condition on three vertex sets. A reader of graph decompositions encounters both forms: components express what remains connected after deleting vertices, while a small fixed number of parts gives a compact way to state constraints on a partition. Lemma 2.9 identifies exactly when the two forms agree for the half-balance threshold. The same result appears again in the paper as Lemma 6.2, where the authors use it in a later section.

The result does not require a tree decomposition or a treewidth hypothesis. It holds for every finite graph. That generality makes it a useful standalone target: the definitions of deletion, connected components, and the weighted three-partition can be reused wherever graph separators are studied. The mission follows the published SIAM article, with printed page 328 for the main lemma and pages 363–364 for its restatement and the supporting combinatorial observation.

Setting

Let GGG be a finite simple graph with vertex set V(G)V(G)V(G). Let SSS and XXX be subsets of its vertices. The deleted graph G∖XG\setminus XG∖X retains precisely the vertices outside XXX and the edges joining them. Two remaining vertices are in the same connected component when a walk joins them without passing through any vertex of XXX. Write CX(u)C_X(u)CX​(u) for the vertex set of the component containing u∉Xu\notin Xu∈/X. This interpretation follows the paper's notation on page 320.

A balanced SSS-separator is a set XXX for which each component of G∖XG\setminus XG∖X contains at most half the vertices of SSS:

∣CX(u)∩S∣≤∣S∣2for every u∈V(G)∖X.|C_X(u)\cap S|\le\frac{|S|}{2}\qquad\text{for every }u\in V(G)\setminus X.∣CX​(u)∩S∣≤2∣S∣​for every u∈V(G)∖X.

The paper introduces this phrase on page 321. Here balance is a property of XXX relative to SSS; it imposes no bound on the size of XXX. The denominator counts all vertices of SSS, including any that lie in XXX.

A three-part partition of V(G)∖XV(G)\setminus XV(G)∖X is a triple (M1,M2,M3)(M_1,M_2,M_3)(M1​,M2​,M3​) of pairwise disjoint sets whose union is V(G)∖XV(G)\setminus XV(G)∖X. A part may be empty. Two parts have no edge between them if no edge of GGG joins a vertex of one to a vertex of the other. Since the graph is undirected, checking the three unordered pairs of distinct parts covers the requirement for every i≠ji\ne ji=j.

Formalization targets

Lemma 2.9: balanced separators and three parts

The goal is the equivalence stated on page 328, also restated as Lemma 6.2 on page 363:

X is a balanced S-separator⟺V(G)∖X=M1∪˙M2∪˙M3,no edge joins distinct Mi,∣Mi∩S∣≤∣S∣/2(i=1,2,3).X\text{ is a balanced }S\text{-separator} \quad\Longleftrightarrow\quad \begin{gathered} V(G)\setminus X=M_1\mathbin{\dot\cup}M_2\mathbin{\dot\cup}M_3,\\ \text{no edge joins distinct }M_i,\\ |M_i\cap S|\le |S|/2\quad(i=1,2,3). \end{gathered}X is a balanced S-separator⟺V(G)∖X=M1​∪˙M2​∪˙M3​,no edge joins distinct Mi​,∣Mi​∩S∣≤∣S∣/2(i=1,2,3).​

The equivalence is the target, including both directions. It applies even when SSS or V(G)∖XV(G)\setminus XV(G)∖X is empty. It does not include a bound on ∣X∣|X|∣X∣.

Lemma 6.3: three bounded sums

The main supporting result on page 363 says that nonnegative integers a1,…,apa_1,\ldots,a_pa1​,…,ap​ with total qqq and ai≤q/2a_i\le q/2ai​≤q/2 can be divided into three classes, each with sum at most q/2q/2q/2. The milestone list also records the paper's merge inequality and its assertion that a component cannot cross between parts having no edge between them. These are the specific claims used in the published discussion of Lemma 2.9.

Significance

Lemma 2.9 lets a componentwise balance condition be represented by three sets whose coverage, disjointness, edge separation, and cardinalities can be inspected directly. It gives an exact equivalence, so the three-part formulation loses no balanced separators and introduces none that fail the original definition. That is the mathematical content needed when a later argument represents a separator by a bounded number of regions rather than by a list of all its components. The result is already proved in the 2016 paper; the open work in this mission is a machine-checked formalization of that known result and its cited supporting claims.

Formalizing the equivalence also establishes reusable interfaces for vertex deletion and component membership in a finite simple graph. A future development can state a separator condition using IsBalancedSSep, or use the three-part conclusion without redefining what a component of G∖XG\setminus XG∖X means. The independent integer-partition lemma has uses whenever indivisible nonnegative weights, each no larger than half the total, must be grouped into three bounded classes. Nothing in that statement depends on graphs.

Difficulty

There may be arbitrarily many components of G∖XG\setminus XG∖X, although the conclusion permits only three parts. Simply assigning all components to one part can violate the half bound, while splitting a component between different parts may create forbidden edges. A component's weight is the number of its vertices in SSS, and those weights can be uneven or zero. The theorem has to accommodate all such patterns without changing the threshold ∣S∣/2|S|/2∣S∣/2. In the converse direction, the absence of edges between the three parts must control entire walks, not only their first edge; ordinary connectivity in GGG would allow a walk through XXX and would describe the wrong components.

Formalization scope

The Lean development uses SimpleGraph V with V : Type, [Fintype V], and [DecidableEq V]. Vertex sets are Finset V. The shared walk-based AvoidReach G X u v requires every vertex on a walk to lie outside XXX, including both endpoints; avoidComp G X u collects the vertices reachable in this way. It is used only for u∉Xu\notin Xu∈/X when quantifying over components. This shared definition matches the paper's G∖XG\setminus XG∖X. The graph itself need not have decidable adjacency, since the statements concern propositions rather than computations.

Half bounds are written as 2c≤∣S∣2c\le |S|2c≤∣S∣ or 2c≤q2c\le q2c≤q in natural-number arithmetic. This is equivalent to the paper's rational half bound and avoids any interpretation of natural-number division. The three parts may be empty, so X=V(G)X=V(G)X=V(G) is a genuine boundary case. The set SSS may meet XXX; the right-hand denominator remains ∣S∣|S|∣S∣. The graph may have no vertices. There is no treewidth parameter or size condition on XXX: adding one would change Lemma 2.9 and can make its reverse implication false. Nor may components be computed using connectivity in the original graph, where paths through deleted vertices could merge them.

The required infrastructure is finite graph walks, finite sets, cardinalities, sums over finite index types, and the three original claims in the milestone list. The graph-component definitions and the integer grouping theorem are reusable beyond this mission. Contributions that prove any milestone or the full equivalence under exactly these conventions are in scope.

Selected references

  • H. L. Bodlaender, P. G. Drange, M. S. Dregi, F. V. Fomin, D. Lokshtanov and M. Pilipczuk, A c^k n 5-approximation algorithm for treewidth, SIAM Journal on Computing 45(2):317–378, 2016. DOI: 10.1137/130947374.
6 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: mikedeng1

A c^k n 5-Approximation Algorithm for Treewidth 3: A Rooted Tree with a Measure μ ≥ 1, Superadditive over Children and Shrinking by C < 1 Along Each Edge, Has at Most (1+1/(1−C))μ(r)−1 NodesResearch Paper

Motivation

Treewidth measures how closely a graph resembles a tree. Bodlaender, Drange, Dregi, Fomin, Lokshtanov and Pilipczuk (SIAM J. Comput. 45(2), 2016) study an algorithm for producing tree decompositions. Its headline result is algorithmic; this mission formalizes one combinatorial lemma used in its analysis.

In §4.3.2, p. 349, the authors isolate a purely combinatorial fact, Lemma 4.3, which bounds the number of nodes of a rooted tree in terms of a measure placed on its nodes. They use it for the partial tree decomposition built by FindPartialTD, with a measure of the form μ(i)=wi/log⁡n\mu(i) = w_i/\log nμ(i)=wi​/logn. This mission formalizes Lemma 4.3 and the steps of its proof. The lemma is self-contained and does not mention graphs or treewidth.

Setting

A rooted tree TTT consists of a finite vertex set V(T)V(T)V(T), a root r∈V(T)r \in V(T)r∈V(T), and a parent map ppp defined on V(T)∖{r}V(T) \setminus \{r\}V(T)∖{r} such that every vertex reaches rrr by iterating ppp. If p(c)=vp(c) = vp(c)=v, then ccc is a child of vvv and vvv is the parent of ccc. A vertex without children is a leaf. The descendants of vvv are the vertices uuu with pi(u)=vp^i(u) = vpi(u)=v for some i≥0i \ge 0i≥0 (including vvv itself), and the subtree TvT_vTv​ rooted at vvv is the tree they span; ∣V(Tv)∣|V(T_v)|∣V(Tv​)∣ is its number of vertices, and Tr=TT_r = TTr​=T.

A measure is any function μ:V(T)→R\mu : V(T) \to \mathbb Rμ:V(T)→R. Lemma 4.3 considers measures with three properties, for a constant CCC:

  1. μ(v)≥1\mu(v) \ge 1μ(v)≥1 for every v∈V(T)v \in V(T)v∈V(T);
  2. for every vertex vvv with children v1,…,vpv_1,\dots,v_pv1​,…,vp​ (where p≥0p \ge 0p≥0), ∑i=1pμ(vi)≤μ(v)\sum_{i=1}^{p} \mu(v_i) \le \mu(v)∑i=1p​μ(vi​)≤μ(v);
  3. 0<C<10 < C < 10<C<1, and μ(v′)≤C μ(v)\mu(v') \le C\,\mu(v)μ(v′)≤Cμ(v) whenever vvv is the parent of v′v'v′.

Throughout, K=1+11−CK = 1 + \frac{1}{1-C}K=1+1−C1​.

Formalization targets

Goal: Lemma 4.3 (p. 349)

Under properties (i)–(iii),

∣V(T)∣  ≤  (1+11−C)μ(r)−1.|V(T)| \;\le\; \Bigl(1 + \frac{1}{1-C}\Bigr)\mu(r) - 1 .∣V(T)∣≤(1+1−C1​)μ(r)−1.

Milestones (the proof on pp. 349–350)

Each step is stated for an arbitrary vertex vvv of TTT, with the subtree TvT_vTv​ in the role of the paper's tree.

  • Base case (p. 349). If vvv is a leaf, then ∣V(Tv)∣=1≤Kμ(v)−1|V(T_v)| = 1 \le K\mu(v) - 1∣V(Tv​)∣=1≤Kμ(v)−1.
  • Summed bound (p. 350). If vvv has children v1,…,vpv_1,\dots,v_pv1​,…,vp​ and ∣V(Tvi)∣≤Kμ(vi)−1|V(T_{v_i})| \le K\mu(v_i) - 1∣V(Tvi​​)∣≤Kμ(vi​)−1 for each iii, then
∣V(Tv)∣≤1−p+K∑i=1pμ(vi).|V(T_v)| \le 1 - p + K\sum_{i=1}^{p}\mu(v_i).∣V(Tv​)∣≤1−p+Ki=1∑p​μ(vi​).
  • Case p≥2p \ge 2p≥2 (p. 350). With the same hypothesis on the children and at least two children, ∣V(Tv)∣≤Kμ(v)−1|V(T_v)| \le K\mu(v) - 1∣V(Tv​)∣≤Kμ(v)−1.
  • Case p=1p = 1p=1 (p. 350). With the same hypothesis and exactly one child, ∣V(Tv)∣≤Kμ(v)−1|V(T_v)| \le K\mu(v) - 1∣V(Tv​)∣≤Kμ(v)−1.
  • Subtree form (p. 350). Under (i)–(iii), ∣V(Tv)∣≤Kμ(v)−1|V(T_v)| \le K\mu(v) - 1∣V(Tv​)∣≤Kμ(v)−1 for every vertex vvv; this is the statement the induction proves, and at v=rv = rv=r it is the goal.

Significance

The result. Lemma 4.3 converts two local conditions, superadditivity of the measure over the children of each node and geometric decay by a factor CCC along each parent–child edge, into a global linear bound on the size of the tree. Superadditivity alone does not bound the size: a long path with constant measure satisfies (i) and (ii). Decay alone does not either: a star with many leaves satisfies (iii). The counting principle can also be used when a recursive construction splits a resource among child nodes while reducing that resource along every edge.

Formalizing it. The lemma is proved in the paper. The mission produces formal statements of the lemma and the main bounds in its proof, over a published, reusable encoding of finite rooted trees by parent maps. A complete development would also establish structural facts about descendants and children that can be reused for other results about finite rooted trees.

Difficulty

The summed bound for the children's subtrees contains the term 1−p1-p1−p. When p=1p=1p=1, superadditivity alone does not give the target's final −1-1−1: a path with constant measure is a counterexample if geometric decay is omitted. Formalization also has to account for the fact that the reusable tree representation is a parent map on a finite type, rather than an inductively constructed tree.

Formalization scope

The rooted tree is the published definition HarelTarjan.Compressed.RootedTree: a finite vertex type V with a root and a total parent map in which every vertex reaches the root, with the convention p(r)=rp(r) = rp(r)=r. ∣V(T)∣|V(T)|∣V(T)∣ is Fintype.card V, and ∣V(Tv)∣|V(T_v)|∣V(Tv​)∣ is the published subtree size size T v (the number of descendants of vvv, including vvv). The local definition file adds IsChild T v c (c≠rc \ne rc=r and p(c)=vp(c) = vp(c)=v) and children T v; the condition c≠rc \ne rc=r removes the pseudo-edge r→rr \to rr→r, so the root is never its own child.

Conventions: μ\muμ is real valued, as on the page; property (ii) is a sum over a possibly empty set of children; the constant CCC of property (iii) is a parameter with the two hypotheses 0<C0 < C0<C and C<1C < 1C<1, because the conclusion is stated with that same CCC. The fraction 11−C\frac{1}{1-C}1−C1​ is real division, and the hypothesis C<1C < 1C<1 keeps it away from Lean's convention 1/0=01/0 = 01/0=0. The bound keeps the page's "−1-1−1".

A trivializing formalization is ruled out explicitly: the parent–child relation is directed by the root, so property (iii) constrains each edge in one direction only. A symmetric reading ("μ(c)≤Cμ(v)\mu(c) \le C\mu(v)μ(c)≤Cμ(v) for all adjacent v,cv, cv,c") would be unsatisfiable for C<1C < 1C<1 and make every statement vacuous; the hypotheses here are satisfied, for example, by the two-vertex tree with μ=(2,1)\mu = (2, 1)μ=(2,1) and C=1/2C = 1/2C=1/2.

A complete development needs the decomposition of size T v as 1+∑c∈ch(v)size T c1 + \sum_{c \in \mathrm{ch}(v)} \mathrm{size}\,T\,c1+∑c∈ch(v)​sizeTc and an induction principle for parent-map trees. Both are reusable for statements about rooted trees given by parent maps, and contributions of them as separate lemmas are welcome. The paper's subsequent application is outside this mission's scope.

Selected references

  • H. L. Bodlaender, P. G. Drange, M. S. Dregi, F. V. Fomin, D. Lokshtanov, M. Pilipczuk, A cknc^k nckn 5-approximation algorithm for treewidth, SIAM Journal on Computing 45(2):317–378, 2016. https://doi.org/10.1137/130947374 (Lemma 4.3 and its proof: pp. 349–350.)
  • D. Harel, R. E. Tarjan, Fast algorithms for finding nearest common ancestors, SIAM Journal on Computing 13(2):338–355, 1984. https://doi.org/10.1137/0213024 (source of the rooted-tree encoding reused here.)
  • N. Robertson, P. D. Seymour, Graph minors. II. Algorithmic aspects of tree-width, Journal of Algorithms 7(3):309–322, 1986. https://doi.org/10.1016/0196-6774(86)90023-4
8 thms2 active usersReviewed
🏆Completed
AlgebraComplexity TheoryLinear algebra·Captain: mikedeng1

Most Tensor Problems Are NP-Hard 4: A Rational 2×2×2 Tensor Has Smaller Rank over the Reals Than over the RationalsResearch Paper

Motivation

The rank of a matrix does not depend on the field in which its entries are read: a rational matrix has the same rank over Q\mathbb QQ, R\mathbb RR and C\mathbb CC, because rank is computed by Gaussian elimination, which never leaves the field of the entries. For 3-tensors, arrays A=[ ⁣[aijk] ⁣]\mathcal A = [\![a_{ijk}]\!]A=[[aijk​]] with three indices, this fails. Tensor rank governs the complexity of bilinear maps (the exponent of matrix multiplication is a statement about the rank of one tensor), the uniqueness of the CANDECOMP/PARAFAC decompositions used in psychometrics and signal processing, and the identifiability of latent-variable models. In each application the field matters: algorithms are run over R\mathbb RR or C\mathbb CC, while complexity results are often proved over Q\mathbb QQ or finite fields.

Håstad (1990) proved that deciding rank⁡(A)≤r\operatorname{rank}(\mathcal A) \le rrank(A)≤r is NP-complete over finite fields and NP-hard over Q\mathbb QQ. De Silva and Lim (2008) gave real tensors whose rank over C\mathbb CC is strictly smaller than their rank over R\mathbb RR. Hillar and Lim (2013, Theorem 1.14) showed that the same phenomenon already occurs between Q\mathbb QQ and R\mathbb RR, for a 2×2×22\times2\times22×2×2 tensor with integer entries, so that Håstad's result over Q\mathbb QQ does not by itself say anything about rank over R\mathbb RR.

Setting

Let EEE be a field. The outer product of x∈El\mathbf x \in E^lx∈El, y∈Em\mathbf y \in E^my∈Em, z∈En\mathbf z \in E^nz∈En is the tensor x⊗y⊗z∈El×m×n\mathbf x\otimes\mathbf y\otimes\mathbf z \in E^{l\times m\times n}x⊗y⊗z∈El×m×n with entries xiyjzkx_iy_jz_kxi​yj​zk​. The rank of A\mathcal AA over EEE is

rank⁡E(A)=min⁡{r:A=∑s=1rλs xs⊗ys⊗zs,  λs∈E, xs∈El, ys∈Em, zs∈En}.\operatorname{rank}_E(\mathcal A) = \min\Big\{ r : \mathcal A = \sum_{s=1}^{r} \lambda_s\,\mathbf x_s\otimes\mathbf y_s\otimes\mathbf z_s,\ \ \lambda_s\in E,\ \mathbf x_s\in E^l,\ \mathbf y_s\in E^m,\ \mathbf z_s\in E^n\Big\}.rankE​(A)=min{r:A=s=1∑r​λs​xs​⊗ys​⊗zs​,  λs​∈E, xs​∈El, ys​∈Em, zs​∈En}.

If A\mathcal AA has entries in a subfield F⊆EF \subseteq EF⊆E, both rank⁡F(A)\operatorname{rank}_F(\mathcal A)rankF​(A) and rank⁡E(A)\operatorname{rank}_E(\mathcal A)rankE​(A) are defined, and rank⁡E(A)≤rank⁡F(A)\operatorname{rank}_E(\mathcal A) \le \operatorname{rank}_F(\mathcal A)rankE​(A)≤rankF​(A).

The paper's example uses x=[1,0]⊤\mathbf x = [1,0]^\topx=[1,0]⊤, y=[0,1]⊤\mathbf y = [0,1]^\topy=[0,1]⊤ and

A=2 x⊗x⊗x−4 y⊗y⊗x+4 y⊗x⊗y−4 x⊗y⊗y∈Q2×2×2.\mathcal A = 2\,\mathbf x\otimes\mathbf x\otimes\mathbf x - 4\,\mathbf y\otimes\mathbf y\otimes\mathbf x + 4\,\mathbf y\otimes\mathbf x\otimes\mathbf y - 4\,\mathbf x\otimes\mathbf y\otimes\mathbf y \in \mathbb Q^{2\times2\times2}.A=2x⊗x⊗x−4y⊗y⊗x+4y⊗x⊗y−4x⊗y⊗y∈Q2×2×2.

A decomposition A=u1⊗u2⊗u3+v1⊗v2⊗v3\mathcal A = \mathbf u_1\otimes\mathbf u_2\otimes\mathbf u_3 + \mathbf v_1\otimes\mathbf v_2\otimes\mathbf v_3A=u1​⊗u2​⊗u3​+v1​⊗v2​⊗v3​ with ui=[ai,bi]⊤\mathbf u_i = [a_i,b_i]^\topui​=[ai​,bi​]⊤, vi=[ci,di]⊤\mathbf v_i = [c_i,d_i]^\topvi​=[ci​,di​]⊤ is equivalent to the eight cubic equations (30) in the twelve unknowns a1,…,d3a_1,\dots,d_3a1​,…,d3​, one for each entry of A\mathcal AA.

In Lean, outer x y z and rankOver E A implement the two definitions, tensorA is A\mathcal AA, and System30 is (30).

Formalization targets

Goal: Theorem 1.14

∃ A∈Q2×2×2:rank⁡R(A)<rank⁡Q(A).\exists\, \mathcal A \in \mathbb Q^{2\times2\times2}:\quad \operatorname{rank}_{\mathbb R}(\mathcal A) < \operatorname{rank}_{\mathbb Q}(\mathcal A).∃A∈Q2×2×2:rankR​(A)<rankQ​(A).

Milestones (proof of Theorem 1.14, p. 0:26)

  1. With z=x+2 y\mathbf z = \mathbf x + \sqrt2\,\mathbf yz=x+2​y and zˉ=x−2 y\bar{\mathbf z} = \mathbf x - \sqrt2\,\mathbf yzˉ=x−2​y:
zˉ⊗z⊗zˉ+z⊗zˉ⊗z=A,so rank⁡R(A)≤2.\bar{\mathbf z}\otimes\mathbf z\otimes\bar{\mathbf z} + \mathbf z\otimes\bar{\mathbf z}\otimes\mathbf z = \mathcal A,\qquad\text{so } \operatorname{rank}_{\mathbb R}(\mathcal A)\le 2.zˉ⊗z⊗zˉ+z⊗zˉ⊗z=A,so rankR​(A)≤2.
  1. A tensor of rank at most 2 over a field is a sum of two outer products, and for A\mathcal AA the identity (29) A=u1⊗u2⊗u3+v1⊗v2⊗v3\mathcal A = \mathbf u_1\otimes\mathbf u_2\otimes\mathbf u_3 + \mathbf v_1\otimes\mathbf v_2\otimes\mathbf v_3A=u1​⊗u2​⊗u3​+v1​⊗v2​⊗v3​ holds exactly when the coordinates of ui,vi\mathbf u_i, \mathbf v_iui​,vi​ satisfy (30).
  2. Every solution of (30) in a field of characteristic zero satisfies 2c22−d22=02c_2^2 - d_2^2 = 02c22​−d22​=0 and c1d2d3+2=0c_1d_2d_3 + 2 = 0c1​d2​d3​+2=0.
  3. Lemma 8.1: (30) has no rational solution.
  4. rank⁡Q(A)>2\operatorname{rank}_{\mathbb Q}(\mathcal A) > 2rankQ​(A)>2.

Significance

The theorem shows that tensor rank, unlike matrix rank, is not invariant under field extension even between Q\mathbb QQ and R\mathbb RR, and even for the smallest nontrivial format 2×2×22\times2\times22×2×2. Its consequence for complexity is that a hardness result for rank over Q\mathbb QQ cannot be transferred to R\mathbb RR by reading the same instance in a larger field; the paper accordingly re-examines Håstad's construction to obtain hardness over R\mathbb RR and C\mathbb CC (Theorem 8.2), which is outside this mission.

The result is proved in the paper, with the decisive algebraic step delegated to a computer-algebra computation (Appendix). A machine-checked proof replaces that computation by a certificate verified in Lean, and it settles a printed error: one of the two consequences of (30) in the proof of Lemma 8.1 is printed with the wrong sign (see Formalization scope). No formalization of array tensor rank over a field, or of its field dependence, is known to exist in Mathlib or on this platform.

Difficulty

The upper bound is an identity among explicit 2×2×22\times2\times22×2×2 arrays. The lower bound is the substance: one must show that the cubic system (30), which has real solutions, has no rational one. Since (30) is solvable over R\mathbb RR, no argument by signs, inequalities or real geometry can work; the obstruction is arithmetic, coming from the irrationality of 2\sqrt22​. The step that fails in a naive attempt is the elimination: eliminating ten of the twelve unknowns from eight cubic equations by hand is impractical. A second, smaller difficulty is the reduction from "rank⁡Q(A)≤2\operatorname{rank}_{\mathbb Q}(\mathcal A) \le 2rankQ​(A)≤2" to two terms of the special form (29), which requires absorbing the scalars and padding a decomposition with fewer than two terms.

Formalization scope

  • Tensors are functions Fin l → Fin m → Fin n → E, with 0-based indices: the paper's aijka_{ijk}aijk​ is A (i-1) (j-1) (k-1). Vectors are Fin n → E.
  • rankOver E A is the sInf over N\mathbb NN of the lengths rrr of decompositions ∑sλs xs⊗ys⊗zs\sum_s \lambda_s\, \mathbf x_s\otimes\mathbf y_s\otimes\mathbf z_s∑s​λs​xs​⊗ys​⊗zs​. The set is nonempty (one term per entry), so this is the paper's minimum. Zero summands are allowed; this gives the same minimum as the paper's sum of nonzero rank-1 tensors.
  • rank⁡R\operatorname{rank}_{\mathbb R}rankR​ of a rational tensor is rankOver ℝ of its entrywise cast to R\mathbb RR; rank⁡Q\operatorname{rank}_{\mathbb Q}rankQ​ is rankOver ℚ, whose witnesses are rational. A formalization in which both ranks range over real witnesses would make the theorem false.
  • The goal is the printed existential. It is not a loophole: the milestones concern the paper's explicit tensor.
  • Readings of loose phrases: "Suppose not and that there exist ui,vi\mathbf u_i, \mathbf v_iui​,vi​ with (29). Identity (29) gives eight equations found in (30)" is split into a general statement (rank at most 2 over any field means a sum of two outer products) and the equivalence of (29) with (30) over every field of characteristic zero (milestone 2); both are stated in a generality in which their hypotheses can hold, because for A\mathcal AA over Q\mathbb QQ they cannot. "Polynomial consequences of (30)" is read as "holds at every solution of (30) in every field of characteristic zero" (milestone 3); over Q\mathbb QQ alone the statement would be vacuous, since (30) has no rational solution.
  • Corrected error. The paper prints the second consequence as c1d2d3−2=0c_1d_2d_3 - 2 = 0c1​d2​d3​−2=0. It is false: the real solution from milestone 1 has c1d2d3=−2c_1d_2d_3 = -2c1​d2​d3​=−2. The milestone states c1d2d3+2=0c_1d_2d_3 + 2 = 0c1​d2​d3​+2=0 (checked by a Gröbner basis computation over Q\mathbb QQ), which serves the paper's argument equally. The Appendix certificates GkG_kGk​, HkH_kHk​ (p. 0:34) are not used in any statement.
  • Out of scope: Theorem 1.15/8.2 (Håstad's construction over R\mathbb RR and C\mathbb CC) and the conjectures of §13.

Needed infrastructure: finite sums of arrays, Real.sqrt and irrational_sqrt_two, and an ideal-membership certificate for milestone 3. The array rank rankOver is reusable for any statement about tensor rank over a field. The platform's mme_tensor_rank (restriction-based rank of a TensorObj over a single field, from the matrix-multiplication exponent series) is a different object and is not reused. Proofs of any milestone, and alternative certificates for Lemma 8.1, are welcome.

Selected references

  • C. J. Hillar and L.-H. Lim, Most tensor problems are NP-hard, J. ACM 60(6), Art. 45, 2013. https://doi.org/10.1145/2512329 (arXiv: https://arxiv.org/abs/0911.1393)
  • J. Håstad, Tensor rank is NP-complete, J. Algorithms 11(4), 644–654, 1990. https://doi.org/10.1016/0196-6774(90)90014-6
  • V. de Silva and L.-H. Lim, Tensor rank and the ill-posedness of the best low-rank approximation problem, SIAM J. Matrix Anal. Appl. 30(3), 1084–1127, 2008. https://doi.org/10.1137/06066518X
  • F. L. Hitchcock, The expression of a tensor or a polyadic as a sum of products, J. Math. Phys. 6, 164–189, 1927. https://doi.org/10.1002/sapm192761164
8 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: xuanji

Deterministic APSP in O(n^2.995561) time on a Word RAMResearch Paper

Motivation

All-pairs shortest paths (APSP) asks for the exact distance between every ordered pair of vertices in an nnn-vertex weighted directed graph. Floyd–Warshall solves it in O(n3)O(n^3)O(n3) time, and for decades no algorithm beat n3−δn^{3-\delta}n3−δ for any constant δ>0\delta>0δ>0 on graphs with polynomially bounded integer weights. In 2026, Alman and Vassilevska Williams (arXiv:2610.06783) gave a deterministic O(n2.99942)O(n^{2.99942})O(n2.99942) algorithm, the campaign's first entry. Later entries tightened the accounting to 2.99832.99832.9983, 2.997912.997912.99791 and 2.9960012.9960012.996001.

This entry records the deterministic exponent 2.9955612.9955612.995561, a saving of about 0.004440.004440.00444 below 333, roughly 11% more than the 2.9960012.9960012.996001 entry.

Setting

The model is the campaign's fixed deterministic word RAM (foundation mission: Truly Subcubic APSP on a Word RAM). A finite program uses add, subtract and multiply modulo 2W2^W2W, indirect load and store, a sign branch, and accept or reject, on words of width W≥b(log⁡2n+1)W \ge b(\log_2 n + 1)W≥b(log2​n+1). Inputs have integer weights of absolute value at most nκn^\kappanκ for a fixed κ\kappaκ, and there are no negative cycles. The machine has no source of randomness; the algorithm behind this entry is deterministic.

Formalization target

The goal is the campaign template with the value 2.9955612.9955612.995561:

TrulySubcubicAPSP.APSP.SolvedInTime 2.995561,\texttt{TrulySubcubicAPSP.APSP.SolvedInTime}\ 2.995561,TrulySubcubicAPSP.APSP.SolvedInTime 2.995561,

which says there is a deterministic word-RAM program that solves APSP in O(n2.995561)O(n^{2.995561})O(n2.995561) steps.

How the bound arises

The algebraic core is the tensor construction of Alman and Vassilevska Williams, which evaluates KKK independent N0×DN_0\times DN0​×D by D×N0D\times N_0D×N0​ integer products in one run and answers requested output entries. Two local refinements sharpen its exponents: pruned encodings (branches with more than mmm copies of the symbol P0P_0P0​ are never materialized) and an exact binomial tail for the box preprocessing, giving

Γ(c,θ)=cH(1/c)−cH((1−θ)/c)−θln⁡9ln⁡4,q(θ)=H(θ)+θln⁡9ln⁡4.\Gamma(c,\theta) = \frac{cH(1/c) - cH((1-\theta)/c) - \theta\ln 9}{\ln 4},\qquad q(\theta) = \frac{H(\theta)+\theta\ln 9}{\ln 4}.Γ(c,θ)=ln4cH(1/c)−cH((1−θ)/c)−θln9​,q(θ)=ln4H(θ)+θln9​.

On top of the deterministic filtering reduction of the 2.9960012.9960012.996001 entry (moduli chosen one small prime factor at a time, with exact modular witness counts certifying positive answers and eliminating blocks of unresolved queries), this entry adds two changes to the counting oracle:

  1. Two-digit target residue. For modulus ppp, the target residue −zab mod p-z_{ab} \bmod p−zab​modp is written as hk+lh k + lhk+l with k=⌈p⌉k=\lceil\sqrt p\rceilk=⌈p​⌉, and the two digits are absorbed into the outer row and column indices. One product of outer dimension n⌈p⌉n\lceil\sqrt p\rceiln⌈p​⌉ and inner dimension spspsp per middle block replaces one product per residue.
  2. Batching middle blocks into the tensor slots. The T=⌈n/s⌉T=\lceil n/s\rceilT=⌈n/s⌉ products, one per middle-vertex block, are assigned to the KKK independent product slots of the tensor construction, so input encodings are shared across different blocks.

With middle blocks of size s=nε/2s=n^{\varepsilon/2}s=nε/2 the encoding cost becomes TNDbT N D^{b}TNDb with b(c)=(c−1)ln⁡3/ln⁡4b(c)=(c-1)\ln 3/\ln 4b(c)=(c−1)ln3/ln4, and all-edges Exact Triangle runs in n3−δ+o(1)n^{3-\delta+o(1)}n3−δ+o(1) with

δ=min⁡{εΓ, 1−ε(b−14), ε(12−q)},\delta = \min\{\varepsilon\Gamma,\ 1-\varepsilon(b-\tfrac14),\ \varepsilon(\tfrac12-q)\},δ=min{εΓ, 1−ε(b−41​), ε(21​−q)},

subject to the batch conditions ε(κ+12)<1\varepsilon(\kappa+\tfrac12)<1ε(κ+21​)<1 and ε(b−14)<1\varepsilon(b-\tfrac14)<1ε(b−41​)<1, where κ(c)=cH(1/c)/ln⁡4\kappa(c)=cH(1/c)/\ln 4κ(c)=cH(1/c)/ln4. Deterministic bit scaling transfers the bound to min-plus product and APSP with polylogarithmic overhead.

The exact rational parameters c=20c = 20c=20, θ=0.113138\theta = 0.113138θ=0.113138 and ε=0.067235\varepsilon = 0.067235ε=0.067235 give δ>0.00443921\delta > 0.00443921δ>0.00443921 (rational interval certificate for log⁡2,log⁡3,…\log 2,\log 3,\dotslog2,log3,… with error below 10−6210^{-62}10−62). Hence APSP runs in n2.99556079+o(1)n^{2.99556079+o(1)}n2.99556079+o(1), and the gap 2.995561−2.99556079>02.995561 - 2.99556079 > 02.995561−2.99556079>0 absorbs the subpolynomial factor.

Significance

This is the strongest deterministic entry so far. Compared with 2.9960012.9960012.996001, the saving below cubic time grows from about 0.00399930.00399930.0039993 to about 0.00443930.00443930.0044393, coming entirely from cheaper input encodings in the counting oracle.

Selected references

  • J. Alman and V. Vassilevska Williams, Truly Subquadratic 3SUM and Truly Subcubic APSP via Triangles in Sparse Lopsided Graphs (2026). https://arxiv.org/abs/2610.06783
  • Deterministic APSP in O(n2.995561)O(n^{2.995561})O(n2.995561): an explicit refinement of the thin-product method, technical note, revised 7 October 2026. This is the source of 2.9955612.9955612.995561 and has not been peer reviewed.
5 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs? 2: Random-Hyperplane Rounding Approximates Balanced MAX-2SAT within β ≈ 0.943Research Paper

Motivation

MAX-2SAT asks for an assignment of Boolean variables that maximizes the total weight of satisfied clauses, each clause being a disjunction of two literals. It is one of the basic constraint satisfaction problems of approximation theory, and its approximability has been studied alongside MAX-CUT since semidefinite programming entered the field.

Khot, Kindler, Mossel and O'Donnell (SIAM J. Comput. 37(1), 2007) show that, assuming the Unique Games Conjecture, it is NP-hard to approximate MAX-2SAT within any factor greater than

β=min⁡π/2≤θ≤π2+(2/π)θ3−cos⁡θ≈0.943\beta = \min_{\pi/2 \le \theta \le \pi} \frac{2 + (2/\pi)\theta}{3 - \cos\theta} \approx 0.943β=π/2≤θ≤πmin​3−cosθ2+(2/π)θ​≈0.943

(their Theorem 3), and that their reduction produces balanced instances, in which every variable carries as much weight positively as negatively. Their Theorem 4 shows that for this balanced restriction the bound is tight: a Goemans–Williamson style semidefinite relaxation followed by random-hyperplane rounding approximates Balanced-MAX-2SAT within any factor smaller than β\betaβ. This mission formalizes Theorem 4.

Timeline.

  • 1995: Goemans and Williamson give the 0.878 algorithm for MAX-CUT and a 0.878 algorithm for MAX-2SAT by semidefinite programming and random-hyperplane rounding (J. ACM 42(6)).
  • 2007: Khot, Kindler, Mossel and O'Donnell prove UGC-hardness at β\betaβ for MAX-2SAT, and show β\betaβ is achievable for balanced instances (Theorem 4).
  • 2007: Austrin shows that, under the Unique Games Conjecture, general MAX-2SAT is hard to approximate beyond about 0.9401, strictly below β\betaβ, so balanced instances are not the hardest ones (STOC 2007); for the balanced version β\betaβ remains the threshold.

Setting

Treat the bit TRUE as −1-1−1 and FALSE as 111 (the paper's §7.2 convention). An assignment of the variables x0,…,xn−1x_0,\dots,x_{n-1}x0​,…,xn−1​ is a point x∈{−1,1}nx \in \{-1,1\}^nx∈{−1,1}n. A literal is y=rixiy = r_i x_iy=ri​xi​ with a sign ri∈{−1,1}r_i \in \{-1,1\}ri​∈{−1,1} (ri=−1r_i = -1ri​=−1 for the negated variable ¬xi\neg x_i¬xi​); it is true when y=−1y = -1y=−1. A weighted MAX-2SAT instance is a finite list of clauses C=(y∨z)C = (y \vee z)C=(y∨z) with y=rixiy = r_ix_iy=ri​xi​, z=rjxjz = r_jx_jz=rj​xj​ (the two variables may coincide), with nonnegative weights wCw_CwC​. The satisfied weight of xxx is

sat(x)=∑CwC [ y=−1 or z=−1 ],OPT=max⁡x∈{−1,1}nsat(x).\mathrm{sat}(x) = \sum_C w_C\,[\,y = -1 \text{ or } z = -1\,], \qquad \mathrm{OPT} = \max_{x\in\{-1,1\}^n} \mathrm{sat}(x).sat(x)=C∑​wC​[y=−1 or z=−1],OPT=x∈{−1,1}nmax​sat(x).

An instance is balanced (Definition 12) if for each variable iii, the expected satisfied weight when xi=1x_i = 1xi​=1 and the other variables are uniform equals the expected satisfied weight when xi=−1x_i = -1xi​=−1 and the others are uniform.

The semidefinite relaxation replaces each xix_ixi​ by a unit vector vi∈Rdv_i \in \mathbb R^dvi​∈Rd and the balanced objective by

SDPobj(v)=∑C=(rixi∨rjxj)wC(34−14 (rivi)⋅(rjvj)),\mathrm{SDPobj}(v) = \sum_{C = (r_ix_i\vee r_jx_j)} w_C\Bigl(\tfrac34 - \tfrac14\,(r_iv_i)\cdot(r_jv_j)\Bigr),SDPobj(v)=C=(ri​xi​∨rj​xj​)∑​wC​(43​−41​(ri​vi​)⋅(rj​vj​)),

with optimal value SDP=sup⁡SDPobj(v)\mathrm{SDP} = \sup \mathrm{SDPobj}(v)SDP=supSDPobj(v) over unit-vector families in every dimension. Hyperplane rounding draws a standard Gaussian vector g∈Rdg \in \mathbb R^dg∈Rd and sets xi=sgn⁡(g⋅vi)x_i = \operatorname{sgn}(g\cdot v_i)xi​=sgn(g⋅vi​).

Formalization targets

Goal: Theorem 4 (p. 12), as the guarantee of the algorithm

For every balanced instance with nonnegative weights, every ε≥0\varepsilon \ge 0ε≥0, every unit-vector family vvv with SDPobj(v)≥SDP−ε\mathrm{SDPobj}(v) \ge \mathrm{SDP} - \varepsilonSDPobj(v)≥SDP−ε, and every standard Gaussian vector ggg,

E[sat(sgn⁡(g⋅vi))i]  ≥  β (OPT−ε),\mathbb E\bigl[\mathrm{sat}(\operatorname{sgn}(g\cdot v_i))_i\bigr] \;\ge\; \beta\,(\mathrm{OPT} - \varepsilon),E[sat(sgn(g⋅vi​))i​]≥β(OPT−ε),

with the satisfied weight integrable. The constant is Theorem 3's exact minimum β\betaβ, not its decimal rounding.

Milestones (proof of Theorem 4, pp. 21–22)

  1. Arithmetization: [ y∨z ]=34−14y−14z−14yz[\,y\vee z\,] = \tfrac34 - \tfrac14 y - \tfrac14 z - \tfrac14 yz[y∨z]=43​−41​y−41​z−41​yz on {−1,1}2\{-1,1\}^2{−1,1}2.
  2. Balanced   ⟺  \iff⟺ the linear terms cancel: sat(x)=∑CwC(34−14yz)\mathrm{sat}(x) = \sum_C w_C(\tfrac34 - \tfrac14 yz)sat(x)=∑C​wC​(43​−41​yz) for all xxx.
  3. Relaxation: OPT≤SDP\mathrm{OPT} \le \mathrm{SDP}OPT≤SDP for balanced instances.
  4. Hyperplane identity E[xixj]=1−2πarccos⁡(vi⋅vj)\mathbb E[x_ix_j] = 1 - \tfrac2\pi\arccos(v_i\cdot v_j)E[xi​xj​]=1−π2​arccos(vi​⋅vj​), already proved on the platform as Grothendieck's identity (in the equivalent form 2πarcsin⁡\tfrac2\pi\arcsinπ2​arcsin).
  5. Per-clause bound: 34−14(1−2πarccos⁡t)≥β(34−14t)\tfrac34 - \tfrac14(1 - \tfrac2\pi\arccos t) \ge \beta(\tfrac34 - \tfrac14 t)43​−41​(1−π2​arccost)≥β(43​−41​t) for all t∈[−1,1]t\in[-1,1]t∈[−1,1].

Significance

The result. Together with Theorem 3, Theorem 4 pins the approximability of Balanced-MAX-2SAT at exactly β\betaβ under the Unique Games Conjecture: the constant arising from the Majority Is Stablest analysis of the hardness reduction coincides with the constant of a semidefinite rounding algorithm. It also explains why the hardness reduction for MAX-2SAT cannot give more than β\betaβ without abandoning balanced instances.

Formalizing it. The theorem is proved in the paper; no machine-checked proof is known to exist. A formal proof produces a verified approximation guarantee for a randomized rounding scheme that holds for every near-optimal vector solution, and a reusable layer for weighted 2-CSPs on {−1,1}n\{-1,1\}^n{−1,1}n: arithmetization, balancedness, the vector relaxation and its rounding. The hyperplane identity is already available on the platform, so the remaining work is combinatorial and analytic rather than probabilistic.

Difficulty

The naive approach, rounding the full arithmetized objective 34−14y−14z−14yz\tfrac34 - \tfrac14 y - \tfrac14 z - \tfrac14 yz43​−41​y−41​z−41​yz, fails: the relaxation of a linear term rixir_ix_iri​xi​ has no vector counterpart that random-hyperplane rounding treats correctly, and for unbalanced instances the achievable ratio is different. The whole argument rests on balancedness making the linear terms vanish identically, and the equivalence between Definition 12 (a statement about conditional expectations) and the cancellation of linear coefficients must be established with care, including clauses whose two literals involve the same variable.

The second difficulty is the constant. β\betaβ is defined as a minimum over θ∈[π/2,π]\theta\in[\pi/2,\pi]θ∈[π/2,π] only, while the per-clause comparison is needed for all inner products t∈[−1,1]t\in[-1,1]t∈[−1,1], that is for all θ∈[0,π]\theta\in[0,\pi]θ∈[0,π]. Showing that the ratio 2+(2/π)θ3−cos⁡θ\frac{2 + (2/\pi)\theta}{3-\cos\theta}3−cosθ2+(2/π)θ​ does not drop below β\betaβ on [0,π/2][0,\pi/2][0,π/2] is a genuine one-variable inequality, not a definitional unfolding. Finally, the expectation must be computed for a genuine Gaussian vector, with the sign convention at 000 handled almost surely.

Formalization scope

  • Assignments are Fin n → Bool read through pm true = -1, pm false = 1; a literal is (i, r) : Fin n × Bool with r = true for ¬xi\neg x_i¬xi​. The two literals of a clause may involve the same variable.
  • An instance is a structure with m clauses, a clause map, and real weights with a nonnegativity field (Definition 10's "nonnegative weight function").
  • Balancedness is Definition 12, stated as equality of the sums of satisfied weight over the two halves {xi=1}\{x_i = 1\}{xi​=1} and {xi=−1}\{x_i = -1\}{xi​=−1} of the cube; the common factor 2−(n−1)2^{-(n-1)}2−(n−1) is dropped.
  • OPT is a maximum over the 2n2^n2n assignments. SDP is a real supremum over unit-vector families Fin n → Fin d → ℝ in every dimension ddd; the set is nonempty and bounded above by the total weight.
  • beta is the infimum of the image of [π/2,π][\pi/2,\pi][π/2,π], i.e. Theorem 3's attained minimum. Defining it over [0,π][0,\pi][0,π] instead would make milestone 5 definitional and is ruled out.
  • The Gaussian vector is the platform predicate IsStandardGaussianVector (measurable, independent coordinates of law N(0,1)N(0,1)N(0,1) on an arbitrary probability space); the expectation is a Bochner integral and its integrability is part of the conclusion. The rounding outputs FALSE on the null event g⋅vi=0g\cdot v_i = 0g⋅vi​=0.
  • Not formalized: polynomial running time. The paper obtains an (SDP−ε)(\mathrm{SDP}-\varepsilon)(SDP−ε)-optimal solution in polynomial time by citing Goemans–Williamson; the goal quantifies over every such solution. "Within any factor smaller than β\betaβ" follows by taking ε\varepsilonε small, because OPT≥12∑CwC\mathrm{OPT} \ge \tfrac12\sum_C w_COPT≥21​∑C​wC​.
  • The goal cannot be met trivially: the vector family is universally quantified (not chosen inside the statement), the expectation is over a genuine Gaussian, and the instance ranges over all balanced weighted instances (a nontrivial balanced instance such as (x1∨x2)∧(¬x1∨¬x2)(x_1\vee x_2)\wedge(\neg x_1\vee\neg x_2)(x1​∨x2​)∧(¬x1​∨¬x2​) exists).

Welcome contributions: proofs of the milestones, a bridge from Real.sign (used by the platform's Grothendieck identity) to the {−1,1}\{-1,1\}{−1,1}-valued rounding, and the one-variable analysis behind the per-clause bound.

Selected references

  • S. Khot, G. Kindler, E. Mossel, R. O'Donnell, Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs?, SIAM J. Comput. 37(1), 2007. https://doi.org/10.1137/S0097539705447372
  • M. X. Goemans, D. P. Williamson, Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming, J. ACM 42(6), 1995. https://doi.org/10.1145/227683.227684
  • P. Austrin, Balanced Max 2-Sat might not be the hardest, STOC 2007. https://doi.org/10.1145/1250790.1250818
  • R. Vershynin, High-Dimensional Probability, Cambridge University Press, 2018, Lemma 3.6.6 (Grothendieck's identity). https://doi.org/10.1017/9781108231596
9 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Matroid Prophet Inequalities 3: Stopping at the First Value Above E[max X_i]/2 Earns at Least Half the Prophet's Expected MaximumResearch Paper

Motivation

A prophet inequality compares two players facing the same random sequence of rewards X1,X2,…,XnX_1, X_2, \dots, X_nX1​,X2​,…,Xn​. The gambler sees the values one at a time and must decide, as each value arrives, whether to stop and collect it; a value passed over is lost. The prophet knows the whole sequence in advance and simply takes its maximum. In 1978 Krengel, Sucheston and Garling showed that when the XiX_iXi​ are independent, non-negative and E[max⁡iXi]<∞\mathbb E[\max_i X_i] < \inftyE[maxi​Xi​]<∞, the gambler has a stopping rule τ\tauτ with

2 E[Xτ]  ≥  E[max⁡iXi],2\,\mathbb E[X_\tau] \;\ge\; \mathbb E\big[\max_i X_i\big],2E[Xτ​]≥E[imax​Xi​],

and that the factor 222 cannot be improved. This inequality, labelled (1) in Kleinberg and Weinberg's Matroid Prophet Inequalities (arXiv:1201.4764, STOC 2012), is the starting point of optimal stopping theory's prophet inequalities and, more recently, of a large literature in online algorithms and algorithmic mechanism design, where it is the reason that a single posted price can extract a constant fraction of the optimal welfare or revenue.

Timeline.

  • 1977: Krengel and Sucheston prove the inequality with factor 4 in place of 2 (Bull. Amer. Math. Soc. 83).
  • 1978: Krengel and Sucheston publish the result attributed to Krengel, Sucheston and Garling, the factor-2 inequality (1) for independent non-negative rewards with E[max⁡iXi]<∞\mathbb E[\max_i X_i] < \inftyE[maxi​Xi​]<∞; the factor 222 cannot be improved.
  • 1984: Samuel-Cahn shows that a single threshold suffices: stopping at the first value above a threshold TTT with Pr⁡[max⁡iXi>T]=12\Pr[\max_i X_i > T] = \tfrac12Pr[maxi​Xi​>T]=21​ (a median of max⁡iXi\max_i X_imaxi​Xi​) already achieves the factor 222 (doi:10.1214/aop/1176993223).
  • 2012: Kleinberg and Weinberg, introducing the matroid prophet inequality, give in §3.1 a second single-threshold rule, with threshold T=E[max⁡iXi]/2T = \mathbb E[\max_i X_i]/2T=E[maxi​Xi​]/2, and a half-page proof that it earns at least TTT. This rule and its analysis are the rank-one case of their matroid algorithm.

This mission formalizes that §3.1 result.

Setting

Let (Ω,F,P)(\Omega, \mathcal F, \mathbb P)(Ω,F,P) be a probability space and n≥1n \ge 1n≥1. Let X1,…,XnX_1, \dots, X_nX1​,…,Xn​ be real random variables on Ω\OmegaΩ that are independent (as a family), non-negative, and such that the prophet's value max⁡iXi\max_i X_imaxi​Xi​ has finite expectation. Define

T=12 E[max⁡iXi],p=Pr⁡[max⁡iXi≥T].T = \tfrac12\,\mathbb E\big[\max_i X_i\big], \qquad p = \Pr\big[\max_i X_i \ge T\big].T=21​E[imax​Xi​],p=Pr[imax​Xi​≥T].

The single-threshold rule observes X1,X2,…X_1, X_2, \dotsX1​,X2​,… in order and stops at the first time τ\tauτ with Xτ≥TX_\tau \ge TXτ​≥T, collecting XτX_\tauXτ​. If no XiX_iXi​ reaches TTT, the rule accepts nothing and collects 000. Write XτX_\tauXτ​ for the amount collected; it equals Xτ(ω)(ω)X_{\tau(\omega)}(\omega)Xτ(ω)​(ω) on the event {max⁡iXi≥T}\{\max_i X_i \ge T\}{maxi​Xi​≥T}, which has probability ppp, and 000 off it.

In Lean the variables are X : Fin n → Ω → ℝ with [NeZero n]; max⁡iXi\max_i X_imaxi​Xi​ is maxX X, TTT is thr P X, ppp is stopProb P X, and XτX_\tauXτ​ is reward P X, all in the namespace MatroidProphetKW.RankOne.

Formalization targets

Goal: the half-mean threshold rule

E[Xτ]  ≥  T  =  12 E[max⁡iXi].\mathbb E[X_\tau] \;\ge\; T \;=\; \tfrac12\,\mathbb E\big[\max_i X_i\big].E[Xτ​]≥T=21​E[imax​Xi​].

This is inequality (1) for an explicit rule, which is stronger than (1)'s existence statement. The constant 12\tfrac1221​ is sharp, so the goal is stated with it.

Milestones (in the order the paper's argument uses them)

  1. Tail bound, for every x>Tx > Tx>T:
Pr⁡[Xτ>x]  ≥  (1−p)∑i=1nPr⁡[Xi>x].\Pr[X_\tau > x] \;\ge\; (1-p)\sum_{i=1}^n \Pr[X_i > x].Pr[Xτ​>x]≥(1−p)i=1∑n​Pr[Xi​>x].
  1. Comparison with the prophet's tail, for every x>Tx > Tx>T:
Pr⁡[Xτ>x]  ≥  (1−p) Pr⁡[max⁡iXi>x].\Pr[X_\tau > x] \;\ge\; (1-p)\,\Pr\big[\max_i X_i > x\big].Pr[Xτ​>x]≥(1−p)Pr[imax​Xi​>x].
  1. The prophet's upper tail:
∫T∞Pr⁡[max⁡iXi>x] dx  ≥  T.\int_T^\infty \Pr\big[\max_i X_i > x\big]\,dx \;\ge\; T.∫T∞​Pr[imax​Xi​>x]dx≥T.
  1. The gambler's lower tail:
∫0TPr⁡[Xτ>x] dx  ≥  pT.\int_0^T \Pr[X_\tau > x]\,dx \;\ge\; pT.∫0T​Pr[Xτ​>x]dx≥pT.

Significance

The result. A threshold that depends on the distributions only through one number, E[max⁡iXi]\mathbb E[\max_i X_i]E[maxi​Xi​], already matches the optimal worst-case guarantee of the best stopping rule. Because it is a single price, the rule translates directly into a posted-price mechanism: a seller who posts the price TTT to arriving buyers obtains half of the expected maximum value. The same accounting, in which accepted value is charged against the threshold and rejected value against the probability of having accepted nothing, is what Kleinberg and Weinberg generalize to matroids (missions 1 and 2 of this series).

Formalizing it. The result is proved and classical; the work here is to formalize its known proof. No machine-checked proof of the factor-2 prophet inequality is in Mathlib, and none was found among the platform's published theorems in October 2026. A completed development provides the inequality itself, the tail comparisons, and the layer-cake bookkeeping for a stopped reward, all of which are reusable for other single-threshold prophet inequalities (Samuel-Cahn's median rule, kkk-choice and posted-price variants).

Difficulty

The expected reward of the rule is not a function of the marginals of the individual XiX_iXi​ alone in an obvious way: the event that the rule is still running when XiX_iXi​ arrives depends on X1,…,Xi−1X_1, \dots, X_{i-1}X1​,…,Xi−1​, and the reward is XτX_\tauXτ​ at a random index. The natural first attempt, comparing XτX_\tauXτ​ and max⁡iXi\max_i X_imaxi​Xi​ pointwise, fails, since on a given outcome the rule may stop early at a value just above TTT while the maximum comes later. The comparison has to be made between distributions, at each level xxx, and it has to use independence to decouple "nothing accepted before time iii" from "Xi>xX_i > xXi​>x". The rest is measure-theoretic bookkeeping that is routine on paper and not routine in Lean: expressing expectations of non-negative variables as integrals of tail probabilities, splitting them at TTT, and keeping track of integrability.

Formalization scope

  • Probability space. Ω with a MeasurableSpace, P : Measure Ω with [IsProbabilityMeasure P].
  • Variables. X : Fin n → Ω → ℝ, [NeZero n]; each X i measurable; iIndepFun X P (mutual independence); 0 ≤ X i ω for all i, ω; Integrable (maxX X) P, which is the paper's E[max⁡iXi]<∞\mathbb E[\max_i X_i] < \inftyE[maxi​Xi​]<∞.
  • Maximum. Finset.sup' over the nonempty index set; no junk supremum.
  • Expectations and probabilities. Bochner integrals (∫ ω, … ∂P) and Measure.real probabilities. Tail integrals are Lebesgue integrals of x↦Pr⁡[⋅>x]x \mapsto \Pr[\cdot > x]x↦Pr[⋅>x] over (T,∞)(T, \infty)(T,∞) and (0,T](0, T](0,T].
  • Weak and strict inequalities are as printed: the rule stops at Xτ≥TX_\tau \ge TXτ​≥T, p=Pr⁡[max⁡iXi≥T]p = \Pr[\max_i X_i \ge T]p=Pr[maxi​Xi​≥T], tails are Pr⁡[⋅>x]\Pr[\cdot > x]Pr[⋅>x], for x>Tx > Tx>T.
  • The rule may accept nothing. The reward is 000 when no value reaches TTT; the rule is not forced to stop at XnX_nXn​.

The threshold TTT is a definition, E[max⁡iXi]/2\mathbb E[\max_i X_i]/2E[maxi​Xi​]/2, not a free parameter constrained by hypotheses; a formalization in which TTT is arbitrary and the upper-tail bound is assumed would make the goal a rearrangement of its hypotheses, and is ruled out.

Infrastructure that a complete development needs, and that is welcome as separate contributions: the layer-cake formula E[Y]=∫0∞Pr⁡[Y>x] dx\mathbb E[Y] = \int_0^\infty \Pr[Y > x]\,dxE[Y]=∫0∞​Pr[Y>x]dx for non-negative integrable YYY split at a level TTT (Mathlib has the unsplit form, MeasureTheory.integral_eq_integral_meas_lt); measurability and integrability of the stopped reward (it is dominated by max⁡iXi\max_i X_imaxi​Xi​); and the probability of the event "the first i−1i-1i−1 values are below TTT and Xi>xX_i > xXi​>x" as a product under iIndepFun.

Selected references

  • Robert Kleinberg and S. Matthew Weinberg, Matroid Prophet Inequalities, STOC 2012, pp. 123–136; preprint arXiv:1201.4764v1, 2012. https://arxiv.org/abs/1201.4764 (doi:10.1145/2213977.2213991)
  • Ulrich Krengel and Louis Sucheston, Semiamarts and finite values, Bulletin of the American Mathematical Society 83, 1977, pp. 745–747.
  • Ulrich Krengel and Louis Sucheston, On semiamarts, amarts, and processes with finite value, Advances in Probability and Related Topics 4, 1978, pp. 197–266.
  • Ester Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Annals of Probability 12(4), 1984, pp. 1213–1216. https://doi.org/10.1214/aop/1176993223
5 thms2 active usersReviewed
🏆Completed
Harmonic Analysis·Captain: marwahaha

Unbounded Violations of the Square-Root Degree BoundOpen Problem

Motivation

The linear Fourier coefficients measure a Boolean function’s correlation with individual inputs. The source studies whether their sum can be controlled solely by the square root of the function’s real polynomial degree. The source is OpenAI's September 2026 manuscript.

Setting

A Boolean function here takes values in {−1,1}\{-1,1\}{−1,1} on a finite sign cube. Fourier coefficients use the uniform distribution. The Fourier degree is the largest support size of a nonzero coefficient; it is unrelated to degree over a field of characteristic two.

Formalization targets

∀C>0 ∃f:∑if^({i})>Cdeg⁡f,{∑i∣f^({i})∣deg⁡f:deg⁡f>0} is unbounded above.\forall C>0\ \exists f:\quad\sum_i\widehat f(\{i\})>C\sqrt{\deg f},\qquad \left\{\frac{\sum_i|\widehat f(\{i\})|}{\sqrt{\deg f}}:\deg f>0\right\}\text{ is unbounded above}.∀C>0 ∃f:i∑​f​({i})>Cdegf​,{degf​∑i​∣f​({i})∣​:degf>0} is unbounded above.

Two things about real Fourier analysis on Boolean cubes, where a Boolean input is read as a sign (false is +1, true is -1), averages are uniform, and degree is the ordinary real Fourier degree, meaning the largest size of a subset s with nonzero Fourier coefficient, the coefficient being the average of f(x) times the product of the signs of the coordinates in s. First, SignedViolations holds: for every real C>0 there is a positive integer n and a function f from {false,true}^n to the reals that takes only the values -1 and 1, is nonconstant, and satisfies C·√(deg f) < Σᵢ f̂({i}), the plain signed sum of its degree-one Fourier coefficients over single coordinates. Second, the set of ratios (Σᵢ |f̂({i})|)/√(deg f), taken over all positive n and all Boolean-valued f on n coordinates with positive Fourier degree, is not bounded above in the reals, so the supremum of these ratios is infinite.

The goal is OAI.SquareRootDegree.main.

Significance

Both signed violations and unbounded absolute ratios are retained. The result concerns failure of every constant multiple, which is stronger than exhibiting one violation of a proposed constant-one inequality. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

A large ambient dimension is not itself a violation: the denominator depends on degree. The function must remain Boolean and nonconstant while its linear coefficient sum outgrows that denominator.

Formalization scope

Inputs are Fin n → Bool, with false interpreted as +1+1+1 and true as −1-1−1. The first clause requires positive dimension and a nonconstant function. The second restricts to positive Fourier degree and uses ¬ BddAbove, avoiding a real-valued infinity convention.

The shared definitions are supplied by SquareRootDegree. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, Unbounded Violations of the Square-Root Degree Bound, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
33 thms2 active usersReviewed
🏆Completed
Captain: marwahaha

An exponential state lower bound for two-way nondeterministic complementationOpen Problem

Motivation

Allowing a finite automaton to move its head in both directions complicates the state cost of language complement. A lower bound independent of alphabet size must handle alphabets that grow with the witness. The source manuscript presents the surrounding research claim.

Setting

A two-way nondeterministic automaton has a finite state set, two endmarkers and left/stay/right moves. Acceptance is the existence of a finite run reaching an accepting state. The witness alphabet consists of relations on Fin(n−2), and its language tests whether their ordered product is nonempty.

Formalization target

For every n≥4, construct one n-state witness A for that language such that every complement automaton B satisfies

∣QB∣≥12 2⌊(n−4)/127⌋−1.|Q_B|\ge\frac12\,2^{\lfloor(n-4)/127\rfloor}-1.∣QB​∣≥21​2⌊(n−4)/127⌋−1.

For n≥131, every deterministic automaton for the same language must satisfy the corresponding bound without the minus one.

The selected formal target is OAI.TwoWayComplementation.explicit_family_main.

Significance and status

Both bounds concern the same explicit-language witness. The goal includes determinization as well as complementation, while the companion target isolates the complement bound. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

The lower bound ranges over every finite state type and every competing automaton. Producing one inefficient complement construction would not establish it.

Formalization scope

Natural-number subtraction and division determine the exponent. Runs start on the left endmarker and may have length zero. Tape positions remain inside the marked input. The relation alphabet is finite but grows with n. Source groups redeclaring the automaton model remain independent.

Selected references

  • OpenAI, An exponential state lower bound for two-way nondeterministic complementation, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
51 thms2 active usersReviewed
🏆Completed
Analysis·Captain: marwahaha

Average sensitivity of polynomial threshold functionsOpen Problem

Motivation

Average sensitivity measures how often a Boolean decision changes after one coordinate flip. For polynomial threshold rules, a degree-sensitive estimate limits the total influence of all coordinates. The source manuscript presents the surrounding research claim.

Setting

A polynomial threshold function evaluates a real multilinear polynomial p on the uniform cube {−1,1}ⁿ, then applies sign with sign(0)=1. Average sensitivity is the sum, over coordinates, of the fraction of cube vertices whose output changes under that flip.

Formalization target

For n≥1 and 1≤d≤n, prove

AS⁡(sign⁡p)≤8dn\operatorname{AS}(\operatorname{sign}p)\le8d\sqrt nAS(signp)≤8dn​

for every multilinear p of total degree at most d.

The selected formal target is OAI.LeanBlast.GotsmanLinial.gotsmanLinialStatement.

Significance and status

The constant is uniform in both dimension and degree. The formal target is the asymptotic Gotsman–Linial estimate with its explicit coefficient eight. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

A separate estimate for fixed degree would not establish the bound uniformly as d varies with n. Zeros of p on the cube must respect the specified tie convention.

Formalization scope

The cube is Fin n→Bool and coordinates are converted to ±1. Multilinearity is a support predicate on Mathlib multivariate polynomials, and the degree condition is explicit. General polynomial reduction to multilinear form is not an additional attached theorem.

Selected references

  • OpenAI, Average sensitivity of polynomial threshold functions, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
20 thms2 active usersReviewed
🏆Completed
Complexity TheoryQuantum Information·Captain: wurtle

Product-projection localization and the QAC0 parity lower boundResearch Paper

Motivation

Parity, PARITYn(x)=x1⊕⋯⊕xn\mathrm{PARITY}_n(x)=x_1\oplus\cdots\oplus x_nPARITYn​(x)=x1​⊕⋯⊕xn​, is the standard test of whether a shallow circuit can aggregate information from all of its inputs. Classically, constant-depth circuits with unbounded fan-in AND/OR gates (AC0\mathsf{AC}^0AC0) cannot compute it: Furst, Saxe and Sipser (Math. Systems Theory 1984) and Ajtai (APAL 1983) proved superpolynomial lower bounds, and Håstad's switching lemma gave nearly optimal exponential ones (STOC 1986). The quantum analogue QAC0\mathsf{QAC}^0QAC0 allows arbitrary one-qubit unitaries and Toffoli gates of unbounded arity, but gates in one layer must act on disjoint qubits, so a wire cannot control many simultaneous gates. Moore (arXiv:quant-ph/9903046, 1999) showed that coherent parity and quantum fanout are equivalent under Hadamard conjugation, and conjectured that neither is in QAC0\mathsf{QAC}^0QAC0. Because fanout makes constant-depth quantum circuits very powerful (Høyer–Špalek, ToC 2005), whether PARITY∉QAC0\mathrm{PARITY}\notin\mathsf{QAC}^0PARITY∈/QAC0 has been a central question about shallow quantum computation.

Background

  • 1999 — Moore introduces the quantum circuit classes and the parity/fanout conjecture.
  • 2002 — Green, Homer, Moore and Pollett develop quantum counting classes and modular-gate equivalences (QIC 2002).
  • 2006 — Fang, Fenner, Green, Homer and Zhang: depth Ω(log⁡(n/(a+1)))\Omega(\log(n/(a+1)))Ω(log(n/(a+1))) for exact clean parity with aaa ancillas (QIC 2006).
  • 2020–2021 — Padé, Fenner, Grier and Thierauf rule out exact clean parity at entangling depth two (arXiv:2005.12169); Rosenthal bounds approximate parity unitaries (ITCS 2021).
  • 2024–2025 — Pauli-spectrum lower bounds with restricted ancillas (Nadimpalli, Parham, Vasconcelos, Yuen, STOC 2024); no fixed parity advantage with barely superlinear ancillas (Anshu, Dong, Ou, Yao, STOC 2025), extended by Dong, Ou and Yao (arXiv:2510.00593).
  • 2026 — Joshi, Tal, Vasconcelos and Wright: exact parity lower bounds at entangling depth three without size restriction (STOC 2026); Gretta, Gupta and Joshi relate the question to Fourier concentration (arXiv:2604.02793).
  • September 2026 — Two OpenAI preprints claim the lower bound for every fixed depth and every polynomial number of qubits, by independent arguments: product-projection localization (source) and regular trajectories with pruning (source).

This mission asks for a formal proof of the parity lower bound stated as Theorem 1 of an OpenAI preprint dated September 24, 2026 (source). The preprint has not been peer reviewed and its claims have not been independently verified; on the platform the Lean goal is open.

Setting

A circuit acts on NNN qubits, with state space (C2)⊗N(\mathbb C^2)^{\otimes N}(C2)⊗N and computational basis indexed by bit strings y∈{0,1}Ny\in\{0,1\}^Ny∈{0,1}N. The allowed gates are arbitrary one-qubit unitaries and generalized Toffoli gates ∣z1,…,zt,b⟩↦∣z1,…,zt,b⊕z1⋯zt⟩|z_1,\dots,z_t,b\rangle\mapsto|z_1,\dots,z_t,b\oplus z_1\cdots z_t\rangle∣z1​,…,zt​,b⟩↦∣z1​,…,zt​,b⊕z1​⋯zt​⟩ on distinct control and target qubits. A layer is a set of gates with pairwise disjoint supports, and a depth-ddd circuit is a product W=Ld⋯L1W=L_d\cdots L_1W=Ld​⋯L1​ of at most ddd layers. Gates and their complex entries may depend on nnn but not on the input.

On input x∈{0,1}nx\in\{0,1\}^nx∈{0,1}n with n≤Nn\le Nn≤N, the circuit starts in ∣x⟩⊗∣0⟩⊗(N−n)|x\rangle\otimes|0\rangle^{\otimes(N-n)}∣x⟩⊗∣0⟩⊗(N−n). One designated output qubit is measured in the computational basis; all other qubits are discarded in arbitrary states, and the input need not be preserved. The success probability on xxx is

Pr⁡[output=PARITYn(x)]=∑y: yout=PARITYn(x)∣⟨y∣W∣x,0⟩∣2.\Pr[\text{output}=\mathrm{PARITY}_n(x)]=\sum_{y:\ y_{\mathrm{out}}=\mathrm{PARITY}_n(x)}\bigl|\langle y|W|x,0\rangle\bigr|^2 .Pr[output=PARITYn​(x)]=y: yout​=PARITYn​(x)∑​​⟨y∣W∣x,0⟩​2.

A circuit computes parity with worst-case advantage ε\varepsilonε if this probability is at least 1/2+ε1/2+\varepsilon1/2+ε for every xxx.

Formalization targets

Goal: the parity lower bound (Theorem 1, p. 1)

Fix an integer d≥0d\ge0d≥0, a real c≥1c\ge1c≥1 and 0<ε≤1/20<\varepsilon\le1/20<ε≤1/2. Then for all sufficiently large nnn, for every NNN with n≤N≤ncn\le N\le n^cn≤N≤nc, every circuit of depth at most ddd on NNN qubits and every choice of output qubit, there is an input x∈{0,1}nx\in\{0,1\}^nx∈{0,1}n with

Pr⁡[output=PARITYn(x)]<12+ε.\Pr[\text{output}=\mathrm{PARITY}_n(x)]<\tfrac12+\varepsilon .Pr[output=PARITYn​(x)]<21​+ε.

With ε=1/6\varepsilon=1/6ε=1/6 this is the usual bounded-error statement PARITY∉QAC0\mathrm{PARITY}\notin\mathsf{QAC}^0PARITY∈/QAC0 in the measured-output model.

Significance

The result itself. It answers Moore's question for every fixed depth and every polynomial bound on the total number of qubits, with arbitrary final garbage and any fixed positive advantage, whereas earlier results fixed the entangling depth or restricted the number of ancillas. Through Hadamard conjugation it also excludes constant-depth polynomial-size coherent fanout. The preprint derives further consequences (Section 7): state-preparation obstructions (Corollary 8, p. 14), a qualitative quantum LMN-type Fourier tail bound (Corollary 9, p. 16), and, via reductions of Xu and Li, lower bounds for majority and other symmetric functions (Corollaries 10–11, pp. 17–18). The structural Theorem 2 (p. 5), localization of conjugated product projections, is of independent interest.

Formalizing it. The statement is elementary (finite matrices, Born probabilities) while the proof is a two-level induction with polynomial approximation, so a formal proof would give a fully checked circuit lower bound in quantum complexity, an area with few machine-checked results. A companion OpenAI preprint gives an independent proof by regular trajectories and pruning.

Difficulty

Light-cone arguments fail at once: a single Toffoli gate may touch every qubit, so after one layer an output can depend on all inputs. Spectral and Pauli-weight methods previously needed ancilla bounds such as O~(n1+2−d)\tilde O(n^{1+2^{-d}})O~(n1+2−d). The preprint's route controls transitions from a product condition to states with many mismatches, ∥[M≥Nt] U [D=0] U† [M=0]∥≤e−Ns\bigl\|[M\ge N^t]\,U\,[D=0]\,U^\dagger\,[M=0]\bigr\|\le e^{-N^s}​[M≥Nt]U[D=0]U†[M=0]​≤e−Ns for all fixed 0≤s<t0\le s<t0≤s<t (Theorem 2, p. 5). The obstacle is that reflection expansions cost exponentially in the projection's support, and low-degree polynomial surrogates for a product projection are accurate only at low mismatch counts; the uncontrolled high-count error is handled by a second induction on thresholds that exchanges the roles of the two counts.

Formalization scope

  • Word N := Fin N → Fin 2; operators are complex matrices indexed by words. Gate.local q u is a one-qubit unitary tensored with identities; Gate.toffoli controls target is the permutation matrix flipping the target when all controls are 111 (an empty control set gives a NOT gate, itself a one-qubit unitary).
  • PhysicalLayer N is a list of gates whose supports are pairwise disjoint; its matrix is the product of the gate matrices. physicalCircuitMatrix layers applies the layers in list order (rightmost matrix acts first).
  • inputWord x pads xxx with zeros; successProbability W out x sums ∣Wy,(x,0)∣2|W_{y,(x,0)}|^2∣Wy,(x,0)​∣2 over all yyy whose output bit equals the parity of xxx, so final garbage is unrestricted.
  • The output qubit out : Fin N is arbitrary, including an input qubit. The quantifier order is: depth, size bound and advantage fixed first; then a threshold n0n_0n0​; then every n≥n0n\ge n_0n≥n0​, every NNN in range, every circuit and every output qubit.
  • No intermediate measurement, postselection or fanout gate is in the model; the statement is a pure statement about unitary matrices, with no complexity-class machinery.
  • ParityStatement takes the size bound as a real exponent: N≤ncN\le n^cN≤nc with c≥1c\ge1c≥1 real, n≤Nn\le Nn≤N, and depth layers.length ≤ d with d≥0d\ge0d≥0, exactly as in Theorem 1. Its conclusion is the negation of "for every xxx, success ≥1/2+ε\ge 1/2+\varepsilon≥1/2+ε".

Welcome contributions: a reusable Lean model of unitary circuits on qubits, spectral projections of commuting count operators, and Chebyshev-type polynomial approximation with coefficient bounds (Lemma 3, p. 6).

Selected references

  • OpenAI, Product-projection localization and the QAC0 parity lower bound, OpenAI Math Release preprint, September 24, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Product-projection-localization-and-the-QAC0-parity-lower-bound-September-24-2026/paper.pdf
  • OpenAI, Regular trajectories, pruning and quantum parity, OpenAI Math Release preprint, September 24, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Regular-trajectories-pruning-and-quantum-parity-September-24-2026/paper.pdf
  • C. Moore, Quantum circuits: fanout, parity, and counting, arXiv:quant-ph/9903046 (1999). https://arxiv.org/abs/quant-ph/9903046v3
  • M. Furst, J. B. Saxe, M. Sipser, Parity, circuits, and the polynomial-time hierarchy, Math. Systems Theory 17 (1984), 13–27. https://doi.org/10.1007/BF01744431
  • M. Ajtai, Σ11\Sigma^1_1Σ11​-formulae on finite structures, Ann. Pure Appl. Logic 24 (1983), 1–48. https://doi.org/10.1016/0168-0072(83)90038-6
  • J. Håstad, Almost optimal lower bounds for small depth circuits, STOC 1986. https://doi.org/10.1145/12130.12132
  • F. Green, S. Homer, C. Moore, C. Pollett, Counting, fanout and the complexity of quantum ACC, QIC 2 (2002). https://doi.org/10.26421/QIC2.1-3
  • P. Høyer, R. Špalek, Quantum fan-out is powerful, Theory of Computing 1 (2005). https://doi.org/10.4086/toc.2005.v001a005
  • M. Fang, S. Fenner, F. Green, S. Homer, Y. Zhang, Quantum lower bounds for fanout, QIC 6 (2006). https://doi.org/10.26421/QIC6.1-3
  • G. Rosenthal, Bounds on the QAC0 complexity of approximating parity, ITCS 2021. https://doi.org/10.4230/LIPIcs.ITCS.2021.32
  • S. Nadimpalli, N. Parham, F. Vasconcelos, H. Yuen, On the Pauli spectrum of QAC0, STOC 2024. https://doi.org/10.1145/3618260.3649662
  • M. R. Joshi, A. Tal, F. Vasconcelos, J. Wright, Improved lower bounds for QAC0, STOC 2026. https://doi.org/10.1145/3798129.3800922
  • L. Gretta, M. Gupta, M. R. Joshi, Parity ∉ QAC0 ⟺ QAC0 is Fourier-concentrated, arXiv:2604.02793 (2026). https://arxiv.org/abs/2604.02793v2
32 thms2 active usersReviewed
🏆Completed
CombinatoricsProbability·Captain: wurtle

Variance of the Random k-SAT Hitting TimeResearch Paper

Motivation

Add random clauses one at a time to a Boolean formula on nnn variables until it first becomes unsatisfiable. The index HnH_nHn​ of that first failure is the satisfiability hitting time of random kkk-SAT. Its mean, divided by nnn, converges to the satisfiability threshold; its variance measures the width of the transition window. Friedgut's sharp-threshold theorem shows the window is o(n)o(n)o(n), but quantitative widths have remained far from the n\sqrt nn​ scale suggested by lower bounds. This mission asks for the order of the variance of HnH_nHn​ for every fixed k≥3k\ge3k≥3.

Timeline

  • 1981. Efron and Stein prove their variance inequality, the basic tool for fluctuation bounds of functions of independent inputs (doi:10.1214/aos/1176345462).
  • 1999. Friedgut, with an appendix by Bourgain, proves a sharp threshold sequence for each fixed kkk (doi:10.1090/S0894-0347-99-00305-7).
  • 2002. Wilson proves an Ωk(n)\Omega_k(\sqrt n)Ωk​(n​) separation of central quantiles for the proper-clause model (doi:10.1002/rsa.10050).
  • 2005. Boucheron, Bousquet, Lugosi and Massart give moment inequalities for functions of independent variables (doi:10.1214/009117904000000856).
  • 2022. Ding, Sly and Sun prove the satisfiability conjecture for large kkk (doi:10.4007/annals.2022.196.1.1).
  • 2026. Carenini proves an Ok,η(n/log⁡n)O_{k,\eta}(n/\log n)Ok,η​(n/logn) window (ECCC TR26-145, arXiv:2609.26222) and then a polynomial window Ok,η(n1/2+1/k)O_{k,\eta}(n^{1/2+1/k})Ok,η​(n1/2+1/k) with variance Ok(n1+2/k)O_k(n^{1+2/k})Ok​(n1+2/k), resolving the satisfiability conjecture for every fixed k≥3k\ge3k≥3 (ECCC TR26-229, made public October 5, 2026); priority for that resolution belongs to Carenini. A companion OpenAI preprint gives an alternative proof of the limiting threshold.

The source of this mission is an OpenAI preprint dated September 27, 2026.

Setting

Fix k≥3k\ge3k≥3 and n≥kn\ge kn≥k. A proper kkk-clause is an OR of literals on kkk distinct variables; let C1,C2,…C_1,C_2,\dotsC1​,C2​,… be independent uniform choices among the 2k(nk)2^k\binom nk2k(kn​) signed proper clauses (signs fair, whole clauses may repeat). Put

Fm=C1∧⋯∧Cm,F0=true,Hn=min⁡{m≥1: Fm unsatisfiable},F_m=C_1\wedge\dots\wedge C_m,\qquad F_0=\text{true},\qquad H_n=\min\{m\ge1:\ F_m\ \text{unsatisfiable}\},Fm​=C1​∧⋯∧Cm​,F0​=true,Hn​=min{m≥1: Fm​ unsatisfiable},

and, for fixed B>0B>0B>0, the capped hitting time Tn,B=min⁡{Hn,⌊Bn⌋}T_{n,B}=\min\{H_n,\lfloor Bn\rfloor\}Tn,B​=min{Hn​,⌊Bn⌋}. Since each assignment survives a clause with probability 1−2−k1-2^{-k}1−2−k, HnH_nHn​ is a.s. finite with all moments. Write

ℓk(n)={log⁡(en),k=3,1,k≥4,Uk=log⁡2−log⁡(1−2−k).\ell_k(n)=\begin{cases}\log(en),&k=3,\\1,&k\ge4,\end{cases}\qquad U_k=\frac{\log2}{-\log(1-2^{-k})}.ℓk​(n)={log(en),1,​k=3,k≥4,​Uk​=−log(1−2−k)log2​.

Formalization targets

Goal: Theorem 1.1

There are constants Ck,ck>0C_k,c_k>0Ck​,ck​>0 with

Var⁡(Hn)≤Ck n ℓk(n)(n≥k),Var⁡(Hn)≥ckn(n large),\operatorname{Var}(H_n)\le C_k\,n\,\ell_k(n)\quad(n\ge k),\qquad \operatorname{Var}(H_n)\ge c_kn\quad(n\ \text{large}),Var(Hn​)≤Ck​nℓk​(n)(n≥k),Var(Hn​)≥ck​n(n large),

and for every fixed B>0B>0B>0 a constant Ck,BC_{k,B}Ck,B​ with Var⁡(Tn,B)≤Ck,B n ℓk(n)\operatorname{Var}(T_{n,B})\le C_{k,B}\,n\,\ell_k(n)Var(Tn,B​)≤Ck,B​nℓk​(n); if B>UkB>U_kB>Uk​ then also Var⁡(Tn,B)≥ckn\operatorname{Var}(T_{n,B})\ge c_knVar(Tn,B​)≥ck​n for large nnn. Hence Var⁡(Hn)=Θk(n)\operatorname{Var}(H_n)=\Theta_k(n)Var(Hn​)=Θk​(n) for k≥4k\ge4k≥4. Lean: OAI.RandomKSAT.variance_main, open on the platform.

Milestone: Propositions A.1–A.2 (optimality of exponents)

The killing-probability exponent β=k/(k−1)\beta=k/(k-1)β=k/(k−1) in the lifetime bound τk(S)qd(S)β≤Ckdβ\tau_k(S)q_d(S)^\beta\le C_kd^\betaτk​(S)qd​(S)β≤Ck​dβ (Proposition 2.3) cannot be decreased, and the block-error term g−(k−1)g^{-(k-1)}g−(k−1) in the replacement lemma cannot be improved to o(g−(k−1))o(g^{-(k-1)})o(g−(k−1)) uniformly. Lean: OAI.RandomKSAT.sharpness.

Significance

For k≥4k\ge4k≥4 the theorem determines the variance of the hitting time up to constants, so the transition window has width Θk(n)\Theta_k(\sqrt n)Θk​(n​) in the variance sense, matching Wilson's lower bound and improving Carenini's Ok(n1+2/k)O_k(n^{1+2/k})Ok​(n1+2/k) variance bound. For k=3k=3k=3 it leaves only a logarithmic gap, closed in a companion OpenAI preprint. Chebyshev's inequality then gives concentration of HnH_nHn​ about EHn\mathbb EH_nEHn​ at scale nℓk(n)\sqrt{n\ell_k(n)}nℓk​(n)​.

The results are proved in an OpenAI preprint; they have not been peer reviewed, and no machine-checked proof exists.

Difficulty

The Efron–Stein inequality reduces the upper bound to the expected squared delay caused by deleting one clause, which counts pairs of prefixes at which that clause is pivotal. Controlling this occupation time requires a uniform estimate relating how quickly a set of assignments is killed by shorter (k−1)(k-1)(k−1)-clauses to its lifetime under kkk-clauses, valid for every assignment set with no lower cutoff. Earlier arguments truncate the number of clauses incident to the deleted clause's variables at a logarithmic level, which costs a logarithm; keeping that number as a random parameter without destroying independence is the main obstacle. Appendix A shows the relevant exponents are sharp.

Formalization scope

  • Clause n k is a dependent pair of a kkk-element Finset (Fin n) and a sign vector on it; clauseLaw is uniform; streamLaw is the infinite product (Measure.infinitePi).
  • firstFailure ω is the least mmm with an unsatisfiable prefix, valued in ℕ∞; H = (firstFailure ω).toNat; T B ω = (min (firstFailure ω) ⌊Bn⌋).toNat. The infinite case has probability zero.
  • variance is ProbabilityTheory.variance under streamLaw n k; ell, U are as displayed.
  • In the milestone, blockKill u s S g is the probability that ggg independent proper sss-clauses kill SSS, and lifetime u k S =∑mP(S survives m clauses)=\sum_m\mathbb P(S\text{ survives }m\text{ clauses})=∑m​P(S survives m clauses) is τk(S)\tau_k(S)τk​(S).

Infrastructure: product measures on clause streams, Efron–Stein, conditioning on incidence patterns. Formalizations of Proposition 2.3 (lifetime from shorter-clause killing), Proposition 4.3 (conditional squared delay), Corollary 5.2 and Proposition 6.2 (linear variance lower bound) are welcome.

Selected references

  • OpenAI, Variance of the Random k-SAT Hitting Time, preprint, September 27, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Variance-of-the-Random-k-SAT-Hitting-Time-September-27-2026/article.pdf
  • OpenAI, A Limiting Satisfiability Threshold for Every Fixed Clause Size, preprint, September 25, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/A-Limiting-Satisfiability-Threshold-for-Every-Fixed-Clause-Size-September-25-2026/article.pdf
  • G. Carenini, A polynomial scaling window for random k-SAT and a proof of the satisfiability conjecture, ECCC TR26-229, 2026. https://eccc.weizmann.ac.il/report/2026/229/
  • G. Carenini, The scaling window of random k-SAT, ECCC TR26-145, 2026. https://arxiv.org/abs/2609.26222
  • E. Friedgut (appendix by J. Bourgain), Sharp thresholds of graph properties, and the k-SAT problem, J. Amer. Math. Soc., 1999. https://doi.org/10.1090/S0894-0347-99-00305-7
  • D. B. Wilson, On the critical exponents of random k-SAT, Random Structures Algorithms, 2002. https://doi.org/10.1002/rsa.10050
  • J. Ding, A. Sly, N. Sun, Proof of the satisfiability conjecture for large k, Ann. of Math., 2022. https://doi.org/10.4007/annals.2022.196.1.1
  • B. Efron, C. Stein, The jackknife estimate of variance, Ann. Statist., 1981. https://doi.org/10.1214/aos/1176345462
  • S. Boucheron, O. Bousquet, G. Lugosi, P. Massart, Moment inequalities for functions of independent random variables, Ann. Probab., 2005. https://doi.org/10.1214/009117904000000856
32 thms2 active usersReviewed
🏆Completed
CombinatoricsProbability·Captain: wurtle

A Limiting Satisfiability Threshold for Every Fixed Clause SizeResearch Paper

Motivation

A random kkk-SAT formula on nnn Boolean variables is a conjunction of mmm independent random clauses, each an OR of kkk literals on distinct variables. As the clause density m/nm/nm/n grows, the formula changes from almost surely satisfiable to almost surely unsatisfiable. Random kkk-SAT is a central model in probabilistic combinatorics, the theory of algorithms and statistical physics: its threshold is where hard instances are expected to concentrate, and it is a proving ground for methods from spin-glass theory. The satisfiability conjecture, formulated explicitly by Chvátal and Reed, asserts that for each fixed kkk the transition happens at a limiting density αk\alpha_kαk​ that does not drift with nnn.

Timeline

  • 1992. Chvátal and Reed settle k=2k=2k=2 and formulate the conjecture for every fixed clause size (doi:10.1109/SFCS.1992.267789); Goerdt gives an independent proof for k=2k=2k=2 (doi:10.1006/jcss.1996.0081).
  • 1999. Friedgut, with an appendix by Bourgain, proves a sharp transition around a sequence of densities, leaving open whether the sequence converges (doi:10.1090/S0894-0347-99-00305-7).
  • 2002, 2006. Mézard, Parisi and Zecchina, and Mertens, Mézard and Zecchina, predict threshold values via the cavity method (doi:10.1126/science.1073287, doi:10.1002/rsa.20090).
  • 2004. Achlioptas and Peres prove bounds 2klog⁡2−O(k)2^k\log2-O(k)2klog2−O(k) (doi:10.1090/S0894-0347-04-00464-3).
  • 2013, 2014. Bayati, Gamarnik and Tetali develop combinatorial interpolation for sparse random structures (doi:10.1214/12-AOP816); Abbe and Montanari study concentration of solution counts (doi:10.1002/rsa.20501).
  • 2016. Coja-Oghlan and Panagiotou locate the threshold sequence within ok(1)o_k(1)ok​(1) of 2klog⁡2−(1+log⁡2)/22^k\log2-(1+\log2)/22klog2−(1+log2)/2 (doi:10.1016/j.aim.2015.11.007).
  • 2022. Ding, Sly and Sun prove the conjecture for all sufficiently large kkk, with the 1RSB value (doi:10.4007/annals.2022.196.1.1).
  • 2026. Carenini proves a polynomial scaling window and resolves the conjecture for every fixed k≥3k\ge3k≥3 (ECCC TR26-229, made public October 5, 2026; https://eccc.weizmann.ac.il/report/2026/229/). Priority for the resolution belongs to Carenini.

The source of this mission is an OpenAI preprint dated September 25, 2026, which gives an alternative proof of the existence of the limiting threshold.

Setting

Fix k≥3k\ge3k≥3. For n≥kn\ge kn≥k, a proper kkk-clause chooses kkk distinct variables among x1,…,xnx_1,\dots,x_nx1​,…,xn​ uniformly and gives each an independent fair sign, so each of the 2k(nk)2^k\binom nk2k(kn​) clauses is equally likely. Let C1,C2,…C_1,C_2,\dotsC1​,C2​,… be independent such clauses (sampled with replacement: two positions may hold the same clause) and

Fn,m=⋀i=1mCi,Pn(m)=P(Fn,m is satisfiable),Pn(0)=1.F_{n,m}=\bigwedge_{i=1}^mC_i,\qquad P_n(m)=\mathbb P(F_{n,m}\ \text{is satisfiable}),\qquad P_n(0)=1 .Fn,m​=i=1⋀m​Ci​,Pn​(m)=P(Fn,m​ is satisfiable),Pn​(0)=1.

The ratio c=m/nc=m/nc=m/n is the clause density.

Formalization targets

Goal: Theorem 1.1

For every fixed integer k≥3k\ge3k≥3 there is αk∈(0,∞)\alpha_k\in(0,\infty)αk​∈(0,∞) such that

lim⁡n→∞Pn(⌊cn⌋)={1,0≤c<αk,0,c>αk.\lim_{n\to\infty}P_n(\lfloor cn\rfloor)=\begin{cases}1,&0\le c<\alpha_k,\\ 0,&c>\alpha_k.\end{cases}n→∞lim​Pn​(⌊cn⌋)={1,0,​0≤c<αk​,c>αk​.​

No assertion is made at c=αkc=\alpha_kc=αk​, and the value of αk\alpha_kαk​ is not identified. Lean: OAI.FixedClauseThreshold.main, open on the platform.

Significance

The theorem settles, for every fixed k≥3k\ge3k≥3, the existence half of the threshold question: Friedgut's sharp transition happens at a location that converges. Previously this was known only for large kkk (Ding–Sly–Sun) and for k=2k=2k=2. Existence is a prerequisite for questions about the value of αk\alpha_kαk​, its computability, and the fluctuations of the satisfiability hitting time, which companion OpenAI preprints address. The proof here proceeds through concentration of a capped last satisfiable index and a comparison between system sizes; it does not rely on Carenini's window.

The result is proved in an OpenAI preprint; it has not been peer reviewed, and no machine-checked proof exists.

Difficulty

A sharp-threshold theorem gives a narrow window at each nnn but no control of how the window's center moves with nnn. Convergence needs a comparison between different system sizes, and interpolation methods from spin-glass theory deliver free-energy bounds, not hard satisfiability statements, and often only for even arity. The center must also be shown to concentrate polynomially, which requires bounding how many variables are forced along the clause process.

Formalization scope

  • ProperClause n k is a function Fin n → Option Bool with exactly kkk defined entries; some b at iii is the literal satisfied when σi=b\sigma_i=bσi​=b.
  • Formula n k m := Fin m → ProperClause n k (ordered, with replacement); properSATProbability n k m is the exact ratio of satisfiable formulas to all formulas, which equals Pn(m)P_n(m)Pn​(m) under the uniform product law.
  • Degenerate sizes: m=0m=0m=0 gives probability 111; for n<kn<kn<k and m>0m>0m>0 the ensemble is empty and the ratio is 000 by convention, affecting only finitely many nnn.
  • HasLimitingThreshold k asserts ∃ α>0\exists\,\alpha>0∃α>0 with limits 111 for 0≤c<α0\le c<\alpha0≤c<α and 000 for c>αc>\alphac>α at m=⌊cn⌋m=\lfloor cn\rfloorm=⌊cn⌋.

Infrastructure: finite counting of formulas, Efron–Stein-type variance bounds, a deterministic concentration-to-convergence lemma (Theorem 5.1), and the Poisson/interpolation comparison with the transfer back to proper clauses. Formalizations of Proposition 2.2 (integrated forcing), Proposition 3.3 (polynomial concentration) and Theorem 5.1 are welcome.

Selected references

  • OpenAI, A Limiting Satisfiability Threshold for Every Fixed Clause Size, preprint, September 25, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/A-Limiting-Satisfiability-Threshold-for-Every-Fixed-Clause-Size-September-25-2026/article.pdf
  • G. Carenini, A polynomial scaling window for random k-SAT and a proof of the satisfiability conjecture, ECCC TR26-229, 2026. https://eccc.weizmann.ac.il/report/2026/229/
  • V. Chvátal, B. Reed, Mick gets some (the odds are on his side), FOCS 1992. https://doi.org/10.1109/SFCS.1992.267789
  • E. Friedgut (appendix by J. Bourgain), Sharp thresholds of graph properties, and the k-SAT problem, J. Amer. Math. Soc., 1999. https://doi.org/10.1090/S0894-0347-99-00305-7
  • D. Achlioptas, Y. Peres, The threshold for random k-SAT is 2klog⁡2−O(k)2^k\log2-O(k)2klog2−O(k), J. Amer. Math. Soc., 2004. https://doi.org/10.1090/S0894-0347-04-00464-3
  • A. Coja-Oghlan, K. Panagiotou, The asymptotic k-SAT threshold, Adv. Math., 2016. https://doi.org/10.1016/j.aim.2015.11.007
  • J. Ding, A. Sly, N. Sun, Proof of the satisfiability conjecture for large k, Ann. of Math., 2022. https://doi.org/10.4007/annals.2022.196.1.1
  • M. Bayati, D. Gamarnik, P. Tetali, Combinatorial approach to the interpolation method and scaling limits in sparse random graphs, Ann. Probab., 2013. https://doi.org/10.1214/12-AOP816
  • E. Abbe, A. Montanari, On the concentration of the number of solutions of random satisfiability formulas, Random Structures Algorithms, 2014. https://doi.org/10.1002/rsa.20501
20 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: wurtle

Snaky in 21 Maker movesResearch Paper

Motivation

In a Maker–Breaker achievement game, two players alternately claim cells of a board; Maker wins by owning every cell of some copy of a fixed shape, and Breaker only tries to prevent this. Polyomino achievement games on the infinite square grid, introduced by Frank Harary, ask which small polyominoes are winners (Maker can force a copy) and which are losers (Breaker can prevent it forever). The six-cell shape Snaky is the long-standing hard case: Maker was known to win with a one-stone handicap or in higher dimensions, but the ordinary planar game without handicap remained undecided.

Timeline

  • 2004. Sieben shows that Snaky is a winner in 41 dimensions and records earlier handicap-two strategies of Harary, Harborth and Seemann, as well as the non-existence of a pairing strategy for Breaker (Integers 4, 2004).
  • 2007. Halupczok and Schlage-Puchta prove that Snaky wins in three dimensions, loses on an 8×88\times88×8 board, and has planar handicap number at most one (Integers 7, 2007). Ito and Miyagawa give another handicap-one construction.
  • 2008. Sieben develops proof trees for weak achievement games and gives a finite proof sequence for the handicap-one win, describing the ordinary planar problem as undecided (Integers 8, 2008).
  • 2011. Csernenszky, Martin and Pluhár give a computer-free proof that Breaker has no pairing defense for Snaky (Integers 11, 2011).
  • 2023, 2025. Shaik, Mayer-Eichberger, van de Pol and Saffidine study QBF encodings of finite Maker–Breaker games, including Snaky on a 5×55\times55×5 board (arXiv:2301.07345); Boucher and Villemaire treat strong achievement games (doi:10.21428/594757db.6ae0c84a).

The source of this mission, an OpenAI preprint dated September 25, 2026, settles the ordinary planar game: Snaky is a winner, within 21 Maker moves.

Setting

The board is Z2\mathbb Z^2Z2, initially empty. Snaky is

S={(0,0),(1,0),(2,0),(3,0),(3,1),(4,1)}.S=\{(0,0),(1,0),(2,0),(3,0),(3,1),(4,1)\}.S={(0,0),(1,0),(2,0),(3,0),(3,1),(4,1)}.

An allowed copy is t+R(S)t+R(S)t+R(S) with t∈Z2t\in\mathbb Z^2t∈Z2 and RRR one of the eight 2×22\times22×2 signed permutation matrices (rotations by quarter turns and reflections; no scaling). Maker moves first; then Breaker and Maker alternate, each claiming one previously unclaimed cell. Maker wins when it owns all cells of an allowed copy.

A Maker policy is a rule that, given the current position, returns an unclaimed cell. In the fixed-endpoint formulation, the policy keeps claiming fresh cells even after a win, and one asks that after Maker's NNN-th claim its set of cells contain an allowed copy whenever Breaker's first N−1N-1N−1 replies were legal.

Formalization targets

Milestone: Proposition 10 (finite identities of the 35-move certificate)

A pure computation on a printed certificate of 616 cards: card counts, 1,837 placement terms, required-set/envelope/height data of four interface cards, and uniform bounds for all cards.

Milestone: Theorem 11

∃ Maker policy σ: every legal play⇒an allowed copy of S within 35 Maker claims.\exists\ \text{Maker policy}\ \sigma:\ \text{every legal play} \Rightarrow \text{an allowed copy of } S \text{ within } 35 \text{ Maker claims}.∃ Maker policy σ: every legal play⇒an allowed copy of S within 35 Maker claims.

Goal: Theorem 1

∃ Maker policy σ: every legal play⇒an allowed copy of S within 21 Maker claims.\exists\ \text{Maker policy}\ \sigma:\ \text{every legal play} \Rightarrow \text{an allowed copy of } S \text{ within } 21 \text{ Maker claims}.∃ Maker policy σ: every legal play⇒an allowed copy of S within 21 Maker claims.

The Lean statement OAI.SnakyPrototype.snaky_winning_strategy_21_with_legal_states is open on the platform.

Significance

Theorem 1 decides the ordinary planar Snaky game, recorded as undecided by Sieben (2008), and gives an explicit bound of 21 Maker moves (a win by the 41st individual turn). It also gives a win on the finite 17×1717\times1717×17 board (Corollary 6), and removes the handicap from the earlier handicap-one strategies. The paper does not claim the bound 21 is optimal or address the strong game in which both players seek a copy.

The result is proved in an OpenAI preprint that has not been peer reviewed. Its correctness rests on a soundness lemma for a composition rule together with large finite certificates checked by standalone programs. A machine-checked proof would replace this combination of informal soundness argument and external computation by a single certified statement.

Difficulty

The board is infinite and Breaker may play anywhere, so no finite game-tree search applies directly: a proof must cover all Breaker replies, including those far from the action. Pairing strategies, the usual tool for proving shapes are losers, are known to fail for Snaky, but that does not give Maker a strategy. The certificate approach needs a composition rule whose soundness accounts for arbitrary previous ownership on both sides; the move count must be the number of actual Maker claims, including any replacement moves.

Formalization scope

  • Cells are ℤ × ℤ; snaky is the six-cell set above and HasSnaky M asks for r : Fin 8, t : Cell with snaky.image (placement r t) ⊆ M, where orient lists all eight signed permutations.
  • A Policy is a function of a move counter, the Maker set and the Breaker set; it must never return an owned cell. playState σ N β ∅ ∅ k is the position after kkk Maker claims and kkk Breaker replies.
  • LegalRepliesBeforeFinal σ N β ∅ ∅ constrains only the first N−1N-1N−1 Breaker replies; the theorems conclude a copy of SSS, exactly NNN Maker cells, and disjointness of the two players' sets throughout.
  • The certificate milestone stores the cards as an Array Entry and computes rowAt i (required set, envelope, height) by the composition recursion; it is a decidable statement about explicit finite data.

A trivializing reading is ruled out: the policy is required to be legal on all inputs, and Breaker's replies are arbitrary legal cells of the infinite board. A complete development needs a soundness proof for the composition rule (Lemma 3) and verified evaluation of the certificates; the policy, game and certificate infrastructure is shared between the 21- and 35-move statements. Contributions formalizing Lemma 3, Proposition 5 (the 21-move certificate identities) and Corollary 6 are welcome.

Selected references

  • OpenAI, Snaky in 21 Maker moves, preprint, September 25, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Snaky-in-21-Maker-moves-September-25-2026/article.pdf
  • N. Sieben, Snaky is a 41-dimensional winner, Integers 4, 2004. https://math.colgate.edu/~integers/eg5/eg5.pdf
  • I. Halupczok, J.-C. Schlage-Puchta, Achieving Snaky, Integers 7, 2007. https://math.colgate.edu/~integers/hg2/hg2.pdf
  • N. Sieben, Proof trees for weak achievement games, Integers 8, 2008. https://math.colgate.edu/~integers/ig7/ig7.pdf
  • H. Ito, H. Miyagawa, Snaky is a winner with one handicap, 8th Hellenic European Conference on Computer Mathematics and its Applications, 2007.
  • A. Csernenszky, R. R. Martin, A. Pluhár, On the complexity of Chooser–Picker positional games, Integers 11, 2011. https://math.colgate.edu/~integers/lg2/lg2.pdf
  • I. Shaik, V. Mayer-Eichberger, J. van de Pol, A. Saffidine, Implicit state and goals in QBF encodings for positional games, preprint, 2023. https://arxiv.org/abs/2301.07345
  • S. Boucher, R. Villemaire, The QBF Cover encoding for Harary's Tic-Tac-Toe, Canadian Conference on AI, 2025. https://doi.org/10.21428/594757db.6ae0c84a
9 thms2 active usersReviewed
PreviousPage 5 of 10Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me