Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Theoretical Computer Science

464 missions · 242 completed

The mathematical foundations of computation: which problems can be solved, by what algorithms, and at what cost in time, space, or communication. Distinguished by its emphasis on rigor and unconditional lower bounds, it spans computational complexity, algorithm design, automata and computability, cryptography, and the analysis of Boolean functions.

Missions

Open222Completed242All464
Graph TheoryLinear algebraProbability+1·Captain: mikedeng1

Graph Sparsification by Effective Resistances 1: Sampling O(n log n/ε²) Edges by Effective Resistance Yields a (1±ε) Spectral Sparsifier with Probability 1/2Research Paper

Motivation

Many graph algorithms run in time proportional to the number of edges. A sparsifier of a weighted graph GGG is a graph HHH on the same vertices with far fewer edges that approximates GGG for the purpose at hand, so that the algorithm can be run on HHH instead. Benczúr and Karger (1996) showed that every graph has a sparsifier with O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges preserving the weight of every cut up to a factor 1±ε1\pm\varepsilon1±ε. Spielman and Teng (2004) introduced the stronger spectral notion, in which the Laplacian quadratic form is preserved for every real vector, not only for cut indicators; their sparsifiers had O(nlog⁡cn)O(n\log^c n)O(nlogcn) edges for a large constant ccc and were the first step of their nearly-linear-time solvers for symmetric diagonally dominant linear systems.

Spielman and Srivastava (arXiv:0803.0929, STOC 2008, SIAM J. Comput. 2011) proved that independent sampling of O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges, each edge with probability proportional to its weight times its effective resistance, yields a spectral sparsifier. The result improved both earlier bounds, replaced a recursive partitioning construction by a one-line sampling rule, and made effective resistance a standard tool in graph algorithms. Batson, Spielman and Srivastava (arXiv:0808.0163) later obtained O(n/ε2)O(n/\varepsilon^2)O(n/ε2) edges deterministically, by a slower method built on the same matrix Π\PiΠ.

Setting

Let G=(V,E,w)G=(V,E,w)G=(V,E,w) be a connected weighted undirected graph with n=∣V∣n=|V|n=∣V∣ vertices, m=∣E∣m=|E|m=∣E∣ edges and weights we>0w_e>0we​>0. Orient every edge arbitrarily, so that it has a head and a tail (distinct vertices).

  • The incidence matrix B∈Rm×nB\in\mathbb R^{m\times n}B∈Rm×n has B(e,v)=1B(e,v)=1B(e,v)=1 if vvv is the head of eee, −1-1−1 if vvv is its tail, and 000 otherwise; beb_ebe​ denotes its row for eee. WWW is the diagonal m×mm\times mm×m matrix with W(e,e)=weW(e,e)=w_eW(e,e)=we​.
  • The Laplacian is L=BTWBL=B^{\mathsf T}WBL=BTWB, with quadratic form xTLx=∑ewe (x(head e)−x(tail e))2x^{\mathsf T}Lx=\sum_e w_e\,(x(\mathrm{head}\,e)-x(\mathrm{tail}\,e))^2xTLx=∑e​we​(x(heade)−x(taile))2.
  • L+L^{+}L+ is the Moore–Penrose pseudoinverse of LLL: if L=∑i=1n−1λiuiuiTL=\sum_{i=1}^{n-1}\lambda_iu_iu_i^{\mathsf T}L=∑i=1n−1​λi​ui​uiT​ over its nonzero eigenvalues, then L+=∑i=1n−1λi−1uiuiTL^{+}=\sum_{i=1}^{n-1}\lambda_i^{-1}u_iu_i^{\mathsf T}L+=∑i=1n−1​λi−1​ui​uiT​.
  • The effective resistance of the edge eee is Re=beL+beTR_e=b_eL^{+}b_e^{\mathsf T}Re​=be​L+beT​: the potential difference across eee when a unit current enters at one end and leaves at the other, the edges being resistors of conductance wew_ewe​.
  • Π=W1/2BL+BTW1/2\Pi=W^{1/2}BL^{+}B^{\mathsf T}W^{1/2}Π=W1/2BL+BTW1/2 is an m×mm\times mm×m matrix with Π(e,e)=weRe\Pi(e,e)=w_eR_eΠ(e,e)=we​Re​.
  • Sparsify(G,q)(G,q)(G,q) draws qqq edges independently with replacement, the edge eee with probability pe=weRe/∑fwfRfp_e=w_eR_e/\sum_f w_fR_fpe​=we​Re​/∑f​wf​Rf​, and gives eee the weight we/(qpe)w_e/(qp_e)we​/(qpe​) for each time it is drawn. Its output HHH has Laplacian L~=BTW1/2SW1/2B\tilde L=B^{\mathsf T}W^{1/2}SW^{1/2}BL~=BTW1/2SW1/2B, where SSS is the random diagonal matrix with S(e,e)=#{draws of e}/(qpe)S(e,e)=\#\{\text{draws of }e\}/(qp_e)S(e,e)=#{draws of e}/(qpe​).

Formalization targets

Goal: Theorem 1

There are an absolute constant CCC and a threshold N0N_0N0​ such that, for every n≥N0n\ge N_0n≥N0​, every connected weighted graph on nnn vertices and every 1/n<ε≤11/\sqrt n<\varepsilon\le11/n​<ε≤1, with q=⌈9C2nlog⁡n/ε2⌉q=\lceil 9C^2n\log n/\varepsilon^2\rceilq=⌈9C2nlogn/ε2⌉, with probability at least 1/21/21/2

∀x∈Rn:(1−ε) xTLx  ≤  xTL~x  ≤  (1+ε) xTLx.\forall x\in\mathbb R^n:\qquad (1-\varepsilon)\,x^{\mathsf T}Lx\;\le\;x^{\mathsf T}\tilde Lx\;\le\;(1+\varepsilon)\,x^{\mathsf T}Lx .∀x∈Rn:(1−ε)xTLx≤xTL~x≤(1+ε)xTLx.

The constant CCC is left unfixed; the statement asserts the shape q=O(nlog⁡n/ε2)q=O(n\log n/\varepsilon^2)q=O(nlogn/ε2) with the paper's explicit dependence on CCC.

Milestones

  1. Lemma 3 (four parts): Π\PiΠ is an orthogonal projection; im⁡Π=im⁡W1/2B\operatorname{im}\Pi=\operatorname{im}W^{1/2}BimΠ=imW1/2B; the eigenvalues of Π\PiΠ are 111 with multiplicity n−1n-1n−1 and 000 with multiplicity m−n+1m-n+1m−n+1; Π(e,e)=∥Π(⋅,e)∥2\Pi(e,e)=\|\Pi(\cdot,e)\|^2Π(e,e)=∥Π(⋅,e)∥2.
  2. Lemma 4: for a nonnegative diagonal SSS, ∥ΠSΠ−ΠΠ∥2≤ε\|\Pi S\Pi-\Pi\Pi\|_2\le\varepsilon∥ΠSΠ−ΠΠ∥2​≤ε implies (1−ε)xTLx≤xTBTW1/2SW1/2Bx≤(1+ε)xTLx(1-\varepsilon)x^{\mathsf T}Lx\le x^{\mathsf T}B^{\mathsf T}W^{1/2}SW^{1/2}Bx\le(1+\varepsilon)x^{\mathsf T}Lx(1−ε)xTLx≤xTBTW1/2SW1/2Bx≤(1+ε)xTLx for all xxx.
  3. Lemma 5 (Rudelson–Vershynin): for independent samples y1,…,yqy_1,\dots,y_qy1​,…,yq​ of a random vector with ∥y∥2≤M\|y\|_2\le M∥y∥2​≤M and ∥E yyT∥2≤1\|\mathbb E\,yy^{\mathsf T}\|_2\le1∥EyyT∥2​≤1, and q≥2q\ge2q≥2,
E∥1q∑j=1qyjyjT−E yyT∥2≤CMlog⁡qqwhenever the right side is <1.\mathbb E\Big\|\frac1q\sum_{j=1}^q y_jy_j^{\mathsf T}-\mathbb E\,yy^{\mathsf T}\Big\|_2\le CM\sqrt{\frac{\log q}{q}}\quad\text{whenever the right side is }<1.E​q1​j=1∑q​yj​yjT​−EyyT​2​≤CMqlogq​​whenever the right side is <1.

Significance

Theorem 1 says that every weighted graph is spectrally approximated by a reweighted subgraph with O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges. A spectral approximation preserves cut weights, the eigenvalues of the Laplacian up to 1±ε1\pm\varepsilon1±ε, effective resistances, and the condition number of LLL as a preconditioner, so any algorithm whose output depends on these quantities can run on HHH. Combined with fast approximate computation of effective resistances (the second mission of this series), it gives a nearly-linear-time construction, and it is the sampling step used in Laplacian solvers, in sparsification of sums of rank-one matrices, and in leverage-score sampling for regression, where weRew_eR_ewe​Re​ is exactly the statistical leverage of a row.

The result is proved in the paper; to our knowledge no machine-checked proof exists. This mission formalizes the statement and the paper's proof structure: the linear algebra of Π\PiΠ (Lemma 3), the deterministic reduction from quadratic forms to a spectral-norm bound (Lemma 4), and the matrix concentration inequality (Lemma 5), which is the substantive analytic input and is itself a reusable result about sums of independent rank-one matrices.

Difficulty

The deterministic part is linear algebra over the pseudoinverse. The obstacle is concentration: the expected Laplacian of HHH equals LLL, but bounding the deviation uniformly over all x∈Rnx\in\mathbb R^nx∈Rn is a statement about the spectral norm of a random matrix, and a union bound over a net of directions costs a factor of nnn in the sample count rather than log⁡n\log nlogn. Scalar Chernoff bounds per cut, which suffice for cut sparsifiers, do not give the spectral statement. Lemma 5 is the matrix inequality that removes this loss, and no inequality of this kind (a concentration bound for the spectral norm of a sum of independent random matrices) is in Mathlib.

Formalization scope

All declarations sit in the namespace EffResSparsify.Sampling.

  • Graphs. A structure WGraph V E with orientation maps head, tail : E → V, weights w : E → ℝ, and the fields head e ≠ tail e (no loops) and 0 < w e. Parallel edges are allowed; nothing in §3 uses simplicity. Connectivity is a separate hypothesis on the underlying simple graph and includes V≠∅V\ne\emptysetV=∅. In Theorem 1 the vertex type is Fin n; the edge type is an arbitrary finite type.
  • Pseudoinverse. L+L^{+}L+ is the matrix of the published Moore–Penrose pseudoinverse HarmonicGames.Decomposition.pinv of x↦Lxx\mapsto Lxx↦Lx on Euclidean RV\mathbb R^VRV; it equals the spectral formula above and is the gauge-fixed inverse, never "some solution of Lx=yLx=yLx=y".
  • Sampling. pep_epe​ is defined as weRe/∑fwfRfw_eR_e/\sum_f w_fR_fwe​Re​/∑f​wf​Rf​; the identity ∑fwfRf=n−1\sum_f w_fR_f=n-1∑f​wf​Rf​=n−1 is part of the proof. An outcome of Sparsify is a sequence in EqE^qEq with probability ∏ipsi\prod_i p_{s_i}∏i​psi​​, and probabilities and expectations are finite sums over EqE^qEq, with no measure theory.
  • Norms and logarithms. ∥⋅∥2\|\cdot\|_2∥⋅∥2​ is the ℓ2\ell_2ℓ2​ operator norm on matrices (Matrix.Norms.L2Operator); vector norms in Lemma 5 are Euclidean; log⁡\loglog is natural (the base is absorbed into CCC).
  • Constants. In Theorem 1, ∃C>0, ∃N0, ∀n≥N0\exists C>0,\ \exists N_0,\ \forall n\ge N_0∃C>0, ∃N0​, ∀n≥N0​ precede the graph and ε\varepsilonε; the sample count is ⌈9C2nlog⁡n/ε2⌉\lceil 9C^2n\log n/\varepsilon^2\rceil⌈9C2nlogn/ε2⌉, rounded up because the printed value is not an integer. In Lemma 5, ∃C>0\exists C>0∃C>0 precedes the dimension, the distribution, MMM and qqq.
  • Corrected statement. Lemma 5 as printed, with right side min⁡(CMlog⁡q/q,1)\min(CM\sqrt{\log q/q},1)min(CMlogq/q​,1), is false (at q=1q=1q=1 the bound is 000). The formal milestone is Rudelson and Vershynin's own Theorem 3.1: q≥2q\ge2q≥2, and the bound a=CMlog⁡q/qa=CM\sqrt{\log q/q}a=CMlogq/q​ holds when a<1a<1a<1. It is stated for finitely supported distributions, which is all Theorem 1 uses. Theorem 1 applies it with a≤ε/2a\le\varepsilon/2a≤ε/2, so the correction does not affect the goal.
  • Not a trivialization. Theorem 1 does not take Lemma 5, a bound on E∥ΠSΠ−Π∥2\mathbb E\|\Pi S\Pi-\Pi\|_2E∥ΠSΠ−Π∥2​, or a free sample count as a hypothesis; a statement with any of these, or with "∃q\exists q∃q" in place of ⌈9C2nlog⁡n/ε2⌉\lceil 9C^2n\log n/\varepsilon^2\rceil⌈9C2nlogn/ε2⌉, is a different theorem.

Reusable beyond this mission: the weighted Laplacian with its pseudoinverse and effective resistances, and Lemma 5, which applies to any sampling scheme for sums of rank-one matrices (leverage-score sampling, column subset selection). Contributions toward a matrix Chernoff or Rudelson-type inequality in Mathlib are welcome.

Selected references

  • D. A. Spielman, N. Srivastava, Graph Sparsification by Effective Resistances, arXiv:0803.0929v4, 2009; SIAM J. Comput. 40(6), 2011. https://arxiv.org/abs/0803.0929, https://doi.org/10.1137/080734029
  • M. Rudelson, R. Vershynin, Sampling from large matrices: an approach through geometric functional analysis, J. ACM 54(4), 2007. https://doi.org/10.1145/1255443.1255449
  • M. Rudelson, Random vectors in the isotropic position, J. Funct. Anal. 164(1), 1999. https://doi.org/10.1006/jfan.1998.3384
  • A. A. Benczúr, D. R. Karger, Approximating s-t minimum cuts in Õ(n²) time, STOC 1996. https://doi.org/10.1145/237814.237827
  • D. A. Spielman, S.-H. Teng, Spectral sparsification of graphs, SIAM J. Comput. 40(4), 2011 (arXiv:0808.4134). https://arxiv.org/abs/0808.4134
  • J. Batson, D. A. Spielman, N. Srivastava, Twice-Ramanujan sparsifiers, SIAM J. Comput. 41(6), 2012 (arXiv:0808.0163). https://arxiv.org/abs/0808.0163
9 thms1 active userReviewed
Graph TheoryLinear algebra·Captain: mikedeng1

Graph Sparsification by Effective Resistances 2: Approximate Laplacian Solves Preserve Effective-Resistance Sketches up to (1±ε)²Research Paper

Motivation

The effective resistance between two vertices of a weighted graph is the voltage difference that appears between them when the graph is viewed as an electrical network, edge weights being conductances, and one unit of current is injected at one vertex and extracted at the other. Effective resistances drive the spectral sparsification algorithm of Spielman and Srivastava (arXiv:0803.0929): sampling each edge with probability proportional to its weight times its effective resistance yields a sparse graph whose Laplacian approximates the original one. They are also used as a distance on graphs in the analysis of social and small-world networks, where they reflect how many short paths connect two vertices.

Computing every effective resistance exactly requires the pseudoinverse of the Laplacian, which costs far more than the size of the graph. Section 4 of the paper shows that all of them can be approximated in nearly linear time: a random projection compresses the relevant vectors to O(log⁡n)O(\log n)O(logn) dimensions, and the projected vectors are obtained from O(log⁡n)O(\log n)O(logn) calls to a fast approximate Laplacian solver (Spielman–Teng). This mission formalizes the deterministic statement that makes this procedure correct, Lemma 9: approximate solves, at a stated accuracy, do not destroy the approximation that the random projection provides.

Setting

Let G=(V,E,w)G=(V,E,w)G=(V,E,w) be a connected, simple, weighted undirected graph with n=∣V∣n=|V|n=∣V∣ vertices, edge set EEE and edge weights we>0w_e>0we​>0. Orient every edge arbitrarily, so that it has a head and a tail. The signed incidence matrix B∈RE×VB\in\mathbb R^{E\times V}B∈RE×V has B(e,v)=1B(e,v)=1B(e,v)=1 if vvv is the head of eee, −1-1−1 if vvv is its tail, and 000 otherwise. With WWW the diagonal matrix of weights, the Laplacian is L=BTWBL=B^{\mathsf T}WBL=BTWB, a symmetric positive semidefinite matrix whose kernel is spanned by the all-ones vector when GGG is connected. Its Moore–Penrose pseudoinverse is L+=∑λi≠0λi−1uiuiTL^+=\sum_{\lambda_i\neq 0}\lambda_i^{-1}u_iu_i^{\mathsf T}L+=∑λi​=0​λi−1​ui​uiT​, where uiu_iui​ are orthonormal eigenvectors of LLL with nonzero eigenvalues λi\lambda_iλi​.

For a vertex uuu let χu\chi_uχu​ be its indicator vector. The effective resistance between uuu and vvv is

Ruv=(χu−χv)TL+(χu−χv),R_{uv}=(\chi_u-\chi_v)^{\mathsf T}L^+(\chi_u-\chi_v),Ruv​=(χu​−χv​)TL+(χu​−χv​),

and Re=RabR_e=R_{ab}Re​=Rab​ for an edge eee with endpoints a,ba,ba,b. The LLL-norm of y∈RVy\in\mathbb R^Vy∈RV is ∥y∥L=yTLy\|y\|_L=\sqrt{y^{\mathsf T}Ly}∥y∥L​=yTLy​. Let wmin⁡w_{\min}wmin​ and wmax⁡w_{\max}wmax​ be the smallest and largest edge weights.

A resistance sketch is a k×nk\times nk×n matrix ZZZ (columns indexed by VVV) with

(1−ε)Ruv≤∥Z(χu−χv)∥2≤(1+ε)Ruvfor all u,v,(1-\varepsilon)R_{uv}\le\|Z(\chi_u-\chi_v)\|^2\le(1+\varepsilon)R_{uv}\quad\text{for all }u,v,(1−ε)Ruv​≤∥Z(χu​−χv​)∥2≤(1+ε)Ruv​for all u,v,

where ∥⋅∥\|\cdot\|∥⋅∥ is the Euclidean norm. In the paper, Z=QW1/2BL+Z=QW^{1/2}BL^+Z=QW1/2BL+ for a random ±1/k\pm1/\sqrt k±1/k​ matrix QQQ with k=O(log⁡n/ε2)k=O(\log n/\varepsilon^2)k=O(logn/ε2), and the Johnson–Lindenstrauss lemma makes it a sketch with high probability. Write ziz_izi​ and z~i\tilde z_iz~i​ for the iii-th rows of ZZZ and of an approximation Z~\widetilde ZZ, as vectors in RV\mathbb R^VRV.

Formalization targets

Goal: Lemma 9 (p. 11)

Let 0<ε<10<\varepsilon<10<ε<1. If ZZZ is a resistance sketch, if every row satisfies

∥zi−z~i∥L≤δ∥zi∥L,(4)\|z_i-\tilde z_i\|_L\le\delta\|z_i\|_L,\tag{4}∥zi​−z~i​∥L​≤δ∥zi​∥L​,(4)

and if

δ≤ε32(1−ε)wmin⁡(1+ε)n3wmax⁡,(5)\delta\le\frac{\varepsilon}{3}\sqrt{\frac{2(1-\varepsilon)w_{\min}}{(1+\varepsilon)n^3w_{\max}}},\tag{5}δ≤3ε​(1+ε)n3wmax​2(1−ε)wmin​​​,(5)

then for every pair u,vu,vu,v

(1−ε)2Ruv≤∥Z~(χu−χv)∥2≤(1+ε)2Ruv.(1-\varepsilon)^2R_{uv}\le\|\widetilde Z(\chi_u-\chi_v)\|^2\le(1+\varepsilon)^2R_{uv}.(1−ε)2Ruv​≤∥Z(χu​−χv​)∥2≤(1+ε)2Ruv​.

The lemma is stated for arbitrary kkk, ZZZ and Z~\widetilde ZZ: nothing about the random projection or the solver enters beyond (4) and the sketch property.

Milestones

  • Trace identity (§3, p. 8): ∑eweRe=n−1\sum_{e}w_eR_e=n-1∑e​we​Re​=n−1 for a connected graph.
  • Proposition 10 (p. 12): Ruv≥2/(nwmax⁡)R_{uv}\ge 2/(nw_{\max})Ruv​≥2/(nwmax​) for distinct vertices u≠vu\neq vu=v of a connected simple graph.

Significance

Lemma 9 is the correctness half of the paper's Theorem 2: together with a Johnson–Lindenstrauss lemma and the Spielman–Teng solver it yields a data structure, built in O~(mlog⁡r/ε2)\widetilde O(m\log r/\varepsilon^2)O(mlogr/ε2) time, that returns any effective resistance to within a factor (1±ε)2(1\pm\varepsilon)^2(1±ε)2 in O(log⁡n/ε2)O(\log n/\varepsilon^2)O(logn/ε2) time. This in turn makes the effective-resistance sampling of the paper's Theorem 1 run in nearly linear time, and the same sketch-and-solve pattern has been reused in later work on Laplacian solvers, graph sparsification and electrical-flow algorithms.

The result is proved in the paper. Formalizing it produces machine-checked statements of three facts that recur throughout spectral graph theory: the trace identity ∑eweRe=n−1\sum_e w_eR_e=n-1∑e​we​Re​=n−1 (Foster's theorem in its weighted form), the lower bound on effective resistances by comparison with the complete graph, and the stability of a resistance sketch under relative LLL-norm errors. Neither Mathlib nor this platform states any of them for the linear-algebraic definition of effective resistance used here.

Difficulty

The hypothesis (4) controls the error row by row, in the LLL-norm on RV\mathbb R^VRV, while the conclusion concerns the columns of Z~\widetilde ZZ applied to χu−χv\chi_u-\chi_vχu​−χv​, in the Euclidean norm on Rk\mathbb R^kRk, and it is a relative bound for every pair at once. A relative bound cannot hold unless RuvR_{uv}Ruv​ is bounded below uniformly over all pairs of distinct vertices, which is where the factors n3n^3n3, wmin⁡w_{\min}wmin​ and wmax⁡w_{\max}wmax​ of (5) come from. Such a lower bound is false for multigraphs, whose parallel edges can make RuvR_{uv}Ruv​ arbitrarily small, and the relation between the LLL-norm of a row and the Euclidean norms of the columns involves every edge of the graph, not only a path between uuu and vvv.

Proposition 10 is classically derived from Rayleigh's monotonicity law. Its standard formal statement on this platform concerns the probabilistic definition of effective resistance through hitting probabilities of a random walk, which is a different definition from (χu−χv)TL+(χu−χv)(\chi_u-\chi_v)^{\mathsf T}L^+(\chi_u-\chi_v)(χu​−χv​)TL+(χu​−χv​); no theorem relating the two is available.

Formalization scope

The graph is a structure WGraph V E over finite types VVV (vertices, n=n=n= Fintype.card V) and EEE (edges), with head, tail : E → V, head e ≠ tail e, weights w : E → ℝ with 0 < w e. Connectivity is that of the underlying simple graph (Mathlib's SimpleGraph.Connected, which includes V≠∅V\neq\emptysetV=∅); simplicity means that no two edges join the same unordered pair. Matrices are Mathlib matrices indexed by EEE and VVV. L+L^+L+ is the published Moore–Penrose pseudoinverse HarmonicGames.Decomposition.pinv of x↦Lxx\mapsto Lxx↦Lx on the Euclidean space RV\mathbb R^VRV, converted back to a matrix; for symmetric LLL this is the spectral pseudoinverse of §2.2. ∥Zx∥2\|Z x\|^2∥Zx∥2 is the sum of squares of the coordinates, not Lean's sup norm. n3n^3n3 is the real number n3n^3n3.

Choices committed to, relative to the page:

  • wmin⁡w_{\min}wmin​, wmax⁡w_{\max}wmax​ are any reals with 0<wmin⁡≤we≤wmax⁡0<w_{\min}\le w_e\le w_{\max}0<wmin​≤we​≤wmax​ for all edges; the exact extremes are an instance, and looser bounds only make (5) and Proposition 10 weaker.
  • ε\varepsilonε is assumed to satisfy 0<ε<10<\varepsilon<10<ε<1; the paper gives no range, and for ε≥1\varepsilon\ge1ε≥1 the square root in (5) has a non-positive argument.
  • The graph is assumed simple in Lemma 9 and Proposition 10. Proposition 10 is false for multigraphs (two parallel unit edges give R=1/2<1=2/(nwmax⁡)R=1/2<1=2/(nw_{\max})R=1/2<1=2/(nwmax​)), and the proof of Lemma 9 uses it.
  • Proposition 10 is stated for u≠vu\neq vu=v. As printed it claims all u,vu,vu,v, which fails at u=vu=vu=v since Ruu=0R_{uu}=0Ruu​=0.
  • The trace identity requires connectivity only.

A trivializing formalization is ruled out: the goal does not assume the intermediate inequality ∣∥Zx∥−∥Z~x∥∣≤(ε/3)∥Zx∥|\|Zx\|-\|\widetilde Zx\||\le(\varepsilon/3)\|Zx\|∣∥Zx∥−∥Zx∥∣≤(ε/3)∥Zx∥ of the proof, nor a stronger condition on δ\deltaδ than (5); its hypotheses are satisfiable (for example Z~=Z\widetilde Z=ZZ=Z with Z=W1/2BL+Z=W^{1/2}BL^+Z=W1/2BL+ and δ=0\delta=0δ=0), and its conclusion is not vacuous for n≥2n\ge2n≥2.

Infrastructure that a complete development needs, and that is reusable beyond this mission: the identity L+LL+=L+L^+LL^+=L^+L+LL+=L+ and LL+LL^+LL+ as the projection onto 1⊥\mathbf 1^\perp1⊥ for a connected Laplacian; the trace identity; Loewner-order monotonicity of RuvR_{uv}Ruv​ in the edge weights; and the effective resistances of the complete graph. Contributions of any of these as separate lemmas are welcome. The random projection (Johnson–Lindenstrauss) and the solver's running time are outside this mission.

Selected references

  • D. A. Spielman, N. Srivastava, Graph Sparsification by Effective Resistances, arXiv:0803.0929v4, 2009; SIAM J. Comput. 40(6), 2011. https://arxiv.org/abs/0803.0929, https://doi.org/10.1137/080734029
  • D. A. Spielman, S.-H. Teng, Nearly-linear time algorithms for preconditioning and solving symmetric, diagonally dominant linear systems, arXiv:cs/0607105. https://arxiv.org/abs/cs/0607105
  • D. Achlioptas, Database-friendly random projections: Johnson–Lindenstrauss with binary coins, J. Comput. Syst. Sci. 66(4), 2003. https://doi.org/10.1016/S0022-0000(03)00025-4
  • P. G. Doyle, J. L. Snell, Random Walks and Electric Networks, MAA, 1984. https://arxiv.org/abs/math/0001057
5 thms1 active userReviewed
Machine LearningProbability·Captain: mikedeng1

What Can We Learn Privately? III: An ε-Local Algorithm Simulates Any t-Query Statistical Query Algorithm from O(t log(t/β) b²/(ε²τ²)) SamplesResearch Paper

Motivation

In the local model of differential privacy, no trusted curator ever sees the raw data: each individual randomizes their own record before handing it to the analyst. This is how private telemetry is collected in practice (randomized response and its descendants), and it raises a basic question: which learning tasks remain possible when the learner only sees locally randomized records?

Kasiviswanathan, Lee, Nissim, Raskhodnikova and Smith answered it in What Can We Learn Privately? (arXiv:0803.0924v3, the accepted version of SIAM J. Comput. 40(3) (2011) 793–826, DOI 10.1137/090756090; theorem numbers below are the arXiv v3's). They showed that local private learning is equivalent, up to polynomial factors, to learning in Kearns' statistical query (SQ) model (Kearns 1998), where an algorithm sees a distribution only through approximate expectations. This mission formalizes one direction of that equivalence: every SQ algorithm can be run by a local algorithm (§5.1.1, Theorem 5.7). The other direction (Lemma 5.8) is a separate mission of this series.

Timeline. Blum, Dwork, McSherry and Nissim (PODS 2005) observed that SQ algorithms can be simulated by a trusted curator adding noise to sums. Dwork, McSherry, Nissim and Smith (TCC 2006) introduced the Laplace mechanism. Kasiviswanathan et al. (FOCS 2008; journal version 2011) showed the simulation works even in the local model, with each record entering a single randomizer.

Setting

A database is a vector z=(z1,…,zn)∈Dnz=(z_1,\dots,z_n)\in D^nz=(z1​,…,zn​)∈Dn; two databases are neighbors if they differ in exactly one entry. A randomized algorithm AAA is ε\varepsilonε-differentially private if Pr⁡[A(z)∈S]≤eεPr⁡[A(z′)∈S]\Pr[A(z)\in S]\le e^{\varepsilon}\Pr[A(z')\in S]Pr[A(z)∈S]≤eεPr[A(z′)∈S] for all neighbors z,z′z,z'z,z′ and all measurable sets SSS of outputs. An ε\varepsilonε-local randomizer is an ε\varepsilonε-differentially private map applied to a single record: Pr⁡[R(u)∈S]≤eεPr⁡[R(u′)∈S]\Pr[R(u)\in S]\le e^{\varepsilon}\Pr[R(u')\in S]Pr[R(u)∈S]≤eεPr[R(u′)∈S] for all u,u′u,u'u,u′.

The Laplace distribution Lap(s)\mathrm{Lap}(s)Lap(s) has density 12se−∣x∣/s\frac1{2s}e^{-|x|/s}2s1​e−∣x∣/s.

An SQ oracle SQPSQ_PSQP​ for a distribution PPP on DDD receives a query g:D→[−b,b]g:D\to[-b,b]g:D→[−b,b] and a tolerance τ\tauτ, and may return any vvv with ∣v−Eu∼P[g(u)]∣≤τ|v-\mathbb E_{u\sim P}[g(u)]|\le\tau∣v−Eu∼P​[g(u)]∣≤τ. An SQ algorithm with ttt queries asks (g0,τ0),…,(gt−1,τt−1)(g_0,\tau_0),\dots,(g_{t-1},\tau_{t-1})(g0​,τ0​),…,(gt−1​,τt−1​), where (gk,τk)(g_k,\tau_k)(gk​,τk​) may depend on the earlier answers a0,…,ak−1a_0,\dots,a_{k-1}a0​,…,ak−1​ (adaptive), and outputs a function of all answers. A vector aaa is a valid transcript against SQPSQ_PSQP​ if every aka_kak​ is within τk\tau_kτk​ of the true mean of the query gkg_kgk​ asked at that point.

For one query ggg, the randomizer Rg(u)=g(u)+ηR_g(u)=g(u)+\etaRg​(u)=g(u)+η with η∼Lap(2b/ε)\eta\sim\mathrm{Lap}(2b/\varepsilon)η∼Lap(2b/ε) is applied to each record, and the local algorithm Ag\mathcal A_gAg​ outputs the average 1n∑i(g(zi)+ηi)\frac1n\sum_i(g(z_i)+\eta_i)n1​∑i​(g(zi​)+ηi​). The simulation of an SQ algorithm answers its kkk-th query gkg_kgk​ by running Agk\mathcal A_{g_k}Agk​​ on the kkk-th block of mmm fresh entries zkm,…,zkm+m−1z_{km},\dots,z_{km+m-1}zkm​,…,zkm+m−1​ and finally outputs what the SQ algorithm outputs on these answers.

Formalization targets

Goal: Theorem 5.7 (local simulation of SQ)

There is an absolute constant c>0c>0c>0 such that, for every SQ algorithm with ttt queries into [−b,b][-b,b][−b,b], and every ε>0\varepsilon>0ε>0; the accuracy claim further takes every tolerance at least τ\tauτ, ε≤1\varepsilon\le1ε≤1, ετ≤4b\varepsilon\tau\le4bετ≤4b and 0<β<10<\beta<10<β<1:

the simulation is ε-differentially private for every block size m and every n≥tm,\text{the simulation is }\varepsilon\text{-differentially private for every block size }m\text{ and every }n\ge tm,the simulation is ε-differentially private for every block size m and every n≥tm, m ≥ c ln⁡(t/β) b2ε2τ2, z∼Pn ⟹ Pr⁡[the simulated answers are a valid transcript against SQP] ≥ 1−β.m\ \ge\ c\,\frac{\ln(t/\beta)\,b^2}{\varepsilon^2\tau^2},\ z\sim P^n\ \Longrightarrow\ \Pr\bigl[\text{the simulated answers are a valid transcript against }SQ_P\bigr]\ \ge\ 1-\beta .m ≥ cε2τ2ln(t/β)b2​, z∼Pn ⟹ Pr[the simulated answers are a valid transcript against SQP​] ≥ 1−β.

On that event the simulation outputs exactly what the SQ algorithm outputs against a valid oracle. The constant is left unspecified, as in the paper.

Milestones

  1. RgR_gRg​ is an ε\varepsilonε-local randomizer; Ag\mathcal A_gAg​ is ε\varepsilonε-differentially private (p. 20).
  2. Hoeffding's bound for the empirical mean of ggg: Pr⁡[∣1n∑g(ui)−v∣≥τ/2]≤2e−τ2n/(8b2)\Pr[|\frac1n\sum g(u_i)-v|\ge\tau/2]\le2e^{-\tau^2n/(8b^2)}Pr[∣n1​∑g(ui​)−v∣≥τ/2]≤2e−τ2n/(8b2).
  3. The average of nnn i.i.d. Lap(2b/ε)\mathrm{Lap}(2b/\varepsilon)Lap(2b/ε) variables lies in [−τ/2,τ/2][-\tau/2,\tau/2][−τ/2,τ/2] with probability at least 1−β/21-\beta/21−β/2 once n≥cln⁡(1/β)b2/(ε2τ2)n\ge c\ln(1/\beta)b^2/(\varepsilon^2\tau^2)n≥cln(1/β)b2/(ε2τ2).
  4. Lemma 5.6: Ag\mathcal A_gAg​ approximates EP[g]\mathbb E_P[g]EP​[g] within ±τ\pm\tau±τ with probability 1−β1-\beta1−β from n≥cln⁡(1/β)b2/(ε2τ2)n\ge c\ln(1/\beta)b^2/(\varepsilon^2\tau^2)n≥cln(1/β)b2/(ε2τ2) samples.

Significance

Theorem 5.7 is the inclusion "SQ ⊆ local" in the paper's characterization of local private learning: every concept class learnable with statistical queries is learnable by an ε\varepsilonε-local algorithm, with sample size growing like tlog⁡(t/β)b2/(ε2τ2)t\log(t/\beta)b^2/(\varepsilon^2\tau^2)tlog(t/β)b2/(ε2τ2). Combined with the converse simulation (Lemma 5.8), it identifies local private learnability with SQ learnability (Theorem 5.14). It thereby transfers the known SQ lower bounds, such as the one for parity, to the local model. It also shows that nonadaptive SQ algorithms become noninteractive local protocols.

The result is proved in the paper; to our knowledge it has no machine-checked proof. A formalization fixes what "the simulation gives the same output" means against an adversarial oracle and an adaptive algorithm. It also supplies reusable Lean objects for local differential privacy, Laplace noise and SQ algorithms.

Difficulty

The privacy half is the easy-looking part, but it is adaptive: the query asked in block kkk depends on the noisy answers from blocks 0,…,k−10,\dots,k-10,…,k−1. A database change in block kkk therefore changes the law of all later answers, not only aka_kak​. The argument must use that every entry enters exactly one randomizer and compose along the adaptive transcript.

The accuracy half has the same adaptivity issue: the union bound over queries needs, for each kkk, the failure probability of block kkk conditioned on everything before it. That is where the fresh blocks and measurability are used. The concentration step for Laplace averages is sub-exponential, not sub-Gaussian. The naive use of the paper's appendix lemma (A.3) fails: it is stated as an equality for every deviation δ>0\delta>0δ>0, but its proof only covers deviations of order the Laplace scale.

Formalization scope

Databases are Fin n → D (0-based). Randomized algorithms are identified with the laws of their outputs (Measure); differential privacy is required on all measurable sets. An SQ algorithm is a deterministic adaptive strategy (SQAlg): a randomized one is a mixture over its coins, to which the result transfers. "At most ttt queries" is "exactly ttt" after padding with dummy queries. Queries are real valued with ∣g∣≤b|g|\le b∣g∣≤b, as the paper allows after Definition 5.4. Block kkk consists of the database indices km,…,km+m−1km,\dots,km+m-1km,…,km+m−1, so the blocks are disjoint by construction, and the simulated answers are a deterministic function of the database and the t×mt\times mt×m noise array. The natural logarithm replaces the paper's base 2, which only changes ccc. Constants are existential and quantified before everything else.

Explicit choices, each recorded in the item that makes it:

  • ετ≤4b\varepsilon\tau\le4bετ≤4b in Lemma 5.6, the Laplace step and Theorem 5.7. Without it the printed statements are false: for ετ/b\varepsilon\tau/bετ/b large a single sample is allowed, and its Laplace noise exceeds τ\tauτ too often.
  • ε≤1\varepsilon\le1ε≤1 in Lemma 5.6 and in the accuracy half of Theorem 5.7 (the privacy half holds for every ε>0\varepsilon>0ε>0). Without it the threshold cln⁡(1/β)b2/(ε2τ2)c\ln(1/\beta)b^2/(\varepsilon^2\tau^2)cln(1/β)b2/(ε2τ2) can be smaller than the sample size needed to estimate E[g]\mathbb E[g]E[g] at all. The paper's own remark about an O(ε−2)O(\varepsilon^{-2})O(ε−2) factor presumes ε=O(1)\varepsilon=O(1)ε=O(1).
  • β≤1/2\beta\le1/2β≤1/2 in the Laplace step, which is false for β\betaβ near 111.
  • Each query is jointly measurable in (earlier answers, record), and the output map is measurable for the privacy claim.
  • "Gives the same output as ASQ\mathcal A_{SQ}ASQ​" is "the simulated answers are a valid transcript against SQPSQ_PSQP​". Accuracy bounds the measure of the failure event by β\betaβ.
  • "Noninteractive if nonadaptive" and "efficient" are not formalized.

A trivializing formalization is ruled out: the oracle is not replaced by the exact expectation, accuracy is required for every query actually asked (not only the first), privacy holds for every database (not only i.i.d. samples), and the constant ccc cannot depend on ttt, β\betaβ, ε\varepsilonε, τ\tauτ, bbb or the algorithm.

Needed infrastructure: the Laplace distribution as a probability measure and its moment generating function, a Hoeffding bound for bounded i.i.d. variables, the Laplace mechanism, and adaptive composition along a transcript. All of these are reusable beyond this mission. Proofs of the milestones, of standalone Laplace and composition lemmas, and of the goal are welcome.

Selected references

  • S. P. Kasiviswanathan, H. K. Lee, K. Nissim, S. Raskhodnikova, A. Smith, What Can We Learn Privately?, SIAM J. Comput. 40(3) (2011) 793–826. arXiv:0803.0924v3, https://arxiv.org/abs/0803.0924 ; DOI https://doi.org/10.1137/090756090
  • M. Kearns, Efficient noise-tolerant learning from statistical queries, J. ACM 45(6) (1998) 983–1006. https://doi.org/10.1145/293347.293351
  • C. Dwork, F. McSherry, K. Nissim, A. Smith, Calibrating noise to sensitivity in private data analysis, TCC 2006, LNCS 3876, 265–284. https://doi.org/10.1007/11681878_14
  • A. Blum, C. Dwork, F. McSherry, K. Nissim, Practical privacy: the SuLQ framework, PODS 2005, 128–138. https://doi.org/10.1145/1065167.1065184
  • W. Hoeffding, Probability inequalities for sums of bounded random variables, J. Amer. Statist. Assoc. 58 (1963) 13–30. https://doi.org/10.1080/01621459.1963.10500830
9 thms1 active userReviewed
🏆Completed
Convex Optimization·Captain: marwahaha

Exponential PSD rank of positively shifted matching matricesOpen Problem

Motivation

Semidefinite representations may be smaller than linear descriptions of a polytope. Lower bounds for their matrix size require a factorization obstruction that applies to arbitrary positive-semidefinite factors. The source manuscript presents the surrounding research claim.

Setting

For even n, columns are perfect matchings of the complete graph. Rows comprise edges and odd vertex subsets. The unshifted slack matrix has edge-incidence entries and odd-cut entries |M∩δ(U)|−1. Its real PSD rank is the least positive r admitting trace products of positive-semidefinite r×r factors.

Formalization target

Prove that every positive real power is eventually exceeded:

∀C>0  ∃n0≥4  ∀ even n≥n0,nC<psdRank⁡(n).\forall C>0\;\exists n_0\ge4\;\forall\text{ even }n\ge n_0,\qquad n^C<\operatorname{psdRank}(n).∀C>0∃n0​≥4∀ even n≥n0​,nC<psdRank(n).

The separate lift target gives the same superpolynomial lower bound for every exact affine PSD lift.

The selected formal target is OAI.PerfectMatchingPSD.main.

Significance and status

The selected formal goal excludes polynomial-size factorizations. The manuscript dated October 5 states exponential bounds for positively shifted matching matrices; that stronger shifted statement is not the existing published target. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

Factors are unrestricted real PSD matrices, with no rank-one or symmetry requirement. Lower bounds for nonnegative rank alone do not rule them out.

Formalization scope

The target concerns the full unshifted row set and uses real exponentiation with C fixed before n₀. The affine-lift companion quantifies over affine sections and affine images of PSD cones. Independent definition groups are retained separately. The description deliberately makes no exponential or positive-shift claim for these references.

Selected references

  • OpenAI, Exponential PSD rank of positively shifted matching matrices, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
39 thms1 active userReviewed
Algebra·Captain: marwahaha

Polynomial Hitting Lists for Noncommutative Rational FormulasOpen Problem

Motivation

Inversion gates create domains of definition as well as nonzero-value conditions. A rational hitting list must find a point where every inverse exists and where the final value is invertible. The source manuscript presents the surrounding research claim.

Setting

A noncommutative rational formula over ℚ has variables, constants, sums, ordered products and inverse gates, with tree-node size. Evaluation is a relation requiring genuine two-sided inverses. Admissible means defined at some positive-dimensional rational matrix tuple; nonzero means one such defined value is nonzero.

Formalization target

Construct one deterministic finite-state Turing machine and positive integers C,k which, on unary n,s≥1, outputs a list H of common positive-dimensional rational tuples with

dim⁡H,∣encode⁡(H)∣,time⁡(H)≤C(n+s+1)k,\dim H,\quad|\operatorname{encode}(H)|,\quad\operatorname{time}(H)\le C(n+s+1)^k,dimH,∣encode(H)∣,time(H)≤C(n+s+1)k,

and every admissible nonzero size-s formula has a defined invertible value at some tuple in H.

The selected formal target is OAI.RationalHitting.main.

Significance and status

The output-length bound controls the full binary representation, including rational entries and all tuples. No separate inverse-depth or coefficient-height parameter is added. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

A tuple detecting one rational expression may encounter a singular inverse in another. Definedness and invertibility must be guaranteed at a list point for every eligible formula.

Formalization scope

Matrices and constants are rational; scalars use the algebra map. The fixed TM0 alphabet and state space, self-delimiting binary output and unary parameter input are explicit. The matrix dimension is shared across the entire list and required positive.

Selected references

  • OpenAI, Polynomial Hitting Lists for Noncommutative Rational Formulas, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
2 thms1 active userReviewed
🏆Completed
Algebra·Captain: marwahaha

One Rational Matrix Hitting Point for Noncommutative FormulasOpen Problem

Motivation

Testing a noncommutative polynomial at scalar points can lose its ordered-word structure. Matrix evaluation preserves noncommutativity and permits a single prescribed tuple to test an entire bounded-size formula class. The source manuscript presents the surrounding research claim.

Setting

A division-free formula has scalar and variable leaves and addition or ordered multiplication gates. Its size counts every tree node. Nonzero means that at least one coefficient of its word series is nonzero. The published generator is an explicit tuple of rational matrices depending only on n and s.

Formalization target

For all n,s≥1, every characteristic-zero field F and every formula f of size at most s, prove

f≠0⟹f(T1,…,Tn)≠0,f\ne0\quad\Longrightarrow\quad f(T_1,\ldots,T_n)\ne0,f=0⟹f(T1​,…,Tn​)=0,

where the rational tuple T is coerced into F and has dimension 2ns², except for the specified one-variable size-one case.

The selected formal target is OAI.NCHitting.universal_hitting.

Significance and status

One tuple is universal for the whole size class and every characteristic-zero coefficient field. The formal goal establishes its hitting property. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

Nonzero word coefficients must survive the same matrix substitution uniformly across all formulas. Choosing a point separately for each f would reverse the required quantifiers.

Formalization scope

Formula coefficients are defined by word convolution; evaluation uses scalar matrices and the explicit rational generator. The theorem asserts nonzero matrix output, not invertibility. The manuscript’s deterministic construction-time claim is not a separate statement in this selected Lean target.

Selected references

  • OpenAI, One Rational Matrix Hitting Point for Noncommutative Formulas, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
27 thms1 active userReviewed
Probability·Captain: marwahaha

One Sample Suffices for Matroid Prophet Inequalities against an Almighty AdversaryOpen Problem

Motivation

Online selection must commit before all values arrive, while the offline optimum sees the full vector. The mission asks how much one independent sample per item can recover under a matroid feasibility constraint. The source manuscript presents the surrounding research claim.

Setting

A matroid on Fin n specifies feasible independent subsets. An online rule sees the full initial sample vector, a finite random seed and the arriving label/value prefix. Sample and value coordinates are jointly independent, corresponding marginals agree, and the seed is independent of all of them.

Formalization target

For every labeled matroid, construct a distribution-independent rule and seed law such that every prefix is feasible and, for every measurable arrival permutation,

E[reward⁡]≥2−310E[OPT⁡].\mathbb E[\operatorname{reward}]\ge2^{-310}\mathbb E[\operatorname{OPT}].E[reward]≥2−310E[OPT].

The arrival order may depend on all samples, all values and the entire seed. Reward integrability is also required.

The selected formal target is OAI.MatroidProphet.one_sample.

Significance and status

The rule and its seed distribution depend only on the known matroid. The allowed adversary is stronger than an order chosen before the values or random seed are revealed. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

Independence of the input coordinates does not imply independence of the adversarial order. The guarantee must survive an order selected with full information while decisions remain irrevocable.

Formalization scope

Values are nonnegative almost surely, and only the actual offline optimum is assumed integrable. The hidden-vector target with ratio 2⁻²⁹³ provides an available supporting milestone. The duplicated one-sample formulation and secretary consequence remain references in their independent source group.

Selected references

  • OpenAI, One Sample Suffices for Matroid Prophet Inequalities against an Almighty Adversary, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
6 thms1 active userReviewed
Linear algebra·Captain: marwahaha

Complex Matrix Multiplication Below 2.258 and Rectangular BoundsOpen Problem

Motivation

Rectangular matrix products arise when the two outer dimensions are much larger than the inner dimension. The dual exponent records the largest inner growth rate compatible with arithmetic exponent two. The source manuscript presents the surrounding research claim.

Setting

For k∈[0,1], ω_ℂ(1,k,1) is the infimum of exponents for multiplying an n×⌈nᵏ⌉ matrix by a ⌈nᵏ⌉×n matrix over ℂ. The dual exponent α is the supremum of k for which this infimum equals two.

Formalization target

Prove the strict bound

αC>93200=0.465.\alpha_{\mathbb C}>\frac{93}{200}=0.465.αC​>20093​=0.465.

The additional published rectangular endpoint asserts ω_ℂ(1,709/1000,1)<523/250=2.092.

The selected formal target is OAI.MatrixMultiplication.complex_alpha_gt_93_div_200.

Significance and status

Strictness is part of both statements. The supplied goal concerns the complex dual exponent; the manuscript title’s square bound and broader field claims are not attached formal targets. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

An algorithm for one size does not establish an asymptotic exponent. The definition quantifies over every positive slack and all positive sizes with one bound constant for each slack.

Formalization scope

Algorithms are division-free arithmetic programs with constants and input gates of cost zero and addition, subtraction and multiplication of cost one. Correctness is quantified over all input matrices. The dual exponent is a real supremum of exact exponent-two shapes, using the prescribed inner-dimension ceiling.

Selected references

  • OpenAI, Complex Matrix Multiplication Below 2.258 and Rectangular Bounds, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
3 thms1 active userReviewed
Mathematical Logic·Captain: wurtle

Weak and strong normalization in pure type systemsResearch Paper

Motivation: does having a normal form imply termination?

Pure type systems (PTSs) are a uniform framework covering the simply typed λ-calculus, System F, the calculus of constructions and the type theories behind proof assistants such as Coq and Lean. A system is specified by its sorts (like ∗\ast∗ and □\square□), axioms (∗:□\ast:\square∗:□) and product rules (which dependent function types may be formed). Normalization is the key metatheoretic property: it underlies logical consistency and decidability of type checking. There are two versions. A term is weakly normalizing if some sequence of β-reductions reaches a normal form, and strongly normalizing if every reduction sequence is finite. Strong normalization is what implementations need (any evaluation strategy terminates) but it is much harder to prove. The Barendregt–Geuvers–Klop conjecture asserts that, for pure type systems, the system-wide weak property already implies the strong one.

Timeline

  • 1989 — Girard's Proofs and Types presents the Tait–Girard reducibility method for strong normalization (book).
  • 1993 — Geuvers states the system-wide conjecture for β and βη reduction in his thesis (Logics and Type Systems, Nijmegen, Conjecture 8.1.2) (thesis).
  • 1997 — Sørensen proves the implication for generalized nondependent, clean, negatable systems via continuation-passing translations (thesis, Copenhagen, Theorem 3.5.20).
  • 2001 — Barthe, Hatcliff and Sørensen prove a uniform nondependent version (TCS 2001).
  • 2006 — Barthe and Coquand show that erasing λ-domain annotations can identify non-convertible terms in non-normalizing PTSs (JFP 2006), a constraint on erasure-based approaches.
  • 2014 — Roux and van Doorn develop a structural theory of PTSs, preserving weak normalization under sums and added rules (RTA–TLCA 2014).
  • 2023 — Mull reduces the conjecture within tiered systems to an irrelevance-eliminating translation (TYPES 2022, LIPIcs 2023) and extends the nondependent results in his thesis (Chicago, 2023).
  • 2025 — Roux proposes internal strong-normalization proofs for specific systems (TYPES 2025 abstract).
  • 2026 — An OpenAI preprint, Weak and strong normalization in pure type systems (OpenAI Math Release, September 25, 2026), claims the β-version of the conjecture for every PTS, with no functionality assumption. The preprint has not been peer reviewed and its theorem is not formally verified.

Setting

A specification consists of a type SSS of sorts, an axiom relation A⊆S2\mathcal A\subseteq S^2A⊆S2 and a rule relation R⊆S3\mathcal R\subseteq S^3R⊆S3; neither is assumed functional. Expressions are

M,N,A,B::=x∣s∣MN∣λx:A. M∣Πx:A. B,s∈S,M,N,A,B ::= x\mid s\mid MN\mid \lambda x{:}A.\,M\mid \Pi x{:}A.\,B,\qquad s\in S,M,N,A,B::=x∣s∣MN∣λx:A.M∣Πx:A.B,s∈S,

up to renaming of bound variables. β-reduction is the compatible closure of (λx:A.M)N→βM[x:=N](\lambda x{:}A.M)N\to_\beta M[x:=N](λx:A.M)N→β​M[x:=N], with steps allowed everywhere, including inside the annotation AAA of a λ and both parts of a Π. Typing Γ⊢M:A\Gamma\vdash M:AΓ⊢M:A is generated by the seven standard PTS rules (axiom, variable, weakening, product, abstraction, application, conversion up to =β=_\beta=β​). A context is valid if each declared type is typed by a sort in the preceding prefix, and MMM is legal in Γ\GammaΓ if Γ⊢M:A\Gamma\vdash M:AΓ⊢M:A or Γ⊢A:M\Gamma\vdash A:MΓ⊢A:M for some AAA.

The system is weakly (strongly) normalizing if every legal expression in every valid context is weakly (strongly) normalizing.

Formalization targets

Goal: β-Barendregt–Geuvers–Klop (Theorem 1)

For every specification P=(S,A,R)\mathcal P=(S,\mathcal A,\mathcal R)P=(S,A,R),

(∀Γ valid, ∀M legal in Γ: M is weakly β-normalizing) ⟹ (∀Γ valid, ∀M legal in Γ: M is strongly β-normalizing).\bigl(\forall \Gamma\ \text{valid},\ \forall M\ \text{legal in }\Gamma:\ M\ \text{is weakly }\beta\text{-normalizing}\bigr) \ \Longrightarrow\ \bigl(\forall \Gamma\ \text{valid},\ \forall M\ \text{legal in }\Gamma:\ M\ \text{is strongly }\beta\text{-normalizing}\bigr).(∀Γ valid, ∀M legal in Γ: M is weakly β-normalizing) ⟹ (∀Γ valid, ∀M legal in Γ: M is strongly β-normalizing).

Both quantifiers range over the whole system; the theorem does not claim that an individual weakly normalizing term is strongly normalizing, and it says nothing about η-reduction. The goal statement is published on the platform with status Open: no machine-checked proof exists yet.

Significance

The result itself. For any PTS, a proof that every legal term has a normal form now yields termination of every β-reduction strategy, including reductions inside types and annotations that may continue after the computational body is normal. Earlier results needed nondependent products, cleanliness, negatability, a tiered sort hierarchy, or a translation requiring extra product rules; the general case — arbitrary sorts and nonfunctional rules — was not covered by any earlier result since Geuvers' 1993 formulation.

Formalizing it. The statement is entirely syntactic and finitary, so it is a natural target for a proof assistant, and the relevant objects (de Bruijn syntax, substitution, typing derivations) are standard formalization material. The proof in the source is long (over 70 pages) and combines reducibility candidates with a fixed-point construction over sort profiles; a machine check would substantially raise confidence. A formal PTS metatheory library (substitution lemmas, confluence, subject reduction) would be reusable for other type-theory formalizations.

Difficulty

The obvious route — reducibility candidates à la Tait–Girard — needs a model of types built by recursion on sorts, which fails for impredicative or nonfunctional specifications where a type can have several sorts and no hierarchy is available. Translation methods (CPS or irrelevance elimination) need specific product rules to preserve typing, which a general specification may lack. Weak normalization of one term cannot be used alone; the argument must exploit normal forms of other open expressions. Annotations add a further complication: erasing them can change the equational theory (Barthe–Coquand), so reduction inside annotations must be tracked rather than erased.

Formalization scope

  • Expressions use de Bruijn indices (Expr S with var, sort, app, lam, pi), so α-equivalence is syntactic; substitution is parallel substitution with lifting.
  • Beta is full compatible closure, including lam_domain, pi_domain and pi_body steps; conversion is Relation.EqvGen Beta.
  • HasType has exactly the seven PTS rules; contexts are lists stored newest-first, each declaration typed in its prefix (ValidContext). Legal includes expressions occurring as types.
  • Weak normalization is reduction to a normal form; strong normalization is accessibility for the converse of Beta.
  • The sort type S is arbitrary (any universe), and axioms and rules are arbitrary relations: no functionality, finiteness or hierarchy assumptions.
  • Needed infrastructure: renaming/substitution lemmas, confluence of β, subject reduction for PTSs, reducibility candidates. All are reusable for any PTS formalization.

Selected references

  • J. H. Geuvers, Logics and Type Systems, PhD thesis, Katholieke Universiteit Nijmegen, 1993. https://www.cs.ru.nl/~herman/PUBS/Proefschrift.pdf
  • J.-Y. Girard, Proofs and Types, Cambridge University Press, 1989. https://www.paultaylor.eu/stable/prot.pdf
  • M. H. B. Sørensen, Normalization in λ-Calculus and Type Theory, PhD thesis, University of Copenhagen, 1997. https://di.ku.dk/forskning/Publikationer/tekniske_rapporter/tekniske-rapporter-1997/97-27.pdf
  • G. Barthe, J. Hatcliff and M. H. Sørensen, Weak normalization implies strong normalization in a class of non-dependent pure type systems, Theoret. Comput. Sci. (2001). https://doi.org/10.1016/S0304-3975(01)00012-3
  • G. Barthe and T. Coquand, Remarks on the equational theory of non-normalizing pure type systems, J. Funct. Programming (2006). https://doi.org/10.1017/S0956796803004726
  • C. Roux and F. van Doorn, The structural theory of pure type systems, RTA–TLCA 2014. https://doi.org/10.1007/978-3-319-08918-8_25
  • N. Mull, An irrelevancy-eliminating translation of pure type systems, TYPES 2022, LIPIcs, 2023. https://doi.org/10.4230/LIPIcs.TYPES.2022.7
  • OpenAI, Weak and strong normalization in pure type systems, OpenAI Math Release preprint, September 25, 2026 (source of the goal; Theorem 1, p. 3). https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Weak-and-strong-normalization-in-pure-type-systems-September-25-2026/paper.pdf
2 thms1 active userReviewed
Complexity TheoryMathematical Logic·Captain: wurtle

Witnessed symmetric choice is strictly stronger than choiceless polynomial time with countingResearch Paper

Motivation

A logic for unordered finite structures (graphs, databases, relational inputs given up to isomorphism) must give answers that do not depend on how the input elements are named. Many polynomial-time algorithms nevertheless make arbitrary intermediate choices, for example the pivot in Gaussian elimination, without changing their final answer. Choiceless polynomial time with counting (CPT), introduced by Blass, Gurevich and Shelah (1999), forbids such choices entirely: it computes with hereditarily finite sets over the input elements and can count, but can never pick one element from a set merely because the set is nonempty.

Witnessed symmetric choice (WSC), in the form of Lichter and Schweitzer (2022, arXiv version 3), adds a controlled form of choice: the logic may pick an element of a set provided it also constructs automorphisms of the input showing that all elements of that set are interchangeable, so the answer cannot depend on which one was picked. Lichter and Schweitzer asked whether CPT + WSC is strictly more expressive than CPT. This mission concerns a proof that it is.

Timeline

  • 1992. Cai, Fürer and Immerman construct graph pairs that hide a global parity obstruction from bounded-variable counting logic (doi:10.1007/BF01305232).
  • 1998. Gire and Hoang introduce a fixpoint logic with a symmetry-based choice construct (doi:10.1006/inco.1998.2712).
  • 1999, 2002. Blass, Gurevich and Shelah introduce choiceless polynomial time and its counting extension, and study CFI and linear-algebra instances (doi:10.1016/S0168-0072(99)00005-6, doi:10.2178/jsl/1190150152).
  • 2003. Dawar and Richerby define a fixed-point logic with symmetric choice, with parameters and nesting (doi:10.1007/978-3-540-45220-1_16).
  • 2008. Dawar, Richerby and Rossman show that preordered CFI queries are CPT-definable, and that bounded-rank CPT fails on them (doi:10.1016/j.apal.2007.11.011).
  • 2014–2021. Abu Zaid, Grädel, Grohe and Pakusa, and Lichter and Schweitzer, obtain CPT canonization for structures with small abelian, dihedral or cyclic colour classes (doi:10.1007/978-3-662-44522-8_5, doi:10.4230/LIPIcs.CSL.2021.31).
  • 2010–2023. Rossman and Pago prove functional lower bounds for CPT (doi:10.1007/978-3-642-15025-8_28, doi:10.4230/LIPIcs.CSL.2021.33, doi:10.4230/LIPIcs.MFCS.2023.73).
  • 2022–2023. Lichter and Schweitzer define CPT + WSC, show that definable isomorphism testing yields canonization, and ask whether WSC strictly adds expressive power (arXiv:2205.14003).

The source of this mission is an OpenAI preprint dated September 24, 2026; its companion preprint (September 23, 2026) proves that CPT does not capture polynomial time.

Setting

Let AAA be a finite set of atoms and HF(A)\mathrm{HF}(A)HF(A) the hereditarily finite sets over AAA. CPT terms are built from variables, ∅\emptyset∅, Atoms\mathrm{Atoms}Atoms, Pair(a,b)={a,b}\mathrm{Pair}(a,b)=\{a,b\}Pair(a,b)={a,b}, Union\mathrm{Union}Union, Unique\mathrm{Unique}Unique (the member of a singleton, else ∅\emptyset∅), Card\mathrm{Card}Card (the von Neumann ordinal ∣a∣|a|∣a∣), comprehensions {s(aˉ,u):u∈t(aˉ), θ(aˉ,u)}\{s(\bar a,u):u\in t(\bar a),\ \theta(\bar a,u)\}{s(aˉ,u):u∈t(aˉ), θ(aˉ,u)} and iteration from ∅\emptyset∅; formulas use input relations, equality and Boolean connectives. A sentence (Φ,p)(\Phi,p)(Φ,p) pairs a closed formula with a polynomial ppp that bounds the number of iteration steps and the hereditary size of all intermediate objects on inputs with nnn atoms; exceeding the bounds yields a default or a failure value †\dagger†.

A WSC operator iterates a step term in which, at each stage, a choice term proposes a nonempty set DDD; one element is chosen, and a witness term must produce automorphisms of the entire input that fix the parameters and all earlier stages and map any element of DDD to any other. If the witnesses are valid along every possible choice sequence, the output formula's value on the terminal state is returned; otherwise the value is †\dagger†.

The true-model class of a sentence is the set of finite structures on which it returns true; false and †\dagger† are both outside it.

Formalization targets

Goal: Theorem 1.1

For the fixed vocabulary τ\tauτ of eight binary relations there is a CPT + WSC sentence (Φ,p)(\Phi,p)(Φ,p) with exactly one WSC occurrence such that

(i) (Φ,p) returns true or false on every finite τ-structure;(ii) TrueModels(Φ,p)≠TrueModels(Ψ,q) for every CPT sentence (Ψ,q).\text{(i)}\ (\Phi,p)\ \text{returns true or false on every finite }\tau\text{-structure;}\qquad \text{(ii)}\ \mathrm{TrueModels}(\Phi,p)\neq\mathrm{TrueModels}(\Psi,q)\ \text{for every CPT sentence }(\Psi,q).(i) (Φ,p) returns true or false on every finite τ-structure;(ii) TrueModels(Φ,p)=TrueModels(Ψ,q) for every CPT sentence (Ψ,q).

The Lean statement OAI.WitnessedChoice.main (via BGS.MainStatement) is open on the platform.

Significance

Since every CPT sentence is a CPT + WSC sentence, Theorem 1.1 gives a strict inclusion of definable Boolean queries and answers the expressiveness question posed by Lichter and Schweitzer in the true-model sense. The separation holds against CPT with counting and sets of arbitrary finite rank, not a rank-restricted fragment. It leaves open whether CPT + WSC captures polynomial time and the effect of nesting WSC operators.

The result is proved in an OpenAI preprint, which has not been peer reviewed. No machine-checked proof exists.

Difficulty

Two different tasks must be done. The upper bound requires a legal WSC definition on all inputs, not only on the intended grid structures: witnesses must be genuine automorphisms of the whole input fixing the full history, which the sentence must check, with a fallback when the input is not of the intended shape. The lower bound must defeat every CPT sentence, including those that build nested sets of large rank; rank-sensitive support arguments (Dawar–Richerby–Rossman) do not suffice. The paper uses a nonabelian automorphism group whose central subgroup has rank-independent small supports, then a counting equivalence and a bounded-width description of complete CPT evaluations.

Formalization scope

  • Syntax is a mutual inductive Term n / Formula n with de Bruijn-style Fin n variables, including iterate and the wsc formula; wscCount counts WSC occurrences.
  • Evaluation returns Option (none is †\dagger†). resource p n = ⌊p(n)⌋ bounds iteration length and transitive-closure size.
  • WSC validity (GoodWSC) quantifies over all choice prefixes; witnesses are permutationGraph g for permutations g that are input automorphisms, fix the free parameters and every earlier stage, and act transitively on the choice set.
  • FiniteInput packs any finite carrier type with the eight-symbol relations (Ed, Cf, EB, VB, I, Z δ, δ : ZMod 3). Sentence.isCPT means wscCount = 0.

A complete development needs hereditarily finite sets with permutation actions, support and counting-equivalence theory, and the grid structures; much of this is shared with the companion CPT noncapture mission. Contributions formalizing Proposition 4.4 (a total all-input definition), Proposition 5.3 (transitivity for every parameter tree), Theorem 5.5 (opposite grid answers), Proposition 6.3 (small-orbit support bound), Theorem 8.1 (transfer through small supports) and Theorem 9.3 (eventual equality for every CPT sentence) are welcome.

Selected references

  • OpenAI, Witnessed symmetric choice is strictly stronger than choiceless polynomial time with counting, preprint, September 24, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Witnessed-symmetric-choice-is-strictly-stronger-than-choiceless-polynomial-time-with-counting-September-24-2026/paper.pdf
  • OpenAI, Choiceless polynomial time with counting does not capture polynomial time, preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Choiceless-polynomial-time-with-counting-does-not-capture-polynomial-time-September-23-2026/paper.pdf
  • M. Lichter, P. Schweitzer, Choiceless polynomial time with witnessed symmetric choice, 2023 (arXiv v3). https://arxiv.org/abs/2205.14003
  • A. Blass, Y. Gurevich, S. Shelah, Choiceless polynomial time, Ann. Pure Appl. Logic, 1999. https://doi.org/10.1016/S0168-0072(99)00005-6
  • A. Blass, Y. Gurevich, S. Shelah, On polynomial time computation over unordered structures, J. Symbolic Logic, 2002. https://doi.org/10.2178/jsl/1190150152
  • A. Dawar, D. Richerby, B. Rossman, Choiceless polynomial time, counting and the Cai–Fürer–Immerman graphs, Ann. Pure Appl. Logic, 2008. https://doi.org/10.1016/j.apal.2007.11.011
  • J.-Y. Cai, M. Fürer, N. Immerman, An optimal lower bound on the number of variables for graph identification, Combinatorica, 1992. https://doi.org/10.1007/BF01305232
  • F. Gire, H. K. Hoang, An extension of fixpoint logic with a symmetry-based choice construct, Inform. and Comput., 1998. https://doi.org/10.1006/inco.1998.2712
  • A. Dawar, D. Richerby, A fixed-point logic with symmetric choice, CSL, 2003. https://doi.org/10.1007/978-3-540-45220-1_16
2 thms1 active userReviewed
Complexity TheoryMathematical Logic·Captain: wurtle

Choiceless polynomial time with counting does not capture polynomial timeResearch Paper

Motivation

Descriptive complexity asks whether complexity classes can be characterized by logics, without reference to machines. Immerman and Vardi (1982) showed that on ordered finite structures, first-order logic with a least fixed-point operator expresses exactly the polynomial-time queries. On unordered structures, such as graphs given only up to isomorphism, an algorithm must not depend on an arbitrary ordering of the input, and whether some logic captures polynomial time there is a central open question (Chandra–Harel 1982, Gurevich 1988).

Choiceless polynomial time with counting (CPT), introduced by Blass, Gurevich and Shelah (1999), was for decades the strongest candidate: it computes with hereditarily finite sets built over the input elements, can count, and is invariant under automorphisms by construction. Blass, Gurevich and Shelah conjectured that CPT is still a proper fragment of polynomial time. This mission concerns a proof of that conjecture.

Timeline

  • 1982. Immerman and Vardi capture polynomial time on ordered structures by fixed-point logic (doi:10.1145/800070.802187, doi:10.1145/800070.802186); Chandra and Harel raise the unordered question (doi:10.1016/0022-0000(82)90012-5).
  • 1988. Gurevich formulates the question of a logic capturing polynomial time and conjectures that none exists.
  • 1992. Cai, Fürer and Immerman construct polynomial-time graph queries beyond fixed-point logic with counting (doi:10.1007/BF01305232).
  • 1999, 2002. Blass, Gurevich and Shelah introduce choiceless polynomial time and study CFI and linear-algebra instances as potential separating examples (doi:10.1016/S0168-0072(99)00005-6, doi:10.2178/jsl/1190150152).
  • 2000. Shelah claims noncapture for counting extensions; later accounts continue to list the problem as open.
  • 2008. Dawar, Richerby and Rossman show that CFI queries over ordered base graphs are CPT-definable, and that bounded-rank CPT with counting fails on them (doi:10.1016/j.apal.2007.11.011).
  • 2010–2023. Rossman and Pago prove functional lower bounds for CPT (no construction of hyperplanes, no fine preorders on hypercubes) (doi:10.1007/978-3-642-15025-8_28, doi:10.4230/LIPIcs.CSL.2021.33); Grädel, Pakusa, Schalthöfer and Kaiser characterize CPT by iterated first-order interpretations (doi:10.1109/LICS.2015.68).
  • 2025. Dawar, Grädel, Kullmann and Pago still record the capture problem as open (doi:10.4230/LIPIcs.MFCS.2025.40).

The source of this mission is an OpenAI preprint dated September 23, 2026.

Setting

Fix the field F=F3\mathbb F=\mathbb F_3F=F3​ and the vocabulary of eight binary relation symbols τ={Ed,Cf,EB,VB,I,Z0,Z1,Z2}\tau=\{\mathrm{Ed},\mathrm{Cf},\mathrm{EB},\mathrm{VB},I,Z_0,Z_1,Z_2\}τ={Ed,Cf,EB,VB,I,Z0​,Z1​,Z2​}. For a finite τ\tauτ-structure AAA put

Y={y:Ed(y,y)},X={a:Cf(a,a)},Xt={a∈X:VB(t,a)} (t∈X),Y=\{y:\mathrm{Ed}(y,y)\},\quad X=\{a:\mathrm{Cf}(a,a)\},\quad X_t=\{a\in X:\mathrm{VB}(t,a)\}\ (t\in X),Y={y:Ed(y,y)},X={a:Cf(a,a)},Xt​={a∈X:VB(t,a)} (t∈X), C(y,a)=∑x∈Y, I(a,x) ∑δ∈F, Zδ(y,x)δ.C(y,a)=\sum_{x\in Y,\ I(a,x)}\ \sum_{\delta\in\mathbb F,\ Z_\delta(y,x)}\delta .C(y,a)=x∈Y, I(a,x)∑​ δ∈F, Zδ​(y,x)∑​δ.

With unknowns (λa)a∈X(\lambda_a)_{a\in X}(λa​)a∈X​ and (μy)y∈Y(\mu_y)_{y\in Y}(μy​)y∈Y​ (separate families), the system consists of

∑a∈Xtλa=1(t∈X),μy=∑a∈Xtλa C(y,a)\sum_{a\in X_t}\lambda_a=1\quad(t\in X),\qquad \mu_y=\sum_{a\in X_t}\lambda_a\,C(y,a)a∈Xt​∑​λa​=1(t∈X),μy​=a∈Xt​∑​λa​C(y,a)

for every (t,y)∈X×Y(t,y)\in X\times Y(t,y)∈X×Y such that some a∈Xta\in X_ta∈Xt​ and x∈Yx\in Yx∈Y satisfy I(a,x)I(a,x)I(a,x) and EB(y,x)\mathrm{EB}(y,x)EB(y,x). The query Q(A)Q(A)Q(A) says this system is consistent over F3\mathbb F_3F3​. No promise is imposed on the input.

A CPT program is a fixed finite set of rules that updates dynamic functions whose values are hereditarily finite sets over the atoms of AAA, using pairing, union, comprehension, equality, membership, the input relations, and the cardinality operation (which returns a von Neumann ordinal). A program defines QQQ if for fixed polynomials T,ST,ST,S, on every input of size nnn it halts within T(n)T(n)T(n) steps, touches at most S(n)S(n)S(n) hereditarily finite objects, and accepts exactly when Q(A)Q(A)Q(A) holds. No bound on set rank is imposed.

Formalization targets

Goal: Theorem 1

Q is isomorphism-invariant,Q∈P (from an ordered encoding),Q∉CPT.Q\ \text{is isomorphism-invariant},\qquad Q\in\mathrm{P}\ \text{(from an ordered encoding)},\qquad Q\notin\mathrm{CPT}.Q is isomorphism-invariant,Q∈P (from an ordered encoding),Q∈/CPT.

The Lean statement OAI.CPTSeparation.main is the conjunction of these three clauses. It is open on the platform.

Significance

The theorem confirms the Blass–Gurevich–Shelah noncapture conjecture for the full counting formalism: CPT does not capture polynomial time on unordered structures. It removes the leading candidate logic from Gurevich's question, which itself remains open. Because QQQ is expressible in fixed-point logic with a solvability or rank operator over F3\mathbb F_3F3​ (Corollary 3, p. 3), it also shows that neither of those logics is contained in CPT. The lower bound holds for programs of arbitrary set rank, unlike the bounded-rank lower bounds of Dawar–Richerby–Rossman.

The result is proved in an OpenAI preprint, which has not been peer reviewed. No machine-checked proof exists.

Difficulty

The polynomial-time upper bound is Gaussian elimination. The obstacle is the lower bound against every CPT program, including those that build sets of unbounded rank. Bounded-variable counting games handle fixed-point logic with counting but do not by themselves control CPT, which is strictly stronger (it decides CFI queries over ordered base graphs). Rank-dependent support arguments give lower bounds only for each fixed rank. The paper needs support bounds independent of rank, for which it uses a nonabelian automorphism group acting on grid structures, then a counting equivalence for all supported objects, and finally a transfer to complete computations via an interpretation characterization of CPT.

Formalization scope

  • Input A gives a Boolean-valued binary relation for each Symbol (Ed, Cf, EB, VB, I, Z δ with δ : ZMod 3). Input.query is the existence of λ, μ satisfying the normalization and consistency equations exactly as above; an empty system is consistent.
  • OrdinaryPolynomialTime asks for a function on ordered tables and a Turing.TM2ComputableInPolyTime machine with finite alphabets computing it from the cell-by-cell table encoding, agreeing with the query for every ordering of every structure.
  • FullCPT defines terms and rules over hereditarily finite sets (Lists quotient), a state of finitely many nonempty locations, synchronous consistent updates, halt/accept flags, and the set of occurring objects (active elements plus roots of evaluated terms). EvaluationDefinable Q asks for one program and polynomials time, space that accept exactly the inputs satisfying Q, halting within time and with at most space occurring objects.
  • This is the original operational formulation; the paper's proof passes through the interpretation characterization of CPT (Grädel–Pakusa–Schalthöfer–Kaiser), which a formal proof must either formalize or bypass.

A complete development needs: hereditarily finite sets and automorphism actions on them, support theory, counting equivalence games, the grid structures with their automorphism group, and a CPT-to-interpretation translation. Contributions formalizing Proposition 2 (polynomial-time decidability), Proposition 8 (small-orbit support bound), Proposition 13 (quantitative homogeneity) and Theorem 14 (transfer through small supports) are welcome.

Selected references

  • OpenAI, Choiceless polynomial time with counting does not capture polynomial time, preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Choiceless-polynomial-time-with-counting-does-not-capture-polynomial-time-September-23-2026/paper.pdf
  • A. Blass, Y. Gurevich, S. Shelah, Choiceless polynomial time, Ann. Pure Appl. Logic, 1999. https://doi.org/10.1016/S0168-0072(99)00005-6
  • A. Blass, Y. Gurevich, S. Shelah, On polynomial time computation over unordered structures, J. Symbolic Logic, 2002. https://doi.org/10.2178/jsl/1190150152
  • J.-Y. Cai, M. Fürer, N. Immerman, An optimal lower bound on the number of variables for graph identification, Combinatorica, 1992. https://doi.org/10.1007/BF01305232
  • A. Dawar, D. Richerby, B. Rossman, Choiceless polynomial time, counting and the Cai–Fürer–Immerman graphs, Ann. Pure Appl. Logic, 2008. https://doi.org/10.1016/j.apal.2007.11.011
  • E. Grädel, W. Pakusa, S. Schalthöfer, Ł. Kaiser, Characterising choiceless polynomial time with first-order interpretations, LICS, 2015. https://doi.org/10.1109/LICS.2015.68
  • B. Rossman, Choiceless computation and symmetry, 2010. https://doi.org/10.1007/978-3-642-15025-8_28
  • B. Pago, Choiceless computation and symmetry: limitations of definability, CSL, 2021. https://doi.org/10.4230/LIPIcs.CSL.2021.33
  • N. Immerman, Relational queries computable in polynomial time, STOC, 1982. https://doi.org/10.1145/800070.802187
  • A. K. Chandra, D. Harel, Structure and complexity of relational queries, J. Comput. System Sci., 1982. https://doi.org/10.1016/0022-0000(82)90012-5
2 thms1 active userReviewed
Combinatorics·Captain: wurtle

Polynomial removal fails for ordered binary matricesResearch Paper

Motivation: removal lemmas and property testing for ordered matrices

A removal lemma says that an object far from having a forbidden substructure must contain many copies of it. Such statements are the combinatorial backbone of property testing: if every matrix that is ϵ\epsilonϵ-far from avoiding a pattern HHH contains at least cHϵCHn2kc_H\epsilon^{C_H}n^{2k}cH​ϵCH​n2k copies of HHH, then sampling a number of rows and columns polynomial in 1/ϵ1/\epsilon1/ϵ detects the pattern with constant probability. Whether removal bounds are polynomial determines whether testers are efficient. For binary matrices whose rows and columns carry a fixed order, qualitative removal is known, and the polynomial version was conjectured.

Timeline

  • 2007 — Alon, Fischer and Newman prove polynomial-query testing for fixed finite forbidden families of binary matrices when row and column order is ignored, and raise the ordered question (SIAM J. Comput. 2007, §7).
  • 2007 — Fischer and Rozenberg obtain nonpolynomial lower bounds for a fixed 2×22\times22×2 pattern in ternary host matrices, order ignored (APPROX–RANDOM 2007).
  • 2017 — Alon, Ben-Eliezer and Fischer establish qualitative removal for ordered graphs and matrices: a positive copy density exists for each fixed positive distance (FOCS 2017).
  • 2020 — Alon and Ben-Eliezer prove polynomial removal for families closed under row (or column) permutations and polynomial bounds for many entry-disjoint copies, and pose the polynomial removal question for finite families of ordered binary matrices (Problem 1.4) (Order 2020).
  • 2022 — Gishboliner and Tomon classify polynomial induced removal for ordered graphs, a different single-order symmetric model (Combinatorial Theory 2022).
  • 2025 — The singleton version appears as Conjecture 4.5 in the survey of Gishboliner and Shapira (Comput. Sci. Rev. 2025).
  • 2026 — An OpenAI preprint, Polynomial removal fails for ordered binary matrices (OpenAI Math Release, September 25, 2026), claims a fixed 66×6666\times6666×66 binary pattern for which no polynomial removal bound holds. The preprint has not been peer reviewed and its theorem is not formally verified.

Setting

A binary matrix of order nnn is a map A:[n]×[n]→{0,1}A:[n]\times[n]\to\{0,1\}A:[n]×[n]→{0,1} (in Lean BinaryMatrix n := Fin n → Fin n → Bool). For a k×kk\times kk×k binary pattern HHH, an ordered copy of HHH in AAA is a pair of strictly increasing maps r,c:[k]→[n]r,c:[k]\to[n]r,c:[k]→[n] with A(ri,cj)=H(i,j)A(r_i,c_j)=H(i,j)A(ri​,cj​)=H(i,j) for all i,ji,ji,j: zeros must match as well as ones, and rows and columns are chosen independently. NH(A)N_H(A)NH​(A) is the number of ordered copies, and AAA is HHH-free if NH(A)=0N_H(A)=0NH​(A)=0. The normalized distance to HHH-freeness is

dist⁡H(A)=1n2min⁡B H-free∣{(r,c):A(r,c)≠B(r,c)}∣,\operatorname{dist}_H(A)=\frac1{n^2}\min_{B\ H\text{-free}}\bigl|\{(r,c):A(r,c)\neq B(r,c)\}\bigr|,distH​(A)=n21​B H-freemin​​{(r,c):A(r,c)=B(r,c)}​,

where every cell may be changed in either direction.

The polynomial ordered binary matrix-removal conjecture asserts that for each fixed HHH there are cH,CH>0c_H,C_H>0cH​,CH​>0 such that NH(A)≥cHϵCHn2kN_H(A)\ge c_H\epsilon^{C_H}n^{2k}NH​(A)≥cH​ϵCH​n2k whenever dist⁡H(A)≥ϵ\operatorname{dist}_H(A)\ge\epsilondistH​(A)≥ϵ, for all n≥1n\ge1n≥1 and 0<ϵ<10<\epsilon<10<ϵ<1.

The pattern HHH is explicit: with s=64s=64s=64 and ηb(a)=⌊a/25−b⌋ mod 2\eta_b(a)=\lfloor a/2^{5-b}\rfloor\bmod 2ηb​(a)=⌊a/25−b⌋mod2, the 64×6464\times6464×64 anchor SSS has S(u,v)=ηv−59(u−33)S(u,v)=\eta_{v-59}(u-33)S(u,v)=ηv−59​(u−33) for 33≤u≤6433\le u\le 6433≤u≤64, 60≤v≤6460\le v\le 6460≤v≤64, and S(u,v)=1[u≠v]S(u,v)=\mathbf 1[u\neq v]S(u,v)=1[u=v] otherwise, and

H=(Se1e2e1T10e2T11)∈{0,1}66×66.H=\begin{pmatrix} S & e_1 & e_2\\ e_1^{\mathsf T} & 1 & 0\\ e_2^{\mathsf T} & 1 & 1\end{pmatrix}\in\{0,1\}^{66\times66}.H=​Se1T​e2T​​e1​11​e2​01​​∈{0,1}66×66.

Formalization targets

Goal: no polynomial removal bound for HHH

For every c,C>0c,C>0c,C>0 there exist n≥1n\ge1n≥1, ϵ∈(0,1)\epsilon\in(0,1)ϵ∈(0,1) and a binary n×nn\times nn×n matrix AAA with

dist⁡H(A)≥ϵandNH(A)<c ϵC n132.\operatorname{dist}_H(A)\ge\epsilon\qquad\text{and}\qquad N_H(A)<c\,\epsilon^{C}\,n^{132}.distH​(A)≥ϵandNH​(A)<cϵCn132.

This is the "consequently" clause of Theorem 1.1 of the source, i.e. the negation of the conjecture for this fixed HHH (here 2k=1322k=1322k=132). The source proves more: for every h≥1h\ge1h≥1, with nh=(386h+2)2hn_h=(386h+2)2^hnh​=(386h+2)2h and ϵh=(386h+2)−2\epsilon_h=(386h+2)^{-2}ϵh​=(386h+2)−2, an explicit AhA_hAh​ has dist⁡H(Ah)≥ϵh\operatorname{dist}_H(A_h)\ge\epsilon_hdistH​(Ah​)≥ϵh​ and NH(Ah)≤ϵh2−hnh132N_H(A_h)\le\epsilon_h2^{-h}n_h^{132}NH​(Ah​)≤ϵh​2−hnh132​. The goal statement is published on the platform with status Open: no machine-checked proof exists yet.

Significance

The result itself. A single explicit pattern shows that ordered binary matrix removal can be super-polynomial, answering the finite-family question of Alon and Ben-Eliezer negatively and disproving the singleton conjecture recorded by Gishboliner and Shapira. It also gives a testing lower bound (Corollary 5.1): a canonical row–column sampler needs q≥exp⁡(Ω(ϵh−1/2))q\ge\exp(\Omega(\epsilon_h^{-1/2}))q≥exp(Ω(ϵh−1/2​)) sampled positions per axis on these examples. Earlier non-polynomial examples needed a third symbol in the host; here the host is binary. The example separates hitting all existing copies (a set of 2h2^h2h cells meets them) from repairing the matrix (at least 4h4^h4h edits are needed).

Formalizing it. The statement is fully finite and explicit, so a formal proof would certify both the construction and the two counting estimates. The construction is intricate (tree-indexed blocks with interleaved orders, a 66-cell pattern), which is exactly where a machine check adds confidence.

Difficulty

Two estimates pull in opposite directions. The distance bound must hold against every binary repair, including repairs that create new copies elsewhere; the obvious argument — delete one cell per copy — fails because changing cells can create copies, and the source must show any repair needs at least m2m^2m2 edits. The copy bound requires locating every ordered copy of the 66-cell pattern in the unedited host, not only the designated anchors, which forces a rigidity analysis of how the anchor SSS can embed.

Formalization scope

  • Matrices are Fin n → Fin n → Bool; ordered copies are pairs of StrictMono maps Fin k → Fin n, counted by copyCount. fixedH : BinaryMatrix 66 encodes HHH with 0-based indices (the anchor rule becomes etaBit (u-32) (v-58) for 32≤u32\le u32≤u, 59≤v59\le v59≤v).
  • fixedMinEdits A is the minimum Hamming distance from AAA to an HHH-free matrix (the all-zero matrix is HHH-free, so the minimum is attained by a genuine matrix, and the sentinel n2+1n^2+1n2+1 is never selected); fixedDistance divides by n2n^2n2.
  • The bound c ϵCn132c\,\epsilon^C n^{132}cϵCn132 uses Real.rpow; c,Cc,Cc,C are arbitrary positive reals, and n,ϵ,An,\epsilon,An,ϵ,A are existentially chosen, so the statement is exactly the failure of the conjectured inequality for this HHH. It is weaker than the explicit quantitative family of Theorem 1.1; a stronger milestone recording nh,ϵhn_h,\epsilon_hnh​,ϵh​ and the bound ϵh2−h\epsilon_h2^{-h}ϵh​2−h would be welcome.
  • Needed infrastructure: the explicit tree matrices AhA_hAh​, counting of ordered copies, and a lower bound for Hamming distance to HHH-freeness.

Selected references

  • N. Alon, E. Fischer and I. Newman, Efficient testing of bipartite graphs for forbidden induced subgraphs, SIAM J. Comput. (2007). https://doi.org/10.1137/050627915
  • E. Fischer and E. Rozenberg, Lower bounds for testing forbidden induced substructures in bipartite-graph-like combinatorial objects, APPROX–RANDOM 2007. https://doi.org/10.1007/978-3-540-74208-1_34
  • N. Alon, O. Ben-Eliezer and E. Fischer, Testing hereditary properties of ordered graphs and matrices, FOCS 2017. https://doi.org/10.1109/FOCS.2017.83
  • N. Alon and O. Ben-Eliezer, Efficient removal lemmas for matrices, Order (2020). https://doi.org/10.1007/s11083-019-09494-3
  • L. Gishboliner and I. Tomon, Polynomial removal lemmas for ordered graphs, Combinatorial Theory (2022). https://doi.org/10.5070/C62359151
  • L. Gishboliner and A. Shapira, Polynomial property testing, Computer Science Review (2025). https://doi.org/10.1016/j.cosrev.2025.100806
  • OpenAI, Polynomial removal fails for ordered binary matrices, OpenAI Math Release preprint, September 25, 2026 (source of the goal; Theorem 1.1, p. 1). https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Polynomial-removal-fails-for-ordered-binary-matrices-September-25-2026/paper.pdf
2 thms1 active userReviewed
CombinatoricsGraph Theory·Captain: wurtle

A polynomial-time construction of strong thin treesResearch Paper

Motivation

A thin spanning tree of a graph is a spanning tree that uses only a small fraction of the edges of every cut. Thin trees were introduced for the asymmetric traveling salesman problem: Asadpour, Goemans, Mądry, Oveis Gharan and Saberi showed that a thin tree of low cost can be augmented into a cheap tour, giving an O(log⁡n/log⁡log⁡n)O(\log n/\log\log n)O(logn/loglogn)-approximation (doi:10.1287/opre.2017.1603). Goddyn conjectured that high edge connectivity forces thin trees; the strong thin tree conjecture asks for thinness C/kC/kC/k in every kkk-edge-connected multigraph. For applications one wants not just existence but an efficient algorithm that finds such a tree, also when parallel-edge multiplicities are huge and written in binary.

Background. The maximum-entropy rounding of Asadpour et al. constructs O(log⁡n/(klog⁡log⁡n))O(\log n/(k\log\log n))O(logn/(kloglogn))-thin trees. Oveis Gharan and Saberi constructed O(1/k)O(1/k)O(1/k)-thin trees on planar and bounded-genus graphs (2011, doi:10.1137/1.9781611973082.75). Anari and Oveis Gharan proved existence of poly(log⁡log⁡n)/k\mathrm{poly}(\log\log n)/kpoly(loglogn)/k-thin trees in general (2015, arXiv:1411.4613), without a polynomial-time construction. Klein and Olver (2023, doi:10.1109/FOCS57990.2023.00011) and Klein, Olver and Yeoh (2026, doi:10.4230/LIPIcs.ICALP.2026.129) handled laminar families and near-minimum cuts. A companion OpenAI preprint claims the existence statement of the strong conjecture.

The source of this mission, an OpenAI preprint dated September 23, 2026, claims a deterministic polynomial-time construction.

Setting

Graphs are finite undirected loopless multigraphs; parallel copies count separately. For ∅≠S⊊V(G)\varnothing\ne S\subsetneq V(G)∅=S⊊V(G), δG(S)\delta_G(S)δG​(S) is the multiset of edges with exactly one endpoint in SSS, and GGG is kkk-edge-connected if ∣δG(S)∣≥k|\delta_G(S)|\ge k∣δG​(S)∣≥k for every such SSS. A spanning tree TTT is α\alphaα-thin if ∣δT(S)∣≤α∣δG(S)∣|\delta_T(S)|\le\alpha|\delta_G(S)|∣δT​(S)∣≤α∣δG​(S)∣ for all such SSS. Two input formats are allowed: an explicit list of labelled edge copies, or a list of endpoint pairs with multiplicities written in binary (so the number of edges can be exponential in the input length). Running time is measured in the total binary input length.

Formalization targets

Goal: Theorem 1.1 (algorithmic strong thin trees)

There is an absolute constant CCC and a deterministic algorithm that, given k≥1k\ge1k≥1 and a kkk-edge-connected multigraph GGG on at least one vertex (in either format), returns in time polynomial in the input length a spanning tree TTT with

∣δT(S)∣≤Ck ∣δG(S)∣(∅≠S⊊V(G)),|\delta_T(S)|\le\frac Ck\,|\delta_G(S)|\qquad(\varnothing\ne S\subsetneq V(G)),∣δT​(S)∣≤kC​∣δG​(S)∣(∅=S⊊V(G)),

returning the empty tree for a one-vertex graph. Lean: OAI.AlgorithmicThinTrees.algorithmic_strong_thin_trees, open on the platform.

Significance

The theorem would give an algorithmic resolution of the strong thin tree conjecture: not only do C/kC/kC/k-thin trees exist, they can be found deterministically in polynomial time, even for exponentially many parallel edges. It also yields simultaneous cost-and-cut rounding (Corollary 7.1): from a fractional point whose mass on every cut is at least one, a tree in its support with every cut load and total cost within constant factors, with no metric assumption on costs. The order 1/k1/k1/k is optimal. The result is claimed in an OpenAI preprint that has not been peer reviewed; no machine-checked proof exists.

Difficulty

Existence proofs for thin trees go through the Marcus–Spielman–Srivastava interlacing-families theorem and a fixed-point argument, neither of which is constructive: they show that some choice works without locating it. The algorithm must replace these by explicit, rational, polynomially sized computations (checked signings, rational positive semidefinite decompositions, bounded denominators) and must work with binary multiplicities, where even listing the edges is exponential. Certifying thinness on all exponentially many cuts must also be done without enumerating them.

Formalization scope

  • Graphs: StrongThinTree.MultiGraph n m (vertices Fin n, edges Fin m, loopless). Inputs are ExplicitInput or BinaryInput (ordered, distinct endpoint pairs with multiplicities); a binary input's edge copies are Σ i, Fin (multiplicity i).
  • Valid x: n≥1n\ge1n≥1, k≥1k\ge1k≥1 and EdgeConnected k.
  • The machine model is CurrentKS.Machine: a deterministic machine with finitely many binary stacks and a finite instruction table, run for a fuel bound. Inputs and outputs are self-delimiting binary encodings (CurrentKS.encodeNat).
  • AlgorithmicStrongThinTrees: ∃ C > 0, ∃ M a degree, 0 < a ∧ ∀ x, Valid x → after a * (len + 1)^degree steps M has halted and its output stack encodes a duplicate-free edge list forming a ThinTree C k; for n=1n=1n=1 the output is empty.
  • One machine and one polynomial serve all inputs in both formats.

Needed infrastructure: the existence theory of the companion mission, a model of deterministic computation with polynomial-time bounds, exact rational linear algebra, and constructive spectral sparsification. Contributions formalizing Proposition 2.5, Proposition 3.1, Lemma 6.1, Theorem A.1 (rational rank-one signing) or Corollary 7.1 are welcome.

Selected references

  • OpenAI, A polynomial-time construction of strong thin trees, preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/A-polynomial-time-construction-of-strong-thin-trees-September-23-2026/paper.pdf
  • OpenAI, The strong thin tree conjecture, preprint, September 23, 2026.
  • A. Asadpour, M. X. Goemans, A. Mądry, S. Oveis Gharan, A. Saberi, An O(log n/log log n)-approximation algorithm for the asymmetric traveling salesman problem, Oper. Res., 2017. https://doi.org/10.1287/opre.2017.1603
  • N. Anari, S. Oveis Gharan, Effective-resistance-reducing flows, spectrally thin trees, and asymmetric TSP, FOCS, 2015. https://arxiv.org/abs/1411.4613
  • S. Oveis Gharan, A. Saberi, The asymmetric traveling salesman problem on graphs with bounded genus, SODA, 2011. https://doi.org/10.1137/1.9781611973082.75
  • N. Klein, N. Olver, Thin trees for laminar families, FOCS, 2023. https://doi.org/10.1109/FOCS57990.2023.00011
  • N. Klein, N. Olver, Z. S. Yeoh, Thin trees for near minimum cuts, ICALP, 2026. https://doi.org/10.4230/LIPIcs.ICALP.2026.129
  • O. Svensson, J. Tarnawski, L. A. Végh, A constant-factor approximation algorithm for the asymmetric traveling salesman problem, J. ACM, 2020. https://doi.org/10.1145/3424306
2 thms1 active userReviewed
CombinatoricsGraph Theory·Captain: wurtle

The strong thin tree conjectureResearch Paper

Motivation

A spanning tree keeps a graph connected with as few edges as possible. A spanning tree is thin if, in addition, it uses only a small fraction of the edges of every cut. Thin trees were introduced as a tool for the asymmetric traveling salesman problem (ATSP): Asadpour, Goemans, Mądry, Oveis Gharan and Saberi showed that thin trees, together with cost control, can be augmented cheaply into tours, which gave an O(log⁡n/log⁡log⁡n)O(\log n/\log\log n)O(logn/loglogn)-approximation (doi:10.1287/opre.2017.1603). Goddyn's thin tree conjecture asks whether high edge connectivity alone forces an ε\varepsilonε-thin spanning tree, independently of the number of vertices; the strong form asks for thinness C/kC/kC/k in a kkk-edge-connected graph.

Background. Goddyn recorded the conjecture in a 2004 problem list. The Nash–Williams–Tutte theorem (1961) gives ⌊k/2⌋\lfloor k/2\rfloor⌊k/2⌋ edge-disjoint spanning trees in a kkk-edge-connected graph (doi:10.1112/jlms/s1-36.1.445, doi:10.1112/jlms/s1-36.1.221), so each cut is used about 2/k2/k2/k times on average, but no single tree need be good for every cut. Oveis Gharan and Saberi proved the bound for planar and bounded-genus graphs (2011, doi:10.1137/1.9781611973082.75). Anari and Oveis Gharan obtained thinness poly(log⁡log⁡n)/k\mathrm{poly}(\log\log n)/kpoly(loglogn)/k in general (2015, arXiv:1411.4613), using the Marcus–Spielman–Srivastava interlacing-families method (doi:10.4007/annals.2015.182.1.8). Klein and Olver handled any prescribed laminar family of cuts (2023, doi:10.1109/FOCS57990.2023.00011), and Klein, Olver and Yeoh controlled all near-minimum cuts (2026, doi:10.4230/LIPIcs.ICALP.2026.129). Constant-factor ATSP approximations were obtained by other means (Svensson–Tarnawski–Végh 2020, doi:10.1145/3424306; Traub–Vygen 2022, doi:10.1137/20M1339313), but the thin tree question stayed unresolved.

The source of this mission, an OpenAI preprint dated September 23, 2026, claims the strong thin tree conjecture.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite undirected multigraph without loops; parallel edges are counted separately. For a nonempty proper subset ∅≠S⊊V\varnothing\ne S\subsetneq V∅=S⊊V, let δG(S)\delta_G(S)δG​(S) be the set of edges with exactly one endpoint in SSS. GGG is kkk-edge-connected if ∣δG(S)∣≥k|\delta_G(S)|\ge k∣δG​(S)∣≥k for every such SSS. For an edge set T⊆ET\subseteq ET⊆E, δT(S)=δG(S)∩T\delta_T(S)=\delta_G(S)\cap TδT​(S)=δG​(S)∩T. A spanning tree TTT is α\alphaα-thin if ∣δT(S)∣≤α∣δG(S)∣|\delta_T(S)|\le\alpha|\delta_G(S)|∣δT​(S)∣≤α∣δG​(S)∣ for every nonempty proper SSS.

Formalization targets

Goal: Theorem 1.1 (strong thin trees)

There is a universal constant C>0C>0C>0 such that for every k≥1k\ge1k≥1, every finite loopless kkk-edge-connected multigraph with at least two vertices has a spanning tree TTT with

∣δT(S)∣≤Ck ∣δG(S)∣(∅≠S⊊V).|\delta_T(S)|\le\frac{C}{k}\,|\delta_G(S)|\qquad(\varnothing\ne S\subsetneq V).∣δT​(S)∣≤kC​∣δG​(S)∣(∅=S⊊V).

Lean: OAI.StrongThinTree.strongThinTree, open on the platform.

Significance

The order 1/k1/k1/k is optimal (two vertices joined by kkk parallel edges). The theorem would settle both Goddyn's thin tree conjecture and its strong form, removing the poly(log⁡log⁡n)\mathrm{poly}(\log\log n)poly(loglogn) loss of Anari–Oveis Gharan. It shows that connectivity alone controls all cuts at once, and gives a structural route to ATSP integrality-gap bounds through thin trees. An algorithmic version (deterministic polynomial-time construction) is the subject of the companion mission in this family. The result is claimed in an OpenAI preprint that has not been peer reviewed; no machine-checked proof exists.

Difficulty

Averaging over a Nash–Williams–Tutte packing controls each cut on average but not all cuts simultaneously: there are exponentially many cuts and a union bound over them loses a factor depending on nnn. Spectral approaches control all cuts via a matrix inequality, but spectrally thin trees need not exist when some edges have large effective resistance, which is why previous spectral arguments lost log⁡log⁡n\log\log nloglogn factors. One must instead keep a large tree packing on low-resistance edges through a sequence of sparsifications whose relative losses stay bounded.

Formalization scope

  • MultiGraph n m: vertices Fin n, edges Fin m with endpoint maps and a looplessness proof; parallel edges are distinct edges.
  • cut G T S: the edges of T with exactly one endpoint in S. Connected G T: every nonempty proper S is crossed by T. SpanningTree G T: T connected and every proper deletion disconnects.
  • EdgeConnected G k: every nonempty proper cut has at least k edges.
  • MainStatement: ∃ C > 0, ∀ k ≥ 1, ∀ n ≥ 2, ∀ G k-edge-connected, ∃ T spanning tree, ∀ S nonempty proper, |cut T S| ≤ (C/k)|cut G S| (real arithmetic).

Needed infrastructure: graph Laplacians and effective resistance, the Nash–Williams–Tutte theorem, the Marcus–Spielman–Srivastava mixed-characteristic-polynomial bound, and a Brouwer-type fixed point theorem (the paper proves the finite-dimensional case via Sperner's lemma). Contributions formalizing Theorem 2.3 (Nash–Williams–Tutte), Theorem 3.2, Theorem 4.1, Proposition 6.2 or Theorem A.1 are welcome.

Selected references

  • OpenAI, The strong thin tree conjecture, preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/The-strong-thin-tree-conjecture-September-23-2026/paper.pdf
  • L. A. Goddyn, Some open problems I like, problem list, 2004.
  • A. Asadpour, M. X. Goemans, A. Mądry, S. Oveis Gharan, A. Saberi, An O(log n/log log n)-approximation algorithm for the asymmetric traveling salesman problem, Oper. Res., 2017. https://doi.org/10.1287/opre.2017.1603
  • N. Anari, S. Oveis Gharan, Effective-resistance-reducing flows, spectrally thin trees, and asymmetric TSP, FOCS, 2015. https://arxiv.org/abs/1411.4613
  • A. W. Marcus, D. A. Spielman, N. Srivastava, Interlacing families II: mixed characteristic polynomials and the Kadison–Singer problem, Ann. of Math., 2015. https://doi.org/10.4007/annals.2015.182.1.8
  • S. Oveis Gharan, A. Saberi, The asymmetric traveling salesman problem on graphs with bounded genus, SODA, 2011. https://doi.org/10.1137/1.9781611973082.75
  • N. Klein, N. Olver, Thin trees for laminar families, FOCS, 2023. https://doi.org/10.1109/FOCS57990.2023.00011
  • N. Klein, N. Olver, Z. S. Yeoh, Thin trees for near minimum cuts, ICALP, 2026. https://doi.org/10.4230/LIPIcs.ICALP.2026.129
  • C. St. J. A. Nash-Williams, Edge-disjoint spanning trees of finite graphs, J. London Math. Soc., 1961. https://doi.org/10.1112/jlms/s1-36.1.445
2 thms1 active userReviewed
🏆Completed
Machine LearningProbability·Captain: wurtle

Subsphere methods for memory-sample lower bounds in noiseless Gaussian regressionResearch Paper

Motivation

An exact linear equation can carry arbitrarily fine real information: ddd independent Gaussian equations Yt=⟨Xt,s⟩Y_t = \langle X_t, s\rangleYt​=⟨Xt​,s⟩ determine a vector s∈Rds \in \mathbb{R}^ds∈Rd almost surely. A streaming learner that keeps only finitely many persistent states cannot retain those equations at arbitrary precision. The question is how many fresh equations such a learner needs to estimate a direction to angular accuracy ϵ\epsilonϵ when the information passed between observations is bounded in bits.

This preprint proves an explicit answer for memory o(d2)o(d^2)o(d2): at least 2−16 dlog⁡2(1/ϵ)2^{-16}\, d\log_2(1/\epsilon)2−16dlog2​(1/ϵ) samples, uniformly in 0<ϵ≤1/100 < \epsilon \le 1/100<ϵ≤1/10. With real-valued registers, randomized Kaczmarz needs only order dlog⁡(1/ϵ)d\log(1/\epsilon)dlog(1/ϵ) samples, so the bound shows that bounded memory cannot beat that scale.

Background

  • 2015. Steinhardt and Duchi show memory restrictions affect statistical risk in sparse noisy regression.
  • 2016. Steinhardt, Valiant and Wager relate bounded-memory inference to communication and statistical queries and pose a quadratic-memory versus exponential-sample question for parity learning; Raz proves the separation through finite-width branching programs.
  • 2019. Sharan, Sidford and Valiant prove, for Gaussian covariates with uniform noise of half-width 2−d/52^{-d/5}2−d/5, memory at most d2/4d^2/4d2/4 bits and Euclidean accuracy d−rd^{-r}d−r, an Ω(dlog⁡r)\Omega(d\log r)Ω(dlogr) sample lower bound; their Section 7 uses high moments with independent copies and successive orthogonalization. Dagan, Kur and Shamir prove space lower bounds for different linear-prediction tasks.
  • 2026. The OpenAI preprint Subsphere methods for memory-sample lower bounds in noiseless Gaussian regression (dated September 27, 2026) proves the explicit 2−16dlog⁡2(1/ϵ)2^{-16}d\log_2(1/\epsilon)2−16dlog2​(1/ϵ) bound for exact observations. It has not been peer reviewed; the Lean goal is open on this platform.

Setting

Fix d≥2d \ge 2d≥2, M≥0M \ge 0M≥0, T≥0T \ge 0T≥0, and 0<ϵ≤1/100 < \epsilon \le 1/100<ϵ≤1/10. For a signal s∈Sd−1s \in S^{d-1}s∈Sd−1 the observations are Xt∼N(0,Id)X_t \sim N(0, I_d)Xt​∼N(0,Id​) independent and Yt=⟨Xt,s⟩Y_t = \langle X_t, s\rangleYt​=⟨Xt​,s⟩ exactly. A finite-state Gaussian stream learner reads the pairs in order; at every index its persistent state has at most 2M2^M2M values. Transition and stopping rules may depend on the index, d,M,T,ϵd, M, T, \epsilond,M,T,ϵ, the current state, the whole current pair and fresh randomness, with unrestricted computation. It stops at some τ≤T\tau \le Tτ≤T and outputs s^∈Sd−1\hat s \in S^{d-1}s^∈Sd−1 from the terminal state, τ\tauτ and fresh randomness. A shared seed may choose the rules; seed and initial state are independent of the signal and rows. The experiment is jointly measurable.

For a linear space HHH and z⊥Hz \perp Hz⊥H, r>0r > 0r>0 with ∥z∥2+r2=1\|z\|^2 + r^2 = 1∥z∥2+r2=1, the affine subsphere z+rS(H)z + rS(H)z+rS(H) is a test set of dimension dim⁡H\dim HdimH. A block of bbb exact Gaussian rows leaves the target, conditionally, uniform on a random residual subsphere of dimension dim⁡H−b\dim H - bdimH−b.

In Lean (OAI.SubsphereCurrent), learners are SeededLearner d M T Ω built from KernelLearners (Markov-kernel transitions on completed observations, states Fin (2^M)), with Admissible measurability, uniformSuccess and per-signal success.

Formalization targets

Goal: full_current_main_scope

The conjunction of the paper's main statements:

  • Theorem 1.2 with Corollary 1.3 (explicit noiseless precision bound). For every M(d)=o(d2)M(d) = o(d^2)M(d)=o(d2) there is a threshold such that for larger ddd, every 0<ϵ≤1/100 < \epsilon \le 1/100<ϵ≤1/10 and every learner with uniform-prior success at least 2/32/32/3, or success at least 2/32/32/3 at every signal,
T≥2−16 dlog⁡2(1/ϵ).T \ge 2^{-16}\, d \log_2(1/\epsilon).T≥2−16dlog2​(1/ϵ).
  • Corollary 6.3: with uniform-prior success at least 1/21/21/2, T≥c dlog⁡2(1/ϵ)T \ge c\, d\log_2(1/\epsilon)T≥cdlog2​(1/ϵ) for an absolute c>0c > 0c>0.
  • Theorem 6.1 (radius-weighted block estimate, with its terminal bound), Proposition 7.1 (all-affine suffix bound), Proposition 8.1 (dimension-parameterized success bound: for mmm-dimensional targets, jkjkjk samples and 2d22^{d^2}2d2 states, Pr⁡{∥s^−s∥≤η}≤(Cj+1η)d/32\Pr\{\|\hat s - s\| \le \eta\} \le (C^{j+1}\eta)^{d/32}Pr{∥s^−s∥≤η}≤(Cj+1η)d/32), and the beta-mixture estimate of Section 9.

Significance

The result. Theorem 1.2 gives explicit constants for the Ω(dlog⁡(1/ϵ))\Omega(d\log(1/\epsilon))Ω(dlog(1/ϵ)) memory–sample bound with exact Gaussian observations and o(d2)o(d^2)o(d2) memory, e.g. T≥2−16r dlog⁡2dT \ge 2^{-16} r\, d\log_2 dT≥2−16rdlog2​d at accuracy d−rd^{-r}d−r. The block estimates are statements about uniform measures on random affine subspheres that are independent of the learning application.

Formalizing it. No machine-checked proof exists; the source is an unrefereed preprint. Companion missions on the same family of preprints (memory and precision, posterior replicas, projection moments) share the learner model; this one is distinguished by explicit constants.

Difficulty

Conditioning on an exact Gaussian block makes the posterior of the signal singular: it is uniform on a lower-dimensional residual subsphere determined by the data. Density-based information arguments therefore fail after one block. The bound must control the success probability of the remaining computation, started from any state, averaged over every affine subsphere of large dimension, uniformly over learners that may process each real-valued pair without limit.

Formalization scope

  • Vector d = EuclideanSpace ℝ (Fin d), signals in the unit sphere with normalized surface measure, rows i.i.d. stdGaussian.
  • Thresholds: success ≥2/3\ge 2/3≥2/3 (and ≥1/2\ge 1/2≥1/2 for the Corollary 6.3 conjunct), in ℝ≥0∞; the constant 2−162^{-16}2−16 is written (2:ℝ)⁻¹ ^ 16 and the logarithm is Real.logb 2.
  • Block sizes are natural-number floors d/16, d/32, d/8; the fixed-length estimate uses Fin (2^(d^2)) states.
  • The seed space is an arbitrary probability space; randomized learners are covered by seeds.

The goal cannot be satisfied vacuously: hypotheses range over all admissible learners and the success thresholds are attainable with large TTT.

Needed infrastructure: Haar measure on Grassmannians or orthogonal groups, beta laws of projected directions, spherical caps, measurable selection of Borel rule versions. Contributions proving individual conjuncts are welcome.

Selected references

  • OpenAI, Subsphere methods for memory-sample lower bounds in noiseless Gaussian regression, OpenAI Math Release preprint, September 27, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Subsphere-methods-for-memory-sample-lower-bounds-in-noiseless-Gaussian-regression-September-27-2026/paper.pdf
  • V. Sharan, A. Sidford, G. Valiant, Memory-Sample Tradeoffs for Linear Regression with Small Error, STOC 2019. https://doi.org/10.1145/3313276.3316403
  • J. Steinhardt, J. Duchi, Minimax Rates for Memory-Bounded Sparse Linear Regression, COLT 2015. https://proceedings.mlr.press/v40/Steinhardt15.html
  • J. Steinhardt, G. Valiant, S. Wager, Memory, Communication, and Statistical Queries, COLT 2016. https://proceedings.mlr.press/v49/steinhardt16.html
  • R. Raz, Fast Learning Requires Good Memory, 2016. https://arxiv.org/abs/1602.05161
  • Y. Dagan, G. Kur, O. Shamir, Space Lower Bounds for Linear Prediction in the Streaming Model, COLT 2019. https://proceedings.mlr.press/v99/dagan19b.html
  • P. Frankl, H. Maehara, Some Geometric Applications of the Beta Distribution, Ann. Inst. Statist. Math. 42 (1990).
45 thms1 active userReviewed
Information TheoryProbability·Captain: wurtle

Replacing Gaussian observations in memory-constrained inferenceResearch Paper

Motivation

A finite message chosen from data changes the conditional distribution of those data. In memory-constrained inference this matters directly: a learner observing a signal SSS through exact Gaussian equations keeps a finite state WWW, and after conditioning on WWW the rows that were used to select it are biased. An independent Gaussian matrix has the same unconditional law as those rows, but once its labels are revealed it need not leave the same information about SSS.

This preprint quantifies the cost of that replacement. For a uniform signal on the sphere and a message of entropy at most d2d^2d2, replacing the actual rows by fresh independent rows increases the remaining conditional information by at most O(d)O(d)O(d). As an application, learners with o(d2)o(d^2)o(d2) persistent bits need Ω(dlog⁡(1/ϵ))\Omega(d\log(1/\epsilon))Ω(dlog(1/ϵ)) exact Gaussian observations to reach angular accuracy ϵ\epsilonϵ.

Background

  • 1975. Mattila's two-point averaging estimate controls projection energies by inverse distances.
  • 2015–2017. Steinhardt and Duchi establish memory-dependent minimax bounds for sparse noisy regression; Raz proves branching-program time–space lower bounds for parity learning (2016) and broader discrete problems (2017).
  • 2016–2017. Russo and Zou bound the bias of a selected statistic by the information used for selection; Xu and Raginsky give an information-theoretic bound on generalization via a sub-Gaussian test under the product law.
  • 2019. Sharan, Sidford and Valiant prove an Ω(dlog⁡r)\Omega(d\log r)Ω(dlogr) sample lower bound for Gaussian regression with small uniform noise and d2/4d^2/4d2/4 bits at Euclidean accuracy d−rd^{-r}d−r. Dagan, Kur and Shamir prove quadratic-space lower bounds for related linear-algebra tasks.
  • 2026. The OpenAI preprint Replacing Gaussian observations in memory-constrained inference (dated September 27, 2026) proves the replacement comparison and its streaming consequence. It has not been peer reviewed; the Lean goal is open on this platform.

Setting

Let σ\sigmaσ be uniform probability on Sd−1S^{d-1}Sd−1, γk\gamma_kγk​ the law of a k×dk \times dk×d matrix with i.i.d. N(0,1)N(0,1)N(0,1) entries, HHH discrete entropy and I(⋅ ;⋅∣⋅)I(\cdot\,;\cdot\mid\cdot)I(⋅;⋅∣⋅) conditional mutual information, all in nats. Put

m=⌊d/10⌋,ℓ=⌊d/2⌋,r=ℓ−m.m = \lfloor d/10\rfloor, \qquad \ell = \lfloor d/2\rfloor, \qquad r = \ell - m.m=⌊d/10⌋,ℓ=⌊d/2⌋,r=ℓ−m.

Let S∼σS \sim \sigmaS∼σ and A∼γmA \sim \gamma_mA∼γm​ be independent, and let WWW be a countable message with an arbitrary joint law with (S,A)(S, A)(S,A).

  • In the aligned experiment, keep (S,A,W)(S, A, W)(S,A,W) and append an independent rrr-row Gaussian matrix CCC, so the analyst sees G1=(A;C)G_1 = (A; C)G1​=(A;C) and G1SG_1 SG1​S.
  • In the independent experiment, keep (S,W)(S, W)(S,W) and draw a fresh ℓ\ellℓ-row Gaussian matrix G0G_0G0​ independent of (S,W)(S, W)(S,W).

In Lean (OAI.CurrentProjection), the joint law of ((S,W),A)((S, W), A)((S,W),A) is a probability measure P on (Sphere d × W) × Rows (d/10) d whose (S,A)(S, A)(S,A) marginal is uniformSphere d ⊗ gaussianRows (d/10) d; alignedExperiment and P.fst.prod (gaussianRows ...) are the two experiments; exposedInformation is I(S;W∣G,GS)I(S; W \mid G, GS)I(S;W∣G,GS) computed as a relative entropy via condKernel; shannonEntropy is H(W)H(W)H(W).

Formalization targets

Goal: Theorem 4.1 (Critical-radius comparison)

There are an absolute KKK and d0d_0d0​ such that for d≥d0d \ge d_0d≥d0​ and every such countable WWW with H(W)≤d2H(W) \le d^2H(W)≤d2,

I0(S;W∣G0,G0S)≤I1(S;W∣G1,G1S)+Kd.I_0(S; W \mid G_0, G_0 S) \le I_1(S; W \mid G_1, G_1 S) + K d .I0​(S;W∣G0​,G0​S)≤I1​(S;W∣G1​,G1​S)+Kd.

Milestones

  • Theorem 3.1 (mixed projection moment and exact density version): for ℓ=m+r<d−1\ell = m + r < d - 1ℓ=m+r<d−1, r≥qr \ge qr≥q, and a finite measure ρ\rhoρ on the sphere with ρ(B(z,t))≤Btℓ\rho(B(z,t)) \le B t^\ellρ(B(z,t))≤Btℓ and ρ(B(z,t))≤Dtd−1\rho(B(z,t)) \le D t^{d-1}ρ(B(z,t))≤Dtd−1,
[EX(EZ pρ,δ((X;Z),(X;Z)s))q]1/q≤eCdB(1+log⁡+(D/B)),\Big[\mathbb{E}_X\big(\mathbb{E}_Z\, p_{\rho,\delta}((X;Z),(X;Z)s)\big)^q\Big]^{1/q} \le e^{Cd} B\big(1 + \log^+(D/B)\big),[EX​(EZ​pρ,δ​((X;Z),(X;Z)s))q]1/q≤eCdB(1+log+(D/B)),

with an exact-density version when ρ≪σ\rho \ll \sigmaρ≪σ.

  • Proposition 3.2 (actual-row tilt and exact-label limit).
  • Propositions 5.3 and 5.4 (one-level and two-label auxiliary-row comparisons).
  • Proposition 6.1 (averaged information increase per block, hybrid route).
  • Proposition 7.1 (information through a Gaussian block, fiber route) and Lemma 7.2 (two-point Gaussian fiber measure identity).

Significance

The result. Theorem 4.1 converts a statement about the actual, selection-biased rows into one about fresh rows at an additive cost of O(d)O(d)O(d), which is the step that lets block-by-block information bounds be iterated along a stream. With the residual-sphere endpoint it gives the lower bound T=Ω(dlog⁡(1/ϵ))T = \Omega(d\log(1/\epsilon))T=Ω(dlog(1/ϵ)) for learners with o(d2)o(d^2)o(d2) bits (Theorem 8.4, Corollary 8.7). The mixed projection moment (Theorem 3.1) is a reusable estimate on exact Gaussian projections of measures with local mass control.

Formalizing it. All results are in an unrefereed preprint, with no machine-checked proofs. The streaming theorems themselves (Theorem 8.4, Theorem 8.6, Corollary 8.7) are not among the published Lean targets and remain future work.

Difficulty

Conditioning on WWW biases AAA in a way that depends on the unknown signal, so the two experiments have different joint laws even though their (S,W)(S, W)(S,W) and (S,G)(S, G)(S,G) marginals agree. A direct comparison of densities fails because the exact label density under the actual law can be large on a selection-dependent set; controlling it requires a high moment of the projected density with the row-information charge I(A;W∣S)≤H(W)I(A; W \mid S) \le H(W)I(A;W∣S)≤H(W) entering only with coefficient 1/q1/q1/q.

Formalization scope

  • Signals live on Metric.sphere (0 : EuclideanSpace ℝ (Fin d)) 1 with normalized surface measure; rows are Fin k → EuclideanSpace ℝ (Fin d) with stdGaussian entries.
  • Messages are countable types with measurable singletons (finite types for some milestones); entropies and informations are ℝ≥0∞-valued.
  • Row counts are d/10, d/2 - d/10, d/32, d/8, d/4, d/3 as in each source statement.

The goal is not vacuous: it quantifies over all joint laws with the stated marginal and entropy bound, and the right side is finite for many of them.

Needed infrastructure: conditional mutual information for standard Borel variables, chain rules, exact density versions of Gaussian projections, local mass bounds on the sphere. Contributions toward any milestone are welcome.

Selected references

  • OpenAI, Replacing Gaussian observations in memory-constrained inference, OpenAI Math Release preprint, September 27, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Replacing-Gaussian-observations-in-memory-constrained-inference-September-27-2026/paper.pdf
  • V. Sharan, A. Sidford, G. Valiant, Memory-Sample Tradeoffs for Linear Regression with Small Error, STOC 2019. https://doi.org/10.1145/3313276.3316403
  • J. Steinhardt, J. Duchi, Minimax Rates for Memory-Bounded Sparse Linear Regression, COLT 2015. https://proceedings.mlr.press/v40/Steinhardt15.html
  • R. Raz, Fast Learning Requires Good Memory, 2016. https://arxiv.org/abs/1602.05161
  • R. Raz, A Time-Space Lower Bound for a Large Class of Learning Problems, FOCS 2017. https://doi.org/10.1109/FOCS.2017.73
  • Y. Dagan, G. Kur, O. Shamir, Space Lower Bounds for Linear Prediction in the Streaming Model, COLT 2019. https://proceedings.mlr.press/v99/dagan19b.html
  • D. Russo, J. Zou, Controlling Bias in Adaptive Data Analysis Using Information Theory, AISTATS 2016. https://proceedings.mlr.press/v51/russo16.html
  • A. Xu, M. Raginsky, Information-theoretic analysis of generalization capability of learning algorithms, NeurIPS 2017. https://papers.nips.cc/paper_files/paper/2017/hash/ad71c82b22f4f65b9398f76d8be4c615-Abstract.html
  • P. Mattila, Hausdorff Dimension, Orthogonal Projections and Intersections with Planes, Ann. Acad. Sci. Fenn. 1 (1975). https://doi.org/10.5186/aasfm.1975.0110
12 thms1 active userReviewed
AnalysisProbability·Captain: wurtle

Projection moments, positive cap domination, and Riesz estimates on the sphereResearch Paper

Motivation

A linear projection can concentrate a measure even when the measure has no atoms; how much depends on how much mass sits near the affine subspaces that the projection collapses. Quantitative versions of this principle go back to the potential-theoretic projection method of Kaufman and Mattila, which relates ball-growth bounds ν(B(x,r))≤Krβ\nu(B(x,r)) \le K r^\betaν(B(x,r))≤Krβ to the behaviour of projections. This preprint proves explicit, dimension-dependent versions for random exact projections and applies them to a learning question: how many noiseless Gaussian measurements ⟨xt,s⟩\langle x_t, s\rangle⟨xt​,s⟩ does a learner with MMM bits of memory need to recover a unit vector sss to angular accuracy ϵ\epsilonϵ?

The answer proved here is that M=o(d2)M = o(d^2)M=o(d2) bits force T≥c dlog⁡(1/ϵ)T \ge c\,d\log(1/\epsilon)T≥cdlog(1/ϵ) measurements, matching the real-valued randomized Kaczmarz scale, and more generally T≥c dlog⁡(1/ϵ)/(1+M/d2)T \ge c\,d\log(1/\epsilon)/(1 + M/d^2)T≥cdlog(1/ϵ)/(1+M/d2) for every MMM.

Timeline

  • 1975. Mattila relates Hausdorff dimension, orthogonal projections and ball-growth measures through inverse-distance energy averaging.
  • 1984. Drury's affine-plane change of variables for kkk-plane transforms contains the simplex-volume Jacobian used in projection calculations.
  • 2014–2016. Shamir's finite-message framework includes bounded-memory online learning; Steinhardt and Duchi (2015) prove memory-dependent minimax rates for sparse regression; Steinhardt, Valiant and Wager (2016) relate memory, communication and statistical queries; Raz (2016) proves the quadratic-memory versus exponential-sample separation for parity learning.
  • 2019. Sharan, Sidford and Valiant prove an Ω(dlog⁡r)\Omega(d\log r)Ω(dlogr) sample bound for Gaussian regression with small uniform noise, d2/4d^2/4d2/4 bits and Euclidean accuracy d−rd^{-r}d−r, using high-moment expansions and successive orthogonalization. Dagan, Kur and Shamir prove quadratic-space bounds for two other linear-prediction tasks.
  • 2026. The OpenAI preprint Projection moments, positive cap domination, and Riesz estimates on the sphere (dated September 27, 2026) gives three independent proofs of the Ω(dlog⁡(1/ϵ))\Omega(d\log(1/\epsilon))Ω(dlog(1/ϵ)) bound for exact observations and o(d2)o(d^2)o(d2) memory. It has not been peer reviewed; the Lean goal is open on this platform.

Setting

Let σ\sigmaσ be uniform probability on Sd−1⊂RdS^{d-1} \subset \mathbb{R}^dSd−1⊂Rd. A finite measure ν\nuν on Rd\mathbb{R}^dRd satisfies an all-ball mass bound with constants K,βK, \betaK,β if ν(B(x,r))≤Krβ\nu(B(x,r)) \le K r^\betaν(B(x,r))≤Krβ for every ball. For an orthonormal kkk-frame PPP, P#νP_\#\nuP#​ν is the image measure on Rk\mathbb{R}^kRk and g(P,⋅)g(P,\cdot)g(P,⋅) its density. The Riesz functional of h:Sd−1→[0,1]h : S^{d-1} \to [0,1]h:Sd−1→[0,1] is V(h)=sup⁡z∫h(s)∥s−z∥−d/2 dσ(s)V(h) = \sup_{z} \int h(s)\|s-z\|^{-d/2}\,d\sigma(s)V(h)=supz​∫h(s)∥s−z∥−d/2dσ(s).

In the finite-state regression experiment, the signal S∼σS \sim \sigmaS∼σ; at each step a row xt∼N(0,Id)x_t \sim N(0, I_d)xt​∼N(0,Id​) arrives with its exact label ⟨xt,S⟩\langle x_t, S\rangle⟨xt​,S⟩. A learner keeps one of 2M2^M2M states, may use arbitrary measurable randomized transitions of the current state and pair, stops by a deterministic horizon TTT, and outputs a unit vector from its terminal state, stopping index and fresh randomness. Success means arccos⁡⟨S^,S⟩≤ϵ\arccos\langle \hat S, S\rangle \le \epsilonarccos⟨S^,S⟩≤ϵ.

In Lean (OAI.ProjectionMoments, OAI.NoiselessRegression), learners are FiniteKernelLearner d M T (Markov-kernel transitions on completed observations, states Fin (2^M)), mixed over a seed space Ξ with probability ρ; seededSuccess is uniform-prior success; AllBallMass ν K β, coordinateDensity, frameLaw, capMeasure, rieszPotential encode the geometric objects.

Formalization targets

Goal: OAI.ProjectionMoments.main

A conjunction of the paper's results, including:

  • Theorem 2.4 (finite-memory precision bound). There is an absolute c>0c > 0c>0 such that for every M(d)=o(d2)M(d) = o(d^2)M(d)=o(d2), eventually in ddd, uniform-sphere success at least 2/32/32/3 at accuracy 0<ϵ≤1/100 < \epsilon \le 1/100<ϵ≤1/10 forces
T≥c dlog⁡(1/ϵ),T \ge c\, d \log(1/\epsilon),T≥cdlog(1/ϵ),

also under an every-signal guarantee.

  • Corollary 2.5, in the weakened form that M≤Ad2M \le A d^2M≤Ad2 gives T≥cAdlog⁡(1/ϵ)T \ge c_A d\log(1/\epsilon)T≥cA​dlog(1/ϵ) (the paper proves T≥c dlog⁡(1/ϵ)/(1+M/d2)T \ge c\,d\log(1/\epsilon)/(1+M/d^2)T≥cdlog(1/ϵ)/(1+M/d2)).
  • Theorem 3.3 (integrated orthonormal-projection moment). If ν\nuν is finite, supported in B(z,R)B(z,R)B(z,R), with ν(B(x,r))≤Krβ\nu(B(x,r)) \le K r^\betaν(B(x,r))≤Krβ, and k+q≤dk+q \le dk+q≤d, 0<β≤d0 < \beta \le d0<β≤d, β−k−(q−2)≥1\beta - k - (q-2) \ge 1β−k−(q−2)≥1, then
(∬g(P,u)q du dϑd,k(P))1/q≤Cd(Cd)k(1−1/q)KRβ−k(1−1/q).\Big(\iint g(P,u)^q\,du\,d\vartheta_{d,k}(P)\Big)^{1/q} \le C^d (C\sqrt d)^{k(1-1/q)} K R^{\beta - k(1-1/q)}.(∬g(P,u)qdudϑd,k​(P))1/q≤Cd(Cd​)k(1−1/q)KRβ−k(1−1/q).
  • Theorem 3.5, Corollary 3.4 and Proposition 3.7 (normalized and all-radii moments, one-block propagation), Proposition 4.1 (positive domination by countable sums of cap measures), Lemma 5.3 (projection density at deterministic offsets), and the explicit success bounds of Propositions 3.8, 4.4 and 5.4 for arbitrary MMM.
  • A bridge showing the kernel learner model agrees with the seeded deterministic learner model.

Significance

The result. The projection moment estimates are general statements about finite measures with ball-growth control and apply beyond learning. In the learning application they give three proofs, with different stopping and accuracy costs, that o(d2)o(d^2)o(d2) bits cannot beat the dlog⁡(1/ϵ)d\log(1/\epsilon)dlog(1/ϵ) sample scale for exact Gaussian measurements, plus an explicit trade-off for all MMM.

Formalizing it. The results are in an unrefereed preprint; there is no machine-checked proof. The conjunct FixedQuadraticMemory coincides with part of the goal of the companion mission on Memory and precision in noiseless Gaussian regression, so progress here is shared.

Difficulty

Integrated density norms do not determine density values on a matrix-dependent graph, so pointwise statements need an explicitly chosen density version. The high moments of projected densities require controlling collisions of qqq independent points under projection, which leads to inverse affine heights whose integrability must be extracted from the ball-growth hypothesis at all scales. In the learning application, conditioning on an exact label produces a singular posterior, so arguments that track a posterior density fail.

Formalization scope

  • Space is EuclideanSpace ℝ (Fin d); frames are orthonormal families Fin k → E drawn by frameLaw; densities are ℝ≥0∞-valued with explicit measurable versions.
  • Parameters are natural-number floors (d/4, d/8, d/16); block counts appear as (T+k-1)/k.
  • Learners: FiniteKernelLearner with CompletedRules almost surely in the seed; success probabilities are ℝ≥0∞.

The goal has no trivial reading: each conjunct quantifies over all measures or learners satisfying the stated hypotheses, and the hypotheses are satisfiable.

Needed infrastructure: Stiefel and Haar measures, Gaussian polar decomposition of matrices, Gram–Schmidt Jacobians, spherical caps, Riesz potentials. Contributions proving individual conjuncts (for example Theorem 3.3) are welcome.

Selected references

  • OpenAI, Projection moments, positive cap domination, and Riesz estimates on the sphere, OpenAI Math Release preprint, September 27, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Projection-moments-positive-cap-domination-and-Riesz-estimates-on-the-sphere-September-27-2026/paper.pdf
  • P. Mattila, Hausdorff Dimension, Orthogonal Projections and Intersections with Planes, Ann. Acad. Sci. Fenn. Ser. A I Math. 1 (1975). https://doi.org/10.5186/aasfm.1975.0110
  • S. W. Drury, Generalizations of Riesz Potentials and LpL^pLp Estimates for Certain kkk-Plane Transforms, Illinois J. Math. 28 (1984).
  • V. Sharan, A. Sidford, G. Valiant, Memory-Sample Tradeoffs for Linear Regression with Small Error, STOC 2019. https://doi.org/10.1145/3313276.3316403
  • R. Raz, Fast Learning Requires Good Memory, 2016. https://arxiv.org/abs/1602.05161
  • J. Steinhardt, G. Valiant, S. Wager, Memory, Communication, and Statistical Queries, COLT 2016. https://proceedings.mlr.press/v49/steinhardt16.html
  • J. Steinhardt, J. Duchi, Minimax Rates for Memory-Bounded Sparse Linear Regression, COLT 2015. https://proceedings.mlr.press/v40/Steinhardt15.html
  • O. Shamir, Fundamental Limits of Online and Distributed Algorithms for Statistical Learning and Estimation, NeurIPS 2014.
  • Y. Dagan, G. Kur, O. Shamir, Space Lower Bounds for Linear Prediction in the Streaming Model, COLT 2019. https://proceedings.mlr.press/v99/dagan19b.html
2 thms1 active userReviewed
Information TheoryProbability·Captain: wurtle

Localization costs and information growth for exact Gaussian observationsResearch Paper

Motivation

An exact linear observation ⟨x,S⟩\langle x, S\rangle⟨x,S⟩ of a real signal can carry arbitrarily many bits. A finite message computed from a block of such observations cannot, but its information content is not controlled by the number of observations alone: if earlier messages have already concentrated the signal in a small region, the next block can exploit that concentration. Bounds of this kind are the engine of memory–sample lower bounds for noiseless Gaussian regression, where a learner with MMM bits of memory must recover a unit vector to angular accuracy ϵ\epsilonϵ from a stream of exact Gaussian measurements.

This preprint asks how to restore a geometric spread condition on the posterior while paying for the information revealed in doing so, and proves that, for a cube-shaped prior on a spherical patch, ttt blocks of Θ(d)\Theta(d)Θ(d) exact measurements with messages of at most exp⁡(Ad2)\exp(Ad^2)exp(Ad2) values reveal only OA(dt)O_A(dt)OA​(dt) nats.

Background

  • 2015. Steinhardt and Duchi prove memory–sample trade-offs for noisy sparse regression.
  • 2016. Steinhardt, Valiant and Wager formulate a memory/sample conjecture for parity learning; Raz proves a quadratic-memory versus exponential-sample separation for parities, extended to a broad class of finite problems in 2017.
  • 2019. Sharan, Sidford and Valiant prove an Ω(dlog⁡r)\Omega(d\log r)Ω(dlogr) sample lower bound for Gaussian regression with small additive noise, memory at most d2/4d^2/4d2/4 bits and Euclidean accuracy d−rd^{-r}d−r; their Section 7 expands projection moments into independent signal copies. Dagan, Kur and Shamir prove quadratic-memory lower bounds for approximately solving a consistent linear system in random order.
  • 2026. OpenAI preprints on exact observations: Posterior replicas and conditional information in Gaussian regression, Replacing Gaussian observations in memory-constrained inference, and the present Localization costs and information growth for exact Gaussian observations (dated September 27, 2026), which supplies several localization routes to the Ω(dlog⁡(1/ϵ))\Omega(d\log(1/\epsilon))Ω(dlog(1/ϵ)) lower bound for o(d2)o(d^2)o(d2) memory. None of these preprints is peer reviewed; the Lean goal is open on this platform.

Setting

Let ddd be large, n=d−1n = d - 1n=d−1, k=⌊n/16⌋k = \lfloor n/16\rfloork=⌊n/16⌋, m=⌊n/8⌋m = \lfloor n/8\rfloorm=⌊n/8⌋. The cube prior is normalized Lebesgue measure μ0\mu_0μ0​ on the half-open cube Q0=[−1/(2n),1/(2n))nQ_0 = [-1/(2\sqrt n), 1/(2\sqrt n))^nQ0​=[−1/(2n​),1/(2n​))n, and the chart ϕ(z)=(z,1−∥z∥2)\phi(z) = (z, \sqrt{1 - \|z\|^2})ϕ(z)=(z,1−∥z∥2​) maps it into Sd−1S^{d-1}Sd−1. Dyadic cells of level JJJ subdivide Q0Q_0Q0​ into 2nJ2^{nJ}2nJ half-open subcubes of side 2−J/n2^{-J}/\sqrt n2−J/n​.

Draw Z∼μ0Z \sim \mu_0Z∼μ0​. In block i=1,…,ti = 1, \dots, ti=1,…,t an independent standard Gaussian k×dk \times dk×d matrix XiX_iXi​ is drawn, and (Xi,Xiϕ(Z))(X_i, X_i\phi(Z))(Xi​,Xi​ϕ(Z)) is observed exactly. A message Wi∈{1,…,N}W_i \in \{1, \dots, N\}Wi​∈{1,…,N} is drawn from a Borel probability kernel of the block data, whose choice may depend on the preceding messages W1,…,Wi−1W_1, \dots, W_{i-1}W1​,…,Wi−1​. Information is measured in nats by mutual information I(⋅ ;⋅)I(\cdot\,;\cdot)I(⋅;⋅), defined as a relative entropy.

In Lean (OAI.RepeatedLocalization), Coordinate n = Fin n → ℝ, cubePrior n is Lebesgue measure conditioned on initialCube n, chart is ϕ\phiϕ, a Cell n is a level JJJ with a multi-index in Fin (2^J), a BlockRule n N is a measurable probability vector on Fin N indexed by block data, Rules n N t chooses a rule for each block from the past history, and experimentLaw rules is the joint law of (Z,W1,…,Wt)(Z, W_1, \dots, W_t)(Z,W1​,…,Wt​).

Formalization targets

Goal: Theorem 3.2 (Repeated localization), repeated_localization

There is an absolute c>0c > 0c>0 such that for every C0>0C_0 > 0C0​>0 there is CCC with the following property, for ddd large. If

(2/m+e−ck)log⁡N≤C0d,\big(2/m + e^{-ck}\big)\log N \le C_0 d,(2/m+e−ck)logN≤C0​d,

then one can reveal nested dyadic cells Q0⊃Q1⊃⋯⊃QtQ_0 \supset Q_1 \supset \cdots \supset Q_tQ0​⊃Q1​⊃⋯⊃Qt​ containing ZZZ, with QiQ_iQi​ a finite-valued measurable function of ZZZ and W1,…,WiW_1, \dots, W_iW1​,…,Wi​, such that the augmented transcript Πt=(W1,Q1,…,Wt,Qt)\Pi_t = (W_1, Q_1, \dots, W_t, Q_t)Πt​=(W1​,Q1​,…,Wt​,Qt​) satisfies

I(Z;Πt)≤Cdt,E Jt≤Ct,I(Z; \Pi_t) \le C d t, \qquad \mathbb{E}\, J_t \le C t,I(Z;Πt​)≤Cdt,EJt​≤Ct,

where JtJ_tJt​ is the level of QtQ_tQt​. An alphabet of size N≤exp⁡(Ad2)N \le \exp(Ad^2)N≤exp(Ad2) satisfies the hypothesis with C0C_0C0​ depending only on AAA.

Milestones (results from the paper's other routes)

  • Lemma 5.2 (finite expected regularization of a finite-relative-entropy posterior by a terminating dyadic search).
  • Lemma 12.1 (convexity and coercivity of the kernel potential Φ(ν)=D(ν∥σ)−∫log⁡Jν dν\Phi(\nu) = D(\nu\|\sigma) - \int \log J_\nu\, d\nuΦ(ν)=D(ν∥σ)−∫logJν​dν).
  • Proposition 12.6 (the potential grows by at most CdCdCd per block).
  • Lemma 13.2 (inverse simplex-volume moment under a ball bound, with no support restriction).

Significance

The result. Theorem 3.2 is the first information estimate in the paper and the model for its later routes: it shows that revealing a nested dyadic cell after each block, which restores the spread condition needed by the projection estimate, costs only O(d)O(d)O(d) nats per block. Since the original message history is a function of Πt\Pi_tΠt​, the bound also controls the information in the messages alone. Combined with the paper's endpoint arguments this yields the lower bound T≥c dlog⁡(1/ϵ)T \ge c\,d\log(1/\epsilon)T≥cdlog(1/ϵ) for learners with o(d2)o(d^2)o(d2) bits.

Formalizing it. These results are proved only in an unrefereed preprint; no machine-checked proofs exist. The milestones are independent analytic statements (an entropy regularization, a convex potential and its drift, an inverse-volume moment) that are reusable in the companion missions on exact Gaussian observations.

Difficulty

The information a block reveals depends on how concentrated the current posterior is, and earlier messages can make it arbitrarily concentrated. Simply conditioning on messages gives no control. Revealing a localizing cell restores spread, but naming a cell itself costs information, and the count of candidate cells at depth jjj grows like 2nj/22^{nj/2}2nj/2; the argument must show that confinement to a depth-jjj cell (worth njnjnj bits relative to the prior) pays for this, uniformly over all message rules.

Formalization scope

  • The prior is the image of cube volume under ϕ\phiϕ, not surface measure; coordinates are Fin n → ℝ, and ddd appears as n + 1.
  • Row counts and parameters are natural-number floors n / 16, n / 8. Gaussian entries are gaussianReal 0 1.
  • A disclosure Q : Disclosure n N t is valid when each cell map is measurable with finite range, contains ZZZ, lies in Q0Q_0Q0​, and the cells are nested. The goal asserts existence of a valid disclosure with mutualInformation (augmentedLaw rules Q) ≤ C (n+1) t and expected final level at most CtCtCt.
  • Mutual information is klDiv of the joint law against the product of marginals, valued in ℝ≥0∞.

The goal is not trivial: the trivial disclosure (always Q0Q_0Q0​) does not bound the information in arbitrary messages, and the quantifier order (absolute ccc, then C0C_0C0​, then CCC) matches the source.

Needed infrastructure: Gaussian projections of measures on cells, LmL^mLm density bounds, dyadic cell combinatorics, and relative-entropy chain rules. Contributions toward any milestone are welcome.

Selected references

  • OpenAI, Localization costs and information growth for exact Gaussian observations, OpenAI Math Release preprint, September 27, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Localization-costs-and-information-growth-for-exact-Gaussian-observations-September-27-2026/paper.pdf
  • OpenAI, Posterior replicas and conditional information in Gaussian regression, OpenAI Math Release preprint, September 27, 2026. https://github.com/openai/math/blob/main/preprints/Posterior-replicas-and-conditional-information-in-Gaussian-regression-September-27-2026/paper.pdf
  • V. Sharan, A. Sidford, G. Valiant, Memory-Sample Tradeoffs for Linear Regression with Small Error, STOC 2019. https://doi.org/10.1145/3313276.3316403
  • R. Raz, Fast Learning Requires Good Memory, 2016. https://arxiv.org/abs/1602.05161
  • R. Raz, A Time-Space Lower Bound for a Large Class of Learning Problems, FOCS 2017. https://doi.org/10.1109/FOCS.2017.73
  • J. Steinhardt, G. Valiant, S. Wager, Memory, Communication, and Statistical Queries, COLT 2016. https://proceedings.mlr.press/v49/steinhardt16.html
  • J. Steinhardt, J. Duchi, Minimax Rates for Memory-Bounded Sparse Linear Regression, COLT 2015. https://proceedings.mlr.press/v40/Steinhardt15.html
  • Y. Dagan, G. Kur, O. Shamir, Space Lower Bounds for Linear Prediction in the Streaming Model, COLT 2019. https://proceedings.mlr.press/v99/dagan19b.html
  • T. Austin, Multi-variate correlation and mixtures of product measures, Kybernetika, 2020.
2 thms1 active userReviewed
Information TheoryStatistics·Captain: wurtle

Posterior replicas and conditional information in Gaussian regressionResearch Paper

Motivation

Suppose an unknown unit vector s∈Sd−1s \in S^{d-1}s∈Sd−1 is observed through exact linear measurements Yj=⟨Xj,s⟩Y_j = \langle X_j, s\rangleYj​=⟨Xj​,s⟩ with independent Gaussian rows Xj∼N(0,Id)X_j \sim N(0, I_d)Xj​∼N(0,Id​). If every pair is kept, ddd rows determine sss. A learner that can keep only a bounded number of bits between measurements must compress each exact real label into a state update, and the question is how many measurements this costs for a prescribed angular accuracy ϵ\epsilonϵ. Exact labels make the question delicate: a real label has no built-in bit precision, so noise-based arguments do not apply.

This preprint attacks the question through a conditional information bound for a single block of observations: how much information about sss can a finite message formed from kkk exact Gaussian measurements carry, beyond what an independent Gaussian projection of sss (revealed only to the analyst) already reveals? Iterating such a block bound over a stream gives a memory–sample lower bound.

Timeline

  • 1960. Watanabe introduces total correlation as a measure of multivariate dependence; Austin (2020) develops its chain rules on general probability spaces.
  • 2015. Steinhardt and Duchi prove memory and communication lower bounds for noisy sparse linear regression.
  • 2016–2017. Raz proves that learning parities requires quadratic memory or exponentially many samples, and extends the branching-program method to a large class of finite learning problems.
  • 2019. Sharan, Sidford and Valiant prove an Ω(dlog⁡r)\Omega(d\log r)Ω(dlogr) sample lower bound for Gaussian regression with tiny uniform noise, at most d2/4d^2/4d2/4 bits and Euclidean accuracy d−rd^{-r}d−r, in a stated range of rrr. Dagan, Kur and Shamir prove quadratic-space lower bounds for two other linear-prediction tasks.
  • 2026. Two companion OpenAI preprints treat exact observations: Memory and precision in noiseless Gaussian regression (memory Ad2Ad^2Ad2, backward propagation of success bounds) and Replacing Gaussian observations in memory-constrained inference. The present OpenAI preprint, Posterior replicas and conditional information in Gaussian regression (dated September 27, 2026), gives multi-replica block bounds and derives the o(d2)o(d^2)o(d2)-memory consequence. It has not been peer reviewed; the Lean goal is open on this platform.

Setting

Let σd\sigma_dσd​ be uniform probability on Sd−1S^{d-1}Sd−1. In a block experiment the signal SSS has law p=fσdp = f\sigma_dp=fσd​ with a Borel density 0≤f≤L0 \le f \le L0≤f≤L. Independently draw a k×dk\times dk×d standard Gaussian matrix AAA and observe (A,AS)(A, AS)(A,AS). A message WWW with values in a finite set is drawn from a measurable Markov kernel of (A,AS)(A, AS)(A,AS). Finally an ℓ×d\ell \times dℓ×d standard Gaussian matrix BBB is drawn independently of everything. The quantity of interest is the conditional mutual information

I(S;W∣B,BS),I(S; W \mid B, BS),I(S;W∣B,BS),

in nats, and H(W)H(W)H(W) denotes the Shannon entropy of the message.

A finite-state learner with MMM bits reads pairs (Xj,Yj)(X_j, Y_j)(Xj​,Yj​) once, in order, keeps a state in a set of size 2M2^M2M, may stop at any index up to a deterministic horizon TTT, and outputs a unit vector from its terminal state, stopping index and fresh randomness only. Transitions and stopping may be arbitrary measurable randomized rules of the current state and current pair; shared randomness is independent of the signal and samples.

In Lean (OAI.PosteriorReplicas), sphereLaw d is normalized surface measure, gaussianRows d k is the product of stdGaussian, signalMessageLaw p κ is the law of (S,W)(S, W)(S,W), sideLaw ℓ appends (B,BS)(B, BS)(B,BS), conditionalInformation is the relative entropy of the joint law from the conditionally independent coupling, and messageEntropy is H(W)H(W)H(W). Learners are CompletedKernelLearner d M with Markov-kernel transitions on the completed observation space, wrapped in a JointKernelExperiment over a seed space (Ω,ρ)(\Omega, \rho)(Ω,ρ).

Formalization targets

Goal: OAI.PosteriorReplicas.source_main

The goal is the conjunction of the paper's principal statements:

  • Theorem 1.1 (Gaussian replica block bound). For large ddd, with k=2⌊d/16⌋k = 2\lfloor d/16\rfloork=2⌊d/16⌋, t=k+1t = k+1t=k+1, ℓ=4k\ell = 4kℓ=4k, there is an absolute CCC with
I(S;W∣B,BS)≤H(W)t+Cd+Clog⁡(2+log⁡L),I(S; W \mid B, BS) \le \frac{H(W)}{t} + Cd + C\log(2 + \log L),I(S;W∣B,BS)≤tH(W)​+Cd+Clog(2+logL),

uniformly over the prior, LLL, and the message kernel.

  • Theorem 1.2 (Uniform-prior sample lower bound). There is an absolute c>0c > 0c>0 such that for every M(d)=o(d2)M(d) = o(d^2)M(d)=o(d2), eventually in ddd, every learner with uniform-prior success Pr⁡{arccos⁡⟨S^,S⟩≤ϵ}≥2/3\Pr\{\arccos\langle \hat S, S\rangle \le \epsilon\} \ge 2/3Pr{arccos⟨S^,S⟩≤ϵ}≥2/3, 0<ϵ≤1/100 < \epsilon \le 1/100<ϵ≤1/10, has T≥c dlog⁡(1/ϵ)T \ge c\,d\log(1/\epsilon)T≥cdlog(1/ϵ).
  • Theorem 3.3 (the finite equal-label measure identity) and the accompanying density-version statement for projected laws.
  • The alternative block comparisons: Theorem 5.1 (distance bins), Proposition 7.5 (Haar frames), Proposition 8.1 (synthetic Gaussian route) and Proposition 9.1 (Stiefel incidence).

Significance

The result. Theorem 1.2 shows that with o(d2)o(d^2)o(d2) persistent bits, the dlog⁡(1/ϵ)d\log(1/\epsilon)dlog(1/ϵ) sample scale of real-valued Kaczmarz-type methods cannot be improved for exact Gaussian measurements, under the uniform prior and with an absolute constant. Theorem 1.1 is a reusable statement in its own right: the entropy of a message is divided by a factor proportional to ddd, and the dependence on the prior density bound LLL is only doubly logarithmic, which is what allows conditioning on rare learner states.

Formalizing it. These results appear only in an unrefereed preprint, and none has a machine-checked proof. The companion preprint Memory and precision in noiseless Gaussian regression proves a related statement for memory Ad2Ad^2Ad2 by a different method; the two missions share the learner model but not the block estimates. Formalizing the goal requires conditional mutual information for general (non-discrete) random variables and the exact equal-label geometry, both of which would be reusable.

Difficulty

Conditioning on one exact observation confines the signal to a lower-dimensional section of the sphere, so posterior densities with respect to σd\sigma_dσd​ do not exist and density-based arguments fail. Bounding the information in the message by H(W)H(W)H(W) alone is far too weak: a message of d2d^2d2 bits could then carry all relevant information. The block bound must instead account for what the analyst's independent projection already reveals, uniformly over priors with large density bounds LLL, since rare learner states produce such priors.

Formalization scope

  • Vectors are EuclideanSpace ℝ (Fin d); priors are measures on the ambient space given as (sphereLaw d).withDensity f with 0≤f≤L0 \le f \le L0≤f≤L.
  • Messages are Markov kernels into Fin N with NeZero N; information quantities are ℝ≥0∞-valued relative entropies (klDiv), entropies use natural logarithms.
  • Row counts are natural-number floors such as 2 * (d / 16), d / 8, d / 2 as in the paper.
  • The streaming conjunct quantifies over all memory sequences with IsLittleO atTop M (d^2), all horizons TTT, all 0<ϵ≤1/100 < \epsilon \le 1/100<ϵ≤1/10, all seed spaces and all JointKernelExperiments whose output kernel agrees almost surely with the run of the per-seed learner.

The goal cannot be met vacuously: block bounds are stated for every finite message kernel, and the streaming hypothesis (success at least 2/32/32/3) is satisfiable by learners with large TTT.

A complete development needs Gaussian matrices and their projections, coarea-type identities for equal labels, conditional kernels (condKernel), relative entropy chain rules, and spherical measure estimates. Contributions that isolate one conjunct (for example Theorem 3.3 or Theorem 1.1) are welcome.

Selected references

  • OpenAI, Posterior replicas and conditional information in Gaussian regression, OpenAI Math Release preprint, September 27, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Posterior-replicas-and-conditional-information-in-Gaussian-regression-September-27-2026/paper.pdf
  • OpenAI, Memory and precision in noiseless Gaussian regression, OpenAI Math Release preprint, September 27, 2026. https://github.com/openai/math/blob/main/preprints/Memory-and-precision-in-noiseless-Gaussian-regression-September-27-2026/paper.pdf
  • V. Sharan, A. Sidford, G. Valiant, Memory-Sample Tradeoffs for Linear Regression with Small Error, STOC 2019. https://doi.org/10.1145/3313276.3316403
  • R. Raz, Fast Learning Requires Good Memory: A Time-Space Lower Bound for Parity Learning, 2016. https://arxiv.org/abs/1602.05161
  • R. Raz, A Time-Space Lower Bound for a Large Class of Learning Problems, FOCS 2017. https://doi.org/10.1109/FOCS.2017.73
  • J. Steinhardt, J. Duchi, Minimax Rates for Memory-Bounded Sparse Linear Regression, COLT 2015. https://proceedings.mlr.press/v40/Steinhardt15.html
  • Y. Dagan, G. Kur, O. Shamir, Space Lower Bounds for Linear Prediction in the Streaming Model, COLT 2019. https://proceedings.mlr.press/v99/dagan19b.html
  • S. Watanabe, Information Theoretical Analysis of Multivariate Correlation, IBM J. Res. Dev., 1960.
  • T. Austin, Multi-variate correlation and mixtures of product measures, Kybernetika, 2020.
2 thms1 active userReviewed
AlgebraComplexity Theory·Captain: wurtle

Homogeneous depth-five lower bounds for iterated matrix multiplicationResearch Paper

Motivation

Iterated matrix multiplication asks for the (1,1)(1,1)(1,1) entry of a product of ddd matrices of size w×ww\times ww×w with independent variable entries,

IMMw,d=(X(1)⋯X(d))1,1=∑i1,…,id−1∈[w]x1,i1(1)xi1,i2(2)⋯xid−1,1(d).\mathrm{IMM}_{w,d}=\bigl(X^{(1)}\cdots X^{(d)}\bigr)_{1,1}=\sum_{i_1,\dots,i_{d-1}\in[w]}x^{(1)}_{1,i_1}x^{(2)}_{i_1,i_2}\cdots x^{(d)}_{i_{d-1},1}.IMMw,d​=(X(1)⋯X(d))1,1​=i1​,…,id−1​∈[w]∑​x1,i1​(1)​xi1​,i2​(2)​⋯xid−1​,1(d)​.

It has polynomial-size arithmetic circuits when depth is unrestricted and is complete for algebraic branching programs, so it is the standard test case for the cost of restricting circuit depth. Depth-reduction theorems (Agrawal–Vinay, Koiran, Tavenas) show that any polynomial-size circuit for a degree-ddd polynomial can be flattened to homogeneous depth four with size NO(d)N^{O(\sqrt d)}NO(d​); lower bounds of the form NΩ(d)N^{\Omega(\sqrt d)}NΩ(d​) at small depth are therefore exactly at the threshold that depth reduction permits, and improving them slightly would separate general circuits from formulas. Nisan and Wigderson asked for an explicit homogeneous polynomial requiring superpolynomial size at constant depth, even at depth five.

Timeline

  • 1995. Nisan and Wigderson introduce partial-derivative measures and ask for superpolynomial homogeneous constant-depth lower bounds, even at depth five.
  • 2008–2015. Agrawal–Vinay, Koiran (doi:10.1016/j.tcs.2012.03.041) and Tavenas (doi:10.1016/j.ic.2014.09.004) reduce general circuits to homogeneous depth four of size NO(d)N^{O(\sqrt d)}NO(d​).
  • 2014. Gupta, Kamath, Kayal and Saptharishi develop shifted partial derivatives (doi:10.1145/2629541); Kayal, Limaye, Saha and Srinivasan prove exponential bounds for homogeneous depth-four formulas.
  • 2015. Fournier, Limaye, Malod and Srinivasan prove IMM lower bounds for restricted depth-four formulas (doi:10.1137/140990280); Bera and Chakrabarti prove a depth-five IMM lower bound with bounded bottom support (doi:10.4230/LIPIcs.CCC.2015.183).
  • 2017. Kumar and Saraf prove dΩ(d)d^{\Omega(\sqrt d)}dΩ(d​) for homogeneous depth-four circuits computing IMMd5,d\mathrm{IMM}_{d^5,d}IMMd5,d​ (doi:10.1137/140999335); Kumar and Saptharishi prove exponential homogeneous depth-five bounds over finite fields for a VNP family (doi:10.4230/LIPIcs.CCC.2017.31).
  • 2021/2025. Limaye, Srinivasan and Tavenas prove superpolynomial lower bounds for all constant-depth circuits, including IMM in the low-degree regime (doi:10.1145/3734215).
  • 2022–2024. Bhargav–Dutta–Saxena (doi:10.4230/LIPIcs.MFCS.2022.18), Amireddy–Garg–Kayal–Saha–Thankey (doi:10.4230/LIPIcs.ICALP.2023.12) and Forbes (doi:10.4230/LIPIcs.CCC.2024.31) improve exponents or extend fields, in regimes with ddd small relative to www.

These results either restrict the bottom linear forms, use a different width–degree regime, or concern a different polynomial. The source of this mission, an OpenAI preprint dated September 25, 2026, claims the sharp nΘ(n)n^{\Theta(\sqrt n)}nΘ(n​) bound in the balanced regime w=d=nw=d=nw=d=n with unrestricted bottom forms.

Setting

An arithmetic circuit over a field KKK is a finite DAG whose leaves are variables or field elements; sum gates take KKK-linear combinations of their inputs, product gates multiply their inputs (with multiplicity). A ΣΠΣΠΣ\Sigma\Pi\Sigma\Pi\SigmaΣΠΣΠΣ circuit has five layers of types +,×,+,×,++,\times,+,\times,++,×,+,×,+ from the output down, with a single output gate; edges join consecutive layers and bottom sums read leaves. Fan-in, fan-out and sharing are unrestricted, and bottom linear forms may involve any number of variables. The circuit is syntactically homogeneous if, with variables of degree 111, constants of degree 000 and product degrees adding, every sum gate has all inputs of the same formal degree. Size is the number of vertices, leaves included. The target is IMMn,n\mathrm{IMM}_{n,n}IMMn,n​, of degree nnn in n3n^3n3 variables.

Formalization targets

Goal: Theorem 1.1, Corollary 6.1 and Proposition 6.2

There is n0n_0n0​ such that for all n≥n0n\ge n_0n≥n0​, every syntactically homogeneous ΣΠΣΠΣ\Sigma\Pi\Sigma\Pi\SigmaΣΠΣΠΣ circuit computing IMMn,n\mathrm{IMM}_{n,n}IMMn,n​ over C\mathbb CC, and more generally over any field of characteristic zero, has

size ≥ nn/400.\text{size}\ \ge\ n^{\sqrt n/400}.size ≥ nn​/400.

Conversely, over every field and for every n≥2n\ge2n≥2 there is such a circuit with

size ≤ 2n3+rn2+rnt+1+nr−1+1 ≤ nn+4,t=⌈n⌉, r=⌈n/t⌉.\text{size}\ \le\ 2n^3+rn^2+rn^{t+1}+n^{r-1}+1\ \le\ n^{\sqrt n+4},\qquad t=\lceil\sqrt n\rceil,\ r=\lceil n/t\rceil.size ≤ 2n3+rn2+rnt+1+nr−1+1 ≤ nn​+4,t=⌈n​⌉, r=⌈n/t⌉.

The Lean statement OAI.Problem335.main bundles the three clauses and is open on the platform. The constant 1/4001/4001/400 is the paper's and is not optimized.

Significance

The theorem determines the size of homogeneous depth-five circuits for IMMn,n\mathrm{IMM}_{n,n}IMMn,n​ up to the constant in the exponent: nΘ(n)n^{\Theta(\sqrt n)}nΘ(n​). It removes the bottom-support restriction of Bera–Chakrabarti and works at the balanced width–degree point w=d=nw=d=nw=d=n, where the shifted-partials bounds of Amireddy et al. and the low-degree results of Limaye–Srinivasan–Tavenas do not apply directly. It answers the depth-five instance of the Nisan–Wigderson question for an explicit polynomial in VP. It does not give superpolynomial bounds for general circuits.

The result is claimed in an OpenAI preprint; it has not been peer reviewed and no machine-checked proof exists. The upper-bound clause is elementary and a natural first formal target; the lower bound requires a new rank measure and its estimates.

Difficulty

Depth-five circuits with unrestricted bottom linear forms can use linear forms involving all n3n^3n3 variables, which defeats measures that rely on bottom forms having small support (the Bera–Chakrabarti approach) or on set-multilinearization with degree-dependent losses (which are too costly when d=wd=wd=w). Partial-derivative and shifted-partial measures applied directly give bounds that degrade with the bottom fan-in. One needs a measure that is small for every product of homogeneous low-degree polynomials of arbitrary support and large for IMMn,n\mathrm{IMM}_{n,n}IMMn,n​.

Formalization scope

  • Depth5Circuit K n stores the leaves (D5Leaf: a scalar or a variable index in Fin n × Fin n × Fin n), bottom sums (lists of coefficient–leaf pairs), lower products (lists of bottom gates), middle sums, upper products, and one output sum, with explicit formal degrees and homogeneity constraints at every sum gate; empty sums have degree 000.
  • circuitSize counts leaves plus all gates plus the output gate; circuitValue evaluates to an MvPolynomial.
  • imm K n is the (0,0)(0,0)(0,0) entry of the ordered product of the nnn matrices Xij(t)X^{(t)}_{ij}Xij(t)​.
  • The lower bound is stated over ℂ and, with a threshold chosen before the field, over every Field with CharZero; the upper bound over every Field, with the explicit upperGateBound.

A complete development needs multivariate polynomial algebra, the derivative-multiplication operator g[k,m](∂V,U)g_{[k,m]}(\partial_V,U)g[k,m]​(∂V​,U) and its rank, an integral (Bargmann–Fock type) moment estimate over C\mathbb CC, and a transfer to characteristic zero via integer minors. Contributions formalizing Proposition 6.2 (the upper bound) and Proposition 3.1 (the circuit-side rank bound) are welcome.

Selected references

  • OpenAI, Homogeneous depth-five lower bounds for iterated matrix multiplication, preprint, September 25, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Homogeneous-depth-five-lower-bounds-for-iterated-matrix-multiplication-September-25-2026/Homogeneous-depth-five-lower-bounds-for-iterated-matrix-multiplication-September-25-2026.pdf
  • N. Nisan, A. Wigderson, Lower bounds on arithmetic circuits via partial derivatives, FOCS 1995.
  • S. Tavenas, Improved bounds for reduction to depth 4 and depth 3, Inform. and Comput., 2015. https://doi.org/10.1016/j.ic.2014.09.004
  • S. K. Bera, A. Chakrabarti, A depth-five lower bound for iterated matrix multiplication, CCC 2015. https://doi.org/10.4230/LIPIcs.CCC.2015.183
  • M. Kumar, S. Saraf, On the power of homogeneous depth 4 arithmetic circuits, SIAM J. Comput., 2017. https://doi.org/10.1137/140999335
  • M. Kumar, R. Saptharishi, An exponential lower bound for homogeneous depth-5 circuits over finite fields, CCC 2017. https://doi.org/10.4230/LIPIcs.CCC.2017.31
  • N. Limaye, S. Srinivasan, S. Tavenas, Superpolynomial lower bounds against low-depth algebraic circuits, J. ACM, 2025. https://doi.org/10.1145/3734215
  • P. Amireddy, A. Garg, N. Kayal, C. Saha, B. Thankey, Low-depth arithmetic circuit lower bounds: bypassing set-multilinearization, ICALP 2023. https://doi.org/10.4230/LIPIcs.ICALP.2023.12
2 thms1 active userReviewed
AlgebraMathematical Logic·Captain: wurtle

Generalized Star Height at Most ThreeResearch Paper

Motivation: how many nested stars does a regular language need?

A regular expression describes a set of words using letters, union, concatenation and the Kleene star P∗P^*P∗ (any finite repetition of words from PPP). The star height of an expression is the depth of nesting of its stars, and it measures how many layers of unbounded repetition a regular language genuinely needs. For ordinary expressions this hierarchy is infinite. Allowing complement as an additional operation changes the picture: Boolean conditions can replace some layers of repetition, and the generalized star-height problem asks how far this goes. Whether every regular language has generalized star height at most some fixed number — and in particular whether one star always suffices — has been one of the longest-standing questions in the algebraic theory of automata.

Timeline

  • 1963 — Eggan connects ordinary star height with the cycle structure of transition graphs and raises the question of its unboundedness (Michigan Math. J. 1963).
  • 1965 — Schützenberger characterizes the star-free languages (generalized height 000) as those recognized by finite aperiodic monoids (Inform. Control 1965).
  • 1966 — Dejean and Schützenberger show that ordinary star height is unbounded already over a two-letter alphabet (Inform. Control 1966).
  • 1992 — Pin, Straubing and Thérien prove generalized height at most one for languages recognized by finite nilpotent groups of class two and for further monoid classes (Inform. Comput. 1992, Theorems 7.3 and 7.8).
  • 2002 — Straubing distinguishes the questions "is generalized star height bounded?" and "is it at most one?" in his account of the problem (LATIN 2002, p. 537).
  • 2016–2017 — Bourne and Ruškuc prove height-one bounds for subword-counting languages with factors of length at most three (Theor. Comput. Sci. 2016); Bourne extends this to arbitrary fixed factors in his thesis (St Andrews, 2017, hdl:10023/12024).
  • 2026 — Companion OpenAI preprints prove uniform bounds of thirteen (Finite Monoid Computations and a Uniform Generalized Star-Height Bound) and four (Generalized Star Height at Most Four).
  • 2026 — The OpenAI preprint Generalized Star Height at Most Three (OpenAI Math Release, September 25, 2026) claims the bound three. It has not been peer reviewed and its theorem is not formally verified. Whether height one always suffices remains open; no language of generalized height greater than one is known.

Setting

Fix a finite alphabet Σ\SigmaΣ and let Σ∗\Sigma^*Σ∗ be the set of finite words. A generalized regular expression over Σ\SigmaΣ is built from the constants 000 (denoting ∅\emptyset∅) and 111 (denoting {ε}\{\varepsilon\}{ε}), single letters a∈Σa\in\Sigmaa∈Σ, union P∪QP\cup QP∪Q, concatenation PQPQPQ, complement ¬P\neg P¬P (taken in Σ∗\Sigma^*Σ∗), and star P∗P^*P∗. Its height is defined by

h(0)=h(1)=h(a)=0,h(P∪Q)=h(PQ)=max⁡{h(P),h(Q)},h(¬P)=h(P),h(P∗)=1+h(P).h(0)=h(1)=h(a)=0,\quad h(P\cup Q)=h(PQ)=\max\{h(P),h(Q)\},\quad h(\neg P)=h(P),\quad h(P^*)=1+h(P).h(0)=h(1)=h(a)=0,h(P∪Q)=h(PQ)=max{h(P),h(Q)},h(¬P)=h(P),h(P∗)=1+h(P).

For a regular language L⊆Σ∗L\subseteq\Sigma^*L⊆Σ∗, the generalized star height hΣ(L)h_\Sigma(L)hΣ​(L) is the least height of an expression over Σ\SigmaΣ denoting LLL.

In Lean (namespace OAI.GeneralizedStarHeight), expressions are an inductive type Expression Alphabet with exactly these seven constructors, Expression.language interprets them in Mathlib's Language Alphabet (complement is Language complement, i.e. relative to all words), Expression.height is the recursion above, and HasHeightAtMost L n means some expression has language LLL and height at most nnn.

Formalization targets

Goal: generalized star height at most three (Theorem 1.1)

For every finite alphabet Σ\SigmaΣ and every regular language L⊆Σ∗L\subseteq\Sigma^*L⊆Σ∗,

hΣ(L)≤3.h_\Sigma(L)\le 3 .hΣ​(L)≤3.

The goal is published on the platform with status Open.

Significance

The result itself. Before 2026 it was not known whether generalized star height is bounded at all; all positive results covered restricted families of monoids or languages. Theorem 1.1 gives a uniform bound independent of the alphabet and of the recognizing automaton, settling the boundedness question. It leaves open the sharper question of whether height one always suffices: no language is known to require height two. A uniform bound also implies that the hierarchy of generalized heights has at most four nonempty levels, which narrows where any separating example must be sought.

Formalizing it. The statement is short and fully elementary, but the proof composes many constructions (finite-monoid recognition, prefix codes of episodes, split identities, marker scales) whose height accounting is error-prone. A formal proof would certify the boundedness theorem itself. Mathlib already has regular languages (Language.IsRegular) and ordinary regular expressions; this mission adds generalized expressions with complement and their height.

Difficulty

The classical lower bounds for ordinary star height do not transfer once complement is allowed, and complement can simulate many but not obviously all counting arguments. The natural approach — write each fiber of a morphism from Σ∗\Sigma^*Σ∗ to a finite monoid by an expression that simulates the monoid computation letter by letter — needs one star per level of the computation's dependence on earlier history, and the depth of this dependence grows with the monoid. Group components are the difficulty: aperiodic monoids give height zero, but counting modulo nnn and nonabelian group computations require stars, and a uniform bound must handle arbitrary finite groups nested inside arbitrary monoids without the number of stars growing with their size.

Formalization scope

  • The alphabet is any Type u with [Finite Alphabet]; regularity is Mathlib's Language.IsRegular (acceptance by a finite-state DFA).
  • Expressions must use letters of the same alphabet, so no auxiliary letters may be introduced; complement is relative to all words over that alphabet.
  • height charges 111 only for stars; complement, union and concatenation are free, exactly as in the source. Since HasHeightAtMost asks only for existence of an expression, no bound on expression size or computability is claimed, matching the source's remark that the construction bounds nesting only.
  • Needed infrastructure: recognition of regular languages by finite monoids, prefix codes and unique factorization, and closure of bounded-height expressions under Boolean operations. The generalized-expression layer is reusable for the companion bounds (four and thirteen) and for formal work on star-free languages.

Selected references

  • L. C. Eggan, Transition graphs and the star-height of regular events, Michigan Math. J. 10 (1963). https://doi.org/10.1307/mmj/1028998975
  • M.-P. Schützenberger, On finite monoids having only trivial subgroups, Inform. Control 8 (1965). https://doi.org/10.1016/S0019-9958(65)90108-7
  • F. Dejean and M.-P. Schützenberger, On a question of Eggan, Inform. Control 9 (1966). https://doi.org/10.1016/S0019-9958(66)90083-0
  • J.-É. Pin, H. Straubing and D. Thérien, Some results on the generalized star-height problem, Inform. Comput. 101 (1992). https://doi.org/10.1016/0890-5401(92)90063-L
  • H. Straubing, On logical descriptions of regular languages, LATIN 2002, LNCS 2286. https://doi.org/10.1007/3-540-45995-2_46
  • T. Bourne and N. Ruškuc, On the star-height of subword counting languages and their relationship to Rees zero-matrix semigroups, Theor. Comput. Sci. 653 (2016). https://doi.org/10.1016/j.tcs.2016.09.024
  • T. Bourne, Counting subwords and other results related to the generalised star-height problem for regular languages, PhD thesis, University of St Andrews, 2017. https://hdl.handle.net/10023/12024
  • OpenAI, Generalized Star Height at Most Three, OpenAI Math Release preprint, September 25, 2026 (Theorem 1.1, p. 2). https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Generalized-Star-Height-at-Most-Three-September-25-2026/article.pdf
2 thms1 active userReviewed
Complexity TheoryGraph Theory·Captain: wurtle

Variable-dimension Weisfeiler–Leman equivalence on general and subcubic graphsResearch Paper

Motivation

Weisfeiler–Leman (WL) refinement compares two graphs by repeatedly refining colors of ordered vertex kkk-tuples. For every fixed dimension kkk this is a polynomial-time procedure, with running time nO(k)n^{O(k)}nO(k). When kkk is part of the input, that computation is no longer polynomial, and the complexity of deciding the outcome becomes a question in its own right. Seppelt (2024) proved coNP-hardness and recorded Berkholz's question whether the problem is EXPTIME-complete.

This preprint answers that question for the joint-update convention: deciding kkk-WL equivalence of two explicit graphs with kkk in binary is EXPTIME-complete, even on connected graphs of maximum degree three.

Background

  • 1968. Weisfeiler and Leman introduce the refinement method.
  • 1982. Luks shows isomorphism of graphs of bounded degree is decidable in polynomial time.
  • 1992. Cai, Fürer and Immerman construct degree-three graphs with small color classes that remain indistinguishable with linearly many counting variables.
  • 2019. Kiefer and Neuen record the joint-update convention and its bijective (k+1)(k+1)(k+1)-pebble game characterization.
  • 2024–2025. Seppelt, and independently Lichter, Raßmann and Schweitzer, prove coNP-hardness of WL equivalence with the dimension as input. Grohe, Lichter, Neuen and Schweitzer compress CFI graphs to obtain long refinement sequences.
  • 2026. The OpenAI preprint Variable-dimension Weisfeiler–Leman equivalence on general and subcubic graphs (dated September 25, 2026) proves EXPTIME-completeness; companion preprints treat identification and fixed-dimension time lower bounds. It has not been peer reviewed; the Lean goal is open on this platform.

Setting

Graphs are finite, simple, undirected and uncolored, given by adjacency matrices. In the joint-update convention a kkk-tuple's initial color records equalities and adjacencies among its entries; each round adjoins to the old color the multiset, over replacement vertices zzz, of the vector of kkk old colors obtained by replacing each coordinate in turn by zzz. Color names are common to both graphs, and G≡kHG \equiv_k HG≡k​H means their kkk-tuple color histograms agree at every round.

The language WL\mathrm{WL}WL consists of encodings (G,H,k)(G, H, k)(G,H,k) with k≥2k \ge 2k≥2 in binary and G≡kHG \equiv_k HG≡k​H. The language SubWL\mathrm{SubWL}SubWL additionally requires GGG and HHH to be connected, of the same positive order, and of maximum degree at most three. Malformed encodings are excluded.

In Lean (OAI.VariableWL), Graph is a SimpleGraph on Fin order, color and histogram implement the joint update by recursion on rounds, pairCode concatenates the two graph codes (order header plus row-major matrix) and the code of kkk, and complexity classes are defined from an explicit deterministic Turing machine model with OutputsWithin, InEXPTIME, PolytimeReduces and EXPTIMEComplete.

Formalization targets

Goal: Theorem 1.1

Both WL\mathrm{WL}WL and SubWL\mathrm{SubWL}SubWL are EXPTIME-complete under deterministic polynomial-time many-one reductions:

WL, SubWL∈EXPTIME,L≤pWL and L≤pSubWL for every L∈EXPTIME.\mathrm{WL},\ \mathrm{SubWL} \in \mathrm{EXPTIME}, \qquad L \le_p \mathrm{WL} \text{ and } L \le_p \mathrm{SubWL} \text{ for every } L \in \mathrm{EXPTIME}.WL, SubWL∈EXPTIME,L≤p​WL and L≤p​SubWL for every L∈EXPTIME.

Significance

The result. Theorem 1.1 resolves the question recorded by Seppelt and strengthens the known coNP-hardness to EXPTIME-completeness. The subcubic case is notable because isomorphism of bounded-degree graphs is polynomial-time (Luks), yet equivalence under refinement at a supplied dimension remains EXPTIME-complete for degree three; nonisomorphic graphs can be equivalent. Corollary 8.3 shows hardness persists with kkk in unary.

Formalizing it. No machine-checked proof exists; the source is an unrefereed preprint. The uniform computation interface developed here is reused by the companion identification paper, so a formalization would serve both missions.

Difficulty

Membership requires showing that the dimension can be capped before allocating tuple tables (Lemma 2.2), since kkk may exceed the graph order. Hardness requires simulating an arbitrary exponential-time computation by a graph pair whose WL equivalence at a polynomially encoded dimension reflects acceptance. Because the number of address coordinates grows with the input, fixed-dimension constructions with dimension-dependent constants do not give a uniform polynomial-time reduction, and in the subcubic case colors must be realized by uncolored degree-three gadgets that a winning strategy still recognizes.

Formalization scope

  • Graphs: SimpleGraph (Fin order); Subcubic bounds every vertex degree by three; SubWL also demands positive equal orders and connectivity.
  • Equivalence quantifies over all rounds sss; colors are nested Multiset types.
  • Dimension k≥2k \ge 2k≥2 is encoded in binary after a unary length header.
  • The Turing machine model is explicit; EXPTIME bounds are 2c(n+1)d2^{c(n+1)^d}2c(n+1)d and reductions run in c(n+1)dc(n+1)^dc(n+1)d steps.

The statement is not trivial: both membership and hardness are required for both languages.

Needed infrastructure: the bijective game characterization (Lemma 2.4), product-circuit compilation (Proposition 3.2), the general and subcubic realizations (Propositions 5.1 and 7.1) and the uniform compiler (Proposition 8.2). Contributions toward any of these are welcome.

Selected references

  • OpenAI, Variable-dimension Weisfeiler–Leman equivalence on general and subcubic graphs, OpenAI Math Release preprint, September 25, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Variable-dimension-Weisfeiler-Leman-equivalence-on-general-and-subcubic-graphs-September-25-2026/paper.pdf
  • OpenAI, The complexity of identifying a graph by Weisfeiler–Leman refinement, OpenAI Math Release preprint, September 25, 2026. https://github.com/openai/math/blob/main/preprints/The-complexity-of-identifying-a-graph-by-Weisfeiler-Leman-refinement-September-25-2026/paper.pdf
  • B. Weisfeiler, A. Leman, The Reduction of a Graph to Canonical Form and the Algebra Which Appears Therein, 1968. https://www.iti.zcu.cz/wl2018/pdf/wl_paper_translation.pdf
  • J.-Y. Cai, M. Fürer, N. Immerman, An Optimal Lower Bound on the Number of Variables for Graph Identification, Combinatorica 12 (1992). https://doi.org/10.1007/BF01305232
  • E. M. Luks, Isomorphism of Graphs of Bounded Valence Can Be Tested in Polynomial Time, J. Comput. Syst. Sci. 25 (1982). https://doi.org/10.1016/0022-0000(82)90009-5
  • S. Kiefer, D. Neuen, The Power of the Weisfeiler–Leman Algorithm to Decompose Graphs, MFCS 2019.
  • T. Seppelt, An Algorithmic Meta Theorem for Homomorphism Indistinguishability, MFCS 2024.
  • M. Lichter, S. Raßmann, P. Schweitzer, Computational Complexity of the Weisfeiler–Leman Dimension, CSL 2025. https://doi.org/10.4230/LIPIcs.CSL.2025.13
  • M. Grohe, M. Lichter, D. Neuen, P. Schweitzer, Compressing CFI Graphs and Lower Bounds for the Weisfeiler–Leman Refinements, J. ACM 72 (2025). https://doi.org/10.1145/3727978
2 thms1 active userReviewed
Complexity TheoryGraph Theory·Captain: wurtle

Unconditional time lower bounds for Weisfeiler–Leman equivalenceResearch Paper

Motivation

The Weisfeiler–Leman (WL) method colors kkk-tuples of vertices by repeatedly recording their local extension patterns; two graphs are kkk-WL equivalent when the stable color histograms agree. For each fixed kkk the direct algorithm runs in time nO(k)n^{O(k)}nO(k): there are nkn^knk tuples and polynomially many refinement rounds. The question is whether the growing exponent is necessary for any algorithm deciding the equivalence relation, not just for implementations of refinement.

This preprint proves that it is, unconditionally: for every sufficiently large fixed kkk, every deterministic sequential decider for kkk-WL equivalence needs time nckn^{ck}nck at every sufficiently large graph order, without assuming the Exponential Time Hypothesis.

Background

  • 1966. Hennie and Stearns use padded machine indices and clocked self-simulation in their time-hierarchy proof.
  • 1968. Weisfeiler and Leman introduce the refinement method.
  • 1992. Cai, Fürer and Immerman's parity constructions establish limits of bounded-variable graph identification.
  • 1996. Hella introduces the bijective pebble game characterizing counting-logic equivalence.
  • 1999. Grohe proves equivalence in finite-variable logics is complete for polynomial time.
  • 2013. Berkholz proves unconditional time lower bounds with exponent linear in the number of pebbles for existential pebble games.
  • 2024–2025. Seppelt, and Lichter, Raßmann and Schweitzer, prove coNP-hardness of WL equivalence when the dimension is part of the input. Grohe, Lichter, Neuen and Schweitzer prove Ωk(nk/2)\Omega_k(n^{k/2})Ωk​(nk/2) lower bounds on the number of refinement rounds via compressed CFI graphs; such bounds do not constrain other algorithms deciding the equivalence.
  • 2026. The OpenAI preprint Unconditional time lower bounds for Weisfeiler–Leman equivalence (dated September 25, 2026) proves the bound stated below. It has not been peer reviewed; the Lean goal is open on this platform.

Setting

Graphs are finite, simple, undirected and uncolored, given as n×nn \times nn×n adjacency matrices. For a kkk-tuple, the initial color records coordinate equalities and adjacencies. Each refinement step keeps the old color and adds, in the joint convention, the multiset over vertices zzz of the kkk-vectors of colors obtained by replacing each coordinate by zzz; in the separate convention, one such multiset per coordinate. Two nnn-vertex graphs are kkk-WL equivalent if their color histograms agree at every round.

A decider for a convention and dimension kkk is a deterministic machine that halts on every encoded pair of nnn-vertex graphs and accepts exactly the equivalent pairs. Its worst-case time TA(n)T_A(n)TA​(n) is the maximum running time over pairs of nnn-vertex graphs (optionally restricted to connected graphs of diameter at most two).

In Lean (OAI.WLTime), Graph n is a symmetric loopless Boolean matrix on Fin n, tupleColor and histogram define both conventions by recursion on rounds, Equivalent compares all rounds, encodePair encodes nnn and both matrices, and machines are either multitape Turing machines (TM) or logarithmic-word RAMs (RAM) whose word operations are themselves implemented by Turing machines in time polynomial in the word length.

Formalization targets

Goal: Theorem 1.1

There are absolute constants c>0c > 0c>0 and k0k_0k0​ such that for every fixed k≥k0k \ge k_0k≥k0​, either convention, either input class (all graphs, or connected graphs of diameter at most two) and every correct deterministic decider AAA in either machine model, there is n0=n0(A,k)n_0 = n_0(A, k)n0​=n0​(A,k) with

TA(n)≥nckfor every n≥n0.T_A(n) \ge n^{ck} \qquad \text{for every } n \ge n_0 .TA​(n)≥nckfor every n≥n0​.

The exponent constant ccc is independent of kkk and of the program; the threshold n0n_0n0​ may depend on both. The bound holds at every large order, not only infinitely often.

Significance

The result. Theorem 1.1 rules out any running time f(k) ng(k)f(k)\,n^{g(k)}f(k)ng(k) with g(k)=o(k)g(k) = o(k)g(k)=o(k), unconditionally. Earlier lower bounds either concerned the number of refinement rounds, assumed ETH, or treated the dimension as part of the input (coNP- and EXPTIME-hardness), which does not give a fixed-dimension exponent. It covers both standard update conventions and the restricted class of diameter-two graphs.

Formalizing it. No machine-checked proof exists; the source is an unrefereed preprint. The Lean statement fixes explicit machine models, so a proof would include a verified padded diagonalization (Theorem 5.2), a verified computation-to-graph reduction (Theorem 4.3) and a verified compressed consistency construction (Theorem 3.2).

Difficulty

Unconditional time lower bounds in concrete models are rare; the only general technique is diagonalization, which yields hard languages but not hard natural problems. The proof must therefore transfer a diagonal language to WL equivalence through a reduction that is efficient enough to preserve an exponent linear in kkk. A polynomial-time computation with exponent proportional to kkk has too many addressed locations to list in a small reduction, and local consistency is symmetric whereas a computation must propagate information forward without forcing false predecessors to become true.

Formalization scope

  • Decides A c k p requires halting and correctness on every pair in the input class at every order nnn; worstTime is a Finset.sup over pairs in the class.
  • Diameter two includes n>0n > 0n>0 and every pair of vertices equal, adjacent, or with a common neighbour (hence connected).
  • Turing machines have finitely many tapes, states and symbols; RAM words have O(log⁡(n+2))O(\log(n+2))O(log(n+2)) bits, and RAM instructions are fixed finite programs whose word operations carry a polynomial-time implementation.
  • Time is a natural number; the bound nckn^{ck}nck is compared in ℝ.

The statement is not vacuous: correct deciders exist (direct refinement), so the conclusion constrains real algorithms.

Needed infrastructure: bijective pebble games and their equivalence with refinement (Lemma 2.3), Turing machine simulation and clocking, and the graph constructions of Sections 3–4. Contributions toward any of these components are welcome.

Selected references

  • OpenAI, Unconditional time lower bounds for Weisfeiler–Leman equivalence, OpenAI Math Release preprint, September 25, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Unconditional-time-lower-bounds-for-Weisfeiler-Leman-equivalence-September-25-2026/paper.pdf
  • B. Weisfeiler, A. Leman, The Reduction of a Graph to Canonical Form and the Algebra Which Appears Therein, 1968. https://www.iti.zcu.cz/wl2018/pdf/wl_paper_translation.pdf
  • J.-Y. Cai, M. Fürer, N. Immerman, An Optimal Lower Bound on the Number of Variables for Graph Identification, Combinatorica 12 (1992). https://doi.org/10.1007/BF01305232
  • L. Hella, Logical Hierarchies in PTIME, Information and Computation 129 (1996). https://doi.org/10.1006/inco.1996.0070
  • F. C. Hennie, R. E. Stearns, Two-Tape Simulation of Multitape Turing Machines, J. ACM 13 (1966). https://doi.org/10.1145/321356.321362
  • C. Berkholz, Lower Bounds for Existential Pebble Games and k-Consistency Tests, Logical Methods in Computer Science 9 (2013).
  • M. Grohe, Equivalence in Finite-Variable Logics Is Complete for Polynomial Time, Combinatorica 19 (1999). https://doi.org/10.1007/s004939970004
  • M. Grohe, M. Lichter, D. Neuen, P. Schweitzer, Compressing CFI Graphs and Lower Bounds for the Weisfeiler–Leman Refinements, J. ACM 72 (2025). https://doi.org/10.1145/3727978
  • M. Lichter, S. Raßmann, P. Schweitzer, Computational Complexity of the Weisfeiler–Leman Dimension, arXiv:2402.11531, 2024. https://arxiv.org/abs/2402.11531
  • T. Seppelt, An Algorithmic Meta Theorem for Homomorphism Indistinguishability, MFCS 2024.
2 thms1 active userReviewed
Complexity TheoryGraph Theory·Captain: wurtle

The complexity of identifying a graph by Weisfeiler–Leman refinementResearch Paper

Motivation

The Weisfeiler–Leman (WL) algorithm refines colors of vertex tuples to test graph isomorphism, and its dimension kkk controls how much tuple information is used. A graph's Weisfeiler–Leman dimension WLdim(G)\mathrm{WLdim}(G)WLdim(G) is the least kkk for which kkk-WL refinement identifies GGG, i.e. distinguishes it from every non-isomorphic graph. This is a standard measure of the descriptive complexity of an individual graph, tied to counting logics and pebble games. The question here is how hard it is to compute: given GGG and kkk, decide whether WLdim(G)≤k\mathrm{WLdim}(G) \le kWLdim(G)≤k.

Identification differs from testing whether a given pair of graphs is equivalent: it quantifies over every possible comparison graph. The preprint shows the problem is EXPTIME-complete when kkk is part of the input.

Background

  • 1968. Weisfeiler and Leman introduce the refinement method.
  • 1992. Cai, Fürer and Immerman relate WL to counting logic and pebble games and construct parity graphs needing linear dimension.
  • 2017. Arvind, Köbler, Rattan and Verbitsky prove P-hardness of identification by color refinement (dimension one).
  • 2019. Kiefer and Neuen give a game formulation used to analyze WL decompositions.
  • 2024. Seppelt proves coNP-hardness of variable-dimension pair equivalence.
  • 2025. Lichter, Raßmann and Schweitzer prove P-hardness of identification for each fixed k≥2k \ge 2k≥2 and NP-hardness when the dimension is part of the input, including on simple uncolored graphs; they also prove coNP-hardness of pair equivalence independently. Grohe, Lichter, Neuen and Schweitzer introduce compressed CFI graphs for round lower bounds.
  • 2026. The OpenAI preprint The complexity of identifying a graph by Weisfeiler–Leman refinement (dated September 25, 2026) proves EXPTIME-completeness, building on the companion preprint on variable-dimension WL equivalence. It has not been peer reviewed; the Lean goal is open on this platform.

Setting

All graphs are finite, simple, undirected and uncolored. For k≥2k \ge 2k≥2 the joint-update convention is used: a kkk-tuple starts with its equality and adjacency type, and each round adjoins the multiset over vertices zzz of the vector of colors obtained by replacing each coordinate by zzz. For k=1k = 1k=1 ordinary color refinement is used. Colors are shared between graphs. G≡kHG \equiv_k HG≡k​H means the tuple-color histograms agree at every round. kkk-WL identifies GGG if G≡kHG \equiv_k HG≡k​H implies G≅HG \cong HG≅H for every graph HHH, and WLdim(G)\mathrm{WLdim}(G)WLdim(G) is the least positive such kkk.

The decision problem takes a nonempty graph GGG by its adjacency matrix and a positive integer kkk in binary, and asks whether WLdim(G)≤k\mathrm{WLdim}(G) \le kWLdim(G)≤k; malformed inputs are rejected.

In Lean (OAI.WLIdentification), Graph is an order with a symmetric loopless Boolean adjacency on Fin order; Equivalent, Identifies and WLdim follow the definitions above; inputs are bit words consisting of a unary order header, the row-major matrix and the binary dimension; complexity classes are defined from an explicit deterministic single-tape Turing machine model (Machine, run, DecidesWithin, InEXPTIME, PolytimeManyOne, EXPTIMEComplete).

Formalization targets

Goal: Theorem 1.1

The language

{⟨G,k⟩:G nonempty, k≥1, WLdim(G)≤k}\{\langle G, k\rangle : G \text{ nonempty},\ k \ge 1,\ \mathrm{WLdim}(G) \le k\}{⟨G,k⟩:G nonempty, k≥1, WLdim(G)≤k}

is EXPTIME-complete under deterministic polynomial-time many-one reductions: it is decidable in time 2C(n+1)d2^{C(n+1)^d}2C(n+1)d, and every EXPTIME language reduces to it in polynomial time.

Significance

The result. Theorem 1.1 settles the complexity of the input-dimension identification problem, strengthening the NP-hardness of Lichter, Raßmann and Schweitzer to EXPTIME-completeness. By Corollary 7.3 hardness persists with kkk in unary, so it does not come from exponentially large numerical dimensions.

Formalizing it. No machine-checked proof exists; the source is an unrefereed preprint. A formal proof would include a verified reduction from arbitrary exponential-time Turing machine computations to graphs, and a verified upper bound for WL identification. The Turing-machine model and the WL definitions in the Lean statement are reusable for the companion missions on WL equivalence.

Difficulty

Hardness must handle the all-mates quantifier: an encoding of a computation into a graph must ensure that every graph HHH that is kkk-WL equivalent to it is isomorphic to it exactly when the computation accepts. Local recognition of gadgets, as in earlier NP-hardness proofs, shows each incidence piece of HHH has an allowed pattern, but the encoding here admits a whole family of shifted constraints, and one must show every shift arising from an equivalent mate lifts to a single global isomorphism on accepting instances. Membership in EXPTIME is also not immediate, since identification quantifies over infinitely many comparison graphs.

Formalization scope

  • Graphs are Fin n-indexed Boolean adjacency matrices; the problem language requires a nonempty graph, a binary word with leading bit true, and a positive value.
  • WLdim G is sInf of the positive identifying dimensions; this set is nonempty for finite graphs (dimension equal to the order identifies), so the infimum is not the default value.
  • Time is counted in steps of the explicit Turing machine on the input length; EXPTIME uses bounds 2C(n+1)d2^{C(n+1)^d}2C(n+1)d and reductions use bounds C(n+1)dC(n+1)^dC(n+1)d.

The goal is not trivial: membership in EXPTIME and hardness under the explicit machine model are both required.

Needed infrastructure: WL refinement monotonicity, pebble games or an equivalent characterization, CFI-type gadget constructions, and Turing-machine simulation. Contributions toward the upper bound (Proposition 7.1) or the reconstruction results of Sections 3–5 are welcome.

Selected references

  • OpenAI, The complexity of identifying a graph by Weisfeiler–Leman refinement, OpenAI Math Release preprint, September 25, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/The-complexity-of-identifying-a-graph-by-Weisfeiler-Leman-refinement-September-25-2026/paper.pdf
  • OpenAI, Variable-dimension Weisfeiler–Leman equivalence on general and subcubic graphs, OpenAI Math Release preprint, September 25, 2026. https://github.com/openai/math/blob/main/preprints/Variable-dimension-Weisfeiler-Leman-equivalence-on-general-and-subcubic-graphs-September-25-2026/paper.pdf
  • B. Weisfeiler, A. Leman, The Reduction of a Graph to Canonical Form and the Algebra Which Appears Therein, Nauchno-Technicheskaya Informatsiya, 1968. https://www.iti.zcu.cz/wl2018/pdf/wl_paper_translation.pdf
  • J.-Y. Cai, M. Fürer, N. Immerman, An Optimal Lower Bound on the Number of Variables for Graph Identification, Combinatorica 12 (1992). https://doi.org/10.1007/BF01305232
  • V. Arvind, J. Köbler, G. Rattan, O. Verbitsky, Graph Isomorphism, Color Refinement, and Compactness, Computational Complexity 26 (2017).
  • M. Lichter, S. Raßmann, P. Schweitzer, Computational Complexity of the Weisfeiler–Leman Dimension, CSL 2025. https://doi.org/10.4230/LIPIcs.CSL.2025.13 (full version https://arxiv.org/abs/2402.11531)
  • T. Seppelt, An Algorithmic Meta Theorem for Homomorphism Indistinguishability, MFCS 2024.
  • M. Grohe, M. Lichter, D. Neuen, P. Schweitzer, Compressing CFI Graphs and Lower Bounds for the Weisfeiler–Leman Refinements, J. ACM 72 (2025). https://doi.org/10.1145/3727978
  • S. Kiefer, D. Neuen, The Power of the Weisfeiler–Leman Algorithm to Decompose Graphs, MFCS 2019.
2 thms1 active userReviewed
Complexity TheoryLinear algebra·Captain: wurtle

Finite tensor savings and exact Fourier circuitsResearch Paper

Motivation

The discrete Fourier transform of length nnn is computed by the fast Fourier transform with O(nlog⁡n)O(n\log n)O(nlogn) arithmetic operations, and this has been the benchmark since Cooley and Tukey (1965). Whether Ω(nlog⁡n)\Omega(n\log n)Ω(nlogn) operations are necessary is one of the basic open questions of algebraic complexity theory. Lower bounds of order nlog⁡nn\log nnlogn are known only under restrictions on the algorithm: bounded coefficients, unitary 2×22\times22×2 gates on exactly nnn registers, or bounded conditioning of intermediate maps. In the unrestricted model of linear circuits, where coefficients are arbitrary complex numbers and only arithmetic operations are counted, the question remained open. This mission concerns that unrestricted question.

Timeline

  • 1958. Good gives the multidimensional (coprime-factor) form of the Fourier transform (doi:10.1111/j.2517-6161.1958.tb00300.x).
  • 1965. Cooley and Tukey publish the fast Fourier transform (doi:10.1090/S0025-5718-1965-0178586-1).
  • 1969–1970. Rabiner, Schafer and Rader (chirp zzz-transform) and Bluestein reduce arbitrary lengths to convolution (doi:10.1109/TAU.1969.1162034, doi:10.1109/TAU.1970.1162132).
  • 1973. Morgenstern proves an Ω(nlog⁡n)\Omega(n\log n)Ω(nlogn) lower bound for linear circuits with bounded coefficients (doi:10.1145/321752.321761).
  • 2013–2014. Ailon proves lower bounds for 2×22\times22×2 unitary gate models and for well-conditioned computations (arXiv:1305.4745, arXiv:1403.1307).
  • 2023. Alman and Rao improve the leading constants for power-of-two transforms via matrix non-rigidity (doi:10.1145/3564246.3585188).
  • 2025. Alman and Li characterize asymptotic sizes of depth-two circuits for Kronecker powers (arXiv:2509.14489).

The source of this mission, an OpenAI preprint dated September 25, 2026, claims that the Ω(nlog⁡n)\Omega(n\log n)Ω(nlogn) lower bound fails in the unrestricted complex linear-circuit model.

Setting

For n≥2n\ge2n≥2 let ζn=e2πi/n\zeta_n=e^{2\pi i/n}ζn​=e2πi/n and Fn=(ζnjk)0≤j,k<nF_n=(\zeta_n^{jk})_{0\le j,k<n}Fn​=(ζnjk​)0≤j,k<n​. A linear circuit of length nnn has inputs x0,…,xn−1x_0,\dots,x_{n-1}x0​,…,xn−1​ and the constant 000, followed by a finite sequence of gates. Each gate computes u+vu+vu+v, u−vu-vu−v or λu\lambda uλu from previously available values u,vu,vu,v, where λ∈C\lambda\in\mathbb Cλ∈C is a fixed coefficient; each gate costs one. Values may be reused arbitrarily, and the nnn outputs are designated available values. The circuit computes FnF_nFn​ if its outputs equal FnxF_nxFn​x for every x∈Cnx\in\mathbb C^nx∈Cn. Coefficients may depend on nnn and have no bound on size or description; depth, storage and conditioning are unrestricted. Let L(n)L(n)L(n) be the minimum number of gates.

Formalization targets

Goal: Theorem 1.1

lim inf⁡n→∞L(n)nlog⁡2n=0,\liminf_{n\to\infty}\frac{L(n)}{n\log_2 n}=0,n→∞liminf​nlog2​nL(n)​=0,

equivalently: for every c>0c>0c>0 and every N0≥2N_0\ge2N0​≥2 there are n≥N0n\ge N_0n≥N0​ and an exact circuit for FnF_nFn​ with fewer than c nlog⁡2nc\,n\log_2 ncnlog2​n gates. The Lean statement OAI.ExactFourier.main_theorem is this second form and is open on the platform.

The statement does not assert an upper bound for every length, a uniform construction, or anything about numerical stability. A companion OpenAI preprint gives a quantitative all-length bound in a model that also charges coefficient preparation; that result is not part of this mission.

Significance

The theorem refutes the assertion that L(n)≥c nlog⁡2nL(n)\ge c\,n\log_2nL(n)≥cnlog2​n for some fixed c>0c>0c>0 and all large nnn in the unrestricted linear model. It shows that the known lower bounds necessarily depend on their restrictions (bounded coefficients, conditioning, unitary gates). The mechanism, a single finite tensor saving amplified through tensor powers, is a general tool: one strict improvement over the standard axis-by-axis algorithm for one tensor power of one nonmonomial matrix yields an exponent improvement for all tensor powers.

The result is claimed in an OpenAI preprint; it has not been peer reviewed and no machine-checked proof exists. The existence part of the argument is non-constructive (it proceeds by contradiction through price functions and compactness), so a formal proof is a meaningful check.

Difficulty

Leading-constant improvements of the FFT do not change the nlog⁡nn\log nnlogn scale, and every classical structural algorithm (Cooley–Tukey, Good–Thomas, chirp) has that scale. A gain in the exponent of the logarithm needs a saving that compounds across many tensor factors; but a saving for one tensor power of a small matrix does not obviously transfer to Fourier matrices of growing length, because Fourier factorizations introduce diagonal twiddle factors and change the coordinate set. In addition, the existence of a single finite saving is itself not exhibited explicitly and must be proved.

Formalization scope

  • Gate w is add i j, sub i j or scale c i with c : ℂ, referencing the www values available so far.
  • Program n k is a list of kkk gates in topological order; values 0,…,n−10,\dots,n-10,…,n−1 are the inputs and value nnn is the constant 000 (via Fin.snoc x 0).
  • Circuit n has size, a program of that size, and outputs : Fin n → Fin (n+1+size); output selection is free.
  • fourierMatrix n j k = zeta n ^ (j*k) with zeta n = exp(2πi/n); Computes is equality with mulVec for every input.
  • MainStatement: for every real c>0c>0c>0 and N0≥2N_0\ge2N0​≥2 there are n≥N0n\ge N_0n≥N0​ and a computing circuit with size < c * n * logb 2 n.

A complete development needs tensor products of matrices and circuits, the Chinese Remainder (Good–Thomas) identification of FrsF_{rs}Frs​ with Fr⊗FsF_r\otimes F_sFr​⊗Fs​ for coprime r,sr,sr,s, a Toeplitz/Vandermonde factorization of FrF_rFr​ on its own coordinates, and the price-function existence argument (separation, compactness, feedback). Contributions formalizing Lemma 2.3 (tensor amplification) and Proposition 3.4 (transfer of a finite win to Fourier circuits) are natural first steps.

Selected references

  • OpenAI, Finite tensor savings and exact Fourier circuits, preprint, September 25, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Finite-tensor-savings-and-exact-Fourier-circuits-September-25-2026/main.pdf
  • J. W. Cooley, J. W. Tukey, An algorithm for the machine calculation of complex Fourier series, Math. Comp., 1965. https://doi.org/10.1090/S0025-5718-1965-0178586-1
  • J. Morgenstern, Note on a lower bound on the linear complexity of the fast Fourier transform, J. ACM, 1973. https://doi.org/10.1145/321752.321761
  • N. Ailon, A lower bound for Fourier transform computation in a linear model over 2×2 unitary gates, preprint, 2013. https://arxiv.org/abs/1305.4745
  • N. Ailon, An Ω((nlog⁡n)/R)\Omega((n\log n)/R)Ω((nlogn)/R) lower bound for Fourier transform computation in the RRR-well conditioned model, preprint, 2014. https://arxiv.org/abs/1403.1307
  • J. Alman, K. Rao, Faster Walsh–Hadamard and discrete Fourier transforms from matrix non-rigidity, STOC 2023. https://doi.org/10.1145/3564246.3585188
  • I. J. Good, The interaction algorithm and practical Fourier analysis, J. R. Stat. Soc. B, 1958. https://doi.org/10.1111/j.2517-6161.1958.tb00300.x
  • J. Alman, B. Li, Kronecker powers, orthogonal vectors, and the asymptotic spectrum, preprint, 2025. https://arxiv.org/abs/2509.14489
2 thms1 active userReviewed
PreviousPage 16 of 19Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me