Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Complexity Theory

136 missions · 53 completed

Missions

Open83Completed53All136
Graph TheoryTheoretical Computer Science·Captain: wurtle

The Factor-Two Hardness Threshold for Vertex CoverResearch Paper

Motivation

A vertex cover of a graph is a set of vertices meeting every edge; τ(G)\tau(G)τ(G) denotes the minimum size of one. Computing τ(G)\tau(G)τ(G) exactly is NP-hard, but a two-line algorithm — take both endpoints of a maximal matching — always returns a cover of size at most 2τ(G)2\tau(G)2τ(G). Whether any polynomial-time algorithm achieves a fixed factor 2−ε2-\varepsilon2−ε is one of the best-known questions in approximation algorithms. Unconditional NP-hardness was known below 105−21≈1.3610\sqrt5-21\approx1.36105​−21≈1.36 and, after the 2-to-2 Games Theorem, below 2\sqrt22​; factor-two hardness was known only under Khot's Unique Games Conjecture.

This mission asks for a machine-checked proof that every fixed approximation factor below two is NP-hard, as claimed in an OpenAI preprint dated September 23, 2026 (source, Corollary 1.2, p. 1). The preprint's direct reduction starts from ordinary perfect-completeness Label Cover. It has not been peer reviewed and its claim has not been independently verified; on the platform the Lean goal is open.

Timeline

  • 1972 — Karp proves Node Cover NP-complete (Karp 1972); the maximal-matching algorithm gives factor 222.
  • 1992–1998 — Feige–Goldwasser–Lovász–Safra–Szegedy (JACM 1996) link proof checking to approximation; the PCP theorem (Arora–Safra, JACM 1998; Arora–Lund–Motwani–Sudan–Szegedy, JACM 1998) gives a constant gap; Raz's parallel repetition (SICOMP 1998) yields Label Cover with arbitrarily small soundness.
  • 2001 — Håstad: NP-hard below factor 7/67/67/6 (JACM 2001).
  • 2005 — Dinur–Safra: NP-hard below 105−21≈1.3606810\sqrt5-21\approx1.36068105​−21≈1.36068 (Annals 2005).
  • 2002–2008 — Khot's Unique Games Conjecture (STOC 2002); Khot–Regev prove factor-(2−ε)(2-\varepsilon)(2−ε) hardness assuming it (JCSS 2008).
  • 2009 — Karakostas's algorithm achieves 2−Θ(1/log⁡n)2-\Theta(1/\sqrt{\log n})2−Θ(1/logn​) (TALG 2009), a saving that vanishes with nnn.
  • 2017–2023 — The 2-to-2 Games programme (Khot–Minzer–Safra, ToC 2025; Dinur–Khot–Kindler–Minzer–Safra, ToC 2025; Barak–Kothari–Steurer, ITCS 2019; Khot–Minzer–Safra expansion, Annals 2023) gives NP-hardness below 2\sqrt22​.
  • 2026 — The OpenAI preprint claims NP-hardness for every fixed factor below 222.

Setting

A graph is finite, simple, undirected and unweighted, given explicitly by its vertex count nnn and a duplicate-free list of edges {u,v}\{u,v\}{u,v} with u<vu<vu<v. A set SSS of vertices is a cover if every edge has an endpoint in SSS, and τ(G)\tau(G)τ(G) is the least size of a cover. An α\alphaα-approximation algorithm is a deterministic polynomial-time machine that, on every graph, outputs a duplicate-free list of vertices that covers all edges and has length at most α τ(G)\alpha\,\tau(G)ατ(G).

3SAT inputs are bit strings decoding canonically to a conjunction of three-slot clauses; malformed strings are NO instances. A 3SAT decider is a deterministic polynomial-time machine answering membership correctly on every input.

Formalization targets

Milestone: the explicit cover gap (Theorem 1.1, p. 1)

For every integer m≥4m\ge4m≥4 there is a deterministic polynomial-time reduction φ↦Gφ\varphi\mapsto G_\varphiφ↦Gφ​ from 3SAT to explicit simple graphs with

φ satisfiable⇒τ(Gφ)<(12+1m)∣V(Gφ)∣,φ unsatisfiable⇒τ(Gφ)>(1−1m)∣V(Gφ)∣.\varphi\text{ satisfiable}\Rightarrow \tau(G_\varphi)<\Bigl(\tfrac12+\tfrac1m\Bigr)|V(G_\varphi)|,\qquad \varphi\text{ unsatisfiable}\Rightarrow \tau(G_\varphi)>\Bigl(1-\tfrac1m\Bigr)|V(G_\varphi)|.φ satisfiable⇒τ(Gφ​)<(21​+m1​)∣V(Gφ​)∣,φ unsatisfiable⇒τ(Gφ​)>(1−m1​)∣V(Gφ​)∣.

The ratio of the thresholds is 2−6/(m+2)→22-6/(m+2)\to22−6/(m+2)→2. In Lean: OAI.VertexCover.explicit_cover_gap.

Goal: factor-two threshold (Corollary 1.2, p. 1)

For every real α\alphaα with 1≤α<21\le\alpha<21≤α<2, an α\alphaα-approximation algorithm for Vertex Cover yields a polynomial-time 3SAT decider:

∀ α∈[1,2):Approximation(α)  ⟹  ThreeSATDecision.\forall\,\alpha\in[1,2):\quad \mathrm{Approximation}(\alpha)\;\Longrightarrow\;\mathrm{ThreeSATDecision}.∀α∈[1,2):Approximation(α)⟹ThreeSATDecision.

In Lean: OAI.VertexCover.every_fixed_factor_below_two. The preprint derives it from Theorem 1.1 in its final section (pp. 23–24) by choosing mmm from α\alphaα and comparing the returned cover with an exact rational threshold. Together with the matching algorithm, it identifies 222 as the approximation threshold unless P = NP.

Significance

The result itself. The statement removes the Unique Games hypothesis from the Khot–Regev theorem and closes the gap between the elementary factor-222 algorithm and hardness. The density gap of Theorem 1.1 is also a statement about independent sets: YES graphs have independent sets of density nearly 1/21/21/2, NO graphs have none of density above 1/m1/m1/m.

Formalizing it. No machine-checked proof of any super-constant Vertex Cover hardness bound is known to exist. A complete development requires the perfect-completeness Label Cover theorem (Theorem 2.1, p. 4; PCP theorem plus parallel repetition, used as an external input), the explicit graph construction and its polynomial-time implementation (Proposition 3.3, p. 7), and the preprint's analytic soundness argument. The Label Cover input and a library for polynomial-time gap reductions on TM2 machines are reusable for many other hardness missions.

Difficulty

Soundness requires extracting short lists of candidate labels from an arbitrary large independent set, where each list may depend only on its own position's query. If a list also sees the opposite endpoint of a constraint or its occurrence index, the pair-decoding argument against Label Cover soundness breaks down (Introduction, pp. 3–4). Classical approaches either need the stronger Unique Games source promise (Khot–Regev) or only reach densities near 1−1/21-1/\sqrt21−1/2​ (the 2-to-2 route), which gives factor 2\sqrt22​ rather than 222. Averaging to impose the information restriction can erase all variance; the analytic core is retaining it without any dependence on the label alphabet sizes.

Formalization scope

  • Graphs are VertexCover.ExplicitGraph: n : ℕ and a Nodup list of pairs in Fin n × Fin n with e.1 < e.2; coverNumber is the least cardinality of a covering Finset (always defined since univ covers).
  • Encodings: inputs are raw bits; graphs are encoded by ExplicitGraph.bits (vertex count, all vertex names, edge count, edge endpoints, each with prefix-free binary framing); an approximation's output list is encoded by natListBits.
  • Approximation α bundles a polynomial-time TM2 program on graph encodings with finite tape alphabets, whose output is duplicate-free, in range, covers every edge and has length at most α * coverNumber. ThreeSATDecision is a polynomial-time TM2 decider correct on every input.
  • The goal is an implication from an algorithm to a decider: no assumption P ≠ NP is built in, and the hypothesis 1≤α<21\le\alpha<21≤α<2 is satisfied by real algorithms only if 3SAT is easy, which is exactly the content. It cannot be discharged trivially because Approximation α must be correct on every graph.
  • The milestone's thresholds are compared in ℝ with strict inequalities as in the source.

Welcome contributions: Label Cover hardness (PCP theorem + parallel repetition), Efron–Stein decompositions and variance inequalities on product spaces, and general complexity-theoretic infrastructure for Turing.TM2ComputableInPolyTime.

Selected references

  • OpenAI, The Factor-Two Hardness Threshold for Vertex Cover, OpenAI Math Release preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/The-Factor-Two-Hardness-Threshold-for-Vertex-Cover-September-23-2026/paper.pdf
  • R. M. Karp, Reducibility among combinatorial problems, Complexity of Computer Computations, 1972. https://doi.org/10.1007/978-1-4684-2001-2_9
  • J. Håstad, Some optimal inapproximability results, J. ACM 48 (2001). https://doi.org/10.1145/502090.502098
  • I. Dinur, S. Safra, On the hardness of approximating minimum vertex cover, Ann. of Math. 162 (2005). https://doi.org/10.4007/annals.2005.162.439
  • S. Khot, O. Regev, Vertex cover might be hard to approximate to within 2−ε, J. Comput. Syst. Sci. 74 (2008). https://doi.org/10.1016/j.jcss.2007.06.019
  • G. Karakostas, A better approximation ratio for the Vertex Cover problem, ACM Trans. Algorithms (2009). https://doi.org/10.1145/1597036.1597045
  • R. Raz, A parallel repetition theorem, SIAM J. Comput. (1998). https://doi.org/10.1137/S0097539795280895
  • S. Khot, D. Minzer, M. Safra, Pseudorandom sets in Grassmann graph have near-perfect expansion, Ann. of Math. 198 (2023). https://doi.org/10.4007/annals.2023.198.1.1
  • I. Dinur, S. Khot, G. Kindler, D. Minzer, M. Safra, Towards a proof of the 2-to-1 games conjecture?, Theory of Computing 21 (2025). https://doi.org/10.4086/toc.2025.v021a011
  • S. Khot, On the power of unique 2-prover 1-round games, STOC 2002. https://doi.org/10.1145/509907.510017
3 thms1 active userReviewed
Operations ResearchTheoretical Computer Science·Captain: wurtle

A Direct Proof of Optimal Max-Cut HardnessResearch Paper

Motivation

Max-Cut asks for a partition of the vertices of a graph that maximizes the number of edges crossing it. Its decision version is one of Karp's original NP-complete problems, so the natural question is how well it can be approximated in polynomial time. Goemans and Williamson's semidefinite-programming algorithm with random-hyperplane rounding achieves ratio approaching

αGW=min⁡−1≤ρ<12arccos⁡ρπ(1−ρ)=0.878567…\alpha_{\mathrm{GW}}=\min_{-1\le\rho<1}\frac{2\arccos\rho}{\pi(1-\rho)}=0.878567\ldotsαGW​=−1≤ρ<1min​π(1−ρ)2arccosρ​=0.878567…

(GW 1995). Whether any polynomial-time algorithm can beat this constant is a central question of approximation algorithms: unconditional NP-hardness was known only above 16/1716/1716/17, and optimality of αGW\alpha_{\mathrm{GW}}αGW​ was known only under Khot's Unique Games Conjecture.

This mission asks for a machine-checked proof that approximating Max-Cut within any fixed ratio α∈(αGW,1]\alpha\in(\alpha_{\mathrm{GW}},1]α∈(αGW​,1] is NP-hard, even on simple unweighted graphs, as claimed in an OpenAI preprint dated September 23, 2026 (source, Theorem 1.1, p. 1). The preprint gives a direct reduction from the 2-to-1 Games Theorem, not via the Unique Games Conjecture. It has not been peer reviewed and its claim has not been independently verified; on the platform the Lean goal is open.

Timeline

  • 1972 — Karp lists Max-Cut among the original NP-complete problems (Karp 1972).
  • 1995 — Goemans and Williamson give the SDP algorithm with ratio αGW\alpha_{\mathrm{GW}}αGW​ (JACM 1995).
  • 2000–2001 — Håstad's optimal inapproximability results (JACM 2001) combined with the gadgets of Trevisan, Sorkin, Sudan and Williamson (SICOMP 2000) rule out ratios above 16/1716/1716/17.
  • 2002 — Feige and Schechtman show the SDP integrality gap approaches αGW\alpha_{\mathrm{GW}}αGW​ (RSA 2002); Khot formulates the Unique Games Conjecture (STOC 2002).
  • 2007–2010 — Khot, Kindler, Mossel and O'Donnell prove that αGW\alpha_{\mathrm{GW}}αGW​ is optimal assuming the UGC, conditional on Majority Is Stablest (SICOMP 2007), which Mossel, O'Donnell and Oleszkiewicz prove (Annals 2010) via Borell's Gaussian noise-stability bound (1985). O'Donnell–Wu (STOC 2008) and Raghavendra (STOC 2008) extend the UG-based picture.
  • 2017–2025 — The Grassmann-graph programme establishes the 2-to-1 Games Theorem with imperfect completeness: Khot–Minzer–Safra (ToC 2025), Dinur–Khot–Kindler–Minzer–Safra (ToC 2025), Barak–Kothari–Steurer (ITCS 2019), Khot–Minzer–Safra expansion (Annals 2023).
  • 2026 — The OpenAI preprint claims unconditional NP-hardness at every ratio above αGW\alpha_{\mathrm{GW}}αGW​.

Setting

A simple unweighted graph on NNN vertices is given by a symmetric, loopless Boolean adjacency table. A cut is a map ccc from the vertices to {0,1}\{0,1\}{0,1}; its size is the number of unordered edges {u,v}\{u,v\}{u,v} with c(u)≠c(v)c(u)\ne c(v)c(u)=c(v), and MaxCut(G)\mathrm{MaxCut}(G)MaxCut(G) is the largest cut size. An algorithm is an α\alphaα-approximation if it always returns a cut of size at least α⋅MaxCut(G)\alpha\cdot\mathrm{MaxCut}(G)α⋅MaxCut(G).

3SAT inputs are bit strings decoding canonically to a conjunction of three-slot clauses (repeated variables and literals allowed); malformed strings are NO instances. A gap reduction for α\alphaα consists of rationals Y>0Y>0Y>0 and N≥0N\ge0N≥0 with N<αYN<\alpha YN<αY, and a deterministic polynomial-time map φ↦(Gφ,Qφ)\varphi\mapsto(G_\varphi,Q_\varphi)φ↦(Gφ​,Qφ​) outputting a graph together with a positive integer scale QφQ_\varphiQφ​ such that

φ∈3SAT⇒MaxCut(Gφ)Qφ≥Y,φ∉3SAT⇒MaxCut(Gφ)Qφ≤N.\varphi\in\mathrm{3SAT}\Rightarrow \frac{\mathrm{MaxCut}(G_\varphi)}{Q_\varphi}\ge Y,\qquad \varphi\notin\mathrm{3SAT}\Rightarrow \frac{\mathrm{MaxCut}(G_\varphi)}{Q_\varphi}\le N.φ∈3SAT⇒Qφ​MaxCut(Gφ​)​≥Y,φ∈/3SAT⇒Qφ​MaxCut(Gφ​)​≤N.

Given such a reduction, an α\alphaα-approximation algorithm would decide 3SAT by comparing its output with NQφN Q_\varphiNQφ​.

Formalization targets

Goal: optimal Max-Cut hardness (Theorem 1.1, p. 1)

For every real α\alphaα with αGW<α≤1\alpha_{\mathrm{GW}}<\alpha\le1αGW​<α≤1, a gap reduction for α\alphaα from 3SAT to simple unweighted Max-Cut exists:

∀ α∈(αGW,1]:GapReduction(α)≠∅.\forall\,\alpha\in(\alpha_{\mathrm{GW}},1]:\quad \mathrm{GapReduction}(\alpha)\ne\varnothing.∀α∈(αGW​,1]:GapReduction(α)=∅.

In Lean this is OAI.OptimalMaxCut.main : OptimalMaxCut.MainStatement. The preprint proves it from a sharper weighted gap (Theorem 1.2, p. 2): for rational t∈(0,1)t\in(0,1)t∈(0,1), B(t)=2πarcsin⁡tB(t)=\tfrac{2}{\pi}\arcsin tB(t)=π2​arcsint and 0<ε<(t−B(t))/40<\varepsilon<(t-B(t))/40<ε<(t−B(t))/4, it is NP-hard to distinguish Val≥1+t2−ε\mathrm{Val}\ge\frac{1+t}{2}-\varepsilonVal≥21+t​−ε from Val≤1+B(t)2+ε\mathrm{Val}\le\frac{1+B(t)}{2}+\varepsilonVal≤21+B(t)​+ε on graphs with a rational edge distribution; Appendix B (p. 35) converts weighted graphs to simple unweighted ones.

Significance

The result itself. Theorem 1.1 shows that the Goemans–Williamson algorithm is optimal among polynomial-time algorithms unless P = NP, removing the Unique Games hypothesis from the result of Khot, Kindler, Mossel and O'Donnell. It is the most prominent instance of an SDP-tight threshold, and the gap form (Theorem 1.2) gives a whole curve of completeness/soundness pairs.

Formalizing it. No machine-checked proof of any optimal inapproximability result for Max-Cut exists. A full development requires the 2-to-1 Games Theorem in the affine form stated as Proposition 2.2 (p. 6) and derived in Appendix A, the Majority Is Stablest theorem (Lemma 2.1, p. 5), and the paper's new ingredients: tree-code Fourier analysis (Section 5), a vector-valued affine hashing lemma (Lemma 6.1, p. 14), dimension-independent extraction (Proposition 7.1, p. 18) and decoding (Proposition 8.4, p. 24). Several of these — Majority Is Stablest, Boolean Fourier analysis, polynomial-time gap reductions on Turing machines — are reusable libraries in their own right.

Difficulty

The classical long-code test for Max-Cut, analysed via Majority Is Stablest, identifies an influential coordinate of an arbitrary cut. Under the Unique Games Conjecture that coordinate is directly a label of the source game. Starting instead from 2-to-1 games, the influential coordinate is indexed by a gate input of the test, not by a source-game label, and the two endpoints of a source edge cannot in general reconstruct a common context without knowing their projection. The decoding loss must also be independent of the source alphabet, because the alphabet dimension is chosen after the target soundness; a dimension-dependent loss would make the parameter choice circular (Introduction, pp. 3–4).

Formalization scope

  • Graphs are OptimalMaxCut.Graph: a vertex count with a symmetric loopless Bool adjacency function; maxCut maximizes cutSize over all Fin n → Bool, counting each unordered crossing edge once.
  • The output is a ScaledGraph with an explicit positive integer scale; the YES/NO bounds compare maxCut / scale in ℝ, and 0 < scale rules out division by zero.
  • alphaGW is defined as the sInf of 2arccos⁡ρ/(π(1−ρ))2\arccos\rho/(\pi(1-\rho))2arccosρ/(π(1−ρ)) over ρ∈[−1,1)\rho\in[-1,1)ρ∈[−1,1); this set is nonempty and bounded below, so the infimum is the true constant.
  • The reduction is a Turing.TM2ComputableInPolyTime machine with finite tape alphabets, from raw input bits (identity encoding) to ScaledGraph.bits (delimited vertex count and scale, then the full adjacency table); the rational bounds and the machine are fixed before the input.
  • The hypothesis αGW<α≤1\alpha_{\mathrm{GW}}<\alpha\le1αGW​<α≤1 is satisfiable, and the conclusion requires an actual strict gap noBound < α * yesBound with 0 < yesBound, so there is no trivial reading. No assumption P ≠ NP is built in.

Welcome contributions: Boolean and Gaussian Fourier analysis (noise stability, influences, Borell's theorem), Majority Is Stablest, the 2-to-1 Games Theorem, and a reusable library for polynomial-time gap reductions on TM2 machines.

Selected references

  • OpenAI, A Direct Proof of Optimal Max-Cut Hardness, OpenAI Math Release preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/A-Direct-Proof-of-Optimal-Max-Cut-Hardness-September-23-2026/paper.pdf
  • M. X. Goemans, D. P. Williamson, Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming, J. ACM 42 (1995). https://doi.org/10.1145/227683.227684
  • J. Håstad, Some optimal inapproximability results, J. ACM 48 (2001). https://doi.org/10.1145/502090.502098
  • L. Trevisan, G. Sorkin, M. Sudan, D. Williamson, Gadgets, approximation, and linear programming, SIAM J. Comput. 29 (2000). https://doi.org/10.1137/S0097539797328847
  • S. Khot, G. Kindler, E. Mossel, R. O'Donnell, Optimal inapproximability results for MAX-CUT and other 2-variable CSPs?, SIAM J. Comput. 37 (2007). https://doi.org/10.1137/S0097539705447372
  • E. Mossel, R. O'Donnell, K. Oleszkiewicz, Noise stability of functions with low influences: invariance and optimality, Ann. of Math. 171 (2010). https://doi.org/10.4007/annals.2010.171.295
  • U. Feige, G. Schechtman, On the optimality of the random hyperplane rounding technique for MAX CUT, Random Structures Algorithms 20 (2002). https://doi.org/10.1002/rsa.10036
  • I. Dinur, S. Khot, G. Kindler, D. Minzer, M. Safra, Towards a proof of the 2-to-1 games conjecture?, Theory of Computing 21 (2025). https://doi.org/10.4086/toc.2025.v021a011
  • S. Khot, D. Minzer, M. Safra, Pseudorandom sets in Grassmann graph have near-perfect expansion, Ann. of Math. 198 (2023). https://doi.org/10.4007/annals.2023.198.1.1
  • S. Khot, On the power of unique 2-prover 1-round games, STOC 2002. https://doi.org/10.1145/509907.510017
2 thms1 active userReviewed
Theoretical Computer Science·Captain: wurtle

The Unique Games TheoremResearch Paper

Motivation

A Unique Game is a system of constraints between pairs of variables, each constraint saying that the label of one endpoint is a fixed permutation of the label of the other. Deciding whether all constraints can be satisfied is easy (propagate labels along a spanning tree), so the interesting question is approximate: given an instance in which almost all constraints can be satisfied, can a polynomial-time algorithm find a labeling that satisfies even a small fraction?

Khot's Unique Games Conjecture (UGC, 2002) asserts that it cannot, unless P = NP. The conjecture matters because many optimal approximation thresholds have been proved conditionally on it: the Goemans–Williamson ratio for Max-Cut (KKMO 2007), the factor 222 for Vertex Cover (Khot–Regev 2008), the basic-SDP threshold for every constraint satisfaction problem (Raghavendra 2008), and hardness for ordering, multicut/sparsest-cut and correlation-clustering problems. An unconditional proof would turn all of these into NP-hardness results.

This mission asks for a machine-checked proof of the Unique Games Theorem as stated in an OpenAI preprint dated September 23, 2026 (source), which claims a positive resolution of the conjecture. The preprint has not been peer reviewed, and its claim has not been independently verified; on the platform the Lean goal below is open.

Timeline

  • 2001 — Håstad proves optimal inapproximability for linear equations mod 2 with near-perfect completeness (JACM 2001); this gap is the hardness input used by the preprint.
  • 2002 — Khot introduces Unique Games and formulates the conjecture (STOC 2002).
  • 2005–2008 — Conditional optimal hardness for Max-Cut (Khot, Kindler, Mossel, O'Donnell, SICOMP 2007), Vertex Cover (Khot–Regev, JCSS 2008) and every CSP (Raghavendra, STOC 2008). Khot–Vishnoi build SDP integrality gaps (JACM 2015, FOCS 2005).
  • 2005–2010 — Algorithms that delimit the conjecture's quantifiers: Trevisan (ToC 2008), Charikar–Makarychev–Makarychev with value 1−O(ϵlog⁡q)1-O(\sqrt{\epsilon\log q})1−O(ϵlogq​) (STOC 2006), and the subexponential algorithm of Arora–Barak–Steurer (FOCS 2010).
  • 2017–2018 — The 2-to-2 Games programme: Khot–Minzer–Safra (STOC 2017; ToC 2025), Dinur–Khot–Kindler–Minzer–Safra (STOC 2018; ToC 2025), Barak–Kothari–Steurer's shortcode formulation (ITCS 2019), and the Grassmann expansion theorem of Khot–Minzer–Safra (Annals 2023). Together these give NP-hardness of Unique Games with completeness near 1/21/21/2 and arbitrarily small soundness.
  • 2026 — The OpenAI preprint claims completeness arbitrarily close to 111, i.e. the full conjecture (Theorem 1.1, p. 2).

Setting

Fix a finite alphabet KKK. An instance GGG has a finite vertex set and a nonempty list of oriented constraints e=(ue,ve,πe)e=(u_e,v_e,\pi_e)e=(ue​,ve​,πe​) with πe\pi_eπe​ a permutation of KKK; repeated list entries count with multiplicity, and no weights are allowed. A labeling aaa assigns a label to every vertex and satisfies eee when a(ve)=πe(a(ue))a(v_e)=\pi_e(a(u_e))a(ve​)=πe​(a(ue​)). The value of aaa is the fraction of satisfied constraints and val(G)\mathrm{val}(G)val(G) is the maximum over labelings.

An instance is simple bipartite if its vertices split into two sides, every constraint goes from the first side to the second, and no two list entries join the same ordered pair. It is a translation instance over K=F2sK=\mathbb F_2^sK=F2s​ if every constraint has the form a(ve)=a(ue)+cea(v_e)=a(u_e)+c_ea(ve​)=a(ue​)+ce​.

3SAT inputs are bit strings decoding to a conjunction of clauses with exactly three literal slots (repeated variables and literals allowed); the input is a YES instance when it decodes to a satisfiable formula.

Formalization targets

Goal: the Unique Games Theorem (Theorem 1.1, p. 2)

For every ε,δ∈(0,1/2)\varepsilon,\delta\in(0,1/2)ε,δ∈(0,1/2) there exist s≥1s\ge1s≥1 and a deterministic polynomial-time map φ↦Gφ\varphi\mapsto G_\varphiφ↦Gφ​ to simple bipartite translation instances over F2s\mathbb F_2^sF2s​ such that

φ∈3SAT  ⟹  val(Gφ)≥1−ε,φ∉3SAT  ⟹  val(Gφ)≤δ.\varphi\in\mathrm{3SAT}\;\Longrightarrow\;\mathrm{val}(G_\varphi)\ge 1-\varepsilon,\qquad \varphi\notin\mathrm{3SAT}\;\Longrightarrow\;\mathrm{val}(G_\varphi)\le \delta .φ∈3SAT⟹val(Gφ​)≥1−ε,φ∈/3SAT⟹val(Gφ​)≤δ.

The alphabet, the program and the running-time polynomial depend only on (ε,δ)(\varepsilon,\delta)(ε,δ); the two errors are chosen independently, before the alphabet. In Lean this is OAI.UniqueGamesTheorem.theorem11, which asserts that the structure BinaryGapReduction ε δ is inhabited.

Significance

The result itself. The conjecture is the hypothesis behind a large body of tight approximation thresholds; the preprint's Section 8 (pp. 39–43) records how Theorem 1.1 feeds the earlier reductions for Max-Cut, Vertex Cover, Raghavendra's CSP theorem, ordering CSPs, multicut/sparsest cut and correlation clustering. Those reductions and thresholds are due to their original authors. The statement also fixes the conjecture's quantifier order (errors first, then alphabet), which is exactly what the known algorithms above do not contradict.

Formalizing it. No machine-checked proof of the UGC, or of the 2-to-2 theorem it builds on, is known to exist. A complete development would have to formalize Håstad's parity gap, classical parallel repetition for projection games, the Khot–Minzer–Safra Grassmann/shortcode inverse theorem (used as an external input via Theorem 5.1, p. 22 of the preprint), and the preprint's new latent-alphabet gadget and matrix test. Each of these is reusable well beyond this mission.

Difficulty

The central obstacle, identified in the preprint's introduction (pp. 2–4), is completeness: in a unique constraint every label permits exactly one reply, so the natural codeword tests lose a constant fraction of constraints even on honest proofs. For example, on the rank-one matrix shortcode the evaluation M↦MzM\mapsto MzM↦Mz is preserved by a random rank-one update only with probability about 1/21/21/2. The 2-to-2 theorem gives soundness but only near-1/21/21/2 completeness, and pushing completeness to 1−ε1-\varepsilon1−ε while keeping soundness δ\deltaδ independent of the alphabet is a separate problem that the earlier programme left open.

Formalization scope

  • Instances are Foundations.Target.Instance q over alphabet Fin q, with constraints given by explicit forward/inverse permutation tables and a nonemptiness proof; the value is countSatisfied / constraints.length in ℝ, so division by zero cannot occur.
  • The reduction is a Turing.TM2ComputableInPolyTime program from raw input bits (identity encoding, so runtime is measured in the raw input length including sparse variable names) to the bit encoding gameBits; its tape alphabets must be finite.
  • coordinates : Fin alphabet ≃ (Fin s → ZMod 2) fixes the F2s\mathbb F_2^sF2s​ structure, and translations requires every constraint to be a translation in these coordinates; simpleBipartite gives the orientation and the no-parallel-edge condition on list positions.
  • The 3SAT language is BinaryLanguage.language: inputs that decode (canonically) to a satisfiable three-slot formula. Malformed inputs are NO instances and must be mapped to low-value games.
  • The hypotheses 0<ε,δ<1/20<\varepsilon,\delta<1/20<ε,δ<1/2 are satisfiable and the conclusion is a data-carrying structure, so there is no vacuous reading; the completeness clause requires an actual labeling, and soundness quantifies over all labelings.

Welcome contributions: a reusable Lean library for PCP-style gap reductions on TM2 machines, Fourier analysis over F2n\mathbb F_2^nF2n​, parallel repetition for projection games, and the Grassmann expansion theorem.

Selected references

  • OpenAI, The Unique Games Theorem, OpenAI Math Release preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/The-Unique-Games-Theorem-September-23-2026/paper.pdf
  • S. Khot, On the power of unique 2-prover 1-round games, STOC 2002. https://doi.org/10.1145/509907.510017
  • S. Khot, On the Unique Games Conjecture, CCC 2010. https://doi.org/10.1109/CCC.2010.19
  • S. Khot, G. Kindler, E. Mossel, R. O'Donnell, Optimal inapproximability results for MAX-CUT and other 2-variable CSPs?, SIAM J. Comput. 37 (2007). https://doi.org/10.1137/S0097539705447372
  • S. Khot, O. Regev, Vertex cover might be hard to approximate to within 2−ε, J. Comput. Syst. Sci. 74 (2008). https://doi.org/10.1016/j.jcss.2007.06.019
  • P. Raghavendra, Optimal algorithms and inapproximability results for every CSP?, STOC 2008. https://doi.org/10.1145/1374376.1374414
  • J. Håstad, Some optimal inapproximability results, J. ACM 48 (2001). https://doi.org/10.1145/502090.502098
  • B. Barak, P. Kothari, D. Steurer, Small-set expansion in shortcode graph and the 2-to-2 conjecture, ITCS 2019. https://doi.org/10.4230/LIPIcs.ITCS.2019.9
  • S. Khot, D. Minzer, M. Safra, Pseudorandom sets in Grassmann graph have near-perfect expansion, Ann. of Math. 198 (2023). https://doi.org/10.4007/annals.2023.198.1.1
  • S. Arora, B. Barak, D. Steurer, Subexponential algorithms for Unique Games and related problems, FOCS 2010. https://doi.org/10.1109/FOCS.2010.59
2 thms1 active userReviewed
Machine LearningProbabilityTheoretical Computer Science·Captain: mikedeng1

What Can We Learn Privately? V: Masked Parity Is Learnable by Adaptive but Not by Nonadaptive Statistical Queries Under the Uniform DistributionResearch Paper

Motivation

In the local model of differential privacy, each individual randomizes their own data before handing it to an untrusted learner. Local protocols are the deployed form of private data collection, and in practice every round of interaction with the population is expensive: the learner must broadcast new instructions and wait for new reports. Kasiviswanathan, Lee, Nissim, Raskhodnikova and Smith, What Can We Learn Privately? (arXiv:0803.0924v3, published in SIAM J. Comput. 40(3) (2011) 793–826, DOI 10.1137/090756090; theorem numbers below are those of arXiv v3) show that local learning is equivalent to learning with statistical queries (SQ) in the sense of Kearns (1998), and that the equivalence maps noninteractive local learners to nonadaptive SQ learners. The question whether interaction is ever necessary in the local model therefore becomes the question whether adaptivity is ever necessary for SQ learning.

This mission formalizes the paper's answer (§5.3, Theorem 5.16): a concept class, MASKED-PARITY, that an adaptive SQ learner learns exactly with d+1d+1d+1 queries in two rounds, while every nonadaptive SQ learner with fewer than exponentially many queries fails against a specific valid oracle, under the uniform distribution on examples.

Setting

Fix ddd, a power of two. The domain is D={0,1}d×{0,1}log⁡d×{0,1}D=\{0,1\}^d\times\{0,1\}^{\log d}\times\{0,1\}D={0,1}d×{0,1}logd×{0,1}, with points u=(x,i,b)u=(x,i,b)u=(x,i,b), and examples are drawn from the uniform distribution D\mathcal DD on DDD. For r∈{0,1}dr\in\{0,1\}^dr∈{0,1}d and a∈{0,1}a\in\{0,1\}a∈{0,1}, the concept cr,a:D→{+1,−1}c_{r,a}:D\to\{+1,-1\}cr,a​:D→{+1,−1} is

cr,a(x,i,b)={(−1)r⊙x+ab=0,(−1)rib=1,c_{r,a}(x,i,b)=\begin{cases}(-1)^{r\odot x+a}&b=0,\\(-1)^{r_i}&b=1,\end{cases}cr,a​(x,i,b)={(−1)r⊙x+a(−1)ri​​b=0,b=1,​

where r⊙xr\odot xr⊙x is the inner product modulo 2. MASKED-PARITY is the class {cr,a}\{c_{r,a}\}{cr,a​}: on the half b=0b=0b=0 it is the parity rrr or its negation, according to the mask aaa; on the half b=1b=1b=1 it reveals the bit rir_iri​.

A statistical query is a function g(u,y)g(u,y)g(u,y) of an example and a label together with a tolerance τ\tauτ. The SQ oracle for the target ccc answers with any real vvv such that ∣v−Eu∼D[g(u,c(u))]∣≤τ|v-\mathbb E_{u\sim\mathcal D}[g(u,c(u))]|\le\tau∣v−Eu∼D​[g(u,c(u))]∣≤τ; the learner must succeed for every such answer. An SQ learner is nonadaptive if it fixes all its queries before receiving any answer, and adaptive otherwise. Write ⟨f,h⟩=Eu∼D[f(u)h(u)]\langle f,h\rangle=\mathbb E_{u\sim\mathcal D}[f(u)h(u)]⟨f,h⟩=Eu∼D​[f(u)h(u)] and err(f,h)=Pr⁡u∼D[f(u)≠h(u)]\mathrm{err}(f,h)=\Pr_{u\sim\mathcal D}[f(u)\ne h(u)]err(f,h)=Pru∼D​[f(u)=h(u)].

The lower bound uses the decomposition of a query into fg(u)=g(u,1)−g(u,−1)2f_g(u)=\frac{g(u,1)-g(u,-1)}2fg​(u)=2g(u,1)−g(u,−1)​ and Cg=12E[g(u,1)+g(u,−1)]C_g=\frac12\mathbb E[g(u,1)+g(u,-1)]Cg​=21​E[g(u,1)+g(u,−1)], the restrictions cr,asc^s_{r,a}cr,as​, fgsf^s_gfgs​ of cr,ac_{r,a}cr,a​ and fgf_gfg​ to the half b=sb=sb=s (equation (6)), and the oracle

Ocr,a,D(g,τ)={Cg+⟨fg1,cr,a1⟩if ∣⟨fg0,cr,a0⟩∣<τ,E[g(u,cr,a(u))]otherwise.\mathcal O_{c_{r,a},\mathcal D}(g,\tau)=\begin{cases}C_g+\langle f^1_g,c^1_{r,a}\rangle&\text{if }|\langle f^0_g,c^0_{r,a}\rangle|<\tau,\\ \mathbb E[g(u,c_{r,a}(u))]&\text{otherwise.}\end{cases}Ocr,a​,D​(g,τ)={Cg​+⟨fg1​,cr,a1​⟩E[g(u,cr,a​(u))]​if ∣⟨fg0​,cr,a0​⟩∣<τ,otherwise.​

Formalization targets

Goal: Theorem 5.16 (p. 27)

  1. There is a two-round SQ learner (ddd queries, then one), with {0,1}\{0,1\}{0,1}-valued queries of tolerance at least 14d+1\frac1{4d+1}4d+11​, that outputs cr,ac_{r,a}cr,a​ for every target and every valid answers.
  2. O\mathcal OO is a valid SQ oracle, and every nonadaptive learner making ttt queries with values ±1\pm1±1 and tolerance at least 2−d/32^{-d/3}2−d/3, run against O\mathcal OO on a uniformly random target, satisfies
Pr⁡crˉ,aˉ[err(crˉ,aˉ,h)≥14]≥12−t2d/3+2.\Pr_{c_{\bar r,\bar a}}\Bigl[\mathrm{err}(c_{\bar r,\bar a},h)\ge\tfrac14\Bigr]\ge\frac12-\frac t{2^{d/3+2}}.crˉ,aˉ​Pr​[err(crˉ,aˉ​,h)≥41​]≥21​−2d/3+2t​.

Milestones

  • Proposition 5.18 (p. 28): the learner AMP\mathcal A_{\mathrm{MP}}AMP​ recovers r^=r\hat r=rr^=r and a^=a\hat a=aa^=a from every valid answers.
  • Equation (7) (p. 29): E[g(u,cr,a(u))]=Cg+⟨fg0,cr,a0⟩+⟨fg1,cr,a1⟩\mathbb E[g(u,c_{r,a}(u))]=C_g+\langle f^0_g,c^0_{r,a}\rangle+\langle f^1_g,c^1_{r,a}\rangleE[g(u,cr,a​(u))]=Cg​+⟨fg0​,cr,a0​⟩+⟨fg1​,cr,a1​⟩.
  • The oracle (p. 30): O\mathcal OO is valid and answers identically on cr,0c_{r,0}cr,0​ and cr,1c_{r,1}cr,1​ when ∣⟨fg0,cr,00⟩∣<τ|\langle f^0_g,c^0_{r,0}\rangle|<\tau∣⟨fg0​,cr,00​⟩∣<τ.
  • Orthogonality (p. 30): ⟨cr,a0,cr′,a0⟩\langle c^0_{r,a},c^0_{r',a}\rangle⟨cr,a0​,cr′,a0​⟩ is 1/21/21/2 if r=r′r=r'r=r′ and 000 otherwise.
  • Bessel bound (p. 30): ∑(r,a)2⟨fg0,cr,a0⟩2≤1\sum_{(r,a)}2\langle f^0_g,c^0_{r,a}\rangle^2\le1∑(r,a)​2⟨fg0​,cr,a0​⟩2≤1 for ±1\pm1±1-valued ggg.
  • Counting (p. 30): at most 22d/3−12^{2d/3-1}22d/3−1 pairs (r,a)(r,a)(r,a) have ∣⟨fg0,cr,a0⟩∣≥2−d/3|\langle f^0_g,c^0_{r,a}\rangle|\ge2^{-d/3}∣⟨fg0​,cr,a0​⟩∣≥2−d/3.
  • Pr⁡[Good]≥1−t/2d/3+2\Pr[\mathit{Good}]\ge1-t/2^{d/3+2}Pr[Good]≥1−t/2d/3+2 (p. 30).

Significance

The result. Combined with the paper's equivalence between local and SQ learning (Theorem 5.14), Theorem 5.16 shows that interaction is sometimes necessary in local differential privacy: there is a class learnable by an interactive local protocol with polynomially many examples, but not by any noninteractive one with fewer than exponentially many (Corollary 5.17). The separation concerns strong learning under a fixed distribution; the paper notes that adaptive and nonadaptive SQ learning coincide for weak learning, and that a distribution-free separation was left open.

Formalizing it. The result is proved in the paper and has, to our knowledge, no machine-checked proof. The mission produces a self-contained Lean model of statistical query learning with labelled queries and adversarial oracles, a finite Fourier calculus for parities on {0,1}d\{0,1\}^d{0,1}d (orthogonality and a Bessel inequality for ±1\pm1±1-valued functions), and the counting and union-bound argument of SQ lower bounds. The proof of part (2) contains several printed slips (listed below); a formal proof settles the corrected argument.

Difficulty

The upper bound is a direct computation. The difficulty is in part (2): the learner's hypothesis may be any function, not a concept of the class, and the lower bound must hold for every nonadaptive strategy at once. A naive argument that each query "reveals little about aaa" fails, because the true answer to a query does depend on aaa; the argument needs an oracle that is valid (within tolerance of the truth) and yet independent of aaa on most targets, and a quantitative bound on how many targets any single ±1\pm1±1-valued query can correlate with on the half b=0b=0b=0. That bound is an L2L^2L2 statement over all 2d+12^{d+1}2d+1 concepts, not a pointwise one.

Formalization scope

  • Domain and distribution. The index i∈{0,1}log⁡di\in\{0,1\}^{\log d}i∈{0,1}logd is encoded as Fin d, and every theorem assumes d=2md=2^md=2m (implicit in the paper). Vectors are Fin d → ZMod 2, with 0-based bits. Expectations are averages over the finite domain; probabilities over the target are counts of pairs (r,a)(r,a)(r,a) divided by 2d+12^{d+1}2d+1.
  • Values. Concepts, hypotheses and queries are real-valued; labels ±1\pm1±1 are reals. Queries in part (1) take values in {0,1}\{0,1\}{0,1}, as AMP\mathcal A_{\mathrm{MP}}AMP​'s do; queries in part (2) take values ±1\pm1±1 on labels ±1\pm1±1, as in the paper's proof. The paper allows non-Boolean queries (p. 19); a version of part (2) for real queries with values in [−1,1][-1,1][−1,1] is a true strengthening that the same argument supports, and is not stated.
  • Oracles. An SQ oracle is adversarial within the tolerance: the upper bound holds for every valid answer. Part (2) exhibits the paper's oracle O\mathcal OO and asserts its validity for every τ>0\tau>0τ>0. Without that conjunct an "oracle" that ignores the tolerance would make part (2) trivial; the statement rules this out.
  • Learners. Learners are deterministic structures (a nonadaptive learner is a list of queries and tolerances plus an output map; a two-round learner's second-round queries are functions of the first-round answers). A randomized learner is a mixture over its coins and the bounds hold coin by coin. "Efficient" is not modelled. The informal "with a polynomial number of queries" is formalized through its quantitative "Specifically" sentence.
  • Real powers. 2d/32^{d/3}2d/3, 22d/3−12^{2d/3-1}22d/3−1 and 2d/3+22^{d/3+2}2d/3+2 are real powers; no natural-number division is used.
  • Corrections of the proof (not of the theorem). The event Good\mathit{Good}Good on p. 30 is printed with crˉ,aˉc_{\bar r,\bar a}crˉ,aˉ​ and ≤\le≤; the milestone uses crˉ,aˉ0c^0_{\bar r,\bar a}crˉ,aˉ0​ and the strict <<<, which is what the counting display and the oracle's test require. The quotient 22d/3−1/2d+12^{2d/3-1}/2^{d+1}22d/3−1/2d+1 is printed as 2−d/32^{-d/3}2−d/3 and equals 2−d/3−22^{-d/3-2}2−d/3−2; "cr,00=−cr,00c^0_{r,0}=-c^0_{r,0}cr,00​=−cr,00​" should read cr,10=−cr,00c^0_{r,1}=-c^0_{r,0}cr,10​=−cr,00​. The final display of the proof gives 12(1−t/2d/3+2)\frac12(1-t/2^{d/3+2})21​(1−t/2d/3+2), which is at least the theorem's bound.

Contributions welcome: the Fourier facts for {0,1}d\{0,1\}^d{0,1}d (reusable for any parity-based SQ lower bound), the general decomposition (7), and the probability bound of part (2) from the milestones.

Selected references

  • S. P. Kasiviswanathan, H. K. Lee, K. Nissim, S. Raskhodnikova, A. Smith, What Can We Learn Privately?, SIAM J. Comput. 40(3) (2011) 793–826. arXiv:0803.0924v3, DOI 10.1137/090756090.
  • M. Kearns, Efficient noise-tolerant learning from statistical queries, J. ACM 45(6) (1998) 983–1006. DOI 10.1145/293347.293351.
  • A. Blum, M. Furst, J. Jackson, M. Kearns, Y. Mansour, S. Rudich, Weakly learning DNF and characterizing statistical query learning using Fourier analysis, STOC 1994. DOI 10.1145/195058.195147.
  • N. Bshouty, V. Feldman, On using extended statistical queries to avoid membership queries, J. Mach. Learn. Res. 2 (2002) 359–395. JMLR.
11 thms1 active userReviewed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

On Metric Generators of Graphs 2: The Gadget Graph of a 3-Dimensional Matching Instance Has a Minimum T-Join With at Most q Components Exactly When a Matching ExistsResearch Paper

Motivation

Let GGG be a connected graph and TTT a set of vertices of even cardinality. A TTT-join is a set of edges FFF in which exactly the vertices of TTT have odd degree. A TTT-cut is a cut δ(X)\delta(X)δ(X) with ∣X∩T∣|X\cap T|∣X∩T∣ odd. Write τ(G,T)\tau(G,T)τ(G,T) for the minimum size of a TTT-join and ν(G,T)\nu(G,T)ν(G,T) for the maximum number of pairwise disjoint TTT-cuts. Every TTT-cut meets every TTT-join, so ν(G,T)≤τ(G,T)\nu(G,T)\le\tau(G,T)ν(G,T)≤τ(G,T). When equality holds is a central question of combinatorial optimization because of its links to integral multiflows. Seymour (1981) proved equality for all TTT in bipartite graphs. Middendorf and Pfeiffer (1998) showed that deciding equality is NP-complete.

Korach and Penn (1992) proved that a minimum TTT-join FFF with kkk connected components satisfies

τ(G,T)−k+1 ≤ ν(G,T) ≤ ∣F∣.\tau(G,T)-k+1\ \le\ \nu(G,T)\ \le\ |F|.τ(G,T)−k+1 ≤ ν(G,T) ≤ ∣F∣.

So a minimum TTT-join with few components certifies a large packing of TTT-cuts, and a connected one certifies ν=τ\nu=\tauν=τ. Sebő and Tannier (Math. Oper. Res. 2004) therefore study the problem MTSC: given GGG, TTT and an integer kkk, is there a minimum TTT-join with at most kkk connected components? They show it can be solved in polynomial time for k=1k=1k=1 and is NP-complete in general (their Theorem 5). The hardness proof reduces three-dimensional matching (3DM) to MTSC. This mission formalizes the correctness of that reduction.

Setting

Three-dimensional matching. An instance consists of three pairwise disjoint sets WWW, XXX, YYY, each of cardinality qqq, and a set of triples H⊆W×X×YH\subseteq W\times X\times YH⊆W×X×Y. A matching is a subset M⊆HM\subseteq HM⊆H in which every element of W∪X∪YW\cup X\cup YW∪X∪Y occurs in exactly one triple.

The graph GGG. Take a further set ZZZ of qqq points and put T:=W∪X∪Y∪ZT:=W\cup X\cup Y\cup ZT:=W∪X∪Y∪Z, so ∣T∣=4q|T|=4q∣T∣=4q. The graph GGG has as vertices the points of TTT, the triples of HHH, and one new vertex pabp_{ab}pab​ for every unordered pair {a,b}\{a,b\}{a,b} of distinct points of TTT. Its edges are:

  1. a paba\,p_{ab}apab​ and pab bp_{ab}\,bpab​b for every such pair, so any two points of TTT are joined by a path of length 2;
  2. hwhwhw, hxhxhx, hyhyhy and hzhzhz for every h=(w,x,y)∈Hh=(w,x,y)\in Hh=(w,x,y)∈H and every z∈Zz\in Zz∈Z.

There are no other edges. In Lean, GGG is gadget q H and TTT is gadgetT q H.

TTT-joins and components. For F⊆E(G)F\subseteq E(G)F⊆E(G) and a vertex vvv, deg⁡F(v)\deg_F(v)degF​(v) is the number of edges of FFF at vvv. FFF is a TTT-join (IsTJoin) if deg⁡F(v)\deg_F(v)degF​(v) is odd exactly for v∈Tv\in Tv∈T. It is a minimum TTT-join (IsMinTJoin) if no TTT-join of GGG is smaller. The connected components of FFF are those of the graph (V(F),F)(V(F),F)(V(F),F), where V(F)V(F)V(F) is the set of endpoints of edges of FFF. Their number is numComponents F.

Formalization targets

Goal: the Claim in the proof of Theorem 5 (p. 391)

∃ F minimum T-join of G with at most q components  ⟺  ∃ M⊆H a matching.\exists\,F \text{ minimum } T\text{-join of } G \text{ with at most } q \text{ components}\quad\iff\quad \exists\,M\subseteq H \text{ a matching.}∃F minimum T-join of G with at most q components⟺∃M⊆H a matching.

This statement is quantified over every qqq and every HHH, and it is the full mathematical content of the reduction.

Milestones (p. 391, in the order the proof uses them)

  1. Every TTT-join FFF of GGG has ∣F∣≥4q|F|\ge 4q∣F∣≥4q, with equality iff each t∈Tt\in Tt∈T lies in exactly one edge of FFF.
  2. If MMM is a matching, ZZZ can be indexed as {zm:m∈M}\{z_m: m\in M\}{zm​:m∈M}, and for every such indexing ⋃m=(w,x,y)∈M{mw,mx,my,mzm}\bigcup_{m=(w,x,y)\in M}\{mw,mx,my,mz_m\}⋃m=(w,x,y)∈M​{mw,mx,my,mzm​} is a minimum TTT-join with exactly qqq components.
  3. Every minimum TTT-join FFF has ∣F∣=4q|F|=4q∣F∣=4q, and each t∈Tt\in Tt∈T lies in exactly one edge of FFF.
  4. Every minimum TTT-join has at least qqq components. It has exactly qqq iff each component contains a vertex of HHH and exactly one vertex of each of WWW, XXX and YYY.

Significance

The result. The Claim shows that minimizing the number of components of a minimum TTT-join is NP-hard. A Korach–Penn certificate for a large packing of TTT-cuts therefore cannot in general be found by optimizing the component count. This sets the k=1k=1k=1 case, which Sebő and Tannier solve in polynomial time through isometric embeddings of tree metrics, apart from the general case.

Formalizing it. The Claim is proved in the paper, in one paragraph. No machine-checked version is known, and the platform has no TTT-join library. The mission produces a reusable vocabulary for TTT-joins, minimum TTT-joins and the components of an edge set, together with a checked proof that a concrete gadget is correct. One sentence of the published argument is false as written (see Difficulty); a formal proof settles the conclusion independently of it.

Difficulty

The direction from a matching to a TTT-join is a direct verification. The converse has to control an arbitrary minimum TTT-join: its size, the shape of each of its components, and how the components meet WWW, XXX and YYY. A first reading of the printed proof suggests that every vertex outside TTT that carries edges of FFF is adjacent to at most one vertex of each of WWW, XXX, YYY. This is false for the inner vertex of a path joining two vertices of the same class, and the construction joins every pair of points of TTT, including pairs inside WWW. Such components really occur in minimum TTT-joins, so the count of components has to cover them as well. The stated conclusion (at least qqq components, with equality only in the matching-like configuration) remains true.

On the Lean side, the components of an edge set are not the components of the graph with that edge set on all vertices: there every untouched vertex would be a component, and the Claim would become false.

Formalization scope

  • 3DM. WWW, XXX, YYY are three copies of {0,…,q−1}\{0,\dots,q-1\}{0,…,q−1} (Fin q), so their disjointness holds by construction. HHH and MMM are finite sets of triples in Fin q × Fin q × Fin q. IsMatching q M requires each element of each class to be the corresponding coordinate of exactly one triple of MMM, and M⊆HM\subseteq HM⊆H is a separate hypothesis. A covering-only or at-most-one version would be a different problem.
  • The graph. Its vertex type has three kinds of vertices: TTT-vertices (i,j)(i,j)(i,j) with class i∈{0,1,2,3}i\in\{0,1,2,3\}i∈{0,1,2,3} (W,X,Y,ZW,X,Y,ZW,X,Y,Z), one midpoint per non-diagonal unordered pair of TTT-vertices, and one vertex per element of HHH. The adjacency is exactly the two bullets of p. 390. The graph is fixed by the definition, not described by properties.
  • TTT-joins. Edges are unordered pairs (Sym2) and FFF is a Finset of edges of GGG. Parity uses deg⁡F\deg_FdegF​. Minimality is "∣F∣≤∣F′∣|F|\le|F'|∣F∣≤∣F′∣ for all TTT-joins F′F'F′", never an infimum on N\mathbb NN.
  • Components. A component of FFF is a component of the graph with edge set FFF that contains an endpoint of an edge of FFF. Isolated vertices are never counted, and the empty edge set has 000 components.
  • The degenerate case q=0q=0q=0 is included: the graph is empty, F=∅F=\emptysetF=∅ is a minimum TTT-join with 000 components, and M=∅M=\emptysetM=∅ is a matching.
  • Not formalized. Membership of MTSC in NP, polynomial-time computability of the construction, and NP-completeness itself. The platform has no complexity-theory substrate. The Claim is the mathematical statement those rest on.
  • Ruled out. The Claim must not be weakened to "exactly qqq components" or to minimality among TTT-joins with few components, and components must not be counted on the whole vertex type. Each of these changes the statement.

Contributions welcome: proofs of the milestones, general lemmas on TTT-joins (a TTT-join in a graph where TTT is independent has at least ∣T∣|T|∣T∣ edges), and lemmas on the components of an edge set, which are reusable well beyond this mission.

Selected references

  • A. Sebő, E. Tannier, On Metric Generators of Graphs, Mathematics of Operations Research 29(2):383–393, 2004. https://doi.org/10.1287/moor.1030.0070
  • E. Korach, M. Penn, Tight integral duality gap in the Chinese postman problem, Mathematical Programming 55:183–191, 1992.
  • P. D. Seymour, On odd cuts and plane multicommodity flows, Proceedings of the London Mathematical Society 42:178–192, 1981.
  • M. Middendorf, F. Pfeiffer, On the complexity of the edge-disjoint path problem, Combinatorica (cited by Sebő and Tannier as 1998, vol. 8, pp. 103–116) — NP-completeness of deciding ν=τ\nu=\tauν=τ.
  • M. R. Garey, D. S. Johnson, Computers and Intractability, W. H. Freeman, San Francisco, 1979 — NP-completeness of 3DM.
  • A. Frank, A survey on T-joins, T-cuts, and conservative weightings, in Combinatorics, Paul Erdős is Eighty, Vol. 2, 1996, pp. 213–252.
  • Related platform item, not reused: UnrelatedSched.ThreeHalves.ThreeDimMatching (Lenstra–Shmoys–Tardos) encodes 3DM with an indexed family of triples and the covering form of a matching, a different encoding from the paper's set HHH with "exactly one".
8 thms1 active userReviewed
CombinatoricsProbabilityTheoretical Computer Science·Captain: mikedeng1

Software Protection and Simulation on Oblivious RAMs: Every Oblivious Simulation of t Steps Makes max{|y|, Ω(t log t)} AccessesResearch Paper

Motivation

Programs often reveal information through the memory locations they touch, even when the contents of those locations are hidden. An oblivious RAM simulation aims to conceal this access pattern. Goldreich and Ostrovsky studied the cost of doing so for arbitrary RAM programs and showed that the access sequence itself imposes a lower bound on simulation overhead. Their 1996 paper gives an upper-bound construction as well as the lower-bound theorem targeted here. The issue matters when a storage observer can see which addresses are accessed but must learn nothing about the program's private requests.

Theorem 6.1 of the paper states that simulating ttt steps requires at least the initial memory size and, asymptotically, a multiple of tlog⁡tt\log ttlogt accesses. Its proof introduces a simpler ball-and-cell game that grants the player more information and freedom than the RAM simulation. The mission formalizes that game and its lower bound. This makes the combinatorial content of the published argument a precise theorem about randomized behavior and visible observations. The paper's earlier Theorem 1.2.2 on p. 437 is labeled informal and has a different explicit bound; the target here is Theorem 6.1 on pp. 469–470.

Setting

There are mmm numbered balls and mmm numbered cells. Cell iii initially contains ball iii, and a player's hand is empty. Each cell can hold at most one ball and the hand can hold at most bbb balls. In one access, the player names a cell and secretly takes its ball into a nonfull hand, places one held ball into an empty cell, or leaves the cell unchanged. Taking from an empty cell and placing into an occupied cell are illegal. The observer sees the named cell at each access but not the hidden operation. A run of qqq accesses is written a=((v1,h1),…,(vq,hq))a=((v_1,h_1),\ldots,(v_q,h_q))a=((v1​,h1​),…,(vq​,hq​)), and its visible sequence is V(a)=(v1,…,vq)V(a)=(v_1,\ldots,v_q)V(a)=(v1​,…,vq​).

A request sequence r=(r1,…,rt)r=(r_1,\ldots,r_t)r=(r1​,…,rt​) names a ball for each of ttt rounds. A run satisfies rrr if it is legal and there are indices 1≤j1≤⋯≤jt=q1\le j_1\le\cdots\le j_t=q1≤j1​≤⋯≤jt​=q such that ball rir_iri​ is in the player's hand after the first jij_iji​ accesses. Equal indices are permitted: several rounds may finish after the same access. The player may know the entire request sequence in advance. That assumption is part of the paper's game, and the paper notes that its lower bound does not require an online player.

A randomized player assigns each request sequence a probability distribution over finite runs. It is correct if every run with positive probability satisfies its requests. It is oblivious if the distribution of V(a)V(a)V(a) is identical for every pair of request sequences of length ttt. Thus the observer cannot infer the requested balls from the accessed cells, even statistically. These conditions quantify over all request sequences, not a selected input or a single deterministic access pattern.

Formalization targets

Theorem 6.1: access lower bound

For every correct oblivious player and every run in the support of its response, the mission targets

q≥m(t≥1),q≥cbtlog⁡t(m=t, t≥Tb),q\ge m\quad(t\ge1),\qquad q\ge c_b t\log t\quad(m=t,\ t\ge T_b),q≥m(t≥1),q≥cb​tlogt(m=t, t≥Tb​),

where cb>0c_b>0cb​>0 and TbT_bTb​ depend only on the fixed hand size bbb. This is the paper's max⁡{m,Ω(tlog⁡t)}\max\{m,\Omega(t\log t)\}max{m,Ω(tlogt)} form, with mmm representing the number ∣y∣|y|∣y∣ of initially occupied memory words. It asserts a bound on every possible run, rather than only on average access count. No numerical constant is prescribed by the paper.

Intermediate counting targets

The milestones record the first-round mmm bound, the at-most-(b+2)q(b+2)^q(b+2)q count of legal hidden action sequences compatible with a visible sequence, and the implication from obliviousness that one visible sequence can serve every request sequence. They then state the corrected finite counting bounds

∣{r:a⊨r}∣≤multichoose⁡(q,t)bt,mt≤(b+2)qmultichoose⁡(q,t)bt.|\{r:a\models r\}|\le\operatorname{multichoose}(q,t)b^t, \qquad m^t\le(b+2)^q\operatorname{multichoose}(q,t)b^t.∣{r:a⊨r}∣≤multichoose(q,t)bt,mt≤(b+2)qmultichoose(q,t)bt.

These preserve the paper's non-strict round ends. The milestone source text records the published formulas, while the formal statements and descriptions identify the corrections.

Significance

The result limits how cheaply a simulator can hide a program's memory access pattern when the observer sees addresses. In the game, a player is even allowed to remember the entire ball placement without cost, know the future requests, and randomize its actions. A lower bound under these permissive conditions applies to the more constrained access-pattern problem that motivated the game, subject to the paper's reduction from simulation to the game. The mmm term also accounts for the initially occupied memory, independently of the asymptotic term.

The theorem is a published mathematical result, but the mission's Lean declarations are statements with proof holes until solvers supply machine-checked proofs. Formalizing the game creates reusable definitions for legal hidden operations, request satisfaction, randomized players, and visible distributions. Formalizing the corrected counting targets also makes explicit a discrepancy in the printed proof rather than silently relying on an invalid intermediate inequality.

Difficulty

The main difficulty is accounting for requests when several rounds end at the same access. The paper's observation that a fixed qqq-access run serves at most bqb^qbq request sequences is false under its own non-strict indices. A run that fetches every ball it can hold may answer many later rounds without making another access. Likewise, the alternative binomial count in footnote 29 assumes distinct completion points and fails when t>qt>qt>q. The final asymptotic result still has a valid corrected counting target, but a proof cannot quote the published intermediate formulas literally. Randomized behavior adds another precise requirement: equality of visible distributions must support conclusions about runs with positive probability for each request sequence.

Formalization scope

The Lean carrier is the paper's ball-and-cell game from §6, rather than the interactive RAM machine model of §2. The game relaxes the simulation by giving the player free memory of ball locations and advance knowledge of requests. Balls, cells, and rounds use finite types Fin m and Fin t; these are zero-based encodings of the paper's [m][m][m] and round labels. Action steps are counted from one, with the initial state at step zero. PMF represents the player's discrete probability distributions, and equality of PMF.map visible represents observer independence. Every positive-probability run must be legal and satisfy its requests. The visible and hidden sequences have the same finite length qqq.

The two printed estimates bqb^qbq and bq(b+2)q>mtb^q(b+2)^q>m^tbq(b+2)q>mt are false: with m=b=q=2m=b=q=2m=b=q=2 and t=7t=7t=7, taking both balls in two accesses satisfies all 27=1282^7=12827=128 request sequences, while the printed product is 646464. Footnote 29's (qt)bt\binom qt b^t(tq​)bt also vanishes in this example. The formal milestones use Nat.multichoose q t to accommodate repeated round ends; at q=t=0q=t=0q=t=0 its value is defined directly, so no negative binomial upper index is used. The logarithm in the goal is the natural logarithm, and a threshold TbT_bTb​ handles small ttt.

Correctness and legality are part of the player type, so an unrestricted sequence of cell names cannot satisfy the mission by bypassing the hand and cell rules. Obliviousness uses equality of full distributions, and the goal quantifies over every supported run. The required development includes finite-state transition reasoning, finite combinatorial counts, PMF support and mapping, and real logarithm estimates. These components, especially the game interface and support lemmas, can be reused by later access-pattern formalizations.

Selected references

  • Oded Goldreich and Rafail Ostrovsky, Software protection and simulation on oblivious RAMs, Journal of the ACM 43(3):431–473, 1996. DOI: 10.1145/233551.233553. Theorem 6.1 and its proof are on pp. 469–470; the informal Theorem 1.2.2 is on p. 437.
7 thms1 active userReviewed
Algorithmic Game TheoryLinear OptimizationOperations Research·Captain: mikedeng1

The Polynomial Hierarchy and a Simple Model for Competitive Analysis: Every Optimum of the (p+1)-Level Linear Game J'(F) Is Binary, with x(F) = 1 iff the Σ_p Sentence (3.3) HoldsResearch Paper

Why multi-level programs are hard

Multi-level programs model a hierarchy of decision makers: a leader commits to a decision, a follower optimises given it, a follower of the follower optimises given both, and so on. Bilevel programs are the standard model of Stackelberg competition, toll setting, network interdiction and many other leader–follower problems in operations research (Candler and Townsley 1982; Bard and Falk 1982). When every level has a linear criterion and the constraints are linear, each player's problem looks like a linear program, and it is natural to hope that the whole hierarchy is solvable in polynomial time.

R. G. Jeroslow's 1985 paper (Math. Programming 32, 146–164) shows that this hope fails at every level of the polynomial hierarchy: a (p+1)(p+1)(p+1)-level linear program with fixed criteria can encode the truth of a Σp\Sigma_pΣp​ quantified Boolean sentence. The result places multi-level linear programming in the polynomial hierarchy and is widely cited for the Σp\Sigma_pΣp​-hardness of such programs; NP-hardness of bilevel linear programs (Corollary 4.6) is its special case p=1p=1p=1.

Setting

A multi-level program has real variables x=(x1,…,xp)x=(x^1,\dots,x^p)x=(x1,…,xp), a feasible set S0S_0S0​ (a polyhedron {x:∑iAixi≥b}\{x: \sum_i A^ix^i\ge b\}{x:∑i​Aixi≥b} in the linear case), and players p,p−1,…,1p,p-1,\dots,1p,p−1,…,1 who move in that order; player iii controls xix^ixi and minimises a fixed linear criterion cixc^ixcix. The solution sets are defined from the last mover upwards: S1S_1S1​ is the set of x∈S0x\in S_0x∈S0​ at which player 1's criterion is minimal given the choices of all earlier movers, and in general SjS_{j}Sj​ keeps the points of Sj−1S_{j-1}Sj−1​ minimising cjxc^jxcjx among the points of Sj−1S_{j-1}Sj−1​ that agree with xxx on xj+1,…,xpx^{j+1},\dots,x^pxj+1,…,xp. The value is cpxc^pxcpx on SpS_pSp​, when Sp≠∅S_p\neq\emptysetSp​=∅. The sets SjS_jSj​ can be empty even when S0S_0S0​ is a nonempty polytope: the paper's four-level Example has S4=∅S_4=\emptysetS4​=∅ because S3S_3S3​ is not closed.

A propositional formula FFF over blocks of atoms X1,…,XpX_1,\dots,X_pX1​,…,Xp​ (block XkX_kXk​ has nkn_knk​ atoms) is encoded by the linear system LFL_FLF​: one variable x(G)∈[0,1]x(G)\in[0,1]x(G)∈[0,1] per non-atomic subformula, with the inequalities (3.1a)–(3.1c) for ∨\vee∨, ∧\wedge∧, ¬\neg¬. The quantifier of block XkX_kXk​ is Qk=∃Q_k=\existsQk​=∃ when p−kp-kp−k is even, so

(∃Xp)(∀Xp−1)⋯(Q1X1) [F(X1,…,Xp)=1](3.3)(\exists X_p)(\forall X_{p-1})\cdots(Q_1X_1)\,[F(X_1,\dots,X_p)=1] \qquad (3.3)(∃Xp​)(∀Xp−1​)⋯(Q1​X1​)[F(X1​,…,Xp​)=1](3.3)

is a Σp\Sigma_pΣp​ sentence.

The game J′(F)J'(F)J′(F) adds a bookkeeper, player 000, who moves last. Player k≥1k\ge1k≥1 controls the atoms of XkX_kXk​, and player 111 also controls auxiliary variables yyy; the bookkeeper controls the x(G)x(G)x(G), a variable uuu fixed to 111, and auxiliary variables zzz. Two gadgets, (4.1) and (4.6), let the bookkeeper and player 1 turn the linear criteria into the piecewise-linear functions Zk=1−x(F)+2∑jP(xkj)Z_k=1-x(F)+2\sum_jP(x_{kj})Zk​=1−x(F)+2∑j​P(xkj​) (or x(F)+…x(F)+\dotsx(F)+… for universal QkQ_kQk​) and Z1=(1−x(F))+fr(1−x(F))+10L∑jfr(x1j)+…Z_1=(1-x(F))+fr(1-x(F))+10L\sum_j fr(x_{1j})+\dotsZ1​=(1−x(F))+fr(1−x(F))+10L∑j​fr(x1j​)+…, where LLL is the length of FFF, fr(x)=min⁡{x,1−x}fr(x)=\min\{x,1-x\}fr(x)=min{x,1−x}, and P(x)=1P(x)=1P(x)=1 at x∈{0,1}x\in\{0,1\}x∈{0,1}, 222 otherwise.

Formalization targets

Goal: Theorem 4.5 (p≥2p\ge2p≥2)

Let SSS be the set of optimal solutions Sp+1S_{p+1}Sp+1​ of J′(F)J'(F)J′(F). Then S≠∅S\neq\emptysetS=∅; at every optimum all atom variables and all x(G)x(G)x(G) are binary; and

x(F)=1  ⟺  (3.3) holds,value(J′(F))=2np+1−x(F).x(F)=1 \iff (3.3)\ \text{holds},\qquad \text{value}(J'(F)) = 2n_p+1-x(F).x(F)=1⟺(3.3) holds,value(J′(F))=2np​+1−x(F).

Moreover, when (3.3) holds, v∈Rnpv\in\mathbb R^{n_p}v∈Rnp​ is player ppp's block in some optimum iff vvv is binary and the Πp−1\Pi_{p-1}Πp−1​ sentence (4.17) holds at the truth valuation of vvv.

Milestones

In attack order: Lemma 3.1 (correctness of LFL_FLF​ on binary inputs); Lemma 4.1 (robustness of LFL_FLF​ near binary inputs); Lemmas 4.2 and 4.3 (the bottom two levels of a bounded linear multi-level program are solvable, via LP duality); the bookkeeper identities z=∣2y−x∣z=|2y-x|z=∣2y−x∣ and z=fr(x)z=fr(x)z=fr(x) in S1S_1S1​; (4.2) and (4.3) (player 1's and player kkk's responses on the gadgets); Lemma 4.4 (the induction on kkk with the higher blocks fixed). Companion theorems: Corollary 4.6 (the bilevel case: value 000 iff (∃X1)F(\exists X_1)F(∃X1​)F), the §2 Example, and Proposition 3.2 (the pure binary game J(F)J(F)J(F)).

Significance

The theorem shows that deciding the value of a (p+1)(p+1)(p+1)-level linear program with fixed criteria is at least as hard as deciding Σp\Sigma_pΣp​ sentences, so known exact algorithms for multi-level linear programs cannot be expected to run in polynomial time once p≥2p\ge2p≥2, and even recognising an optimal move is Πp−1\Pi_{p-1}Πp−1​-hard. The bilevel case is an early NP-hardness proof for bilevel linear programming, and the construction (a bookkeeper player and absolute-value gadgets that force binary choices) is a template for hardness reductions to leader–follower problems.

The result is proved in the paper but, to our knowledge, has no machine-checked formalization. A formal development makes precise the solution concept (conditional rather than lexicographic minimisation), which the literature states in several inequivalent ways, and checks a proof whose printed version leaves cases to the reader (the ∧\wedge∧, ¬\neg¬ cases of Lemma 4.1, the universal cases of Lemma 4.4) and applies Lemma 4.3 to a feasible set that is unbounded (the (4.1) variable zzz has no upper bound).

Difficulty

The obvious argument, "each existential player picks a satisfying assignment and each universal player a counterexample", works for the pure binary game J(F)J(F)J(F) (Proposition 3.2) but not for continuous variables: a player may choose fractional values, and the solution sets of a multi-level program need not exist (the §2 Example). The work is in showing that every player is forced to binary choices. Player 1's fractional choices are ruled out only through the robustness estimate of Lemma 4.1 with the weight 10L10L10L, and the existence of optimal solutions at every level has to be established along the induction, since it fails for general three-level programs.

Formalization scope

  • Players are indexed from 000; player iii optimises at level i+1i+1i+1. In J′(F)J'(F)J′(F) the players are 0,…,p0,\dots,p0,…,p as in the paper; in the §2 Example and in J(F)J(F)J(F) the paper's player iii is index i−1i-1i−1. Blocks are 0-based: block k : Fin p is the paper's Xk+1X_{k+1}Xk+1​, owned by player k+1k+1k+1 in J′(F)J'(F)J′(F).
  • solSet encodes the conditional minimisation of (3.7), p. 152. HasValue N w requires SN≠∅S_N\neq\emptysetSN​=∅; the value +∞+\infty+∞ is not modelled.
  • Formulas use ¬,∧,∨\neg,\wedge,\vee¬,∧,∨ (the paper rewrites →\to→ as ¬G1∨G2\neg G_1\vee G_2¬G1​∨G2​); the length counts atoms and connectives. Data are real; the paper's rationality assumption plays no role in the statements.
  • The bookkeeper controls the x(G)x(G)x(G) and has criterion "+z+z+z on (4.1) gadgets, −z-z−z on (4.6) gadgets, and +x(G)+x(G)+x(G) for each non-atomic subformula," as stated on p. 155. The (4.1) variable zzz has no upper bound. The constant 111 of (4.4)/(4.7) is the variable uuu with u=1u=1u=1.
  • "Binary value, zero iff F∈BpF\in B_pF∈Bp​" is stated exactly: the value is 2np+1−x(F)2n_p+1-x(F)2np​+1−x(F), and x(F)=1x(F)=1x(F)=1 iff (3.3). "All optimal solutions are binary" covers the atom variables and the x(G)x(G)x(G), not the gadget variable zzz, which equals 222 at y=1y=1y=1, ξ=0\xi=0ξ=0.
  • The goal is not trivialisable: its first conjunct asserts that the optimal set is nonempty, which fails for general multi-level programs (the §2 Example), so the remaining conjuncts are not vacuous.

A complete development needs a linear-programming duality argument for Lemma 4.2 (Mathlib has IsExtreme and Set.extremePoints; LP duality is on the platform as a single-level theorem) and an induction over the levels of the game. The definitions MultilevelProgram, solSet and the formula encoding LSys are reusable for other complexity results on hierarchical optimisation. Proofs of any milestone, including the generic Lemmas 4.2–4.3 and the formula Lemmas 3.1 and 4.1, are welcome independently.

Selected references

  • R. G. Jeroslow, The polynomial hierarchy and a simple model for competitive analysis, Mathematical Programming 32 (1985) 146–164. https://doi.org/10.1007/BF01586088
  • W. Candler and R. Townsley, A linear two-level programming problem, Computers & Operations Research 9 (1982) 59–76. https://doi.org/10.1016/0305-0548(82)90006-5
  • J. F. Bard and J. E. Falk, An explicit solution to the multi-level programming problem, Computers & Operations Research 9 (1982) 77–100. https://doi.org/10.1016/0305-0548(82)90007-7
  • L. J. Stockmeyer, The polynomial-time hierarchy, Theoretical Computer Science 3 (1976) 1–22. https://doi.org/10.1016/0304-3975(76)90061-X
13 thms1 active userReviewed
Dynamic ProgrammingMathematical LogicOperations Research·Captain: mikedeng1

The Complexity of Markov Decision Processes V: A Quantified Boolean Formula Is True Iff Its Partially Observed Markov Decision Process Has a Zero-Cost PolicyResearch Paper

Motivation

A Markov decision process is the standard model of sequential decision making under uncertainty: a controller observes the state of a finite system, chooses a decision, pays a cost, and the system moves to a random next state. In many applications (maintenance, inventory with unreliable records, robotics, medical treatment) the controller does not see the state itself, only partial information about it. This is the partially observed problem, and the usual way to solve it is to replace the state by the conditional distribution of the state given the observations (Åström 1965; Bertsekas). That reformulation has an infinite state space, and Smallwood and Sondik (1973) showed that the finite-horizon cost-to-go is nevertheless piecewise linear, but with a number of pieces that may grow exponentially with the horizon.

Papadimitriou and Tsitsiklis (Math. Oper. Res. 12(3), 1987) asked whether this blow-up is an artefact of the reformulation or intrinsic to the problem. Their Theorem 6 answers it: deciding whether a partially observed process can achieve a given expected cost is PSPACE-hard, already for stationary processes and horizons shorter than the number of states. This mission formalizes the reduction behind that theorem.

Setting

A partially observed stationary Markov decision process has a finite state set SSS, a partition Π\PiΠ of SSS, and an initial state s0s_0s0​. For a state sss write z(s)∈Πz(s) \in \Piz(s)∈Π for the set containing it. Each set zzz carries a nonempty finite set DzD_zDz​ of decisions; decision i∈Dzi \in D_zi∈Dz​ costs c(z,i)c(z, i)c(z,i) and moves a current state s∈zs \in zs∈z to the next state s′s's′ with probability p(s,s′,i)p(s, s', i)p(s,s′,i). The controller sees only the sequence of sets visited, so a policy π\piπ maps each observation sequence z0,…,ztz_0, \dots, z_tz0​,…,zt​ to a decision in DztD_{z_t}Dzt​​. For a horizon TTT, the expected cost of π\piπ is

Jπ(T)=Eπ[∑t=0Tc(z(st),π(z(s0),…,z(st)))],J_\pi(T) = \mathbb{E}_\pi\Bigl[\sum_{t=0}^{T} c\bigl(z(s_t), \pi(z(s_0), \dots, z(s_t))\bigr)\Bigr],Jπ​(T)=Eπ​[t=0∑T​c(z(st​),π(z(s0​),…,z(st​)))],

and the optimal cost is inf⁡πJπ(T)\inf_\pi J_\pi(T)infπ​Jπ​(T).

A quantified Boolean formula is Q1x1⋯Qnxn F(x1,…,xn)Q_1 x_1 \cdots Q_n x_n\, F(x_1, \dots, x_n)Q1​x1​⋯Qn​xn​F(x1​,…,xn​) with each Qj∈{∃,∀}Q_j \in \{\exists, \forall\}Qj​∈{∃,∀} and FFF a conjunction of mmm clauses C1,…,CmC_1, \dots, C_mC1​,…,Cm​, each a set of literals xjx_jxj​ or ¬xj\neg x_j¬xj​. It is true if there is a value of x1x_1x1​ such that for all values of x2x_2x2​, and so on, FFF comes out true. Deciding truth (QSAT) is PSPACE-complete (Stockmeyer and Meyer 1973).

From a formula with m≥1m \ge 1m≥1 clauses the paper builds a process MφM_\varphiMφ​: an initial state, six states Aij,Aij′,Tij,Tij′,Fij,Fij′A_{ij}, A'_{ij}, T_{ij}, T'_{ij}, F_{ij}, F'_{ij}Aij​,Aij′​,Tij​,Tij′​,Fij​,Fij′​ per clause iii and variable jjj, end states Ai,n+1,Ai,n+1′A_{i,n+1}, A'_{i,n+1}Ai,n+1​,Ai,n+1′​, and one absorbing state, so ∣S∣=6mn+2m+2|S| = 6mn + 2m + 2∣S∣=6mn+2m+2. The first transition chooses a clause uniformly; primed states record that the chosen clause is not yet satisfied; existential variables are set by decisions and universal ones by fair coins; the only nonzero cost, 111, is paid at Ai,n+1′A'_{i,n+1}Ai,n+1′​. The horizon is T=2n+2T = 2n + 2T=2n+2.

Formalization targets

Goal: the reduction is correct

For every formula φ\varphiφ in the paper's QSAT class (an alternating prefix beginning with ∃x1\exists x_1∃x1​ and ending with ∀xn\forall x_n∀xn​, and three literals per clause), with m≥1m \ge 1m≥1 clauses and T=2n+2T = 2n+2T=2n+2,

T<∣S∣,(∃π: Jπ(T)=0)  ⟺  φ is true,inf⁡πJπ(T)≤0  ⟺  φ is true.T < |S|, \qquad \bigl(\exists \pi:\ J_\pi(T) = 0\bigr) \iff \varphi \text{ is true}, \qquad \inf_\pi J_\pi(T) \le 0 \iff \varphi \text{ is true}.T<∣S∣,(∃π: Jπ​(T)=0)⟺φ is true,πinf​Jπ​(T)≤0⟺φ is true.

The goal states all three claims the paper makes: the horizon bound (p. 448), the existence of a zero-cost policy (p. 449), and the bound on the optimum (p. 448).

Milestones

  1. The cost splits over the clause chosen at time 1: each clause is chosen with probability 1/m1/m1/m, and a policy has zero expected cost iff it has zero cost for every choice of clause.
  2. If a trajectory of positive probability ends in Ai,n+1′A'_{i,n+1}Ai,n+1′​, the expected cost is at least 2−n/m2^{-n}/m2−n/m.
  3. A zero-cost policy makes the formula true.
  4. A true formula yields a zero-cost policy.

Significance

Theorem 6 locates the partially observed finite-horizon problem in the complexity landscape: unless P = PSPACE there is no polynomial-time algorithm for it, even for stationary processes with short horizons. The paper's Corollary 1 strengthens this into evidence that no polynomial-size precomputed controller exists either. Together these results explain why exact algorithms for partially observed processes are exponential and motivated the later work on approximation and on restricted policy classes.

The formalization adds a machine-checked proof of the correctness of the reduction, the step on which the hardness claim rests, together with a reusable definition of a finite partially observed process with observation-history policies and of quantified Boolean formulas. The paper's argument is a short paragraph; a formal proof has to make precise how a policy that only sees observation sequences determines a strategy for the existential player. As far as we know, no machine-checked proof of this reduction exists.

Difficulty

The "if" direction is a direct translation of a winning strategy into a policy. The "only if" direction is where the work is. A zero-cost policy acts on observation sequences, and the paper argues that it never learns which clause was chosen. Under the paper's own partition this is not literally true: the sets TjT_jTj​ and Tj′T'_jTj′​ differ, so the observations reveal whether the chosen clause was already satisfied. The existential strategy must therefore be extracted from the policy's behaviour on the observation histories in which the clause is still unsatisfied, and one must check that it is a single strategy, independent of the clause, that satisfies every clause against every choice of the universal variables. The bound of milestone 2 also requires tracking the probability of a single trajectory through the coin flips.

Formalization scope

The process is a Lean structure POMDP S Z with an observation map obs : S → Z encoding the partition, nonempty finite decision types D z, real costs c z i, and next-state laws given as Mathlib PMFs, so every transition row is a probability vector. A policy is a function List Z → (z : Z) → D z of the earlier observations and the current one. The expected cost is a finite sum over trajectories x0,…,xTx_0, \dots, x_Tx0​,…,xT​ of their probability times ∑t=0Tc\sum_{t=0}^{T} c∑t=0T​c, and the optimum is the infimum over all policies. Paper clause CiC_iCi​ and variable xjx_jxj​ are Lean indices i−1i - 1i−1 and j−1j - 1j−1.

Choices made explicit:

  • Horizon. The paper prints T=2m+2T = 2m + 2T=2m+2 but says it is "just enough time for the process to reach one of Ai,n+1A_{i,n+1}Ai,n+1​ or Ai,n+1′A'_{i,n+1}Ai,n+1′​", which happens at time 2n+12n+12n+1. With the printed value and m<nm < nm<n the cost is never paid and every formula would map to a zero-cost process. We use T=2n+2T = 2n+2T=2n+2.
  • The set AjA_jAj​. The partition sentence puts all AijA_{ij}Aij​ and Aij′A'_{ij}Aij′​ in one set AjA_jAj​; the decision sentence mentions "the set Aj′A'_jAj′​". We follow the partition sentence.
  • The new state reached from Ai,n+1A_{i,n+1}Ai,n+1​ and Ai,n+1′A'_{i,n+1}Ai,n+1′​ is unspecified; it gets its own set, one zero-cost decision and a self-loop.
  • Formulas. The general QBF definition allows any quantifier prefix and clause width. Every theorem assumes IsPaperQSAT, which requires the paper's alternating prefix ∃x1∀x2⋯∀xn\exists x_1 \forall x_2 \cdots \forall x_n∃x1​∀x2​⋯∀xn​ with n>0n>0n>0 even and three literals per clause. Clauses are sets of literals; three witnesses allow repetitions. m≥1m \ge 1m≥1 is also a hypothesis.
  • Decisions are nonempty; rows are probability vectors.

Policies see only observation sequences. A formalization in which the policy reads the state would make the "only if" direction false and the reduction meaningless; one in which it sees only the current observation would make the "if" direction false. Neither is admissible.

Not formalized: PSPACE-hardness itself (Mathlib has no PSPACE or polynomial-time reductions), the polynomial-time computability of the construction, the membership of the problem in PSPACE (sketched on p. 449), Corollary 1 (a Σ2p\Sigma_2^pΣ2p​ collapse) and Corollary 2 (NP-completeness of the unobserved case, stated without proof).

The definitions of partially observed processes and quantified Boolean formulas are reusable. Contributions of lemmas on trajectory sums (marginalising later coordinates, the probability of a fixed prefix) are welcome; they also serve the other missions of this series.

Selected references

  • C. H. Papadimitriou and J. N. Tsitsiklis, The Complexity of Markov Decision Processes, Mathematics of Operations Research 12(3), 1987, 441–450. https://doi.org/10.1287/moor.12.3.441
  • L. J. Stockmeyer and A. R. Meyer, Word problems requiring exponential time, Proc. 5th ACM STOC, 1973, 1–9. https://doi.org/10.1145/800125.804029
  • R. D. Smallwood and E. J. Sondik, The optimal control of partially observable Markov processes over a finite horizon, Operations Research 21(5), 1973, 1071–1088. https://doi.org/10.1287/opre.21.5.1071
  • K. J. Åström, Optimal control of Markov processes with incomplete state information, Journal of Mathematical Analysis and Applications 10, 1965, 174–205. https://doi.org/10.1016/0022-247X(65)90154-X
  • D. P. Bertsekas, Dynamic Programming: Deterministic and Stochastic Models, Prentice-Hall, 1987.
8 thms1 active userReviewed
PreviousPage 4 of 4Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me