Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Theoretical Computer Science

464 missions · 238 completed

The mathematical foundations of computation: which problems can be solved, by what algorithms, and at what cost in time, space, or communication. Distinguished by its emphasis on rigor and unconditional lower bounds, it spans computational complexity, algorithm design, automata and computability, cryptography, and the analysis of Boolean functions.

Missions

Open226Completed238All464
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Joint Assortment Optimization and Customization under a Mixture of Multinomial Logit Models 1: Augmented Greedy Earns a (1 − 1/e) Fraction of the Optimal Revenue from the Complete Customer TypesResearch Paper

Motivation

Retailers that carry a limited range of products often know something about a customer before choosing which of those products to display. The customized assortment problem asks which products to carry when the displayed assortment may be tailored to the arriving customer's type. This separates the first-stage capacity decision from the later offer decision. El Housni and Topaloglu study the problem under a mixture of multinomial logit choice models and develop an approximation framework for it in their SSRN paper. This mission isolates their structural guarantee for Augmented Greedy, Theorem 4.2 of the PDF version dated 7 December 2021. The theorem identifies the revenue recovered from customer types whose optimal personalized offers agree with a chosen product subset.

The paper contrasts this setting with ordinary assortment optimization, where every type sees the same products. Its later approximation results use the structural guarantee here as a component. The classical comparison is the cardinality-constrained greedy bound for monotone submodular functions, associated with Nemhauser, Wolsey and Fisher (1978). The paper's Appendix B gives an instance in which the customized revenue function lacks global submodularity, so that classical result does not apply directly. El Housni and Topaloglu, §§4 and App. B.

Setting

Let N={1,…,n}N=\{1,\ldots,n\}N={1,…,n} be a finite product set. Product iii has positive revenue rir_iri​, and products are indexed with r1≥⋯≥rn>0r_1\ge\cdots\ge r_n>0r1​≥⋯≥rn​>0. Let M={1,…,m}M=\{1,\ldots,m\}M={1,…,m} be customer types. A type-jjj customer arrives with probability θj≥0\theta_j\ge0θj​≥0, with ∑j∈Mθj=1\sum_{j\in M}\theta_j=1∑j∈M​θj​=1, and assigns each product iii a nonnegative preference weight vijv_{ij}vij​. The no-purchase option has weight one. Offering an assortment T⊆NT\subseteq NT⊆N to that customer gives MNL expected revenue

Rev⁡j(T)=∑i∈Trivij1+∑i∈Tvij.\operatorname{Rev}_j(T)= \frac{\sum_{i\in T}r_i v_{ij}}{1+\sum_{i\in T}v_{ij}}.Revj​(T)=1+∑i∈T​vij​∑i∈T​ri​vij​​.

If the retailer initially carries only S⊆NS\subseteq NS⊆N, it can still choose the best offer to each customer type. Thus fj(S)=max⁡T⊆SRev⁡j(T)f_j(S)=\max_{T\subseteq S}\operatorname{Rev}_j(T)fj​(S)=maxT⊆S​Revj​(T). For C⊆MC\subseteq MC⊆M, write fC(S)=∑j∈Cθjfj(S)f^C(S)=\sum_{j\in C}\theta_j f_j(S)fC(S)=∑j∈C​θj​fj​(S), and abbreviate f=fMf=f^Mf=fM. The first-stage capacity is KKK; an optimal solution S∗S^*S∗ of CAP maximizes f(S)f(S)f(S) among sets with at most KKK products. These definitions and the standing data assumptions are stated in §2 and §4 of the paper.

For each product iii, the prefix Vi={1,…,i}V_i=\{1,\ldots,i\}Vi​={1,…,i} contains products at least as early in the revenue ordering. Greedy starts at the empty set, repeatedly adds an available product that maximizes the new objective value, and stops at cardinality kkk or when the prefix is exhausted. Augmented Greedy runs Greedy on ViV_iVi​ for each iii, using S↦∑j∈Cθjmin⁡(fj(S),ri)S\mapsto\sum_{j\in C}\theta_j\min(f_j(S),r_i)S↦∑j∈C​θj​min(fj​(S),ri​), and returns whichever candidate has the greatest fCf^CfC value. Both stages may break ties arbitrarily. El Housni and Topaloglu, §4.1.

For type jjj, use the optimal personalized assortment Sj∗={i∈S∗:ri≥fj(S∗)}S_j^*=\{i\in S^*:r_i\ge f_j(S^*)\}Sj∗​={i∈S∗:ri​≥fj​(S∗)}, characterized by Lemma E.1. A type j∈Cj\in Cj∈C is complete with respect to P⊆NP\subseteq NP⊆N when P∩Sj∗=P∩S∗P\cap S_j^*=P\cap S^*P∩Sj∗​=P∩S∗; let CPC_PCP​ collect these types. The threshold choice matters because zero-weight products can be present in other optimal offers without helping a customer. El Housni and Topaloglu, Definition 4.1 and App. E.

Formalization targets

Theorem 4.2: complete-type revenue

For every C⊆MC\subseteq MC⊆M, P⊆NP\subseteq NP⊆N, kkk with ∣P∩S∗∣≤k|P\cap S^*|\le k∣P∩S∗∣≤k, and every output Δ\DeltaΔ of Augmented Greedy on C,kC,kC,k,

fC(Δ)≥(1−1/e) fCP(P∩S∗).f^C(\Delta)\ge(1-1/e)\,f^{C_P}(P\cap S^*).fC(Δ)≥(1−1/e)fCP​(P∩S∗).

This is the mission goal, the structural performance statement of Theorem 4.2, p. 11. It does not assert a constant-factor approximation to all of CAP: it identifies the contribution from complete customer types.

Supporting targets

The milestone list follows the results used with this bound: monotonicity of fjf_jfj​ from Appendix C; the MNL threshold assortment of Lemma E.1; submodularity of S↦min⁡(fj(S),ri)S\mapsto\min(f_j(S),r_i)S↦min(fj​(S),ri​) on ViV_iVi​ from Lemma 4.3; and the cited 1−1/e1-1/e1−1/e Greedy guarantee for a nonnegative monotone submodular objective. The greedy milestone compares its output against every feasible set of cardinality at most kkk.

Significance

The theorem says that one algorithmic output captures a fixed fraction of the benchmark supplied by complete types, despite the absence of global submodularity of fff. It connects the local behavior of truncated type revenues to the full customized assortment objective. The paper uses this result in the development of later algorithms; without it, the standard submodular greedy theorem gives no immediate conclusion for CAP. El Housni and Topaloglu, §§4–5.

The mathematical results are proved in the 2021 paper. The formalization work here is to give machine-checkable statements for the objective, the algorithm with all its legal tie choices, and the four supporting targets, then supply proofs. The MNL revenue formula is already available as a published platform definition; the local CAP and algorithm definitions specify the extra model needed by this theorem. A completed development could also support later CAP missions that use the same threshold and submodularity properties.

Difficulty

The tempting argument applies the classical greedy guarantee directly to fff, since fff increases when more products are carried. Appendix B of the paper shows that this fails: even for one customer type, fff need not be submodular. Restricting the ground set to a revenue prefix and truncating each fjf_jfj​ at that prefix's revenue level changes the submodularity question, but the final guarantee must still concern the untruncated fCf^CfC objective. The threshold condition in the definition of CPC_PCP​ is what makes that comparison meaningful. El Housni and Topaloglu, App. B, Lemma 4.3 and Theorem 4.2.

Formalization scope

Products and types are Fin n and Fin m; their zero-based Lean indices correspond to the paper's indices plus one. Assortments and type groups are finite sets. The model assumes ri>0r_i>0ri​>0, vij≥0v_{ij}\ge0vij​≥0, θj≥0\theta_j\ge0θj​≥0, ∑jθj=1\sum_j\theta_j=1∑j​θj​=1, and decreasing revenue order. The no-purchase weight is exactly one. CAP and personalized revenue use maxima over nonempty finite powersets, so empty input sets have their intended value rather than an arbitrary real supremum. The theorem keeps the source's optimality assumption on S∗S^*S∗, even though its particular inequality uses less.

The Greedy predicate describes each successive maximizer and the exact stopping rule. Augmented Greedy requires a Greedy output at every prefix and an fCf^CfC-maximizing choice among them. Thus the output is constrained by the printed algorithm, and the statement covers every tie-break. The type-jjj assortment is defined from S∗S^*S∗ by the Lemma E.1 threshold, rather than supplied as a free set. These choices rule out a size-only output condition, an arbitrarily chosen Sj∗S_j^*Sj∗​, a vacuous run predicate, and real supremum defaults. The target includes the corner cases k=0k=0k=0, C=∅C=\varnothingC=∅, and P∩S∗=∅P\cap S^*=\varnothingP∩S∗=∅, where its right side is zero. Arrival probabilities summing to one force m≥1m\ge1m≥1; Augmented Greedy has an output only when at least one product exists.

The reusable parts are the MNL threshold characterization, finite-set submodularity and the general Greedy bound. Contributions toward those lemmas, the paper's case analysis for Lemma 4.3, and the final structural theorem are in scope. Runtime claims, the paper's later logarithmic approximation theorems and its computational experiments are outside this mission.

Selected references

  • Omar El Housni and Huseyin Topaloglu, Joint Assortment Optimization and Customization under a Mixture of Multinomial Logit Models: Value of Personalized Assortments, SSRN 3830082, version of 7 December 2021; published as Operations Research 71(4), 2023. SSRN preprint. The mission's numbering and page citations use the pinned 2021 PDF.
  • George L. Nemhauser, Laurence A. Wolsey and Marshall L. Fisher, An Analysis of Approximations for Maximizing Submodular Set Functions—I, Mathematical Programming 14, 265–294, 1978. DOI.
9 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: mikedeng1

Fully-Functional Suffix Trees and Optimal Text Searching in BWT-runs Bounded Space 2: A Text Whose BWT Has r Runs Has at Most 2rs Distinct Substrings of Length sResearch Paper

Motivation

A text index answers questions about occurrences of a pattern without scanning the whole text. One reason to compress such an index is that many stored texts are repetitive: multiple versions of a document or genome often share long passages. The Burrows–Wheeler transform (BWT) rearranges a text's symbols in a way that groups related contexts. A small number of equal-symbol runs in the BWT is therefore a useful measure of repetition. Gagie, Navarro, and Prezza use the number of runs to state space bounds for text searching and suffix-tree operations in Fully-Functional Suffix Trees and Optimal Text Searching in BWT-runs Bounded Space.

This mission isolates one exact counting result underneath those data-structure bounds. A length-sss substring is called an sss-mer. The number of different sss-mers measures how many local patterns the text contains; repeated occurrences of the same string count once. Lemma 9 of the 2019 preprint bounds this number directly in terms of BWT runs. The result makes a relation between two notions of text repetition precise: clustering in the BWT and diversity of fixed-length substrings.

Setting

Let T[1..n]T[1..n]T[1..n] be a text over the ordered alphabet [1..σ][1..\sigma][1..σ]. Its final symbol is a unique terminator \=1,smallerthaneveryothersymbolinthetext.Foreach, smaller than every other symbol in the text. For each ,smallerthaneveryothersymbolinthetext.Foreachi\in[1..n],the∗∗suffix∗∗, the **suffix** ,the∗∗suffix∗∗T[i..n]startsatstarts atstartsatiandendsattheterminator.The∗∗suffixarray∗∗and ends at the terminator. The **suffix array**andendsattheterminator.The∗∗suffixarray∗∗SA[1..n]isthepermutationofis the permutation ofisthepermutationof[1..n]thatliststhesesuffixesinincreasinglexicographicorder.Thusthat lists these suffixes in increasing lexicographic order. Thusthatliststhesesuffixesinincreasinglexicographicorder.ThusSA[p]isthestartingpositionoftheis the starting position of theisthestartingpositionofthep$th suffix. This is the setup of §2 of the source preprint, pp. 7–9.

The BWT symbol at position ppp is the character just before the suffix at SA[p]SA[p]SA[p]. When that suffix is the whole text and has no preceding character, its predecessor is read cyclically as T[n]=\$$. The BWT partitions into maximal runs of equal symbols; rdenotestheirnumber.ThefirstandlastBWTpositionsineachruncorrespondto∗∗sampledtextpositions∗∗.Atextsubstringdenotes their number. The first and last BWT positions in each run correspond to **sampled text positions**. A text substringdenotestheirnumber.ThefirstandlastBWTpositionsineachruncorrespondto∗∗sampledtextpositions∗∗.AtextsubstringT[i..j]$ is primary when its interval contains a sampled text position, as in Definition 5, p. 16.

For 1≤s≤n1\le s\le n1≤s≤n, let Ss(T)\mathcal S_s(T)Ss​(T) be the set of length-sss strings occurring in TTT:

Ss(T)={T[a..a+s−1]:1≤a≤n−s+1}.\mathcal S_s(T)=\{T[a..a+s-1]:1\le a\le n-s+1\}.Ss​(T)={T[a..a+s−1]:1≤a≤n−s+1}.

The braces matter: two windows with identical contents give one element. The final allowed window includes the terminator. The text is not padded in this definition.

Formalization targets

Primary occurrences

Lemma 8, p. 17 states that every nonempty substring of TTT has an occurrence with the same contents that is primary. With Sampled⁡(T)\operatorname{Sampled}(T)Sampled(T) denoting sampled text positions, the assertion is

∀ 1≤i≤j≤n,∃ 1≤i′≤j′≤n:T[i′..j′]=T[i..j]and[i′..j′]∩Sampled⁡(T)≠∅.\forall\,1\le i\le j\le n,\quad\exists\,1\le i'\le j'\le n: T[i'..j']=T[i..j]\quad\text{and}\quad [i'..j']\cap\operatorname{Sampled}(T)\ne\varnothing.∀1≤i≤j≤n,∃1≤i′≤j′≤n:T[i′..j′]=T[i..j]and[i′..j′]∩Sampled(T)=∅.

The mission's milestones also capture the suffix-array interval of a pattern, the sampled occurrence of each individual character, and the bound ∣Sampled⁡(T)∣≤2r|\operatorname{Sampled}(T)|\le 2r∣Sampled(T)∣≤2r stated in the proof of Lemma 9. These give precise intermediate claims in the paper's route to the count.

Distinct sss-mers

The main goal is Lemma 9, p. 17:

∣Ss(T)∣≤2rsfor every 1≤s≤n.\boxed{\quad |\mathcal S_s(T)|\le 2rs\quad\text{for every }1\le s\le n.\quad}∣Ss​(T)∣≤2rsfor every 1≤s≤n.​

Here rrr is calculated from the BWT of the text's suffix array. Both inequalities on sss are part of the source statement. The bound concerns distinct strings of a fixed length, not the number n−s+1n-s+1n−s+1 of substring windows.

Significance

The theorem gives an explicit upper bound on the number of different length-sss strings that can appear when the BWT has few runs. In §4.2 the authors use it to bound the text area holding all distinct length-sss substrings; that area supports the alphabet-mapping component of their compressed index. This exact combinatorial assertion remains meaningful independently of a machine model or a choice of data structure. Its role in the broader construction is described around Lemmas 8 and 9, pp. 16–17.

The result is proved in the paper. The work here is to give its objects and claims machine-checkable statements and then close their proofs in Lean. The mission has not already supplied a machine-checked proof of these claims. A completed development would also provide reusable definitions of suffix arrays, BWT run boundaries, and finite sets of distinct substrings for later formalizations of compressed text indexes.

Difficulty

The count is immediate only after every substring can be represented by an occurrence containing a sampled position. A direct count of all starting positions cannot yield the claimed bound: nnn may be large even when rrr is small. The difficult step is therefore the primary-occurrence claim of Lemma 8. Its statement has to preserve both parts of “occurrence”: the replacement interval must have the same length and symbols, and it must stay inside the text. The suffix-array range used there depends on lexicographic order, while sampled positions are defined through changes between adjacent BWT symbols. Connecting those two views of the text is the central obstacle.

Formalization scope

The Lean representation uses N\mathbb NN for symbols and 1-based positions. The functions TTT and SASASA are read only on [1..n][1..n][1..n]. An IsText hypothesis enforces n≥1n\ge1n≥1, membership in [1..σ][1..\sigma][1..σ], and the unique final terminator \=1.An‘IsSuffixArray‘hypothesissaysthat. An `IsSuffixArray` hypothesis says that .An‘IsSuffixArray‘hypothesissaysthatSAmapsmapsmaps[1..n]injectivelyintoitselfandordersitssuffixesstrictly;itdoesnotpresupposeanyclaimaboutBWTsamples.Becausethatfinitedomainhasinjectively into itself and orders its suffixes strictly; it does not presuppose any claim about BWT samples. Because that finite domain hasinjectivelyintoitselfandordersitssuffixesstrictly;itdoesnotpresupposeanyclaimaboutBWTsamples.Becausethatfinitedomainhasnelements,theseconditionsdescribeapermutation.TheBWTiscomputedfromelements, these conditions describe a permutation. The BWT is computed fromelements,theseconditionsdescribeapermutation.TheBWTiscomputedfromTandandandSA,withthepredecessorofposition1readasposition, with the predecessor of position 1 read as position ,withthepredecessorofposition1readaspositionn$. Runs are counted by their starting cells; samples are the corresponding text positions from both ends of every run. The model follows the first sentence of Definition 1, including the last character of the final run. The source's following explanatory clause omits that endpoint.

The set of sss-mers is a finite set of lists formed from every valid window. It is not restricted to primary windows, which would make the goal a different and easier statement. A primary substring carries valid endpoints and a sampled position inside them. The formal statements do not assume that the desired primary occurrence exists; that is precisely the content of Lemma 8. The paper's O(⋅)O(\cdot)O(⋅) space and time results are outside this mission: the goal is their explicit substring-counting content.

A complete proof needs elementary facts about list prefixes and lexicographic order, finite interval images, the BWT's run partition, and cardinalities of substring windows near samples. The definitions and interval lemmas can be reused by other missions on suffix arrays and compressed strings. Contributions proving any of the listed milestones or strengthening the surrounding reusable string infrastructure are within scope.

Selected references

  • Travis Gagie, Gonzalo Navarro, and Nicola Prezza, Fully-Functional Suffix Trees and Optimal Text Searching in BWT-runs Bounded Space, arXiv:1809.02792v2, 2019. Preprint.
  • Travis Gagie, Gonzalo Navarro, and Nicola Prezza, Fully-Functional Suffix Trees and Optimal Text Searching in BWT-runs Bounded Space, Journal of the ACM 67(1), 2020. DOI:10.1145/3375890. The mission follows the preprint's numbering and wording.
7 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Prophet Inequalities Made Easy: Stochastic Optimization by Pricing Nonstochastic Inputs III: Under a Consistent Allocation Rule, (α, β)-Balanced Prices Are Closed Under Maxima of ValuationsResearch Paper

Motivation

Posted prices turn an offline allocation problem into a sequential choice process: each agent sees a menu of outcomes and prices, then chooses an outcome without revealing its full valuation. The balanced prices framework of Dütting, Feldman, Kesselheim, and Lucier gives welfare guarantees by comparing the revenue collected from an allocation with the welfare that remains feasible after it. Its appeal is that the comparison can be checked in a deterministic full-information setting before any probability distribution over valuations enters the analysis. Dütting et al., 2020

One valuation class at a time would make that framework difficult to reuse. Combinatorial auction valuations are often built by taking pointwise maxima of simpler valuations or by adding values from separate markets. Section 5 of the paper asks whether a price construction balanced for the simple class remains balanced after these operations. Theorem 5.3 gives the maximum closure result; Theorem 5.4 gives addition across markets. Appendix B extends both to the weaker balancing condition used elsewhere in the paper. Dütting et al., 2020, §5 and Appendix B

Setting

There are nnn agents in a fixed order. Agent iii receives an outcome xix_ixi​ from a space XiX_iXi​ containing a null outcome. A profile x=(xi)ix=(x_i)_ix=(xi​)i​ is feasible when it lies in F\mathcal FF. The model assumes downward closure: removing the outcomes of any group of agents from a feasible profile keeps it feasible. For a set of agents SSS, write xSx_SxS​ for the profile retaining xix_ixi​ on SSS and assigning the null outcome elsewhere. The prefix x[i−1]x_{[i-1]}x[i−1]​ retains only the agents before iii. Dütting et al., 2020, §2

A valuation profile vvv assigns each agent a function vi:Xi→Rv_i:X_i\to\mathbb Rvi​:Xi​→R. The welfare of xxx is v(x)=∑ivi(xi)v(x)=\sum_i v_i(x_i)v(x)=∑i​vi​(xi​). Every base valuation takes values in [0,1][0,1][0,1], the normalization stated in §2. For any set SSS of profiles, v(OPT⁡(v,S))v(\operatorname{OPT}(v,S))v(OPT(v,S)) denotes the best welfare achievable in SSS. An allocation rule ALG chooses a feasible profile from a valuation profile. A pricing rule assigns a nonnegative, possibly infinite price pi(xi∣y)p_i(x_i\mid y)pi​(xi​∣y) to outcome xix_ixi​ when the partial profile is yyy; an infeasible extension has infinite price. Dütting et al., 2020, pp. 547–548

An exchange-compatible family (Fx)x∈X(\mathcal F_x)_{x\in X}(Fx​)x∈X​ specifies a set of comparison profiles for each profile xxx. It is exchange compatible when replacing any one coordinate of xxx by the corresponding coordinate of any y∈Fxy\in\mathcal F_xy∈Fx​ gives a feasible profile. This property is required for every xxx in the full outcome space. A rule pvp^vpv is (α,β)(\alpha,\beta)(α,β)-balanced for valuation vvv, ALG, and that family, for constants α>0\alpha>0α>0 and β≥0\beta\ge0β≥0 (Definition 3.1), when both inequalities hold for every feasible xxx and every x′∈Fxx'\in\mathcal F_xx′∈Fx​:

v(ALG⁡(v))−v(OPT⁡(v,Fx))α≤∑ipiv(xi∣x[i−1]),∑ipiv(xi′∣x[i−1])≤βv(OPT⁡(v,Fx)).\frac{v(\operatorname{ALG}(v))-v(\operatorname{OPT}(v,\mathcal F_x))}{\alpha} \le \sum_i p_i^v(x_i\mid x_{[i-1]}), \qquad \sum_i p_i^v(x'_i\mid x_{[i-1]}) \le \beta v(\operatorname{OPT}(v,\mathcal F_x)).αv(ALG(v))−v(OPT(v,Fx​))​≤i∑​piv​(xi​∣x[i−1]​),i∑​piv​(xi′​∣x[i−1]​)≤βv(OPT(v,Fx​)).

The maximum extension Vimax⁡V_i^{\max}Vimax​ of a base valuation space ViV_iVi​ consists of nonempty finite pointwise maxima of elements of ViV_iVi​. A base profile v~\tilde vv~ supports an extended profile vvv at xxx if v~i≤vi\tilde v_i\le v_iv~i​≤vi​ at every outcome and v~i(xi)=vi(xi)\tilde v_i(x_i)=v_i(x_i)v~i​(xi​)=vi​(xi​) for every agent. ALG is consistent when v~(ALG⁡(v~))≥v~(ALG⁡(v))\tilde v(\operatorname{ALG}(\tilde v))\ge\tilde v(\operatorname{ALG}(v))v~(ALG(v~))≥v~(ALG(v)) whenever v~\tilde vv~ supports vvv at ALG⁡(v)\operatorname{ALG}(v)ALG(v). The optimal allocation rule has this property by Lemma 5.2. Dütting et al., 2020, p. 554

Formalization targets

Closure under maxima

The goal is Theorem 5.3. Given one exchange-compatible family and a collection (pw)w∈V(p^w)_{w\in V}(pw)w∈V​ balanced for every base profile, consistency of ALG preserves the same constants for every extended profile and every corresponding supporting base profile:

v∈Vmax⁡,v~∈V supports v at ALG⁡(v)⟹pv~ is (α,β)-balanced for v.v\in V^{\max},\quad \tilde v\in V\text{ supports }v\text{ at }\operatorname{ALG}(v) \quad\Longrightarrow\quad p^{\tilde v}\text{ is }(\alpha,\beta)\text{-balanced for }v.v∈Vmax,v~∈V supports v at ALG(v)⟹pv~ is (α,β)-balanced for v.

The milestone list records the welfare supremum comparison and the two price inequalities in the paper's proof. The family Fx\mathcal F_xFx​ remains the same for all base and extended profiles. Dütting et al., 2020, Theorem 5.3 and proof

Closure under addition and weak balancedness

Theorem 5.4 treats mmm separate allocation problems. The joint outcome and feasible set are products; values and prices add across components; ALG applies each component's rule. It asserts balancedness with the same α\alphaα and β\betaβ. Appendix B changes the second balancedness bound to β1v(OPT⁡(v,Fx))+β2v(ALG⁡(v))\beta_1v(\operatorname{OPT}(v,\mathcal F_x))+\beta_2v(\operatorname{ALG}(v))β1​v(OPT(v,Fx​))+β2​v(ALG(v)) and requires strong consistency for maximum closure. Theorems B.2 and B.3 preserve α,β1,β2\alpha,\beta_1,\beta_2α,β1​,β2​ under maxima and addition, respectively. Dütting et al., 2020, Theorems 5.4, B.2, B.3

Significance

The maximum closure theorem lets a balanced-price construction for a simple valuation class cover finite maxima of that class without worsening its balancing constants. The addition theorem lets separately priced markets be combined by summing prices. Together these two operations account for the XOS composition discussed immediately after Theorem 5.4; the paper uses the results to connect its general framework to combinatorial auctions and multidimensional matroid settings. Dütting et al., 2020, p. 555

These results have paper proofs. The work here is to state their exact deterministic content in Lean so later formalizations of the price constructions can import the closure theorems. The definitions of supporting valuations, exchange-compatible families, and extended-real prices are reusable beyond this mission. The companion statements keep the product-market and weak-balancedness variants alongside the central theorem, while their proofs remain to be formalized.

Difficulty

For maximum closure, the prices are indexed by a base profile v~\tilde vv~ but must be balanced for a different profile vvv that is pointwise larger. A supporting profile agrees with vvv only at ALG's outcome ALG⁡(v)\operatorname{ALG}(v)ALG(v), while condition (a) refers to ALG⁡(v~)\operatorname{ALG}(\tilde v)ALG(v~), an outcome ALG chooses for a different input, and both conditions refer to optimal welfare over Fx\mathcal F_xFx​, where v~\tilde vv~ and vvv can differ. Balancedness of pv~p^{\tilde v}pv~ for v~\tilde vv~ therefore says nothing about vvv on its own; without a hypothesis tying ALG's choices for vvv and v~\tilde vv~ together the statement is false, which is why consistency (Definition 5.1) is part of the theorem. The formal statement must keep the real-valued optimum meaningful for maxima of base valuations, so the [0,1][0,1][0,1] normalization of §2 is carried through to Vmax⁡V^{\max}Vmax. Dütting et al., 2020, Definition 5.1 and Theorem 5.3

For addition, a direct product of the component comparison families has an edge case: a component family can be empty while another is nonempty. The paper's displayed product family then makes the lower balancedness inequality too strong. The theorem statements ask for an exchange-compatible family to exist, as the printed theorems do; they do not require that failing product family. This discrepancy is recorded for review. Dütting et al., 2020, proof of Theorem 5.4

Formalization scope

Agents and markets use zero-based finite indices; the paper writes agent indices from one. A profile's prefix contains exactly the agents with smaller indices. Valuations are functions to R\mathbb RR with base values in [0,1][0,1][0,1]. The maximum extension uses a nonempty finite set of base functions, so its maximum is defined at every outcome. Optimal welfare is a real supremum; bounded valuations keep it finite, and the empty set has value zero. Prices are extended nonnegative reals so +∞+\infty+∞ is retained. The lower balancedness inequality embeds its real right side using ofReal, which handles a negative lower bound consistently with nonnegative prices. The upper inequality keeps the price sum in extended reals.

The maximum theorem quantifies over every extended profile and every supporting base profile, including genuinely new maxima. It keeps one exchange-compatible family for all valuations. The maximum-closure theorems require every base price to satisfy the pricing-rule condition and conclude it for the supporting price. ALG feasibility is assumed on Vmax⁡V^{\max}Vmax, which contains the base profiles. The product theorems construct joint outcomes, additive values, componentwise ALG, and summed prices from the component data; they do not admit an unrelated joint allocation rule. Downward closure and a zero price for the null outcome at feasible partial allocations are included for the product statements. The latter is a disclosed assumption satisfied by the paper's pricing examples and needed to handle empty component families. No distribution or posted-price run is part of this deterministic mission. Lemma 5.2 and the strong-consistency companion take an optimal rule to be one that attains the welfare supremum over F\mathcal FF on every profile in Vmax⁡V^{\max}Vmax, the profiles to which Definitions 5.1 and B.1 apply it; the product companions additionally conclude that the summed prices form a pricing rule (infinite off F\mathcal FF). Their ALG feasibility premise concerns the component profiles supplied in the theorem.

The development needs finite dependent products and sums, finite maxima, real suprema of bounded sets, and extended nonnegative arithmetic. Contributions proving the three maximum-closure milestones, the goal, or the product-market companions are all within scope. A proof that specializes the supporting profile to v~=v\tilde v=vv~=v would lose the intended maximum extension and does not satisfy the goal's universal quantification.

Selected references

  • P. Dütting, M. Feldman, T. Kesselheim, and B. Lucier, Prophet Inequalities Made Easy: Stochastic Optimization by Pricing Nonstochastic Inputs, SIAM Journal on Computing 49(3):540–582, 2020. DOI: 10.1137/20M1323850.
7 thms2 active usersReviewed
🏆Completed
Linear algebraNumerical AnalysisOptimization·Captain: mikedeng1

Low Rank Approximation and Regression in Input Sparsity Time 2: Sketched Multiple-Response Regression Is (1 + 4ε)-Optimal in Squared Error If the Sketch Embeds the Subspace and Approximates ProductsResearch Paper

Motivation

Least-squares regression, min⁡X∥AX−B∥F\min_X\|AX-B\|_FminX​∥AX−B∥F​ for a tall matrix A∈Rn×dA\in\mathbb R^{n\times d}A∈Rn×d with n≫dn\gg dn≫d, is among the most frequently solved problems in numerical computation. Direct methods (QR or SVD) cost O(nd2)O(nd^2)O(nd2) time, which is prohibitive when nnn is in the millions. Sketching replaces the problem by a much smaller one: choose a matrix S∈Rt×nS\in\mathbb R^{t\times n}S∈Rt×n with t≪nt\ll nt≪n, form SASASA and SBSBSB, and solve min⁡X∥S(AX−B)∥F\min_X\|S(AX-B)\|_FminX​∥S(AX−B)∥F​ instead. The question is when the solution of the small problem is nearly optimal for the original one.

Clarkson and Woodruff, Low Rank Approximation and Regression in Input Sparsity Time (STOC 2013; JACM 2017), showed that a very sparse random sketch (one non-zero per column, the CountSketch matrix) can be applied in time proportional to the number of non-zero entries of AAA and still yields (1+ε)(1+\varepsilon)(1+ε)-approximate regression and low-rank approximation. §7 of that paper isolates the deterministic part of the argument: two conditions on a fixed sketch SSS that guarantee a near-optimal solution, whatever distribution produced SSS.

Timeline. Sarlós (FOCS 2006) introduced sketch-and-solve regression with fast Johnson–Lindenstrauss transforms. Drineas, Mahoney, Muthukrishnan and Sarlós (Numer. Math. 2011) stated the structural conditions for single-response regression (their Lemma 1); Theorem 36 of Clarkson–Woodruff generalizes it to multiple responses. Clarkson and Woodruff then supplied the sparse sketches meeting the conditions in input-sparsity time.

Setting

All matrices are real. For a vector vvv let ∥v∥22=∑ivi2\|v\|_2^2=\sum_iv_i^2∥v∥22​=∑i​vi2​; for a matrix MMM let ∥M∥F2=∑i,jMij2\|M\|_F^2=\sum_{i,j}M_{ij}^2∥M∥F2​=∑i,j​Mij2​. Fix A∈Rn×dA\in\mathbb R^{n\times d}A∈Rn×d of rank at most rrr, a right-hand side B∈Rn×d′B\in\mathbb R^{n\times d'}B∈Rn×d′ and a sketch S∈Rt×nS\in\mathbb R^{t\times n}S∈Rt×n. Let C(A)={Ax}C(A)=\{Ax\}C(A)={Ax} be the column space and U∈Rn×kU\in\mathbb R^{n\times k}U∈Rn×k a matrix with orthonormal columns (U⊤U=IU^\top U=IU⊤U=I) spanning C(A)C(A)C(A).

  • Y∗Y^*Y∗ is a least-squares minimizer: it minimizes ∥AY−B∥F2\|AY-B\|_F^2∥AY−B∥F2​ (problem (8)).
  • Y~\tilde YY~ is a sketched minimizer: it minimizes ∥S(AY−B)∥F2\|S(AY-B)\|_F^2∥S(AY−B)∥F2​ (problem (7)).
  • SSS is a subspace embedding for AAA with parameter η\etaη if ∣∥SAx∥22−∥Ax∥22∣≤η∥Ax∥22\bigl|\|SAx\|_2^2-\|Ax\|_2^2\bigr|\le\eta\|Ax\|_2^2​∥SAx∥22​−∥Ax∥22​​≤η∥Ax∥22​ for every xxx.
  • SSS satisfies the approximate matrix multiplication event (Lemma 32) for a pair (U,W)(U,W)(U,W) with error parameter eee if ∥U⊤S⊤SW−U⊤W∥F2≤e2∥U∥F2∥W∥F2\|U^\top S^\top SW-U^\top W\|_F^2\le e^2\|U\|_F^2\|W\|_F^2∥U⊤S⊤SW−U⊤W∥F2​≤e2∥U∥F2​∥W∥F2​.

Formalization targets

Goal: Theorem 36 (p. 24)

If SSS is a subspace embedding for AAA with 0≤η≤1/20\le\eta\le1/20≤η≤1/2 and satisfies the event of Lemma 32 for (U,B−AY∗)(U,B-AY^*)(U,B−AY∗) with error parameter ε/r\sqrt{\varepsilon/r}ε/r​, then every sketched minimizer satisfies

∥AY~−B∥F2≤(1+4ε)∥AY∗−B∥F2.\|A\tilde Y-B\|_F^2\le(1+4\varepsilon)\|AY^*-B\|_F^2 .∥AY~−B∥F2​≤(1+4ε)∥AY∗−B∥F2​.

This is the explicit form the paper's proof establishes; the printed (1+ϵ)(1+\epsilon)(1+ϵ) bound on norms follows after rescaling ε\varepsilonε.

Milestones

  • Fact 34 (Pythagorean theorem): C⊤D=0⇒∥C+D∥F2=∥C∥F2+∥D∥F2C^\top D=0\Rightarrow\|C+D\|_F^2=\|C\|_F^2+\|D\|_F^2C⊤D=0⇒∥C+D∥F2​=∥C∥F2​+∥D∥F2​.
  • Fact 35 (normal equations): C−DC^-DC−D is a minimizer; every minimizer X∗X^*X∗ satisfies C⊤(CX∗−D)=0C^\top(CX^*-D)=0C⊤(CX∗−D)=0 and ∥CX−D∥F2=∥C(X−X∗)∥F2+∥CX∗−D∥F2\|CX-D\|_F^2=\|C(X-X^*)\|_F^2+\|CX^*-D\|_F^2∥CX−D∥F2​=∥C(X−X∗)∥F2​+∥CX∗−D∥F2​.
  • Lemma 37: for AAA with orthonormal columns, ∥A(Y~−Y∗)∥F≤2ε∥B−AY∗∥F\|A(\tilde Y-Y^*)\|_F\le2\sqrt\varepsilon\|B-AY^*\|_F∥A(Y~−Y∗)∥F​≤2ε​∥B−AY∗∥F​.
  • Theorem 39 (affine embeddings, an independent companion result of §7.5): under an embedding with parameter ε≤1/2\varepsilon\le1/2ε≤1/2 and the event of Lemma 32 with parameter ε/r\varepsilon/\sqrt rε/r​, ∥S(AX−B)∥F2−∥SB~∥F2\|S(AX-B)\|_F^2-\|S\tilde B\|_F^2∥S(AX−B)∥F2​−∥SB~∥F2​ equals ∥AX−B∥F2−∥B~∥F2\|AX-B\|_F^2-\|\tilde B\|_F^2∥AX−B∥F2​−∥B~∥F2​ up to ±2ε∥AX−B∥F2\pm2\varepsilon\|AX-B\|_F^2±2ε∥AX−B∥F2​ for all XXX, and ∥S(AX−B)∥F2=(1±3ε)∥AX−B∥F2\|S(AX-B)\|_F^2=(1\pm3\varepsilon)\|AX-B\|_F^2∥S(AX−B)∥F2​=(1±3ε)∥AX−B∥F2​ if SSS also preserves ∥B~∥F2\|\tilde B\|_F^2∥B~∥F2​ to 1±ε1\pm\varepsilon1±ε.

Significance

Theorem 36 separates the algorithm design for sketched regression from its correctness proof: any random construction (CountSketch, subsampled randomized Hadamard transforms, leverage-score sampling, Gaussian matrices) yields a (1+O(ε))(1+O(\varepsilon))(1+O(ε))-approximate regression solver once it is shown to satisfy the two conditions with constant probability. Clarkson and Woodruff use it for their input-sparsity-time regression algorithm (Theorem 38) and, through Theorem 39 and affine embeddings, for low-rank approximation. The same conditions recur throughout the randomized numerical linear algebra literature (see Woodruff's survey Sketching as a Tool for Numerical Linear Algebra, 2014).

The results are proved in the paper (§7.3, §7.5 and Appendix A, p. 37). To our knowledge none has a machine-checked proof. Formalizing them produces a reusable, distribution-free layer of sketching theory: the probabilistic statements about specific sketches can then be proved separately and composed with it.

Difficulty

The obvious argument applies the subspace embedding to the residual AY~−BA\tilde Y-BAY~−B, but that vector does not lie in C(A)C(A)C(A), so an embedding of C(A)C(A)C(A) alone says nothing about it; embedding C(A)C(A)C(A) augmented with the columns of BBB instead costs a sketch dimension that grows with d′d'd′. The hypotheses of Theorem 36 control the optimal residual B−AY∗B-AY^*B−AY∗ only through the approximate-product condition, which is far weaker than norm preservation, and the difficulty is to transfer that control to the sketched solution (Lemma 37) with the constants 2ε2\sqrt\varepsilon2ε​ and 1+4ε1+4\varepsilon1+4ε. A second obstacle is the passage from a general AAA of rank at most rrr to an orthonormal basis UUU of C(A)C(A)C(A): it changes ∥A∥F\|A\|_F∥A∥F​, which is why the approximate-product condition is stated for UUU.

Formalization scope

Matrices are Matrix (Fin m) (Fin n) ℝ; squared norms are explicit sums sqNorm and frobSq; the column space is the range of Matrix.mulVecLin; rank is Matrix.rank. Everything is deterministic: SSS is an arbitrary fixed matrix and no probability space appears. The committed conventions are:

  1. The subspace embedding is in squared form. In Theorem 36 and Lemma 37 its parameter η\etaη plays the paper's ϵ02\epsilon_0^2ϵ02​ (so ϵ0≤1/2\epsilon_0\le1/\sqrt2ϵ0​≤1/2​ becomes η≤1/2\eta\le1/2η≤1/2), which is how the proof of Lemma 37 (p. 37) uses it; in Theorem 39 the parameter is ε\varepsilonε itself, as that proof uses it.
  2. "SSS satisfies Lemma 32" is the event inside the probability, for the pair (U,B−AY∗)(U,B-AY^*)(U,B−AY∗) (resp. (U,B~)(U,\tilde B)(U,B~)) that the proofs use, with ≤\le≤ in place of the printed <<< (a weaker hypothesis).
  3. Y~\tilde YY~, Y∗Y^*Y∗, X∗X^*X∗ are arbitrary minimizers; "the solution" need not be unique. The Moore–Penrose inverse is specified by the four Penrose equations.
  4. r≥1r\ge1r≥1 guards ε/r\varepsilon/rε/r and ε/r\varepsilon/\sqrt rε/r​; "n>dn>dn>d" (§7) concerns running times and is not assumed.

A trivializing formalization is ruled out: Y~\tilde YY~ is never defined as Y∗Y^*Y∗, the approximate-product hypothesis is an inequality and not the exact identity U⊤S⊤S(B−AY∗)=0U^\top S^\top S(B-AY^*)=0U⊤S⊤S(B−AY∗)=0, η\etaη is non-negative, and the goal is stated for general AAA of rank at most rrr, not only for orthonormal AAA. The hypotheses are jointly satisfiable (for instance S=IS=IS=I).

A complete development needs the Frobenius inner product and its Pythagorean identity, the normal equations for matrix least squares, the existence of the Moore–Penrose inverse, and the spectral-norm bound for a symmetric matrix from its quadratic form; all are reusable beyond this mission. Proofs of any milestone, and alternative arguments for Theorem 36, are welcome.

Selected references

  • K. L. Clarkson and D. P. Woodruff, Low Rank Approximation and Regression in Input Sparsity Time, arXiv:1207.6365v4, 2013; J. ACM 64(6), 2017. https://arxiv.org/abs/1207.6365
  • P. Drineas, M. W. Mahoney, S. Muthukrishnan and T. Sarlós, Faster Least Squares Approximation, Numerische Mathematik 117(2), 2011. https://arxiv.org/abs/0710.1435
  • T. Sarlós, Improved Approximation Algorithms for Large Matrices via Random Projections, FOCS 2006. https://doi.org/10.1109/FOCS.2006.37
  • D. P. Woodruff, Sketching as a Tool for Numerical Linear Algebra, Foundations and Trends in Theoretical Computer Science 10(1–2), 2014. https://arxiv.org/abs/1411.4357
7 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

A c^k n 5-Approximation Algorithm for Treewidth 2: X Is a Balanced S-Separator iff V(G)∖X Splits into Three Mutually Non-Adjacent Parts Each Holding at Most |S|/2 Vertices of SResearch Paper

Motivation

The paper of Bodlaender, Drange, Dregi, Fomin, Lokshtanov and Pilipczuk (2016) has an algorithmic headline. This mission concerns one of its finite graph lemmas, Lemma 2.9. The lemma translates a condition phrased separately for every connected component into a condition on three vertex sets. A reader of graph decompositions encounters both forms: components express what remains connected after deleting vertices, while a small fixed number of parts gives a compact way to state constraints on a partition. Lemma 2.9 identifies exactly when the two forms agree for the half-balance threshold. The same result appears again in the paper as Lemma 6.2, where the authors use it in a later section.

The result does not require a tree decomposition or a treewidth hypothesis. It holds for every finite graph. That generality makes it a useful standalone target: the definitions of deletion, connected components, and the weighted three-partition can be reused wherever graph separators are studied. The mission follows the published SIAM article, with printed page 328 for the main lemma and pages 363–364 for its restatement and the supporting combinatorial observation.

Setting

Let GGG be a finite simple graph with vertex set V(G)V(G)V(G). Let SSS and XXX be subsets of its vertices. The deleted graph G∖XG\setminus XG∖X retains precisely the vertices outside XXX and the edges joining them. Two remaining vertices are in the same connected component when a walk joins them without passing through any vertex of XXX. Write CX(u)C_X(u)CX​(u) for the vertex set of the component containing u∉Xu\notin Xu∈/X. This interpretation follows the paper's notation on page 320.

A balanced SSS-separator is a set XXX for which each component of G∖XG\setminus XG∖X contains at most half the vertices of SSS:

∣CX(u)∩S∣≤∣S∣2for every u∈V(G)∖X.|C_X(u)\cap S|\le\frac{|S|}{2}\qquad\text{for every }u\in V(G)\setminus X.∣CX​(u)∩S∣≤2∣S∣​for every u∈V(G)∖X.

The paper introduces this phrase on page 321. Here balance is a property of XXX relative to SSS; it imposes no bound on the size of XXX. The denominator counts all vertices of SSS, including any that lie in XXX.

A three-part partition of V(G)∖XV(G)\setminus XV(G)∖X is a triple (M1,M2,M3)(M_1,M_2,M_3)(M1​,M2​,M3​) of pairwise disjoint sets whose union is V(G)∖XV(G)\setminus XV(G)∖X. A part may be empty. Two parts have no edge between them if no edge of GGG joins a vertex of one to a vertex of the other. Since the graph is undirected, checking the three unordered pairs of distinct parts covers the requirement for every i≠ji\ne ji=j.

Formalization targets

Lemma 2.9: balanced separators and three parts

The goal is the equivalence stated on page 328, also restated as Lemma 6.2 on page 363:

X is a balanced S-separator⟺V(G)∖X=M1∪˙M2∪˙M3,no edge joins distinct Mi,∣Mi∩S∣≤∣S∣/2(i=1,2,3).X\text{ is a balanced }S\text{-separator} \quad\Longleftrightarrow\quad \begin{gathered} V(G)\setminus X=M_1\mathbin{\dot\cup}M_2\mathbin{\dot\cup}M_3,\\ \text{no edge joins distinct }M_i,\\ |M_i\cap S|\le |S|/2\quad(i=1,2,3). \end{gathered}X is a balanced S-separator⟺V(G)∖X=M1​∪˙M2​∪˙M3​,no edge joins distinct Mi​,∣Mi​∩S∣≤∣S∣/2(i=1,2,3).​

The equivalence is the target, including both directions. It applies even when SSS or V(G)∖XV(G)\setminus XV(G)∖X is empty. It does not include a bound on ∣X∣|X|∣X∣.

Lemma 6.3: three bounded sums

The main supporting result on page 363 says that nonnegative integers a1,…,apa_1,\ldots,a_pa1​,…,ap​ with total qqq and ai≤q/2a_i\le q/2ai​≤q/2 can be divided into three classes, each with sum at most q/2q/2q/2. The milestone list also records the paper's merge inequality and its assertion that a component cannot cross between parts having no edge between them. These are the specific claims used in the published discussion of Lemma 2.9.

Significance

Lemma 2.9 lets a componentwise balance condition be represented by three sets whose coverage, disjointness, edge separation, and cardinalities can be inspected directly. It gives an exact equivalence, so the three-part formulation loses no balanced separators and introduces none that fail the original definition. That is the mathematical content needed when a later argument represents a separator by a bounded number of regions rather than by a list of all its components. The result is already proved in the 2016 paper; the open work in this mission is a machine-checked formalization of that known result and its cited supporting claims.

Formalizing the equivalence also establishes reusable interfaces for vertex deletion and component membership in a finite simple graph. A future development can state a separator condition using IsBalancedSSep, or use the three-part conclusion without redefining what a component of G∖XG\setminus XG∖X means. The independent integer-partition lemma has uses whenever indivisible nonnegative weights, each no larger than half the total, must be grouped into three bounded classes. Nothing in that statement depends on graphs.

Difficulty

There may be arbitrarily many components of G∖XG\setminus XG∖X, although the conclusion permits only three parts. Simply assigning all components to one part can violate the half bound, while splitting a component between different parts may create forbidden edges. A component's weight is the number of its vertices in SSS, and those weights can be uneven or zero. The theorem has to accommodate all such patterns without changing the threshold ∣S∣/2|S|/2∣S∣/2. In the converse direction, the absence of edges between the three parts must control entire walks, not only their first edge; ordinary connectivity in GGG would allow a walk through XXX and would describe the wrong components.

Formalization scope

The Lean development uses SimpleGraph V with V : Type, [Fintype V], and [DecidableEq V]. Vertex sets are Finset V. The shared walk-based AvoidReach G X u v requires every vertex on a walk to lie outside XXX, including both endpoints; avoidComp G X u collects the vertices reachable in this way. It is used only for u∉Xu\notin Xu∈/X when quantifying over components. This shared definition matches the paper's G∖XG\setminus XG∖X. The graph itself need not have decidable adjacency, since the statements concern propositions rather than computations.

Half bounds are written as 2c≤∣S∣2c\le |S|2c≤∣S∣ or 2c≤q2c\le q2c≤q in natural-number arithmetic. This is equivalent to the paper's rational half bound and avoids any interpretation of natural-number division. The three parts may be empty, so X=V(G)X=V(G)X=V(G) is a genuine boundary case. The set SSS may meet XXX; the right-hand denominator remains ∣S∣|S|∣S∣. The graph may have no vertices. There is no treewidth parameter or size condition on XXX: adding one would change Lemma 2.9 and can make its reverse implication false. Nor may components be computed using connectivity in the original graph, where paths through deleted vertices could merge them.

The required infrastructure is finite graph walks, finite sets, cardinalities, sums over finite index types, and the three original claims in the milestone list. The graph-component definitions and the integer grouping theorem are reusable beyond this mission. Contributions that prove any milestone or the full equivalence under exactly these conventions are in scope.

Selected references

  • H. L. Bodlaender, P. G. Drange, M. S. Dregi, F. V. Fomin, D. Lokshtanov and M. Pilipczuk, A c^k n 5-approximation algorithm for treewidth, SIAM Journal on Computing 45(2):317–378, 2016. DOI: 10.1137/130947374.
6 thms2 active usersReviewed
Complexity TheoryOperations ResearchOptimization·Captain: mikedeng1

Scheduling Problems with Two Competing Agents 7: PARTITION Reduces to Two Agents Each Bounding Their Own Makespan in the Two-Machine Flow Shop and Open ShopResearch Paper

Motivation

In multi-agent scheduling, several decision makers share one processing resource, and each one cares only about the completion of its own jobs. Agnetis, Mirchandani, Pacciarelli and Pacifici (Oper. Res. 52(2), 2004) set up the two-agent version of this problem and classified its complexity for most combinations of classical objectives. Typical settings are a manufacturing cell that serves an internal and an external customer, or two departments that negotiate access to a shared machine. Most of the paper treats a single machine. Its §10 asks what happens when the shared resource is a small shop: two machines that every job must visit.

The answer is that even the simplest two-machine case is hard. In the classical single-agent setting, the two-machine flow shop makespan problem is solved by Johnson's rule (Johnson 1954) and the two-machine open shop makespan problem by Gonzalez and Sahni (1976), both in polynomial time. As soon as two agents each want their own jobs finished early, both problems become NP-hard.

Setting

There are two agents, A and B. Agent A owns jobs J1A,…,JnAAJ^A_1,\dots,J^A_{n_A}J1A​,…,JnA​A​ and agent B owns jobs J1B,…,JnBBJ^B_1,\dots,J^B_{n_B}J1B​,…,JnB​B​. Every job consists of one operation on machine M1M_1M1​ and one on machine M2M_2M2​, and pihX≥0p^X_{ih}\ge 0pihX​≥0 is the processing time of job JiXJ^X_iJiX​ on machine MhM_hMh​. A schedule gives every operation a start time. It is feasible when no operation starts before time 000, each machine processes at most one operation at a time, and the two operations of one job do not overlap in time. Processing is nonpreemptive.

  • In the flow shop F2F2F2 every job is processed first on M1M_1M1​ and then on M2M_2M2​.
  • In the open shop O2O2O2 the two operations of a job may be processed in either order.

The makespan of agent XXX, Cmax⁡XC^X_{\max}CmaxX​, is the latest completion time of an operation of one of its jobs. The recognition problem F2∥Cmax⁡A≤QA, Cmax⁡B≤QBF2\|C^A_{\max}\le Q_A,\ C^B_{\max}\le Q_BF2∥CmaxA​≤QA​, CmaxB​≤QB​ asks, for given thresholds QA,QBQ_A, Q_BQA​,QB​, whether some feasible flow shop schedule has Cmax⁡A≤QAC^A_{\max}\le Q_ACmaxA​≤QA​ and Cmax⁡B≤QBC^B_{\max}\le Q_BCmaxB​≤QB​. The problem O2∥Cmax⁡A≤QA, Cmax⁡B≤QBO2\|C^A_{\max}\le Q_A,\ C^B_{\max}\le Q_BO2∥CmaxA​≤QA​, CmaxB​≤QB​ is the same question for the open shop.

PARTITION (Problem 9.1 of the paper) asks whether a finite list of nonnegative integers p1,…,pkp_1,\dots,p_kp1​,…,pk​ can be split into two parts of equal sum P/2P/2P/2, where P=∑ipiP=\sum_i p_iP=∑i​pi​.

Formalization targets

Goal: Theorems 10.1 and 10.2

PARTITION ≤p F2 ∥ Cmax⁡A≤QA, Cmax⁡B≤QBandPARTITION ≤p O2 ∥ Cmax⁡A≤QA, Cmax⁡B≤QB,\text{PARTITION}\ \le_p\ F2\,\|\,C^A_{\max}\le Q_A,\ C^B_{\max}\le Q_B \qquad\text{and}\qquad \text{PARTITION}\ \le_p\ O2\,\|\,C^A_{\max}\le Q_A,\ C^B_{\max}\le Q_B,PARTITION ≤p​ F2∥CmaxA​≤QA​, CmaxB​≤QB​andPARTITION ≤p​ O2∥CmaxA​≤QA​, CmaxB​≤QB​,

with ≤p\le_p≤p​ polynomial-time many-one reducibility between binary-coded languages. This is how the paper proves "F2∥Cmax⁡A:Cmax⁡BF2\|C^A_{\max}:C^B_{\max}F2∥CmaxA​:CmaxB​ is NP-hard" (Theorem 10.1, p. 238) and "O2∥Cmax⁡A:Cmax⁡BO2\|C^A_{\max}:C^B_{\max}O2∥CmaxA​:CmaxB​ is NP-hard" (Theorem 10.2, p. 239).

Milestones: the two constructions

For Theorem 10.1, with ε=1/(k+1)\varepsilon=1/(k+1)ε=1/(k+1), the paper builds the instance with kkk A-jobs of times (ε,pi)(\varepsilon, p_i)(ε,pi​), one B-job of times (P/2−(k−1)ε, P/2)(P/2-(k-1)\varepsilon,\ P/2)(P/2−(k−1)ε, P/2), and thresholds QA=3P/2+εQ_A = 3P/2+\varepsilonQA​=3P/2+ε, QB=P+εQ_B = P+\varepsilonQB​=P+ε. The milestones are:

  1. under Cmax⁡B≤QBC^B_{\max}\le Q_BCmaxB​≤QB​ the B-job starts on M2M_2M2​ by P/2+εP/2+\varepsilonP/2+ε, and the A-jobs before it on M2M_2M2​ total at most P/2P/2P/2;
  2. for even PPP, PARTITION has a solution if and only if this instance meets both thresholds.

For Theorem 10.2 the instance has kkk A-jobs of time pip_ipi​ on both machines, one B-job of time P/2P/2P/2 on both machines, and thresholds QA=3P/2Q_A=3P/2QA​=3P/2, QB=PQ_B=PQB​=P. The milestones are:

  1. under Cmax⁡B≤QBC^B_{\max}\le Q_BCmaxB​≤QB​ the B-job starts at 000 on one machine and at P/2P/2P/2 on the other;
  2. PARTITION has a solution if and only if this instance meets both thresholds.

Significance

The two theorems mark the boundary of tractability of §10. The single-agent problems F2∥Cmax⁡F2\|C_{\max}F2∥Cmax​ and O2∥Cmax⁡O2\|C_{\max}O2∥Cmax​ are polynomial. Giving the second agent a single job and a deadline is already enough to make the problems NP-hard, so no extension of Johnson's rule or of the Gonzalez–Sahni algorithm solves the two-agent versions unless P = NP. The paper also observes that any other combination of the objectives it considers is NP-hard in these shops.

The theorems are proved in the paper by short reductions. As far as we know none of them is machine-checked. This mission produces checked statements of both reductions on a general two-machine shop model with real start times. It also corrects the flow shop equivalence, which as printed does not hold for odd PPP.

Difficulty

The hard direction of each equivalence goes from a feasible schedule to a partition. A schedule is a set of real start times, not a permutation. Nothing forces the jobs into a fixed order or rules out idle time. The proof has to extract a combinatorial split from interval packing: which A-jobs fit into the gap before the B-job on one machine and which fit into the gap after it. The sum of lengths of pairwise disjoint intervals inside a window must be bounded by the window's length.

In the flow shop the gap after the B-job has length P/2+kεP/2+k\varepsilonP/2+kε, which is not P/2P/2P/2. Integrality of the A-lengths is what closes the gap, and it only works when P/2P/2P/2 is an integer. In the open shop, the same argument has to cover both orders of the B-job's operations. Both reductions output rational data, so the goal also needs a scaling to integer data and a polynomial-time bound on the code map.

Formalization scope

  • Model. Jobs are numbered Fin (n_A + n_B), the A-jobs first. Start times are real numbers, and idle time and different job orders on the two machines are allowed. Flow shop feasibility is the published JohnsonFlowShop.TwoStage.IsFeasible from the Johnson (1954) series. Open shop feasibility is the definition IsOpenFeasible of this mission: no machine overlap between distinct jobs, and no time overlap between the two operations of a job. "Cmax⁡X≤QXC^X_{\max}\le Q_XCmaxX​≤QX​" is stated as "every operation of every XXX-job ends by QXQ_XQX​", so no maximum over a possibly empty set is taken.
  • Languages. The target languages hold the binary codes of instances with natural-number processing times and thresholds that have a feasible schedule meeting both thresholds. PARTITION is the published ProjSchedTW.Complexity.partitionLang (nonnegative sizes, zero allowed), and reducibility is CookPvsNP.PolyReducible. Both come from published definitions of the Neumann–Schwindt–Zimmermann and Cook series. NP-membership is not formalized.
  • Constructions. They are defined over R\mathbb RR exactly as printed. A reduction to the N\mathbb NN-coded languages has to rescale (for example by 2(k+1)2(k+1)2(k+1)). That rescaling is the solver's to choose and is not a milestone.
  • Corrections. The printed flow shop equivalence uses ⌊P/2+kε⌋=P/2\lfloor P/2+k\varepsilon\rfloor = P/2⌊P/2+kε⌋=P/2 and fails for odd PPP: p=(1)p=(1)p=(1) gives a yes-instance of the scheduling problem but has no partition. It also fails for P=0P=0P=0 and k≥2k\ge 2k≥2, where the printed p11Bp^B_{11}p11B​ is negative. Milestone 2 therefore assumes PPP even and (P≥2P\ge2P≥2 or k≤1k\le1k≤1). The goal is unaffected, because odd PPP is a PARTITION no-instance. In the open shop proof, the printed identity "∑piA+∑piB=2P\sum p^A_i+\sum p^B_i = 2P∑piA​+∑piB​=2P" is read as "each machine carries 3P/23P/23P/2 of work", and the statement is unchanged.
  • No trivialization. The flow shop and open shop languages are not restricted to the instances the constructions produce, so they cannot be decided by reading off the construction. A schedule must satisfy the machine and job non-overlap constraints, including in the open shop, where a definition without the job constraint would let a job run on both machines at once.
  • Welcome contributions. Interval-packing lemmas on R\mathbb RR, a polynomial-time bound for list arithmetic over encNats, and a scaling lemma for shop schedules are reusable beyond this mission.

Selected references

  • A. Agnetis, P. B. Mirchandani, D. Pacciarelli, A. Pacifici, Scheduling Problems with Two Competing Agents, Operations Research 52(2) (2004) 229–242. https://doi.org/10.1287/opre.1030.0092
  • S. M. Johnson, Optimal two- and three-stage production schedules with setup times included, Naval Research Logistics Quarterly 1 (1954) 61–68. https://doi.org/10.1002/nav.3800010110
  • T. Gonzalez, S. Sahni, Open shop scheduling to minimize finish time, Journal of the ACM 23(4) (1976) 665–679. https://doi.org/10.1145/321978.321985
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979.
11 thms2 active usersReviewed
Complexity TheoryOperations ResearchOptimization·Captain: mikedeng1

Scheduling Problems with Two Competing Agents 6: PARTITION Reduces to Two Agents Each Bounding Their Own Total Completion Time on One MachineResearch Paper

Two agents sharing one machine

In many production and service settings a single resource is shared by parties with different goals: two departments sending orders to the same machine, two customers of a contract manufacturer, or two classes of requests on one processor. Multi-agent scheduling models this directly. Each agent owns its own jobs and its own objective, and a schedule is judged by the pair of objective values it gives the two agents rather than by a single combined criterion.

Agnetis, Mirchandani, Pacciarelli and Pacifici (Oper. Res. 52(2), 2004, pp. 229–242) set up the systematic study of the two-agent single-machine problem. For each pair of classical objectives they ask how hard it is to optimise one agent's objective while the other agent's objective stays within a given bound. This mission formalises their §9, the case in which both agents minimise their own total completion time. With a single agent, minimising the total completion time is solved by sorting the jobs by length (the shortest-processing-time rule of Smith, 1956). §9 shows that two agents, each with this easiest of objectives, already give an NP-hard problem (Theorem 9.2), and that the problem is solved in pseudopolynomial time by a dynamic program (Theorem 9.3).

Setting

There are two agents, A and B. Agent A owns jobs J1A,…,JnAAJ^A_1,\dots,J^A_{n_A}J1A​,…,JnA​A​ with processing times phA∈Np^A_h\in\mathbb NphA​∈N; agent B owns jobs J1B,…,JnBBJ^B_1,\dots,J^B_{n_B}J1B​,…,JnB​B​ with processing times pkB∈Np^B_k\in\mathbb NpkB​∈N. All jobs are available at time 000 and are processed on one machine, one at a time, without interruption. Since both objectives are nondecreasing in the completion times, a schedule σ\sigmaσ is a sequence of all nA+nBn_A+n_BnA​+nB​ jobs processed back to back from time 000. The completion time Cj(σ)C_j(\sigma)Cj​(σ) of a job is the total processing time of the job and of all jobs before it. Agent A's cost is ∑hChA(σ)\sum_hC^A_h(\sigma)∑h​ChA​(σ) and agent B's cost is ∑kCkB(σ)\sum_kC^B_k(\sigma)∑k​CkB​(σ).

The recognition problem 1∥∑CiA≤QA, ∑CiB≤QB1\|\sum C^A_i\le Q_A,\ \sum C^B_i\le Q_B1∥∑CiA​≤QA​, ∑CiB​≤QB​ asks, for thresholds QA,QBQ_A,Q_BQA​,QB​, whether some schedule has

∑h=1nAChA(σ)≤QAand∑k=1nBCkB(σ)≤QB.\sum_{h=1}^{n_A}C^A_h(\sigma)\le Q_A\qquad\text{and}\qquad\sum_{k=1}^{n_B}C^B_k(\sigma)\le Q_B .h=1∑nA​​ChA​(σ)≤QA​andk=1∑nB​​CkB​(σ)≤QB​.

The source problem is PARTITION (Problem 9.1): given integers p1,…,pkp_1,\dots,p_kp1​,…,pk​ with P=∑ipiP=\sum_ip_iP=∑i​pi​, is there a set S⊆{1,…,k}S\subseteq\{1,\dots,k\}S⊆{1,…,k} with ∑i∈Spi=∑i∉Spi=P/2\sum_{i\in S}p_i=\sum_{i\notin S}p_i=P/2∑i∈S​pi​=∑i∈/S​pi​=P/2?

The paper's reduction numbers the integers so that p1≤⋯≤pkp_1\le\dots\le p_kp1​≤⋯≤pk​ and gives both agents identical job sets, kkk jobs of lengths p1,…,pkp_1,\dots,p_kp1​,…,pk​, with thresholds QA=QB=T/2Q_A=Q_B=T/2QA​=QB​=T/2, where

T=3P+4∑i=1k(k−i)pi.T=3P+4\sum_{i=1}^k(k-i)p_i .T=3P+4i=1∑k​(k−i)pi​.

Writing J[i]J[i]J[i] for the pair JiA,JiBJ^A_i,J^B_iJiA​,JiB​, an SPT schedule processes J[1],…,J[k]J[1],\dots,J[k]J[1],…,J[k] in order, each pair in either internal order; xxx denotes the total length of the pairs in which B goes first.

Formalization targets

Goal: Theorem 9.2

PARTITION ≤p 1∥∑CiA≤QA, ∑CiB≤QB\text{PARTITION}\ \le_p\ 1\|\textstyle\sum C^A_i\le Q_A,\ \sum C^B_i\le Q_BPARTITION ≤p​ 1∥∑CiA​≤QA​, ∑CiB​≤QB​

Here ≤p\le_p≤p​ is polynomial-time many-one reducibility between languages of binary codes: a polynomial-time Turing-machine-computable map on strings that sends codes of PARTITION yes-instances, and only those, to codes of yes-instances of the recognition problem. Together with the NP-completeness of PARTITION (Karp 1972) this is the statement "1∥∑CiA:∑CiB1\|\sum C^A_i : \sum C^B_i1∥∑CiA​:∑CiB​ is binary NP-hard".

Milestones of the proof

  1. Every SPT schedule has ∑CiA+∑CiB=T\sum C^A_i+\sum C^B_i=T∑CiA​+∑CiB​=T, and QA=QB=T/2Q_A=Q_B=T/2QA​=QB​=T/2.
  2. Eqs. (5) and (6): in an SPT schedule, ∑CiA=P+2∑i(k−i)pi+x\sum C^A_i=P+2\sum_i(k-i)p_i+x∑CiA​=P+2∑i​(k−i)pi​+x and ∑CiB=P+2∑i(k−i)pi+(P−x)\sum C^B_i=P+2\sum_i(k-i)p_i+(P-x)∑CiB​=P+2∑i​(k−i)pi​+(P−x).
  3. A schedule with ∑CiA≤T/2\sum C^A_i\le T/2∑CiA​≤T/2 and ∑CiB≤T/2\sum C^B_i\le T/2∑CiB​≤T/2 processes the jobs in nondecreasing order of length.
  4. For pairwise distinct p1<⋯<pkp_1<\dots<p_kp1​<⋯<pk​: PARTITION has a solution iff some schedule meets T/2T/2T/2 for both agents.

Further result: Theorem 9.3 with recursion (7)

With each agent's jobs numbered by nondecreasing length and P(i,j)P(i,j)P(i,j) the total length of J1A,…,JiA,J1B,…,JjBJ^A_1,\dots,J^A_i,J^B_1,\dots,J^B_jJ1A​,…,JiA​,J1B​,…,JjB​, the recursion

F(i,j,q)=min⁡{F(i−1,j,q)+P(i−1,j)+piA; F(i,j−1,q−P(i,j))}F(i,j,q)=\min\bigl\{F(i-1,j,q)+P(i-1,j)+p^A_i;\ F(i,j-1,q-P(i,j))\bigr\}F(i,j,q)=min{F(i−1,j,q)+P(i−1,j)+piA​; F(i,j−1,q−P(i,j))}

with F(0,0,q)=0F(0,0,q)=0F(0,0,q)=0 for q≥0q\ge0q≥0 and F=+∞F=+\inftyF=+∞ for q<0q<0q<0 yields F(nA,nB,Q)=min⁡{∑CiA:∑CiB≤Q}F(n_A,n_B,Q)=\min\{\sum C^A_i:\sum C^B_i\le Q\}F(nA​,nB​,Q)=min{∑CiA​:∑CiB​≤Q}, and +∞+\infty+∞ when no schedule meets the bound.

Significance

Theorem 9.2 fills one cell of the paper's complexity table: even when both agents use the objective that is trivial for one agent, sharing the machine makes the constrained problem NP-hard. Together with Theorem 9.3 it places 1∥∑CiA:∑CiB1\|\sum C^A_i:\sum C^B_i1∥∑CiA​:∑CiB​ exactly: NP-hard under binary encoding, solvable in pseudopolynomial time, hence not strongly NP-hard unless P = NP. The later literature on two-agent and multi-agent scheduling (for example the monograph of Agnetis, Billaut, Gawiejnowicz, Pacciarelli and Soukhal, Multiagent Scheduling, Springer 2014) cites this classification.

Neither result has a machine-checked proof that we know of. The mission adds a formal record of the reduction and of the dynamic program, reusable definitions for the two-agent total-completion-time problem, and a correction of the printed proof: the equivalence between PARTITION and the constructed instance, as printed, holds only when the integers are pairwise distinct. For p=(1,1,1,1,10)p=(1,1,1,1,10)p=(1,1,1,1,10) PARTITION has no solution, yet a schedule meets T/2=41T/2=41T/2=41 for both agents. Theorem 9.2 itself is not affected, since PARTITION remains NP-hard, but a complete formal proof needs a reduction that is correct on every input.

Difficulty

The equivalence for distinct integers rests on two facts: the overall total ∑CiA+∑CiB\sum C^A_i+\sum C^B_i∑CiA​+∑CiB​ is at least TTT for every schedule, with equality only for sequences in nondecreasing order of length; and, with distinct lengths, such a sequence is made of consecutive pairs, whose split is controlled by xxx. The naive formal argument stops at the second fact, which is false with repeated lengths: a block of equal-length jobs can be shared between the agents in ways no sequence of pairs realises. The goal adds the encoding layer: the reduction must be computable in polynomial time on a Turing machine, must handle repeated and zero sizes and odd PPP (where T/2T/2T/2 is not an integer and the language's thresholds are), and must send strings that do not code a PARTITION instance outside the target language. For Theorem 9.3, the dynamic program is correct only because some optimal schedule orders each agent's jobs by length, and the constraint makes this exchange argument less direct than for a single agent.

Formalization scope

Jobs are Fin nA ⊕ Fin nB (Sum.inl h is Jh+1AJ^A_{h+1}Jh+1A​, Sum.inr k is Jk+1BJ^B_{k+1}Jk+1B​, 0-based). Schedules, completion times and the idle-free sequence model are the published MooreLateJobs.Shared.completionTime (Moore 1968 series): a schedule is a duplicate-free list containing every job once, and completion times are real numbers. Processing times and thresholds of the language are natural numbers. Reducibility is the published CookPvsNP.PolyReducible, and PARTITION, the alphabet and the binary codes are the published ProjSchedTW.Complexity.Encoding (partitionLang, whose sizes are natural numbers including 000). The target language allows any job counts and any processing times; identical job sets are a property of the construction only.

The following readings are explicit:

  • An SPT schedule of the construction is given by a choice x:Fin k→Boolx:\mathrm{Fin}\,k\to\mathrm{Bool}x:Fink→Bool of the first agent in each pair; "feasible implies SPT" is stated as "lengths are nondecreasing along the sequence", which is what the paper's exchange argument proves.
  • The milestones take the integers already sorted, as a hypothesis; the paper's thresholds T/2T/2T/2 are real numbers in the milestones.
  • The equivalence milestone assumes p1<⋯<pkp_1<\dots<p_kp1​<⋯<pk​; the printed version with ≤\le≤ is false, as shown above.
  • In recursion (7), the terms F(−1,j,q)F(-1,j,q)F(−1,j,q) and F(i,−1,q)F(i,-1,q)F(i,−1,q) that the paper leaves undefined are +∞+\infty+∞.
  • The running time O(nAnBQ)O(n_An_BQ)O(nA​nB​Q) of Theorem 9.3 is not formalised; only the correctness of (7) is. Membership in NP is not formalised.

The goal cannot be met by a trivial reduction: PolyReducible requires the map to be computed by a polynomial-time Turing machine and to be correct on every string, and the target language contains every two-agent instance, not only those with identical job sets. Contributions welcome: the exchange lemmas for total completion time on the shared sequence model, the SPT formulas, and Turing-machine constructions for list sorting and arithmetic on binary codes, which other reductions of this series reuse.

Selected references

  • A. Agnetis, P. B. Mirchandani, D. Pacciarelli, A. Pacifici, Scheduling Problems with Two Competing Agents, Operations Research 52(2) (2004) 229–242. https://doi.org/10.1287/opre.1030.0092
  • R. M. Karp, Reducibility among Combinatorial Problems, in Complexity of Computer Computations, Plenum (1972) 85–103. https://doi.org/10.1007/978-1-4684-2001-2_9
  • W. E. Smith, Various Optimizers for Single-Stage Production, Naval Research Logistics Quarterly 3 (1956) 59–66. https://doi.org/10.1002/nav.3800030106
  • J. M. Moore, An n Job, One Machine Sequencing Algorithm for Minimizing the Number of Late Jobs, Management Science 15(1) (1968) 102–109. https://doi.org/10.1287/mnsc.15.1.102
  • S. Cook, The P versus NP Problem, Clay Mathematics Institute Millennium Problems (2000). https://www.claymath.org/wp-content/uploads/2022/06/pvsnp.pdf
  • A. Agnetis, J.-C. Billaut, S. Gawiejnowicz, D. Pacciarelli, A. Soukhal, Multiagent Scheduling: Models and Algorithms, Springer (2014). https://doi.org/10.1007/978-3-642-41880-8
12 thms2 active usersReviewed
Complexity TheoryOperations ResearchOptimization·Captain: mikedeng1

Scheduling Problems with Two Competing Agents 2: KNAPSACK Reduces to Minimizing One Agent's Total Weighted Completion Time Under a Makespan Bound for the OtherResearch Paper

Two agents sharing one machine

In many production and logistics settings a single resource is shared by parties with different goals: two departments of a plant that send orders to the same machine, two customers of a contract manufacturer, or two classes of traffic on one processor. Multi-agent scheduling models this directly. Each agent owns its own jobs and its own objective, and a schedule is judged by the pair of objective values it gives the two agents rather than by one combined criterion.

Agnetis, Mirchandani, Pacciarelli and Pacifici (Oper. Res. 52(2), 2004, pp. 229–242) set up the systematic study of the two-agent single-machine problem. For each pair of classical objectives they ask how hard it is to optimise one agent's objective while the other agent's objective stays within a given bound. Their Table 1 lists the outcome for each pair. This mission formalises one entry, Theorem 5.2: when agent A minimises its total weighted completion time and agent B only requires its makespan to stay below a bound, the problem is NP-hard under binary encoding of the numbers. The corresponding single-agent bicriteria problem had been shown NP-hard in the strong sense by Lenstra, Rinnooy Kan and Brucker (1977); the two-agent version differs because only B's jobs are constrained.

Setting

There are two agents, A and B. Agent A owns jobs J1A,…,JnAAJ^A_1,\dots,J^A_{n_A}J1A​,…,JnA​A​; job JhAJ^A_hJhA​ has a processing time phA∈Np^A_h\in\mathbb NphA​∈N and a weight whA∈Nw^A_h\in\mathbb NwhA​∈N. Agent B owns jobs J1B,…,JnBBJ^B_1,\dots,J^B_{n_B}J1B​,…,JnB​B​ with processing times pkB∈Np^B_k\in\mathbb NpkB​∈N. All jobs are available at time 000 and are processed on one machine, one at a time, without interruption.

Because both objectives are nondecreasing in the completion times, there is no reason to leave the machine idle, so a schedule σ\sigmaσ is a sequence of all nA+nBn_A+n_BnA​+nB​ jobs processed back to back from time 000. The completion time Cj(σ)C_j(\sigma)Cj​(σ) of a job jjj is the total processing time of jjj and of all jobs sequenced before it. Agent A's cost is ∑hwhAChA(σ)\sum_{h}w^A_hC^A_h(\sigma)∑h​whA​ChA​(σ); agent B's cost is its makespan Cmax⁡B(σ)=max⁡kCkB(σ)C^B_{\max}(\sigma)=\max_kC^B_k(\sigma)CmaxB​(σ)=maxk​CkB​(σ).

The paper's recognition problem 1∥∑wiCiA≤QA, Cmax⁡B≤QB1\|\sum w_iC^A_i\le Q_A,\ C^B_{\max}\le Q_B1∥∑wi​CiA​≤QA​, CmaxB​≤QB​ asks, for given thresholds QA,QBQ_A,Q_BQA​,QB​, whether some schedule has

∑h=1nAwhAChA(σ)≤QAandCkB(σ)≤QB  for all k.\sum_{h=1}^{n_A}w^A_hC^A_h(\sigma)\le Q_A\qquad\text{and}\qquad C^B_k(\sigma)\le Q_B\ \text{ for all }k .h=1∑nA​​whA​ChA​(σ)≤QA​andCkB​(σ)≤QB​  for all k.

The source problem is KNAPSACK (Problem 5.1): given nonnegative integers u1,…,unu_1,\dots,u_nu1​,…,un​, w1,…,wnw_1,\dots,w_nw1​,…,wn​ and integers b,Wb,Wb,W, is there S⊆{1,…,n}S\subseteq\{1,\dots,n\}S⊆{1,…,n} with ∑i∈Sui≤b\sum_{i\in S}u_i\le b∑i∈S​ui​≤b and ∑i∈Swi≥W\sum_{i\in S}w_i\ge W∑i∈S​wi​≥W?

Formalization targets

Goal: Theorem 5.2

KNAPSACK ≤p 1∥∑wiCiA≤QA, Cmax⁡B≤QB\text{KNAPSACK}\ \le_p\ 1\|\textstyle\sum w_iC^A_i\le Q_A,\ C^B_{\max}\le Q_BKNAPSACK ≤p​ 1∥∑wi​CiA​≤QA​, CmaxB​≤QB​

Here ≤p\le_p≤p​ is polynomial-time many-one reducibility between languages of binary codes: a Turing-machine-computable, polynomial-time map on strings sending codes of KNAPSACK yes-instances, and only those, to codes of yes-instances of the recognition problem. Together with the NP-completeness of KNAPSACK (Garey and Johnson 1979) this is the statement "1∥∑wiCiA:Cmax⁡B1\|\sum w_iC^A_i : C^B_{\max}1∥∑wi​CiA​:CmaxB​ is binary NP-hard".

Milestones

The paper's reduction builds, from a KNAPSACK instance, the two-agent instance with piA=uip^A_i=u_ipiA​=ui​, wiA=wiw^A_i=w_iwiA​=wi​, a single B-job of length p1B=w^u^p^B_1=\hat w\hat up1B​=w^u^ (where u^=∑iui\hat u=\sum_iu_iu^=∑i​ui​, w^=∑iwi\hat w=\sum_iw_iw^=∑i​wi​), and thresholds QB=b+p1BQ_B=b+p^B_1QB​=b+p1B​, QA=w^u^+(w^−W)p1BQ_A=\hat w\hat u+(\hat w-W)p^B_1QA​=w^u^+(w^−W)p1B​. The milestones are the two directions of the proof and their combination:

  1. Eq. (1): if SSS solves KNAPSACK, every sequence with exactly the A-jobs of SSS before the B-job meets both thresholds.
  2. Eq. (2): if ∑iwiui>0\sum_iw_iu_i>0∑i​wi​ui​>0 and a sequence meets both thresholds, the A-jobs before the B-job solve KNAPSACK.
  3. Equivalence: under ∑iwiui>0\sum_iw_iu_i>0∑i​wi​ui​>0, KNAPSACK is a yes-instance iff the constructed instance is.
  4. §8: with every B-job given due date QQQ and Q′=0Q'=0Q′=0, a sequence meets ∑UiB≤Q′\sum U^B_i\le Q'∑UiB​≤Q′ (and A's bound) iff it meets Cmax⁡B≤QC^B_{\max}\le QCmaxB​≤Q, which carries the hardness over to 1∥∑wiCiA:∑UiB1\|\sum w_iC^A_i:\sum U^B_i1∥∑wi​CiA​:∑UiB​.

Significance

Theorem 5.2 fixes the complexity of one cell of the two-agent classification. It shows that the polynomial algorithm for the unweighted case 1∥∑CiA:fmax⁡B1\|\sum C^A_i:f^B_{\max}1∥∑CiA​:fmaxB​ (Theorem 5.5 of the same paper) cannot be extended to arbitrary weights unless P = NP. Through §8 it also settles 1∥∑wiCiA:∑UiB1\|\sum w_iC^A_i:\sum U^B_i1∥∑wi​CiA​:∑UiB​. The hardness is binary, not strong: the reduction produces numbers of size about w^u^\hat w\hat uw^u^, so pseudo-polynomial algorithms are not ruled out, which is consistent with the dynamic programs studied in later two-agent literature.

The result is proved in the paper; no machine-checked proof is known to exist. Formalizing it produces a complete reduction from a two-constraint knapsack problem to a scheduling recognition problem, with the encoding, the degenerate instances and the polynomial running time all made explicit. The model and the KNAPSACK language are reusable by other two-agent reductions (Theorems 9.2, 10.1 and 10.2 of the paper reduce from PARTITION in the same frame).

Difficulty

The two directions of the equivalence are short computations with completion times. The printed argument, however, is not correct as written in two places. The bounds "smaller than w^u^\hat w\hat uw^u^" and "smaller than (w^−W)p1B(\hat w-W)p^B_1(w^−W)p1B​" in the derivation of (1) hold only with equality allowed. The strict inequalities in (2) fail when ∑iwiui=0\sum_iw_iu_i=0∑i​wi​ui​=0, and then the reduction itself fails: with all ui=0u_i=0ui​=0 and W>w^W>\hat wW>w^ the KNAPSACK instance is a no-instance while the constructed instance has QA=QB=0Q_A=Q_B=0QA​=QB​=0 and every schedule meets both thresholds. A complete reduction must recognise such instances and treat them separately.

The construction also produces integer thresholds that can be negative (b<−p1Bb<-p^B_1b<−p1B​, or W>w^+1W>\hat w+1W>w^+1), while instances of the target are coded with natural numbers. Finally, the reduction must be a polynomial-time Turing machine computation over binary codes, including the decoding of arbitrary strings and the binary multiplication w^u^\hat w\hat uw^u^; that is where most of the formal work lies.

Formalization scope

  • Model. Jobs are Fin nA ⊕ Fin nB (0-based: Sum.inl h is Jh+1AJ^A_{h+1}Jh+1A​, Sum.inr k is Jk+1BJ^B_{k+1}Jk+1B​). Schedules and completion times are the published MooreLateJobs.Shared sequence model (IsSchedule, completionTime) of the Moore (1968) series: a duplicate-free list of all jobs, processed without idle time from time 000. Integer processing times are cast to R\mathbb RR.
  • Makespan bound. Cmax⁡B≤QBC^B_{\max}\le Q_BCmaxB​≤QB​ is written as CkB≤QBC^B_k\le Q_BCkB​≤QB​ for every B-job; no nonemptiness of B's job set is assumed.
  • Languages. Polynomial-time reducibility is the published CookPvsNP.PolyReducible (Cook's Definition 3, one-tape Turing machines). Codes use the published binary encoding ProjSchedTW.Complexity.Encoding (alphabet BSym, encNat, encInt) of the Neumann–Schwindt–Zimmermann series. A KNAPSACK instance is coded as the integers n,u1,…,un,w1,…,wn,b,Wn,u_1,\dots,u_n,w_1,\dots,w_n,b,Wn,u1​,…,un​,w1​,…,wn​,b,W; a target instance as the natural numbers nA,nBn_A,n_BnA​,nB​, the processing times and weights, and QA,QBQ_A,Q_BQA​,QB​. The target language allows any nA,nB≥0n_A,n_B\ge0nA​,nB​≥0; the reduction uses nB=1n_B=1nB​=1.
  • Readings of the paper. "Binary NP-hard" is formalised as the reduction from KNAPSACK, without the NP-completeness of KNAPSACK and without membership in NP. The milestone Eq. (2) and the equivalence carry the added hypothesis ∑iwiui>0\sum_iw_iu_i>0∑i​wi​ui​>0; the inequalities "smaller than" in (1) are read as ≤\le≤. Eq. (1) is stated for every order of the jobs inside SSS and inside its complement. The §8 result is stated as the encoding-free equivalence of feasible solutions, not as a reduction between languages.
  • Ruled out. The goal cannot be met by a reduction that ignores the input: the equivalence must hold for every string, and the target language is exactly the codes of yes-instances of the two-agent recognition problem with B's objective the makespan. KNAPSACK here is the two-constraint problem of Problem 5.1, not subset sum.

Contributions welcome: proofs of the two directions, of the equivalence, the treatment of the degenerate instances, and the Turing machine for the reduction, which would also serve the other binary-coded reductions on the platform.

Selected references

  • A. Agnetis, P. B. Mirchandani, D. Pacciarelli, A. Pacifici, Scheduling Problems with Two Competing Agents, Operations Research 52(2) (2004) 229–242. https://doi.org/10.1287/opre.1030.0092
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979.
  • J. K. Lenstra, A. H. G. Rinnooy Kan, P. Brucker, Complexity of Machine Scheduling Problems, Annals of Discrete Mathematics 1 (1977) 343–362. https://doi.org/10.1016/S0167-5060(08)70743-X
  • S. Cook, The P versus NP Problem, Clay Mathematics Institute Millennium Problem description. https://www.claymath.org/wp-content/uploads/2022/06/pvsnp.pdf
  • J. M. Moore, An n Job, One Machine Sequencing Algorithm for Minimizing the Number of Late Jobs, Management Science 15(1) (1968) 102–109. https://doi.org/10.1287/mnsc.15.1.102
11 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: mikedeng1

A c^k n 5-Approximation Algorithm for Treewidth 3: A Rooted Tree with a Measure μ ≥ 1, Superadditive over Children and Shrinking by C < 1 Along Each Edge, Has at Most (1+1/(1−C))μ(r)−1 NodesResearch Paper

Motivation

Treewidth measures how closely a graph resembles a tree. Bodlaender, Drange, Dregi, Fomin, Lokshtanov and Pilipczuk (SIAM J. Comput. 45(2), 2016) study an algorithm for producing tree decompositions. Its headline result is algorithmic; this mission formalizes one combinatorial lemma used in its analysis.

In §4.3.2, p. 349, the authors isolate a purely combinatorial fact, Lemma 4.3, which bounds the number of nodes of a rooted tree in terms of a measure placed on its nodes. They use it for the partial tree decomposition built by FindPartialTD, with a measure of the form μ(i)=wi/log⁡n\mu(i) = w_i/\log nμ(i)=wi​/logn. This mission formalizes Lemma 4.3 and the steps of its proof. The lemma is self-contained and does not mention graphs or treewidth.

Setting

A rooted tree TTT consists of a finite vertex set V(T)V(T)V(T), a root r∈V(T)r \in V(T)r∈V(T), and a parent map ppp defined on V(T)∖{r}V(T) \setminus \{r\}V(T)∖{r} such that every vertex reaches rrr by iterating ppp. If p(c)=vp(c) = vp(c)=v, then ccc is a child of vvv and vvv is the parent of ccc. A vertex without children is a leaf. The descendants of vvv are the vertices uuu with pi(u)=vp^i(u) = vpi(u)=v for some i≥0i \ge 0i≥0 (including vvv itself), and the subtree TvT_vTv​ rooted at vvv is the tree they span; ∣V(Tv)∣|V(T_v)|∣V(Tv​)∣ is its number of vertices, and Tr=TT_r = TTr​=T.

A measure is any function μ:V(T)→R\mu : V(T) \to \mathbb Rμ:V(T)→R. Lemma 4.3 considers measures with three properties, for a constant CCC:

  1. μ(v)≥1\mu(v) \ge 1μ(v)≥1 for every v∈V(T)v \in V(T)v∈V(T);
  2. for every vertex vvv with children v1,…,vpv_1,\dots,v_pv1​,…,vp​ (where p≥0p \ge 0p≥0), ∑i=1pμ(vi)≤μ(v)\sum_{i=1}^{p} \mu(v_i) \le \mu(v)∑i=1p​μ(vi​)≤μ(v);
  3. 0<C<10 < C < 10<C<1, and μ(v′)≤C μ(v)\mu(v') \le C\,\mu(v)μ(v′)≤Cμ(v) whenever vvv is the parent of v′v'v′.

Throughout, K=1+11−CK = 1 + \frac{1}{1-C}K=1+1−C1​.

Formalization targets

Goal: Lemma 4.3 (p. 349)

Under properties (i)–(iii),

∣V(T)∣  ≤  (1+11−C)μ(r)−1.|V(T)| \;\le\; \Bigl(1 + \frac{1}{1-C}\Bigr)\mu(r) - 1 .∣V(T)∣≤(1+1−C1​)μ(r)−1.

Milestones (the proof on pp. 349–350)

Each step is stated for an arbitrary vertex vvv of TTT, with the subtree TvT_vTv​ in the role of the paper's tree.

  • Base case (p. 349). If vvv is a leaf, then ∣V(Tv)∣=1≤Kμ(v)−1|V(T_v)| = 1 \le K\mu(v) - 1∣V(Tv​)∣=1≤Kμ(v)−1.
  • Summed bound (p. 350). If vvv has children v1,…,vpv_1,\dots,v_pv1​,…,vp​ and ∣V(Tvi)∣≤Kμ(vi)−1|V(T_{v_i})| \le K\mu(v_i) - 1∣V(Tvi​​)∣≤Kμ(vi​)−1 for each iii, then
∣V(Tv)∣≤1−p+K∑i=1pμ(vi).|V(T_v)| \le 1 - p + K\sum_{i=1}^{p}\mu(v_i).∣V(Tv​)∣≤1−p+Ki=1∑p​μ(vi​).
  • Case p≥2p \ge 2p≥2 (p. 350). With the same hypothesis on the children and at least two children, ∣V(Tv)∣≤Kμ(v)−1|V(T_v)| \le K\mu(v) - 1∣V(Tv​)∣≤Kμ(v)−1.
  • Case p=1p = 1p=1 (p. 350). With the same hypothesis and exactly one child, ∣V(Tv)∣≤Kμ(v)−1|V(T_v)| \le K\mu(v) - 1∣V(Tv​)∣≤Kμ(v)−1.
  • Subtree form (p. 350). Under (i)–(iii), ∣V(Tv)∣≤Kμ(v)−1|V(T_v)| \le K\mu(v) - 1∣V(Tv​)∣≤Kμ(v)−1 for every vertex vvv; this is the statement the induction proves, and at v=rv = rv=r it is the goal.

Significance

The result. Lemma 4.3 converts two local conditions, superadditivity of the measure over the children of each node and geometric decay by a factor CCC along each parent–child edge, into a global linear bound on the size of the tree. Superadditivity alone does not bound the size: a long path with constant measure satisfies (i) and (ii). Decay alone does not either: a star with many leaves satisfies (iii). The counting principle can also be used when a recursive construction splits a resource among child nodes while reducing that resource along every edge.

Formalizing it. The lemma is proved in the paper. The mission produces formal statements of the lemma and the main bounds in its proof, over a published, reusable encoding of finite rooted trees by parent maps. A complete development would also establish structural facts about descendants and children that can be reused for other results about finite rooted trees.

Difficulty

The summed bound for the children's subtrees contains the term 1−p1-p1−p. When p=1p=1p=1, superadditivity alone does not give the target's final −1-1−1: a path with constant measure is a counterexample if geometric decay is omitted. Formalization also has to account for the fact that the reusable tree representation is a parent map on a finite type, rather than an inductively constructed tree.

Formalization scope

The rooted tree is the published definition HarelTarjan.Compressed.RootedTree: a finite vertex type V with a root and a total parent map in which every vertex reaches the root, with the convention p(r)=rp(r) = rp(r)=r. ∣V(T)∣|V(T)|∣V(T)∣ is Fintype.card V, and ∣V(Tv)∣|V(T_v)|∣V(Tv​)∣ is the published subtree size size T v (the number of descendants of vvv, including vvv). The local definition file adds IsChild T v c (c≠rc \ne rc=r and p(c)=vp(c) = vp(c)=v) and children T v; the condition c≠rc \ne rc=r removes the pseudo-edge r→rr \to rr→r, so the root is never its own child.

Conventions: μ\muμ is real valued, as on the page; property (ii) is a sum over a possibly empty set of children; the constant CCC of property (iii) is a parameter with the two hypotheses 0<C0 < C0<C and C<1C < 1C<1, because the conclusion is stated with that same CCC. The fraction 11−C\frac{1}{1-C}1−C1​ is real division, and the hypothesis C<1C < 1C<1 keeps it away from Lean's convention 1/0=01/0 = 01/0=0. The bound keeps the page's "−1-1−1".

A trivializing formalization is ruled out explicitly: the parent–child relation is directed by the root, so property (iii) constrains each edge in one direction only. A symmetric reading ("μ(c)≤Cμ(v)\mu(c) \le C\mu(v)μ(c)≤Cμ(v) for all adjacent v,cv, cv,c") would be unsatisfiable for C<1C < 1C<1 and make every statement vacuous; the hypotheses here are satisfied, for example, by the two-vertex tree with μ=(2,1)\mu = (2, 1)μ=(2,1) and C=1/2C = 1/2C=1/2.

A complete development needs the decomposition of size T v as 1+∑c∈ch(v)size T c1 + \sum_{c \in \mathrm{ch}(v)} \mathrm{size}\,T\,c1+∑c∈ch(v)​sizeTc and an induction principle for parent-map trees. Both are reusable for statements about rooted trees given by parent maps, and contributions of them as separate lemmas are welcome. The paper's subsequent application is outside this mission's scope.

Selected references

  • H. L. Bodlaender, P. G. Drange, M. S. Dregi, F. V. Fomin, D. Lokshtanov, M. Pilipczuk, A cknc^k nckn 5-approximation algorithm for treewidth, SIAM Journal on Computing 45(2):317–378, 2016. https://doi.org/10.1137/130947374 (Lemma 4.3 and its proof: pp. 349–350.)
  • D. Harel, R. E. Tarjan, Fast algorithms for finding nearest common ancestors, SIAM Journal on Computing 13(2):338–355, 1984. https://doi.org/10.1137/0213024 (source of the rooted-tree encoding reused here.)
  • N. Robertson, P. D. Seymour, Graph minors. II. Algorithmic aspects of tree-width, Journal of Algorithms 7(3):309–322, 1986. https://doi.org/10.1016/0196-6774(86)90023-4
8 thms2 active usersReviewed
Complexity TheoryGraph TheoryLinear algebra·Captain: mikedeng1

Most Tensor Problems Are NP-Hard 2: Graph 3-Colorability Reduces to Tensor Bilinear Feasibility over the Reals and over the Complex NumbersResearch Paper

Motivation

A matrix A∈Cn×nA \in \mathbb C^{n\times n}A∈Cn×n is singular exactly when the pair of linear systems x⊤A=0\mathbf x^\top A = 0x⊤A=0, Ay=0A\mathbf y = 0Ay=0 has a solution with both x\mathbf xx and y\mathbf yy nonzero, and this is decided in polynomial time by Gaussian elimination. The natural analogue for a 3-tensor replaces the two linear systems by three families of bilinear equations, one for each way of contracting the tensor against two vectors. For tensors whose dimensions satisfy the Gelfand–Kapranov–Zelevinsky condition, solvability of that system is equivalent to the vanishing of the hyperdeterminant, and for any tensor it is equivalent to 000 being a singular value in the sense of Lim (2005). The same system appears in multiview geometry (Cohen and Tomasi 1997).

C. J. Hillar and L.-H. Lim, Most Tensor Problems Are NP-Hard (J. ACM 60(6), 2013; arXiv:0911.1393), show that, unlike the matrix case, this feasibility question is NP-hard over R\mathbb RR and over C\mathbb CC (their Theorem 3.7). The proof is a reduction from graph 3-colorability through the polynomial color encoding of a graph, an idea the authors trace to Bayer's thesis (1982) and to Lovász (1994) and De Loera (1995). This mission formalizes that reduction and its consequence for tensor singular values (Theorem 6.2).

Setting

A 3-tensor over a field FFF is an array A=[ ⁣[aijk] ⁣]∈Fl×m×n\mathcal A = [\![a_{ijk}]\!] \in F^{l\times m\times n}A=[[aijk​]]∈Fl×m×n. Its slices are the matrices Ai(j,k)=Bj(i,k)=Ck(i,j)=aijkA_i(j,k) = B_j(i,k) = C_k(i,j) = a_{ijk}Ai​(j,k)=Bj​(i,k)=Ck​(i,j)=aijk​, all read off the same array.

Tensor bilinear feasibility (Problem 3.1) asks, for a rational tensor A∈Ql×m×n\mathcal A \in \mathbb Q^{l\times m\times n}A∈Ql×m×n and F=RF = \mathbb RF=R or C\mathbb CC, whether the system (9)

v⊤Aiw=0 (i≤l),u⊤Bjw=0 (j≤m),u⊤Ckv=0 (k≤n)\mathbf v^\top A_i\mathbf w = 0\ (i \le l),\qquad \mathbf u^\top B_j \mathbf w = 0\ (j \le m),\qquad \mathbf u^\top C_k \mathbf v = 0\ (k \le n)v⊤Ai​w=0 (i≤l),u⊤Bj​w=0 (j≤m),u⊤Ck​v=0 (k≤n)

has a solution u∈Fl\mathbf u \in F^lu∈Fl, v∈Fm\mathbf v\in F^mv∈Fm, w∈Fn\mathbf w \in F^nw∈Fn with each of the three vectors nonzero. In Lean this is TBF A.

The color encoding CGC_GCG​ of a graph G=(V,E)G = (V,E)G=(V,E) on vvv vertices (Definition 2.9) is the set of 4v4v4v quadratics in x1,…,xv,y1,…,yv,zx_1,\dots,x_v,y_1,\dots,y_v,zx1​,…,xv​,y1​,…,yv​,z:

xiyi−z2,yiz−xi2,xiz−yi2,∑j:{i,j}∈E(xi2+xixj+xj2),i=1,…,v.x_iy_i - z^2,\quad y_iz - x_i^2,\quad x_iz - y_i^2,\quad \sum_{j:\{i,j\}\in E}(x_i^2 + x_ix_j + x_j^2),\qquad i = 1,\dots,v .xi​yi​−z2,yi​z−xi2​,xi​z−yi2​,j:{i,j}∈E∑​(xi2​+xi​xj​+xj2​),i=1,…,v.

The tensor AG∈Zl×m×n\mathcal A_G \in \mathbb Z^{l\times m\times n}AG​∈Zl×m×n of the proof of Theorem 3.7 has m=n=2v+1m = n = 2v+1m=n=2v+1 and l=v(2v+5)l = v(2v+5)l=v(2v+5) slices: v(2v+1)v(2v+1)v(2v+1) slices whose bilinear forms are the 2×22\times 22×2 minors of the matrix [v w][\mathbf v\ \mathbf w][v w], then 3v+v3v + v3v+v slices whose bilinear forms restrict, on w=v\mathbf w = \mathbf vw=v, to the polynomials of CGC_GCG​ (Lean: AG G).

The tensor B\mathcal BB of Lemma 3.6 doubles a real tensor A\mathcal AA into R2l×2m×2n\mathbb R^{2l\times 2m\times 2n}R2l×2m×2n through the slices Bi=[Ai00−Ai]B_i = \left[\begin{smallmatrix} A_i & 0 \\ 0 & -A_i\end{smallmatrix}\right]Bi​=[Ai​0​0−Ai​​], Bl+i=[0AiAi0]B_{l+i} = \left[\begin{smallmatrix} 0 & A_i \\ A_i & 0\end{smallmatrix}\right]Bl+i​=[0Ai​​Ai​0​] (Lean: doubling A).

An ℓ2\ell^2ℓ2-singular value σ\sigmaσ of A\mathcal AA (Definition 6.1) admits nonzero u,v,w\mathbf u,\mathbf v,\mathbf wu,v,w with ∑j,kaijkvjwk=σui\sum_{j,k}a_{ijk}v_jw_k = \sigma u_i∑j,k​aijk​vj​wk​=σui​ and the two analogous equations; an ℓ3\ell^3ℓ3-singular value has σui2\sigma u_i^2σui2​, σvj2\sigma v_j^2σvj2​, σwk2\sigma w_k^2σwk2​ on the right. At σ=0\sigma = 0σ=0 both reduce to (9).

Formalization targets

Goal: Theorem 3.7

3-COLORABILITY≤pTBFRand3-COLORABILITY≤pTBFC,\textsf{3-COLORABILITY} \le_p \textsf{TBF}_{\mathbb R} \quad\text{and}\quad \textsf{3-COLORABILITY} \le_p \textsf{TBF}_{\mathbb C},3-COLORABILITY≤p​TBFR​and3-COLORABILITY≤p​TBFC​,

polynomial-time many-one reductions between languages of binary codes. NP-hardness of tensor bilinear feasibility then follows from the NP-completeness of 3-colorability (Karp 1972), which is cited and not part of the statement.

Milestones, in the order the proof uses them

  1. Lemma 2.10. CGC_GCG​ has a nonzero complex zero iff GGG is 3-colorable.
  2. The minors (proof of Theorem 3.7). For nonzero v,w∈CN\mathbf v, \mathbf w \in \mathbb C^Nv,w∈CN, all 2×22\times22×2 minors of [v w][\mathbf v\ \mathbf w][v w] vanish iff v=cw\mathbf v = c\mathbf wv=cw for some c∈Cc \in \mathbb Cc∈C.
  3. Correctness over C\mathbb CC (proof of Theorem 3.7). For v≥1v \ge 1v≥1, TBFC(AG)  ⟺  G\mathrm{TBF}_{\mathbb C}(\mathcal A_G) \iff GTBFC​(AG​)⟺G is 3-colorable.
  4. Lemma 3.6. TBFR(B)  ⟺  TBFC(A)\mathrm{TBF}_{\mathbb R}(\mathcal B) \iff \mathrm{TBF}_{\mathbb C}(\mathcal A)TBFR​(B)⟺TBFC​(A) for real A\mathcal AA.
  5. Theorem 6.2 (further result). 3-colorability reduces to deciding whether 000 is an ℓ2\ell^2ℓ2-singular value, and whether it is an ℓ3\ell^3ℓ3-singular value, over R\mathbb RR and over C\mathbb CC.

Significance

Theorem 3.7 is the hub of the paper's bilinear results: Section 6 derives from it the NP-hardness of deciding whether 000 is a tensor singular value (Theorem 6.2), and the triple bilinear problem (Theorem 3.8) is handled by the same techniques. It separates tensors from matrices in a precise sense: the matrix analogue of (9) is decided by a determinant, while the tensor version encodes a classical NP-complete problem. It does not settle the hardness of the hyperdeterminant, since the dimensions l=v(2v+5)l = v(2v+5)l=v(2v+5), m=n=2v+1m = n = 2v+1m=n=2v+1 of AG\mathcal A_GAG​ violate the GKZ condition; the paper leaves that as a conjecture.

The result is proved in the paper; none of it is formalized on Prove2Me or, to our knowledge, elsewhere. A complete development produces a machine-checked polynomial-time reduction in Cook's Turing-machine model between two concrete algebraic problems, the color-encoding lemma for 3-colorability (reusable by any reduction that goes through polynomial systems, including Theorems 1.3 and 2.6 of the same paper), and the realification of bilinear systems.

Difficulty

The algebra of the reduction is short; two places need care. First, the bilinear system does not see CGC_GCG​ directly: (9) involves two independent vectors v,w\mathbf v, \mathbf wv,w, and the reduction recovers the quadratic system only because the minors force v=cw\mathbf v = c\mathbf wv=cw, which requires both vectors to be nonzero. Second, the converse direction must produce a nonzero u\mathbf uu satisfying the second and third families, a homogeneous linear system of 4v+24v+24v+2 equations in l=v(2v+5)l = v(2v+5)l=v(2v+5) unknowns; this works only when l>4v+2l > 4v+2l>4v+2, which fails for the empty graph, so the reduction has to treat v=0v = 0v=0 separately.

The goal also asks for polynomial-time computability in a Turing-machine model: decoding a graph code, rejecting malformed words, and writing the binary code of AG\mathcal A_GAG​ (or of its doubling over R\mathbb RR). This bookkeeping, not the algebra, is the bulk of a complete proof.

Formalization scope

  • Tensors are functions I → J → K → F over finite index types, 0-based: the paper's aijka_{ijk}aijk​ is A (i-1) (j-1) (k-1). Problem 3.1 requires u\mathbf uu, v\mathbf vv, w\mathbf ww each nonzero, not merely (u,v,w)≠0(\mathbf u, \mathbf v, \mathbf w) \neq 0(u,v,w)=0, and the three equation families come from one tensor.
  • The doubled tensor of Lemma 3.6 is indexed by I ⊕ I, J ⊕ J, K ⊕ K, with Sum.inr i standing for the paper's index l+il+il+i. Lemma 3.6 is stated for this explicit B\mathcal BB; a bare existential would be witnessed by any tensor with the right truth value. Only the equivalence of existence is stated, not the paper's "one-to-one" correspondence (which pairs u′=(p,q)\mathbf u' = (\mathbf p,\mathbf q)u′=(p,q) with the conjugate-type vector p−iq\mathbf p - i\mathbf qp−iq).
  • The paper does not print the matrices of the last 4v4v4v slices of AG\mathcal A_GAG​. The mission fixes the bilinearizations xiy^i−zz^x_i\hat y_i - z\hat zxi​y^​i​−zz^, yiz^−xix^iy_i\hat z - x_i\hat x_iyi​z^−xi​x^i​, xiz^−yiy^ix_i\hat z - y_i\hat y_ixi​z^−yi​y^​i​ and ∑j∼i(xix^i+xix^j+xjx^j)\sum_{j\sim i}(x_i\hat x_i + x_i\hat x_j + x_j\hat x_j)∑j∼i​(xi​x^i​+xi​x^j​+xj​x^j​); each restricts to the printed polynomial on w=v\mathbf w = \mathbf vw=v.
  • "Nontrivial zero" in the minors claim is read as both v\mathbf vv and w\mathbf ww nonzero; the correctness milestone over C\mathbb CC assumes v≥1v \geq 1v≥1, since for v=0v = 0v=0 the printed tensor has no slices and its system (9) is infeasible.
  • "Polynomially reducible" is formalized as Cook–Karp many-one reducibility (CookPvsNP.PolyReducible), which the paper's proof constructs and which implies the paper's oracle notion of §1.4. "NP-hard" in Theorem 6.2 is rendered the same way, and "(ℓ2\ell^2ℓ2 or ℓ3\ell^3ℓ3)" as the claim for each notion. Rational inputs are coded as numerator and denominator in binary; tensors as l,m,nl, m, nl,m,n and then their entries in lexicographic order.
  • The singular-value equations (20)–(21) are taken literally over C\mathbb CC, without conjugates and without normalization; only σ=0\sigma = 0σ=0 is used, where they are scale-free.
  • NP-completeness of 3-colorability is cited, not formalized; no statement mentions P, NP-membership, or hyperdeterminants.
  • A trivializing formalization is ruled out: the goal is the polynomial-time reduction, not the bare equivalence of yes-instances, and the reduction must handle every input word.

The mission reuses the published definitions CookPvsNP_defs (Turing machines, polynomial-time computability, many-one reducibility) and ProjSchedTW.Complexity.Encoding (the binary alphabet and number codes), and Mathlib's SimpleGraph.Colorable. Contributions welcome: the algebraic milestones (Lemma 2.10, the minors, Lemma 3.6) are independent and self-contained; a library of polynomial-time computable list and arithmetic operations on BSym codes would serve both this goal and Theorem 6.2.

Selected references

  • C. J. Hillar, L.-H. Lim, Most Tensor Problems Are NP-Hard, J. ACM 60(6), Art. 45, 2013. https://doi.org/10.1145/2512329 (arXiv:0911.1393v5, https://arxiv.org/abs/0911.1393)
  • R. M. Karp, Reducibility among combinatorial problems, in Complexity of Computer Computations, Plenum, 1972. https://doi.org/10.1007/978-1-4684-2001-2_9
  • L.-H. Lim, Singular values and eigenvalues of tensors: a variational approach, Proc. IEEE CAMSAP, 2005. https://arxiv.org/abs/math/0607648
  • I. M. Gelfand, M. M. Kapranov, A. V. Zelevinsky, Discriminants, Resultants, and Multidimensional Determinants, Birkhäuser, 1994. https://doi.org/10.1007/978-0-8176-4771-1
  • S. A. Cook, The P versus NP problem, Clay Mathematics Institute problem description, 2000. https://www.claymath.org/wp-content/uploads/2022/06/pvsnp.pdf
14 thms2 active usersReviewed
🏆Completed
AlgebraComplexity TheoryLinear algebra·Captain: mikedeng1

Most Tensor Problems Are NP-Hard 4: A Rational 2×2×2 Tensor Has Smaller Rank over the Reals Than over the RationalsResearch Paper

Motivation

The rank of a matrix does not depend on the field in which its entries are read: a rational matrix has the same rank over Q\mathbb QQ, R\mathbb RR and C\mathbb CC, because rank is computed by Gaussian elimination, which never leaves the field of the entries. For 3-tensors, arrays A=[ ⁣[aijk] ⁣]\mathcal A = [\![a_{ijk}]\!]A=[[aijk​]] with three indices, this fails. Tensor rank governs the complexity of bilinear maps (the exponent of matrix multiplication is a statement about the rank of one tensor), the uniqueness of the CANDECOMP/PARAFAC decompositions used in psychometrics and signal processing, and the identifiability of latent-variable models. In each application the field matters: algorithms are run over R\mathbb RR or C\mathbb CC, while complexity results are often proved over Q\mathbb QQ or finite fields.

Håstad (1990) proved that deciding rank⁡(A)≤r\operatorname{rank}(\mathcal A) \le rrank(A)≤r is NP-complete over finite fields and NP-hard over Q\mathbb QQ. De Silva and Lim (2008) gave real tensors whose rank over C\mathbb CC is strictly smaller than their rank over R\mathbb RR. Hillar and Lim (2013, Theorem 1.14) showed that the same phenomenon already occurs between Q\mathbb QQ and R\mathbb RR, for a 2×2×22\times2\times22×2×2 tensor with integer entries, so that Håstad's result over Q\mathbb QQ does not by itself say anything about rank over R\mathbb RR.

Setting

Let EEE be a field. The outer product of x∈El\mathbf x \in E^lx∈El, y∈Em\mathbf y \in E^my∈Em, z∈En\mathbf z \in E^nz∈En is the tensor x⊗y⊗z∈El×m×n\mathbf x\otimes\mathbf y\otimes\mathbf z \in E^{l\times m\times n}x⊗y⊗z∈El×m×n with entries xiyjzkx_iy_jz_kxi​yj​zk​. The rank of A\mathcal AA over EEE is

rank⁡E(A)=min⁡{r:A=∑s=1rλs xs⊗ys⊗zs,  λs∈E, xs∈El, ys∈Em, zs∈En}.\operatorname{rank}_E(\mathcal A) = \min\Big\{ r : \mathcal A = \sum_{s=1}^{r} \lambda_s\,\mathbf x_s\otimes\mathbf y_s\otimes\mathbf z_s,\ \ \lambda_s\in E,\ \mathbf x_s\in E^l,\ \mathbf y_s\in E^m,\ \mathbf z_s\in E^n\Big\}.rankE​(A)=min{r:A=s=1∑r​λs​xs​⊗ys​⊗zs​,  λs​∈E, xs​∈El, ys​∈Em, zs​∈En}.

If A\mathcal AA has entries in a subfield F⊆EF \subseteq EF⊆E, both rank⁡F(A)\operatorname{rank}_F(\mathcal A)rankF​(A) and rank⁡E(A)\operatorname{rank}_E(\mathcal A)rankE​(A) are defined, and rank⁡E(A)≤rank⁡F(A)\operatorname{rank}_E(\mathcal A) \le \operatorname{rank}_F(\mathcal A)rankE​(A)≤rankF​(A).

The paper's example uses x=[1,0]⊤\mathbf x = [1,0]^\topx=[1,0]⊤, y=[0,1]⊤\mathbf y = [0,1]^\topy=[0,1]⊤ and

A=2 x⊗x⊗x−4 y⊗y⊗x+4 y⊗x⊗y−4 x⊗y⊗y∈Q2×2×2.\mathcal A = 2\,\mathbf x\otimes\mathbf x\otimes\mathbf x - 4\,\mathbf y\otimes\mathbf y\otimes\mathbf x + 4\,\mathbf y\otimes\mathbf x\otimes\mathbf y - 4\,\mathbf x\otimes\mathbf y\otimes\mathbf y \in \mathbb Q^{2\times2\times2}.A=2x⊗x⊗x−4y⊗y⊗x+4y⊗x⊗y−4x⊗y⊗y∈Q2×2×2.

A decomposition A=u1⊗u2⊗u3+v1⊗v2⊗v3\mathcal A = \mathbf u_1\otimes\mathbf u_2\otimes\mathbf u_3 + \mathbf v_1\otimes\mathbf v_2\otimes\mathbf v_3A=u1​⊗u2​⊗u3​+v1​⊗v2​⊗v3​ with ui=[ai,bi]⊤\mathbf u_i = [a_i,b_i]^\topui​=[ai​,bi​]⊤, vi=[ci,di]⊤\mathbf v_i = [c_i,d_i]^\topvi​=[ci​,di​]⊤ is equivalent to the eight cubic equations (30) in the twelve unknowns a1,…,d3a_1,\dots,d_3a1​,…,d3​, one for each entry of A\mathcal AA.

In Lean, outer x y z and rankOver E A implement the two definitions, tensorA is A\mathcal AA, and System30 is (30).

Formalization targets

Goal: Theorem 1.14

∃ A∈Q2×2×2:rank⁡R(A)<rank⁡Q(A).\exists\, \mathcal A \in \mathbb Q^{2\times2\times2}:\quad \operatorname{rank}_{\mathbb R}(\mathcal A) < \operatorname{rank}_{\mathbb Q}(\mathcal A).∃A∈Q2×2×2:rankR​(A)<rankQ​(A).

Milestones (proof of Theorem 1.14, p. 0:26)

  1. With z=x+2 y\mathbf z = \mathbf x + \sqrt2\,\mathbf yz=x+2​y and zˉ=x−2 y\bar{\mathbf z} = \mathbf x - \sqrt2\,\mathbf yzˉ=x−2​y:
zˉ⊗z⊗zˉ+z⊗zˉ⊗z=A,so rank⁡R(A)≤2.\bar{\mathbf z}\otimes\mathbf z\otimes\bar{\mathbf z} + \mathbf z\otimes\bar{\mathbf z}\otimes\mathbf z = \mathcal A,\qquad\text{so } \operatorname{rank}_{\mathbb R}(\mathcal A)\le 2.zˉ⊗z⊗zˉ+z⊗zˉ⊗z=A,so rankR​(A)≤2.
  1. A tensor of rank at most 2 over a field is a sum of two outer products, and for A\mathcal AA the identity (29) A=u1⊗u2⊗u3+v1⊗v2⊗v3\mathcal A = \mathbf u_1\otimes\mathbf u_2\otimes\mathbf u_3 + \mathbf v_1\otimes\mathbf v_2\otimes\mathbf v_3A=u1​⊗u2​⊗u3​+v1​⊗v2​⊗v3​ holds exactly when the coordinates of ui,vi\mathbf u_i, \mathbf v_iui​,vi​ satisfy (30).
  2. Every solution of (30) in a field of characteristic zero satisfies 2c22−d22=02c_2^2 - d_2^2 = 02c22​−d22​=0 and c1d2d3+2=0c_1d_2d_3 + 2 = 0c1​d2​d3​+2=0.
  3. Lemma 8.1: (30) has no rational solution.
  4. rank⁡Q(A)>2\operatorname{rank}_{\mathbb Q}(\mathcal A) > 2rankQ​(A)>2.

Significance

The theorem shows that tensor rank, unlike matrix rank, is not invariant under field extension even between Q\mathbb QQ and R\mathbb RR, and even for the smallest nontrivial format 2×2×22\times2\times22×2×2. Its consequence for complexity is that a hardness result for rank over Q\mathbb QQ cannot be transferred to R\mathbb RR by reading the same instance in a larger field; the paper accordingly re-examines Håstad's construction to obtain hardness over R\mathbb RR and C\mathbb CC (Theorem 8.2), which is outside this mission.

The result is proved in the paper, with the decisive algebraic step delegated to a computer-algebra computation (Appendix). A machine-checked proof replaces that computation by a certificate verified in Lean, and it settles a printed error: one of the two consequences of (30) in the proof of Lemma 8.1 is printed with the wrong sign (see Formalization scope). No formalization of array tensor rank over a field, or of its field dependence, is known to exist in Mathlib or on this platform.

Difficulty

The upper bound is an identity among explicit 2×2×22\times2\times22×2×2 arrays. The lower bound is the substance: one must show that the cubic system (30), which has real solutions, has no rational one. Since (30) is solvable over R\mathbb RR, no argument by signs, inequalities or real geometry can work; the obstruction is arithmetic, coming from the irrationality of 2\sqrt22​. The step that fails in a naive attempt is the elimination: eliminating ten of the twelve unknowns from eight cubic equations by hand is impractical. A second, smaller difficulty is the reduction from "rank⁡Q(A)≤2\operatorname{rank}_{\mathbb Q}(\mathcal A) \le 2rankQ​(A)≤2" to two terms of the special form (29), which requires absorbing the scalars and padding a decomposition with fewer than two terms.

Formalization scope

  • Tensors are functions Fin l → Fin m → Fin n → E, with 0-based indices: the paper's aijka_{ijk}aijk​ is A (i-1) (j-1) (k-1). Vectors are Fin n → E.
  • rankOver E A is the sInf over N\mathbb NN of the lengths rrr of decompositions ∑sλs xs⊗ys⊗zs\sum_s \lambda_s\, \mathbf x_s\otimes\mathbf y_s\otimes\mathbf z_s∑s​λs​xs​⊗ys​⊗zs​. The set is nonempty (one term per entry), so this is the paper's minimum. Zero summands are allowed; this gives the same minimum as the paper's sum of nonzero rank-1 tensors.
  • rank⁡R\operatorname{rank}_{\mathbb R}rankR​ of a rational tensor is rankOver ℝ of its entrywise cast to R\mathbb RR; rank⁡Q\operatorname{rank}_{\mathbb Q}rankQ​ is rankOver ℚ, whose witnesses are rational. A formalization in which both ranks range over real witnesses would make the theorem false.
  • The goal is the printed existential. It is not a loophole: the milestones concern the paper's explicit tensor.
  • Readings of loose phrases: "Suppose not and that there exist ui,vi\mathbf u_i, \mathbf v_iui​,vi​ with (29). Identity (29) gives eight equations found in (30)" is split into a general statement (rank at most 2 over any field means a sum of two outer products) and the equivalence of (29) with (30) over every field of characteristic zero (milestone 2); both are stated in a generality in which their hypotheses can hold, because for A\mathcal AA over Q\mathbb QQ they cannot. "Polynomial consequences of (30)" is read as "holds at every solution of (30) in every field of characteristic zero" (milestone 3); over Q\mathbb QQ alone the statement would be vacuous, since (30) has no rational solution.
  • Corrected error. The paper prints the second consequence as c1d2d3−2=0c_1d_2d_3 - 2 = 0c1​d2​d3​−2=0. It is false: the real solution from milestone 1 has c1d2d3=−2c_1d_2d_3 = -2c1​d2​d3​=−2. The milestone states c1d2d3+2=0c_1d_2d_3 + 2 = 0c1​d2​d3​+2=0 (checked by a Gröbner basis computation over Q\mathbb QQ), which serves the paper's argument equally. The Appendix certificates GkG_kGk​, HkH_kHk​ (p. 0:34) are not used in any statement.
  • Out of scope: Theorem 1.15/8.2 (Håstad's construction over R\mathbb RR and C\mathbb CC) and the conjectures of §13.

Needed infrastructure: finite sums of arrays, Real.sqrt and irrational_sqrt_two, and an ideal-membership certificate for milestone 3. The array rank rankOver is reusable for any statement about tensor rank over a field. The platform's mme_tensor_rank (restriction-based rank of a TensorObj over a single field, from the matrix-multiplication exponent series) is a different object and is not reused. Proofs of any milestone, and alternative certificates for Lemma 8.1, are welcome.

Selected references

  • C. J. Hillar and L.-H. Lim, Most tensor problems are NP-hard, J. ACM 60(6), Art. 45, 2013. https://doi.org/10.1145/2512329 (arXiv: https://arxiv.org/abs/0911.1393)
  • J. Håstad, Tensor rank is NP-complete, J. Algorithms 11(4), 644–654, 1990. https://doi.org/10.1016/0196-6774(90)90014-6
  • V. de Silva and L.-H. Lim, Tensor rank and the ill-posedness of the best low-rank approximation problem, SIAM J. Matrix Anal. Appl. 30(3), 1084–1127, 2008. https://doi.org/10.1137/06066518X
  • F. L. Hitchcock, The expression of a tensor or a polyadic as a sum of products, J. Math. Phys. 6, 164–189, 1927. https://doi.org/10.1002/sapm192761164
8 thms2 active usersReviewed
Complexity TheoryGraph TheoryLinear algebra·Captain: mikedeng1

Most Tensor Problems Are NP-Hard 1: Graph 3-Colorability Reduces to Deciding Whether 0 Is an Eigenvalue of a Rational 3-Tensor over the RealsResearch Paper

Motivation

Eigenvalues of matrices are computable in polynomial time to any accuracy, and numerical linear algebra rests on that fact. Higher-order tensors appear in statistics (moment and cumulant tensors), signal processing, quantum information and polynomial optimization, and several notions of tensor eigenvalue were proposed for them, independently by Lim and by Qi in 2005 (Lim 2005; Qi 2005). Hillar and Lim (J. ACM 60(6), 2013, Art. 45; arXiv:0911.1393) showed that most of the natural tensor analogues of tractable matrix problems are NP-hard. Their first example, Theorem 1.3, concerns the simplest one: deciding whether a given number is an eigenvalue of a 3-tensor.

This mission formalizes that theorem together with the lemmas its proof uses. The reduction starts from graph 3-colorability, and its intermediate step, quadratic feasibility (Theorem 2.6), is reused throughout the paper: the bilinear, singular value and triple-bilinear results all go through the same color encoding.

Setting

A 3-tensor over a field FFF is an array A=[ ⁣[aijk] ⁣]∈Fn×n×n\mathcal A=[\![a_{ijk}]\!]\in F^{n\times n\times n}A=[[aijk​]]∈Fn×n×n. A scalar λ∈F\lambda\in Fλ∈F is an eigenvalue of A\mathcal AA (eq. (3) of the paper) if there is a nonzero x∈Fn\mathbf x\in F^nx∈Fn with

∑i,j=1naijk xixj=λxk,k=1,…,n.\sum_{i,j=1}^{n}a_{ijk}\,x_ix_j=\lambda x_k,\qquad k=1,\dots,n.i,j=1∑n​aijk​xi​xj​=λxk​,k=1,…,n.

The sum is over the first two indices. For λ=0\lambda=0λ=0 the condition is invariant under scaling of x\mathbf xx, so no normalization enters.

Problem 1.2 (tensor λ\lambdaλ-eigenvalue) fixes F∈{R,C}F\in\{\mathbb R,\mathbb C\}F∈{R,C} and λ∈Q\lambda\in\mathbb Qλ∈Q, and asks, for a rational tensor A∈Qn×n×n\mathcal A\in\mathbb Q^{n\times n\times n}A∈Qn×n×n, whether λ\lambdaλ is an eigenvalue of A\mathcal AA with an eigenvector in FnF^nFn.

Problem 2.2 (quadratic feasibility) asks, for rational matrices A1,…,Am∈Qn×nA_1,\dots,A_m\in\mathbb Q^{n\times n}A1​,…,Am​∈Qn×n, whether the system x⊤Aix=0\mathbf x^\top A_i\mathbf x=0x⊤Ai​x=0 (i=1,…,mi=1,\dots,mi=1,…,m) has a nonzero solution x∈Fn\mathbf x\in F^nx∈Fn.

A proper 3-coloring of a simple graph G=(V,E)G=(V,E)G=(V,E) assigns one of three colors to each vertex so that adjacent vertices receive different colors.

The color encoding CGC_GCG​ of a graph on vertices 1,…,v1,\dots,v1,…,v (Definition 2.9) is the family of 4v4v4v quadratics in x1,…,xv,y1,…,yv,zx_1,\dots,x_v,y_1,\dots,y_v,zx1​,…,xv​,y1​,…,yv​,z:

xiyi−z2,yiz−xi2,xiz−yi2,∑j:{i,j}∈E(xi2+xixj+xj2),i=1,…,v.x_iy_i-z^2,\quad y_iz-x_i^2,\quad x_iz-y_i^2,\quad \sum_{j:\{i,j\}\in E}(x_i^2+x_ix_j+x_j^2),\qquad i=1,\dots,v.xi​yi​−z2,yi​z−xi2​,xi​z−yi2​,j:{i,j}∈E∑​(xi2​+xi​xj​+xj2​),i=1,…,v.

Lemma 2.7 replaces a complex quadratic system by a real one of twice the size, and Lemma 2.8 pads a real system to a square one. Applied to CGC_GCG​, they give NNN real quadratics x⊤Bkx\mathbf x^\top B_k\mathbf xx⊤Bk​x in NNN unknowns. The tensor TGT_GTG​ with aijk=(Bk)ija_{ijk}=(B_k)_{ij}aijk​=(Bk​)ij​ is the output of the reduction.

Formalization targets

Goal: Theorem 1.3

3-COL ≤p TENSOR-0-EIGR.\textsf{3-COL}\ \le_p\ \textsf{TENSOR-0-EIG}_{\mathbb R}.3-COL ≤p​ TENSOR-0-EIGR​.

Graph 3-colorability is polynomial-time many-one reducible to the language of binary codes of rational tensors having 000 as a real eigenvalue.

Milestones, in the order the proof uses them

  1. Lemma 2.10. CGC_GCG​ has a nonzero complex solution if and only if GGG is 3-colorable.
  2. Lemma 2.7. The 2m2m2m real equations with matrices [Ai00−Ai]\begin{bmatrix}A_i&0\\0&-A_i\end{bmatrix}[Ai​0​0−Ai​​] and [0AiAi0]\begin{bmatrix}0&A_i\\A_i&0\end{bmatrix}[0Ai​​Ai​0​] have a nonzero real solution iff {z⊤Aiz=0}\{\mathbf z^\top A_i\mathbf z=0\}{z⊤Ai​z=0} has a nonzero complex solution.
  3. Lemma 2.8. Padding to r≥m+1r\ge m+1r≥m+1 equations in s≥ns\ge ns≥n unknowns preserves real feasibility.
  4. Theorem 2.6. 3-COL≤p\textsf{3-COL}\le_p3-COL≤p​ quadratic feasibility over R\mathbb RR and over C\mathbb CC.
  5. Proof of Theorem 1.3, first step. 000 is a real eigenvalue of A\mathcal AA iff the square system x⊤Akx=0\mathbf x^\top A_k\mathbf x=0x⊤Ak​x=0, Ak(i,j)=aijkA_k(i,j)=a_{ijk}Ak​(i,j)=aijk​, has a nonzero real solution.
  6. Proof of Theorem 1.3, the construction. GGG is 3-colorable iff 000 is a real eigenvalue of TGT_GTG​.

Significance

The result. Theorem 1.3 shows that deciding whether 000 is an eigenvalue of a rational 3-tensor over R\mathbb RR is NP-hard, in contrast to the matrix case. Because the instance is a single rational tensor with small integer entries, the hardness does not come from numerical precision: it is a property of the exact problem. The same encoding underlies the paper's hardness of approximating an eigenvector (Theorem 1.5) and its remarks on counting eigenvectors (Corollary 1.16).

Formalizing it. The result is proved in the paper, but no part of it is machine-checked. The mission adds three things. It gives a precise language-level statement of what "polynomially reducible" means for this problem. It gives a checked equivalence between 3-colorability and the eigenvalue condition for the explicit tensor TGT_GTG​. And it gives reusable statements about homogeneous quadratic systems (realification and padding), which the bilinear and singular value missions of this series also need.

Difficulty

The algebraic core is Lemma 2.10, and its reverse direction is where a first attempt fails. The fourth family of CGC_GCG​ does not say that each term xi2+xixj+xj2x_i^2+x_ix_j+x_j^2xi2​+xi​xj​+xj2​ vanishes; it says only that their sum over the neighbours of iii vanishes, over C\mathbb CC, where nonzero terms can cancel. A common zero yields a coloring only after the first three families have pinned down each coordinate, and the case z=0z=0z=0 must be excluded separately.

Lemma 2.7 needs care because the matrices AiA_iAi​ are not assumed symmetric: the imaginary part of z⊤Az\mathbf z^\top A\mathbf zz⊤Az is u⊤Av+v⊤Au\mathbf u^\top A\mathbf v+\mathbf v^\top A\mathbf uu⊤Av+v⊤Au, not 2u⊤Av2\mathbf u^\top A\mathbf v2u⊤Av. Lemma 2.8 uses that R\mathbb RR is formally real; it fails over C\mathbb CC.

At the language level, the reduction must be exhibited as a Turing machine computation on binary codes in polynomial time. That is bookkeeping, but it is the part the paper does not write down.

Formalization scope

  • Tensors and vectors. Tensors are arrays Fin n → Fin n → Fin n → F, vectors Fin n → F, and indices are 0-based. The eigenvalue condition is eq. (3) verbatim, without normalization; for λ=0\lambda=0λ=0 none is needed. Rational data are cast into R\mathbb RR or C\mathbb CC.
  • Quadratic polynomials. A homogeneous quadratic is a (not necessarily symmetric) rational matrix MMM, read as x⊤Mx\mathbf x^\top M\mathbf xx⊤Mx, and the monomial xaxbx_ax_bxa​xb​ is the matrix unit EabE_{ab}Eab​. A vertex without neighbours contributes the zero polynomial to CGC_GCG​.
  • Choices in the construction. The square size is N=8v+2N=8v+2N=8v+2. It meets Lemma 2.8's bounds r≥8v+1r\ge 8v+1r≥8v+1 and s≥4v+2s\ge 4v+2s≥4v+2 for every v≥0v\ge 0v≥0; Example 1.4's count differs and is not used.
  • Reducibility. "Polynomially reducible" is Cook's polynomial-time many-one reducibility (CookPvsNP.PolyReducible, published definition CookPvsNP_defs). The paper's reduction maps one graph to one tensor, and a many-one reduction implies the oracle notion of its §1.4.
  • Binary codes. Instances are coded over the alphabet BSym with the binary codes of the published definition ProjSchedTW.Complexity.Encoding. A graph is ν\nuν followed by its adjacency matrix. A rational is its numerator then its denominator. A tensor is nnn followed by its entries in lexicographic order. The target language contains all rational tensors, not only integral ones.
  • Not formalized. NP-completeness of 3-colorability (Karp 1972) is cited, not formalized, and the goal states only the reduction. Approximation (Theorem 1.5), counting (Corollary 1.16) and the solution count of Example 1.4 are out of scope.
  • Trivializations ruled out. Every feasibility statement requires a nonzero solution, since the zero vector solves every homogeneous system. The goal includes polynomial-time computability of the reduction, not just the existence of an equivalence-preserving map, which would be trivial. The milestones concern the paper's explicit CGC_GCG​ and TGT_GTG​, not an arbitrary tensor.

Contributions are welcome in four places:

  • proofs of the milestones;
  • a polynomial-time Turing machine computing G↦TGG\mapsto T_GG↦TG​ on codes;
  • general lemmas on homogeneous quadratic systems over formally real fields;
  • a composition (transitivity) lemma for CookPvsNP.PolyReducible.

Selected references

  • C. J. Hillar and L.-H. Lim, Most Tensor Problems Are NP-Hard, Journal of the ACM 60(6), Article 45, 2013. https://doi.org/10.1145/2512329 (arXiv:0911.1393v5, https://arxiv.org/abs/0911.1393)
  • L.-H. Lim, Singular values and eigenvalues of tensors: a variational approach, Proc. IEEE CAMSAP 2005, pp. 129–132. https://doi.org/10.1109/CAMAP.2005.1574201
  • L. Qi, Eigenvalues of a real supersymmetric tensor, Journal of Symbolic Computation 40(6), 2005, pp. 1302–1324. https://doi.org/10.1016/j.jsc.2005.05.007
  • R. M. Karp, Reducibility among combinatorial problems, in Complexity of Computer Computations, Plenum, 1972, pp. 85–103. https://doi.org/10.1007/978-1-4684-2001-2_9
  • S. Cook, The P versus NP problem, Clay Mathematics Institute Millennium Problem description, 2000. https://www.claymath.org/millennium/p-vs-np/
11 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: xuanji

Deterministic APSP in O(n^2.995561) time on a Word RAMResearch Paper

Motivation

All-pairs shortest paths (APSP) asks for the exact distance between every ordered pair of vertices in an nnn-vertex weighted directed graph. Floyd–Warshall solves it in O(n3)O(n^3)O(n3) time, and for decades no algorithm beat n3−δn^{3-\delta}n3−δ for any constant δ>0\delta>0δ>0 on graphs with polynomially bounded integer weights. In 2026, Alman and Vassilevska Williams (arXiv:2610.06783) gave a deterministic O(n2.99942)O(n^{2.99942})O(n2.99942) algorithm, the campaign's first entry. Later entries tightened the accounting to 2.99832.99832.9983, 2.997912.997912.99791 and 2.9960012.9960012.996001.

This entry records the deterministic exponent 2.9955612.9955612.995561, a saving of about 0.004440.004440.00444 below 333, roughly 11% more than the 2.9960012.9960012.996001 entry.

Setting

The model is the campaign's fixed deterministic word RAM (foundation mission: Truly Subcubic APSP on a Word RAM). A finite program uses add, subtract and multiply modulo 2W2^W2W, indirect load and store, a sign branch, and accept or reject, on words of width W≥b(log⁡2n+1)W \ge b(\log_2 n + 1)W≥b(log2​n+1). Inputs have integer weights of absolute value at most nκn^\kappanκ for a fixed κ\kappaκ, and there are no negative cycles. The machine has no source of randomness; the algorithm behind this entry is deterministic.

Formalization target

The goal is the campaign template with the value 2.9955612.9955612.995561:

TrulySubcubicAPSP.APSP.SolvedInTime 2.995561,\texttt{TrulySubcubicAPSP.APSP.SolvedInTime}\ 2.995561,TrulySubcubicAPSP.APSP.SolvedInTime 2.995561,

which says there is a deterministic word-RAM program that solves APSP in O(n2.995561)O(n^{2.995561})O(n2.995561) steps.

How the bound arises

The algebraic core is the tensor construction of Alman and Vassilevska Williams, which evaluates KKK independent N0×DN_0\times DN0​×D by D×N0D\times N_0D×N0​ integer products in one run and answers requested output entries. Two local refinements sharpen its exponents: pruned encodings (branches with more than mmm copies of the symbol P0P_0P0​ are never materialized) and an exact binomial tail for the box preprocessing, giving

Γ(c,θ)=cH(1/c)−cH((1−θ)/c)−θln⁡9ln⁡4,q(θ)=H(θ)+θln⁡9ln⁡4.\Gamma(c,\theta) = \frac{cH(1/c) - cH((1-\theta)/c) - \theta\ln 9}{\ln 4},\qquad q(\theta) = \frac{H(\theta)+\theta\ln 9}{\ln 4}.Γ(c,θ)=ln4cH(1/c)−cH((1−θ)/c)−θln9​,q(θ)=ln4H(θ)+θln9​.

On top of the deterministic filtering reduction of the 2.9960012.9960012.996001 entry (moduli chosen one small prime factor at a time, with exact modular witness counts certifying positive answers and eliminating blocks of unresolved queries), this entry adds two changes to the counting oracle:

  1. Two-digit target residue. For modulus ppp, the target residue −zab mod p-z_{ab} \bmod p−zab​modp is written as hk+lh k + lhk+l with k=⌈p⌉k=\lceil\sqrt p\rceilk=⌈p​⌉, and the two digits are absorbed into the outer row and column indices. One product of outer dimension n⌈p⌉n\lceil\sqrt p\rceiln⌈p​⌉ and inner dimension spspsp per middle block replaces one product per residue.
  2. Batching middle blocks into the tensor slots. The T=⌈n/s⌉T=\lceil n/s\rceilT=⌈n/s⌉ products, one per middle-vertex block, are assigned to the KKK independent product slots of the tensor construction, so input encodings are shared across different blocks.

With middle blocks of size s=nε/2s=n^{\varepsilon/2}s=nε/2 the encoding cost becomes TNDbT N D^{b}TNDb with b(c)=(c−1)ln⁡3/ln⁡4b(c)=(c-1)\ln 3/\ln 4b(c)=(c−1)ln3/ln4, and all-edges Exact Triangle runs in n3−δ+o(1)n^{3-\delta+o(1)}n3−δ+o(1) with

δ=min⁡{εΓ, 1−ε(b−14), ε(12−q)},\delta = \min\{\varepsilon\Gamma,\ 1-\varepsilon(b-\tfrac14),\ \varepsilon(\tfrac12-q)\},δ=min{εΓ, 1−ε(b−41​), ε(21​−q)},

subject to the batch conditions ε(κ+12)<1\varepsilon(\kappa+\tfrac12)<1ε(κ+21​)<1 and ε(b−14)<1\varepsilon(b-\tfrac14)<1ε(b−41​)<1, where κ(c)=cH(1/c)/ln⁡4\kappa(c)=cH(1/c)/\ln 4κ(c)=cH(1/c)/ln4. Deterministic bit scaling transfers the bound to min-plus product and APSP with polylogarithmic overhead.

The exact rational parameters c=20c = 20c=20, θ=0.113138\theta = 0.113138θ=0.113138 and ε=0.067235\varepsilon = 0.067235ε=0.067235 give δ>0.00443921\delta > 0.00443921δ>0.00443921 (rational interval certificate for log⁡2,log⁡3,…\log 2,\log 3,\dotslog2,log3,… with error below 10−6210^{-62}10−62). Hence APSP runs in n2.99556079+o(1)n^{2.99556079+o(1)}n2.99556079+o(1), and the gap 2.995561−2.99556079>02.995561 - 2.99556079 > 02.995561−2.99556079>0 absorbs the subpolynomial factor.

Significance

This is the strongest deterministic entry so far. Compared with 2.9960012.9960012.996001, the saving below cubic time grows from about 0.00399930.00399930.0039993 to about 0.00443930.00443930.0044393, coming entirely from cheaper input encodings in the counting oracle.

Selected references

  • J. Alman and V. Vassilevska Williams, Truly Subquadratic 3SUM and Truly Subcubic APSP via Triangles in Sparse Lopsided Graphs (2026). https://arxiv.org/abs/2610.06783
  • Deterministic APSP in O(n2.995561)O(n^{2.995561})O(n2.995561): an explicit refinement of the thin-product method, technical note, revised 7 October 2026. This is the source of 2.9955612.9955612.995561 and has not been peer reviewed.
5 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs? 2: Random-Hyperplane Rounding Approximates Balanced MAX-2SAT within β ≈ 0.943Research Paper

Motivation

MAX-2SAT asks for an assignment of Boolean variables that maximizes the total weight of satisfied clauses, each clause being a disjunction of two literals. It is one of the basic constraint satisfaction problems of approximation theory, and its approximability has been studied alongside MAX-CUT since semidefinite programming entered the field.

Khot, Kindler, Mossel and O'Donnell (SIAM J. Comput. 37(1), 2007) show that, assuming the Unique Games Conjecture, it is NP-hard to approximate MAX-2SAT within any factor greater than

β=min⁡π/2≤θ≤π2+(2/π)θ3−cos⁡θ≈0.943\beta = \min_{\pi/2 \le \theta \le \pi} \frac{2 + (2/\pi)\theta}{3 - \cos\theta} \approx 0.943β=π/2≤θ≤πmin​3−cosθ2+(2/π)θ​≈0.943

(their Theorem 3), and that their reduction produces balanced instances, in which every variable carries as much weight positively as negatively. Their Theorem 4 shows that for this balanced restriction the bound is tight: a Goemans–Williamson style semidefinite relaxation followed by random-hyperplane rounding approximates Balanced-MAX-2SAT within any factor smaller than β\betaβ. This mission formalizes Theorem 4.

Timeline.

  • 1995: Goemans and Williamson give the 0.878 algorithm for MAX-CUT and a 0.878 algorithm for MAX-2SAT by semidefinite programming and random-hyperplane rounding (J. ACM 42(6)).
  • 2007: Khot, Kindler, Mossel and O'Donnell prove UGC-hardness at β\betaβ for MAX-2SAT, and show β\betaβ is achievable for balanced instances (Theorem 4).
  • 2007: Austrin shows that, under the Unique Games Conjecture, general MAX-2SAT is hard to approximate beyond about 0.9401, strictly below β\betaβ, so balanced instances are not the hardest ones (STOC 2007); for the balanced version β\betaβ remains the threshold.

Setting

Treat the bit TRUE as −1-1−1 and FALSE as 111 (the paper's §7.2 convention). An assignment of the variables x0,…,xn−1x_0,\dots,x_{n-1}x0​,…,xn−1​ is a point x∈{−1,1}nx \in \{-1,1\}^nx∈{−1,1}n. A literal is y=rixiy = r_i x_iy=ri​xi​ with a sign ri∈{−1,1}r_i \in \{-1,1\}ri​∈{−1,1} (ri=−1r_i = -1ri​=−1 for the negated variable ¬xi\neg x_i¬xi​); it is true when y=−1y = -1y=−1. A weighted MAX-2SAT instance is a finite list of clauses C=(y∨z)C = (y \vee z)C=(y∨z) with y=rixiy = r_ix_iy=ri​xi​, z=rjxjz = r_jx_jz=rj​xj​ (the two variables may coincide), with nonnegative weights wCw_CwC​. The satisfied weight of xxx is

sat(x)=∑CwC [ y=−1 or z=−1 ],OPT=max⁡x∈{−1,1}nsat(x).\mathrm{sat}(x) = \sum_C w_C\,[\,y = -1 \text{ or } z = -1\,], \qquad \mathrm{OPT} = \max_{x\in\{-1,1\}^n} \mathrm{sat}(x).sat(x)=C∑​wC​[y=−1 or z=−1],OPT=x∈{−1,1}nmax​sat(x).

An instance is balanced (Definition 12) if for each variable iii, the expected satisfied weight when xi=1x_i = 1xi​=1 and the other variables are uniform equals the expected satisfied weight when xi=−1x_i = -1xi​=−1 and the others are uniform.

The semidefinite relaxation replaces each xix_ixi​ by a unit vector vi∈Rdv_i \in \mathbb R^dvi​∈Rd and the balanced objective by

SDPobj(v)=∑C=(rixi∨rjxj)wC(34−14 (rivi)⋅(rjvj)),\mathrm{SDPobj}(v) = \sum_{C = (r_ix_i\vee r_jx_j)} w_C\Bigl(\tfrac34 - \tfrac14\,(r_iv_i)\cdot(r_jv_j)\Bigr),SDPobj(v)=C=(ri​xi​∨rj​xj​)∑​wC​(43​−41​(ri​vi​)⋅(rj​vj​)),

with optimal value SDP=sup⁡SDPobj(v)\mathrm{SDP} = \sup \mathrm{SDPobj}(v)SDP=supSDPobj(v) over unit-vector families in every dimension. Hyperplane rounding draws a standard Gaussian vector g∈Rdg \in \mathbb R^dg∈Rd and sets xi=sgn⁡(g⋅vi)x_i = \operatorname{sgn}(g\cdot v_i)xi​=sgn(g⋅vi​).

Formalization targets

Goal: Theorem 4 (p. 12), as the guarantee of the algorithm

For every balanced instance with nonnegative weights, every ε≥0\varepsilon \ge 0ε≥0, every unit-vector family vvv with SDPobj(v)≥SDP−ε\mathrm{SDPobj}(v) \ge \mathrm{SDP} - \varepsilonSDPobj(v)≥SDP−ε, and every standard Gaussian vector ggg,

E[sat(sgn⁡(g⋅vi))i]  ≥  β (OPT−ε),\mathbb E\bigl[\mathrm{sat}(\operatorname{sgn}(g\cdot v_i))_i\bigr] \;\ge\; \beta\,(\mathrm{OPT} - \varepsilon),E[sat(sgn(g⋅vi​))i​]≥β(OPT−ε),

with the satisfied weight integrable. The constant is Theorem 3's exact minimum β\betaβ, not its decimal rounding.

Milestones (proof of Theorem 4, pp. 21–22)

  1. Arithmetization: [ y∨z ]=34−14y−14z−14yz[\,y\vee z\,] = \tfrac34 - \tfrac14 y - \tfrac14 z - \tfrac14 yz[y∨z]=43​−41​y−41​z−41​yz on {−1,1}2\{-1,1\}^2{−1,1}2.
  2. Balanced   ⟺  \iff⟺ the linear terms cancel: sat(x)=∑CwC(34−14yz)\mathrm{sat}(x) = \sum_C w_C(\tfrac34 - \tfrac14 yz)sat(x)=∑C​wC​(43​−41​yz) for all xxx.
  3. Relaxation: OPT≤SDP\mathrm{OPT} \le \mathrm{SDP}OPT≤SDP for balanced instances.
  4. Hyperplane identity E[xixj]=1−2πarccos⁡(vi⋅vj)\mathbb E[x_ix_j] = 1 - \tfrac2\pi\arccos(v_i\cdot v_j)E[xi​xj​]=1−π2​arccos(vi​⋅vj​), already proved on the platform as Grothendieck's identity (in the equivalent form 2πarcsin⁡\tfrac2\pi\arcsinπ2​arcsin).
  5. Per-clause bound: 34−14(1−2πarccos⁡t)≥β(34−14t)\tfrac34 - \tfrac14(1 - \tfrac2\pi\arccos t) \ge \beta(\tfrac34 - \tfrac14 t)43​−41​(1−π2​arccost)≥β(43​−41​t) for all t∈[−1,1]t\in[-1,1]t∈[−1,1].

Significance

The result. Together with Theorem 3, Theorem 4 pins the approximability of Balanced-MAX-2SAT at exactly β\betaβ under the Unique Games Conjecture: the constant arising from the Majority Is Stablest analysis of the hardness reduction coincides with the constant of a semidefinite rounding algorithm. It also explains why the hardness reduction for MAX-2SAT cannot give more than β\betaβ without abandoning balanced instances.

Formalizing it. The theorem is proved in the paper; no machine-checked proof is known to exist. A formal proof produces a verified approximation guarantee for a randomized rounding scheme that holds for every near-optimal vector solution, and a reusable layer for weighted 2-CSPs on {−1,1}n\{-1,1\}^n{−1,1}n: arithmetization, balancedness, the vector relaxation and its rounding. The hyperplane identity is already available on the platform, so the remaining work is combinatorial and analytic rather than probabilistic.

Difficulty

The naive approach, rounding the full arithmetized objective 34−14y−14z−14yz\tfrac34 - \tfrac14 y - \tfrac14 z - \tfrac14 yz43​−41​y−41​z−41​yz, fails: the relaxation of a linear term rixir_ix_iri​xi​ has no vector counterpart that random-hyperplane rounding treats correctly, and for unbalanced instances the achievable ratio is different. The whole argument rests on balancedness making the linear terms vanish identically, and the equivalence between Definition 12 (a statement about conditional expectations) and the cancellation of linear coefficients must be established with care, including clauses whose two literals involve the same variable.

The second difficulty is the constant. β\betaβ is defined as a minimum over θ∈[π/2,π]\theta\in[\pi/2,\pi]θ∈[π/2,π] only, while the per-clause comparison is needed for all inner products t∈[−1,1]t\in[-1,1]t∈[−1,1], that is for all θ∈[0,π]\theta\in[0,\pi]θ∈[0,π]. Showing that the ratio 2+(2/π)θ3−cos⁡θ\frac{2 + (2/\pi)\theta}{3-\cos\theta}3−cosθ2+(2/π)θ​ does not drop below β\betaβ on [0,π/2][0,\pi/2][0,π/2] is a genuine one-variable inequality, not a definitional unfolding. Finally, the expectation must be computed for a genuine Gaussian vector, with the sign convention at 000 handled almost surely.

Formalization scope

  • Assignments are Fin n → Bool read through pm true = -1, pm false = 1; a literal is (i, r) : Fin n × Bool with r = true for ¬xi\neg x_i¬xi​. The two literals of a clause may involve the same variable.
  • An instance is a structure with m clauses, a clause map, and real weights with a nonnegativity field (Definition 10's "nonnegative weight function").
  • Balancedness is Definition 12, stated as equality of the sums of satisfied weight over the two halves {xi=1}\{x_i = 1\}{xi​=1} and {xi=−1}\{x_i = -1\}{xi​=−1} of the cube; the common factor 2−(n−1)2^{-(n-1)}2−(n−1) is dropped.
  • OPT is a maximum over the 2n2^n2n assignments. SDP is a real supremum over unit-vector families Fin n → Fin d → ℝ in every dimension ddd; the set is nonempty and bounded above by the total weight.
  • beta is the infimum of the image of [π/2,π][\pi/2,\pi][π/2,π], i.e. Theorem 3's attained minimum. Defining it over [0,π][0,\pi][0,π] instead would make milestone 5 definitional and is ruled out.
  • The Gaussian vector is the platform predicate IsStandardGaussianVector (measurable, independent coordinates of law N(0,1)N(0,1)N(0,1) on an arbitrary probability space); the expectation is a Bochner integral and its integrability is part of the conclusion. The rounding outputs FALSE on the null event g⋅vi=0g\cdot v_i = 0g⋅vi​=0.
  • Not formalized: polynomial running time. The paper obtains an (SDP−ε)(\mathrm{SDP}-\varepsilon)(SDP−ε)-optimal solution in polynomial time by citing Goemans–Williamson; the goal quantifies over every such solution. "Within any factor smaller than β\betaβ" follows by taking ε\varepsilonε small, because OPT≥12∑CwC\mathrm{OPT} \ge \tfrac12\sum_C w_COPT≥21​∑C​wC​.
  • The goal cannot be met trivially: the vector family is universally quantified (not chosen inside the statement), the expectation is over a genuine Gaussian, and the instance ranges over all balanced weighted instances (a nontrivial balanced instance such as (x1∨x2)∧(¬x1∨¬x2)(x_1\vee x_2)\wedge(\neg x_1\vee\neg x_2)(x1​∨x2​)∧(¬x1​∨¬x2​) exists).

Welcome contributions: proofs of the milestones, a bridge from Real.sign (used by the platform's Grothendieck identity) to the {−1,1}\{-1,1\}{−1,1}-valued rounding, and the one-variable analysis behind the per-clause bound.

Selected references

  • S. Khot, G. Kindler, E. Mossel, R. O'Donnell, Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs?, SIAM J. Comput. 37(1), 2007. https://doi.org/10.1137/S0097539705447372
  • M. X. Goemans, D. P. Williamson, Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming, J. ACM 42(6), 1995. https://doi.org/10.1145/227683.227684
  • P. Austrin, Balanced Max 2-Sat might not be the hardest, STOC 2007. https://doi.org/10.1145/1250790.1250818
  • R. Vershynin, High-Dimensional Probability, Cambridge University Press, 2018, Lemma 3.6.6 (Grothendieck's identity). https://doi.org/10.1017/9781108231596
9 thms2 active usersReviewed
Complexity TheoryOperations Research·Captain: mikedeng1

Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs? 1: Assuming the Unique Games Conjecture, (1/2 − ρ/2)- versus ((arccos ρ)/π + ε)-Satisfiable MAX-CUT Is NP-Hard to DistinguishResearch Paper

Motivation

MAX-CUT asks for a partition of the vertices of a graph that cuts as many edges, or as much edge weight, as possible. It is one of Karp's original NP-hard problems and the standard test case for approximation algorithms. A uniformly random partition cuts half of the edges in expectation. Goemans and Williamson (JACM 1995) rounded a semidefinite relaxation with a random hyperplane and obtained the ratio

αGW=min⁡0<θ<πθ/π(1−cos⁡θ)/2≈0.878567.\alpha_{GW}=\min_{0<\theta<\pi}\frac{\theta/\pi}{(1-\cos\theta)/2}\approx 0.878567.αGW​=0<θ<πmin​(1−cosθ)/2θ/π​≈0.878567.

Whether a better ratio can be achieved in polynomial time was a central open question.

Timeline.

  • 1995: Goemans and Williamson give the αGW\alpha_{GW}αGW​-approximation.
  • 2001: Håstad (JACM 2001) shows, via PCPs and gadgets, that approximating MAX-CUT within 16/17+ϵ≈0.94116/17+\epsilon\approx 0.94116/17+ϵ≈0.941 is NP-hard. This remains the best unconditional bound.
  • 2002: Khot (STOC 2002) formulates the Unique Games Conjecture (UGC).
  • 2004–2007: Khot, Kindler, Mossel and O'Donnell (SIAM J. Comput. 2007) show that the UGC implies that αGW\alpha_{GW}αGW​ is optimal. Their reduction rests on the Majority Is Stablest conjecture, which they formulate.
  • 2005–2010: Mossel, O'Donnell and Oleszkiewicz (Annals of Math. 2010, arXiv:math/0503503) prove Majority Is Stablest via the invariance principle.

Setting

A Unique Label Cover instance L(V,W,E,[M],{σv,w})\mathcal L(V,W,E,[M],\{\sigma_{v,w}\})L(V,W,E,[M],{σv,w​}) is a bipartite graph with left vertices VVV, right vertices WWW and edges E⊆V×WE\subseteq V\times WE⊆V×W, together with a bijection σv,w:[M]→[M]\sigma_{v,w}:[M]\to[M]σv,w​:[M]→[M] on each edge. A labeling assigns a label in [M][M][M] to every vertex, and it satisfies (v,w)(v,w)(v,w) if σv,w(label(w))=label(v)\sigma_{v,w}(\mathrm{label}(w))=\mathrm{label}(v)σv,w​(label(w))=label(v). OPT\mathrm{OPT}OPT is the largest fraction of edges satisfied by a labeling. The Unique Games Conjecture says that for all η,γ>0\eta,\gamma>0η,γ>0 there is M=M(η,γ)M=M(\eta,\gamma)M=M(η,γ) such that it is NP-hard to distinguish instances with label set [M][M][M] and OPT≥1−η\mathrm{OPT}\ge 1-\etaOPT≥1−η from those with OPT≤γ\mathrm{OPT}\le\gammaOPT≤γ.

A weighted MAX-CUT instance is a graph with nonnegative edge weights. It is at least ccc-satisfiable if some partition cuts at least a ccc fraction of the total weight, and at most sss-satisfiable if no partition cuts more than an sss fraction.

On the cube {−1,1}n\{-1,1\}^n{−1,1}n, with TRUE =−1=-1=−1 and the uniform measure, the noise stability of f:{−1,1}n→Rf:\{-1,1\}^n\to\mathbb Rf:{−1,1}n→R at ρ∈[−1,1]\rho\in[-1,1]ρ∈[−1,1] is Sρ(f)=E[f(x)f(y)]\mathbb S_\rho(f)=\mathbf E[f(x)f(y)]Sρ​(f)=E[f(x)f(y)]. Here xxx is uniform and yyy is ρ\rhoρ-correlated with xxx: each yiy_iyi​ independently equals xix_ixi​ with probability 12+12ρ\tfrac12+\tfrac12\rho21​+21​ρ. The influence Infi(f)\mathrm{Inf}_i(f)Infi​(f) is the expected variance of fff in the coordinate xix_ixi​, and the low-degree influence is Infi≤k(f)=∑S∋i,∣S∣≤kf^(S)2\mathrm{Inf}_i^{\le k}(f)=\sum_{S\ni i,|S|\le k}\hat f(S)^2Infi≤k​(f)=∑S∋i,∣S∣≤k​f^​(S)2. Majority Is Stablest states: for ρ∈[0,1)\rho\in[0,1)ρ∈[0,1) and ϵ>0\epsilon>0ϵ>0 there is δ>0\delta>0δ>0 such that every f:{−1,1}n→[−1,1]f:\{-1,1\}^n\to[-1,1]f:{−1,1}n→[−1,1] with E[f]=0\mathbf E[f]=0E[f]=0 and all Infi(f)≤δ\mathrm{Inf}_i(f)\le\deltaInfi​(f)≤δ has Sρ(f)≤1−2πarccos⁡ρ+ϵ\mathbb S_\rho(f)\le 1-\tfrac2\pi\arccos\rho+\epsilonSρ​(f)≤1−π2​arccosρ+ϵ.

Formalization targets

Goal: Theorem 1 (p. 11)

Assume the UGC and Majority Is Stablest. For every −1<ρ<0-1<\rho<0−1<ρ<0 and ϵ>0\epsilon>0ϵ>0 it is NP-hard to distinguish MAX-CUT instances that are at least ccc-satisfiable from those that are at most sss-satisfiable, where

c=12−12ρ,s=arccos⁡ρπ+ϵ.c=\tfrac12-\tfrac12\rho,\qquad s=\frac{\arccos\rho}{\pi}+\epsilon.c=21​−21​ρ,s=πarccosρ​+ϵ.

Choosing ρ\rhoρ to minimize s/cs/cs/c gives hardness of approximation within any factor above αGW\alpha_{GW}αGW​; that consequence is not part of the goal.

Milestones

  • The Fourier formulas Sρ(f)=⟨f,Tρf⟩=∑Sρ∣S∣f^(S)2\mathbb S_\rho(f)=\langle f,T_\rho f\rangle=\sum_S\rho^{|S|}\hat f(S)^2Sρ​(f)=⟨f,Tρ​f⟩=∑S​ρ∣S∣f^​(S)2 (Proposition 7.1) and Infi(f)=∑S∋if^(S)2\mathrm{Inf}_i(f)=\sum_{S\ni i}\hat f(S)^2Infi​(f)=∑S∋i​f^​(S)2 (Proposition 7.2).
  • Three variants of Majority Is Stablest:
    • with low-degree influences (Proposition 7.3);
    • in reverse for ρ∈(−1,0]\rho\in(-1,0]ρ∈(−1,0], without E[f]=0\mathbf E[f]=0E[f]=0 (Proposition 7.4);
    • both at once (Proposition 7.5).
  • The completeness of the Long-Code verifier, (1−2η)(12−12ρ)(1-2\eta)(\tfrac12-\tfrac12\rho)(1−2η)(21​−21​ρ) (§8.2).
  • The arithmetization Pr⁡[acc]=12−12Ev[Sρ(gv)]\Pr[\mathrm{acc}]=\tfrac12-\tfrac12\mathbf E_v[\mathbb S_\rho(g_v)]Pr[acc]=21​−21​Ev​[Sρ​(gv​)] (6).
  • The influence-transfer inequality (7).
  • The candidate-set bound ∣Cand[w]∣≤2k/δ|\mathrm{Cand}[w]|\le 2k/\delta∣Cand[w]∣≤2k/δ.
  • The soundness: acceptance ≥(arccos⁡ρ)/π+ϵ\ge(\arccos\rho)/\pi+\epsilon≥(arccosρ)/π+ϵ forces OPT≥γ′(ϵ,ρ)\mathrm{OPT}\ge\gamma'(\epsilon,\rho)OPT≥γ′(ϵ,ρ), independently of MMM (§8.3).

Significance

Under the UGC, Theorem 1 shows that the Goemans–Williamson algorithm is optimal for MAX-CUT. It also shows that the semidefinite relaxation's integrality gap and the hardness threshold coincide. This correspondence was later extended to every constraint satisfaction problem (Raghavendra, STOC 2008). The verifier analysis here is the template for many later UGC-hardness results: dictatorship tests via noise stability, and list-decoding via low-degree influences.

The paper's result is proved, conditional on the UGC; the UGC itself is open. To our knowledge, neither the reduction nor the Majority Is Stablest theorem has a machine-checked proof. This mission produces a checked version of the conditional reduction. Its by-products are reusable: Fourier analysis on the cube (noise stability, influences, the Bonami–Beckner operator), the Long-Code verifier analysis, and a gap-hardness interface on top of a Turing-machine definition of NP.

Difficulty

Completeness is a short calculation. The difficulty is soundness. A proof that the verifier accepts with probability above (arccos⁡ρ)/π+ϵ(\arccos\rho)/\pi+\epsilon(arccosρ)/π+ϵ must be decoded into a labeling that satisfies a fraction γ′\gamma'γ′ of the edges, and γ′\gamma'γ′ must not depend on the label set size MMM. Labeling each www by a coordinate of large influence of fwf_wfw​ is the obvious decoding, but on its own it does not work. The test is passed with high probability by the averaged functions gvg_vgv​, not by the fwf_wfw​ themselves. Ruling out functions with only small influences is exactly the content of Majority Is Stablest. The analysis needs both the reverse form of Majority Is Stablest for negative ρ\rhoρ and low-degree influences, whose sum is bounded by kkk independently of MMM. Turning the PCP into polynomial-time gap-hardness adds further work on top of the analysis:

  • the regularity assumption must be removed;
  • an irrational ρ\rhoρ must be replaced by a nearby rational one, so that the weights are integers;
  • the reduction must be shown polynomial-time on Turing machines.

Formalization scope

  • The cube. {−1,1}n\{-1,1\}^n{−1,1}n is Fin n → Bool, with TRUE ↦−1\mapsto-1↦−1. Expectations are finite averages.
  • No Fourier shortcuts. Noise stability and influence are defined as on pp. 5–6 (a correlated-pair average, an expected coordinate variance), not by their Fourier formulas, which are milestones.
  • Unique Label Cover. Instances have finite V,WV,WV,W, E⊆V×WE\subseteq V\times WE⊆V×W, and a permutation of Fin M\mathrm{Fin}\,MFinM for every pair. OPT\mathrm{OPT}OPT is the maximum over the finitely many labelings, and 000 when there is none.
  • MAX-CUT instances are loopless graphs with natural-number edge weights (edge multiplicities), as §7.1 permits.
  • NP-hardness. "NP-hard to distinguish" is GapNPHard: every NP language of the published CookPvsNP_defs maps by a polynomial-time Turing-machine computable function to Yes-instances or No-instances. Instances are encoded in unary.
  • Hypotheses of the goal. The UGC is a hypothesis of Theorem 1. Majority Is Stablest, which the paper cites from [45] and does not prove, is a second, disclosed hypothesis, of Theorem 1 and of every milestone that uses it.
  • Regularity. The verifier milestones assume the VVV-side regularity of §8.1; Theorem 1 and the UGC do not.
  • No trivial instances. Every Yes- and No-predicate requires a nonempty edge set, so the empty instance cannot carry the hardness. Placeholder (True/False) versions of the UGC or of Majority Is Stablest would trivialize the goal and are excluded.
  • Welcome contributions.
    • The Fourier milestones are self-contained and reusable.
    • A proof of Majority Is Stablest would discharge the second hypothesis.
    • A formal regularization of Unique Label Cover ([38]) would make the reduction self-contained.

Selected references

  • S. Khot, G. Kindler, E. Mossel, R. O'Donnell, Optimal Inapproximability Results for MAX-CUT and Other 2-Variable CSPs?, SIAM J. Comput. 37(1), 2007. https://doi.org/10.1137/S0097539705447372
  • M. X. Goemans, D. P. Williamson, Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming, J. ACM 42(6), 1995. https://doi.org/10.1145/227683.227684
  • J. Håstad, Some optimal inapproximability results, J. ACM 48(4), 2001. https://doi.org/10.1145/502090.502098
  • S. Khot, On the power of unique 2-prover 1-round games, STOC 2002. https://doi.org/10.1145/509907.510017
  • E. Mossel, R. O'Donnell, K. Oleszkiewicz, Noise stability of functions with low influences: invariance and optimality, Annals of Math. 171(1), 2010. https://doi.org/10.4007/annals.2010.171.295 (arXiv:math/0503503)
16 thms2 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Matroid Prophet Inequalities 3: Stopping at the First Value Above E[max X_i]/2 Earns at Least Half the Prophet's Expected MaximumResearch Paper

Motivation

A prophet inequality compares two players facing the same random sequence of rewards X1,X2,…,XnX_1, X_2, \dots, X_nX1​,X2​,…,Xn​. The gambler sees the values one at a time and must decide, as each value arrives, whether to stop and collect it; a value passed over is lost. The prophet knows the whole sequence in advance and simply takes its maximum. In 1978 Krengel, Sucheston and Garling showed that when the XiX_iXi​ are independent, non-negative and E[max⁡iXi]<∞\mathbb E[\max_i X_i] < \inftyE[maxi​Xi​]<∞, the gambler has a stopping rule τ\tauτ with

2 E[Xτ]  ≥  E[max⁡iXi],2\,\mathbb E[X_\tau] \;\ge\; \mathbb E\big[\max_i X_i\big],2E[Xτ​]≥E[imax​Xi​],

and that the factor 222 cannot be improved. This inequality, labelled (1) in Kleinberg and Weinberg's Matroid Prophet Inequalities (arXiv:1201.4764, STOC 2012), is the starting point of optimal stopping theory's prophet inequalities and, more recently, of a large literature in online algorithms and algorithmic mechanism design, where it is the reason that a single posted price can extract a constant fraction of the optimal welfare or revenue.

Timeline.

  • 1977: Krengel and Sucheston prove the inequality with factor 4 in place of 2 (Bull. Amer. Math. Soc. 83).
  • 1978: Krengel and Sucheston publish the result attributed to Krengel, Sucheston and Garling, the factor-2 inequality (1) for independent non-negative rewards with E[max⁡iXi]<∞\mathbb E[\max_i X_i] < \inftyE[maxi​Xi​]<∞; the factor 222 cannot be improved.
  • 1984: Samuel-Cahn shows that a single threshold suffices: stopping at the first value above a threshold TTT with Pr⁡[max⁡iXi>T]=12\Pr[\max_i X_i > T] = \tfrac12Pr[maxi​Xi​>T]=21​ (a median of max⁡iXi\max_i X_imaxi​Xi​) already achieves the factor 222 (doi:10.1214/aop/1176993223).
  • 2012: Kleinberg and Weinberg, introducing the matroid prophet inequality, give in §3.1 a second single-threshold rule, with threshold T=E[max⁡iXi]/2T = \mathbb E[\max_i X_i]/2T=E[maxi​Xi​]/2, and a half-page proof that it earns at least TTT. This rule and its analysis are the rank-one case of their matroid algorithm.

This mission formalizes that §3.1 result.

Setting

Let (Ω,F,P)(\Omega, \mathcal F, \mathbb P)(Ω,F,P) be a probability space and n≥1n \ge 1n≥1. Let X1,…,XnX_1, \dots, X_nX1​,…,Xn​ be real random variables on Ω\OmegaΩ that are independent (as a family), non-negative, and such that the prophet's value max⁡iXi\max_i X_imaxi​Xi​ has finite expectation. Define

T=12 E[max⁡iXi],p=Pr⁡[max⁡iXi≥T].T = \tfrac12\,\mathbb E\big[\max_i X_i\big], \qquad p = \Pr\big[\max_i X_i \ge T\big].T=21​E[imax​Xi​],p=Pr[imax​Xi​≥T].

The single-threshold rule observes X1,X2,…X_1, X_2, \dotsX1​,X2​,… in order and stops at the first time τ\tauτ with Xτ≥TX_\tau \ge TXτ​≥T, collecting XτX_\tauXτ​. If no XiX_iXi​ reaches TTT, the rule accepts nothing and collects 000. Write XτX_\tauXτ​ for the amount collected; it equals Xτ(ω)(ω)X_{\tau(\omega)}(\omega)Xτ(ω)​(ω) on the event {max⁡iXi≥T}\{\max_i X_i \ge T\}{maxi​Xi​≥T}, which has probability ppp, and 000 off it.

In Lean the variables are X : Fin n → Ω → ℝ with [NeZero n]; max⁡iXi\max_i X_imaxi​Xi​ is maxX X, TTT is thr P X, ppp is stopProb P X, and XτX_\tauXτ​ is reward P X, all in the namespace MatroidProphetKW.RankOne.

Formalization targets

Goal: the half-mean threshold rule

E[Xτ]  ≥  T  =  12 E[max⁡iXi].\mathbb E[X_\tau] \;\ge\; T \;=\; \tfrac12\,\mathbb E\big[\max_i X_i\big].E[Xτ​]≥T=21​E[imax​Xi​].

This is inequality (1) for an explicit rule, which is stronger than (1)'s existence statement. The constant 12\tfrac1221​ is sharp, so the goal is stated with it.

Milestones (in the order the paper's argument uses them)

  1. Tail bound, for every x>Tx > Tx>T:
Pr⁡[Xτ>x]  ≥  (1−p)∑i=1nPr⁡[Xi>x].\Pr[X_\tau > x] \;\ge\; (1-p)\sum_{i=1}^n \Pr[X_i > x].Pr[Xτ​>x]≥(1−p)i=1∑n​Pr[Xi​>x].
  1. Comparison with the prophet's tail, for every x>Tx > Tx>T:
Pr⁡[Xτ>x]  ≥  (1−p) Pr⁡[max⁡iXi>x].\Pr[X_\tau > x] \;\ge\; (1-p)\,\Pr\big[\max_i X_i > x\big].Pr[Xτ​>x]≥(1−p)Pr[imax​Xi​>x].
  1. The prophet's upper tail:
∫T∞Pr⁡[max⁡iXi>x] dx  ≥  T.\int_T^\infty \Pr\big[\max_i X_i > x\big]\,dx \;\ge\; T.∫T∞​Pr[imax​Xi​>x]dx≥T.
  1. The gambler's lower tail:
∫0TPr⁡[Xτ>x] dx  ≥  pT.\int_0^T \Pr[X_\tau > x]\,dx \;\ge\; pT.∫0T​Pr[Xτ​>x]dx≥pT.

Significance

The result. A threshold that depends on the distributions only through one number, E[max⁡iXi]\mathbb E[\max_i X_i]E[maxi​Xi​], already matches the optimal worst-case guarantee of the best stopping rule. Because it is a single price, the rule translates directly into a posted-price mechanism: a seller who posts the price TTT to arriving buyers obtains half of the expected maximum value. The same accounting, in which accepted value is charged against the threshold and rejected value against the probability of having accepted nothing, is what Kleinberg and Weinberg generalize to matroids (missions 1 and 2 of this series).

Formalizing it. The result is proved and classical; the work here is to formalize its known proof. No machine-checked proof of the factor-2 prophet inequality is in Mathlib, and none was found among the platform's published theorems in October 2026. A completed development provides the inequality itself, the tail comparisons, and the layer-cake bookkeeping for a stopped reward, all of which are reusable for other single-threshold prophet inequalities (Samuel-Cahn's median rule, kkk-choice and posted-price variants).

Difficulty

The expected reward of the rule is not a function of the marginals of the individual XiX_iXi​ alone in an obvious way: the event that the rule is still running when XiX_iXi​ arrives depends on X1,…,Xi−1X_1, \dots, X_{i-1}X1​,…,Xi−1​, and the reward is XτX_\tauXτ​ at a random index. The natural first attempt, comparing XτX_\tauXτ​ and max⁡iXi\max_i X_imaxi​Xi​ pointwise, fails, since on a given outcome the rule may stop early at a value just above TTT while the maximum comes later. The comparison has to be made between distributions, at each level xxx, and it has to use independence to decouple "nothing accepted before time iii" from "Xi>xX_i > xXi​>x". The rest is measure-theoretic bookkeeping that is routine on paper and not routine in Lean: expressing expectations of non-negative variables as integrals of tail probabilities, splitting them at TTT, and keeping track of integrability.

Formalization scope

  • Probability space. Ω with a MeasurableSpace, P : Measure Ω with [IsProbabilityMeasure P].
  • Variables. X : Fin n → Ω → ℝ, [NeZero n]; each X i measurable; iIndepFun X P (mutual independence); 0 ≤ X i ω for all i, ω; Integrable (maxX X) P, which is the paper's E[max⁡iXi]<∞\mathbb E[\max_i X_i] < \inftyE[maxi​Xi​]<∞.
  • Maximum. Finset.sup' over the nonempty index set; no junk supremum.
  • Expectations and probabilities. Bochner integrals (∫ ω, … ∂P) and Measure.real probabilities. Tail integrals are Lebesgue integrals of x↦Pr⁡[⋅>x]x \mapsto \Pr[\cdot > x]x↦Pr[⋅>x] over (T,∞)(T, \infty)(T,∞) and (0,T](0, T](0,T].
  • Weak and strict inequalities are as printed: the rule stops at Xτ≥TX_\tau \ge TXτ​≥T, p=Pr⁡[max⁡iXi≥T]p = \Pr[\max_i X_i \ge T]p=Pr[maxi​Xi​≥T], tails are Pr⁡[⋅>x]\Pr[\cdot > x]Pr[⋅>x], for x>Tx > Tx>T.
  • The rule may accept nothing. The reward is 000 when no value reaches TTT; the rule is not forced to stop at XnX_nXn​.

The threshold TTT is a definition, E[max⁡iXi]/2\mathbb E[\max_i X_i]/2E[maxi​Xi​]/2, not a free parameter constrained by hypotheses; a formalization in which TTT is arbitrary and the upper-tail bound is assumed would make the goal a rearrangement of its hypotheses, and is ruled out.

Infrastructure that a complete development needs, and that is welcome as separate contributions: the layer-cake formula E[Y]=∫0∞Pr⁡[Y>x] dx\mathbb E[Y] = \int_0^\infty \Pr[Y > x]\,dxE[Y]=∫0∞​Pr[Y>x]dx for non-negative integrable YYY split at a level TTT (Mathlib has the unsplit form, MeasureTheory.integral_eq_integral_meas_lt); measurability and integrability of the stopped reward (it is dominated by max⁡iXi\max_i X_imaxi​Xi​); and the probability of the event "the first i−1i-1i−1 values are below TTT and Xi>xX_i > xXi​>x" as a product under iIndepFun.

Selected references

  • Robert Kleinberg and S. Matthew Weinberg, Matroid Prophet Inequalities, STOC 2012, pp. 123–136; preprint arXiv:1201.4764v1, 2012. https://arxiv.org/abs/1201.4764 (doi:10.1145/2213977.2213991)
  • Ulrich Krengel and Louis Sucheston, Semiamarts and finite values, Bulletin of the American Mathematical Society 83, 1977, pp. 745–747.
  • Ulrich Krengel and Louis Sucheston, On semiamarts, amarts, and processes with finite value, Advances in Probability and Related Topics 4, 1978, pp. 197–266.
  • Ester Samuel-Cahn, Comparison of threshold stop rules and maximum for independent nonnegative random variables, Annals of Probability 12(4), 1984, pp. 1213–1216. https://doi.org/10.1214/aop/1176993223
5 thms2 active usersReviewed
Quantum Information·Captain: mikedeng1

Search via Quantum Walk 1: Recursive Amplitude Amplification with Approximate Reflections R(βᵢ), βᵢ = 18γ/(4π³i²), Finds a Marked Element with Probability at Least 1/12 − 3γResearch Paper

Motivation

Grover's algorithm finds a marked element among NNN with O(N)O(\sqrt N)O(N​) queries by alternating two reflections: one about the initial state and one that flips the sign of marked states. In quantum-walk search, the initial state ∣π⟩|\pi\rangle∣π⟩ encodes the stationary distribution of a Markov chain, and the reflection about ∣π⟩|\pi\rangle∣π⟩ is too expensive to implement exactly. Magniez, Nayak, Roland and Santha (arXiv:quant-ph/0608026, SIAM J. Comput. 2011) obtain the reflection approximately, by phase estimation on the quantum walk, and need a search procedure that tolerates the approximation error without paying extra cost to reduce it. Their Section 4 supplies one: a variant of the recursive amplitude amplification (RAA) of Høyer, Mosca and de Wolf (ICALP 2003) in which the reflection about ∣π⟩|\pi\rangle∣π⟩ is replaced, at recursion level iii, by an approximate circuit of precision βi=184π3γ/i2\beta_i=\frac{18}{4\pi^3}\gamma/i^2βi​=4π318​γ/i2. The two lemmas of that section, stated "in full generality for potential further applications" (p. 11), are the exact engine of the paper's headline Theorem 3 (search with cost S+1ε(1δU+C)S+\frac1{\sqrt\varepsilon}(\frac1{\sqrt\delta}U+C)S+ε​1​(δ​1​U+C)).

Timeline: Grover (1996) gives quadratic speedup for unstructured search; Brassard, Høyer, Mosca and Tapp (2002) generalize it to amplitude amplification; Høyer, Mosca and de Wolf (2003) introduce RAA to tolerate a bounded-error marking reflection; Szegedy (2004) defines quantum walks for arbitrary reversible chains with detection guarantees; Magniez, Nayak, Roland and Santha (STOC 2007, SIAM 2011) adapt RAA to an approximate initial-state reflection and obtain search, not only detection, for every reversible ergodic chain.

Setting

Let XXX be a finite set and M⊆XM\subseteq XM⊆X a set of marked elements. The state space is H=CX×X\mathcal H=\mathbb C^{X\times X}H=CX×X. The initial state ∣π⟩∈H|\pi\rangle\in\mathcal H∣π⟩∈H is any unit vector (Lemmas 1 and 2 never use its quantum-walk form), and the marked weight is pM=∥ΠM∣π⟩∥2p_M=\|\Pi_M|\pi\rangle\|^2pM​=∥ΠM​∣π⟩∥2, where ΠM\Pi_MΠM​ projects onto the basis states ∣x⟩∣y⟩|x\rangle|y\rangle∣x⟩∣y⟩ with x∈Mx\in Mx∈M.

For each level i≥1i\ge1i≥1 an extra register KiK_iKi​ (a finite-dimensional space with a basis state ∣0⟩|0\rangle∣0⟩) is given together with a unitary RiR_iRi​ on H⊗Ki\mathcal H\otimes K_iH⊗Ki​, playing the role of R(βi)R(\beta_i)R(βi​):

Ri∣π⟩∣0⟩=∣π⟩∣0⟩,∥(Ri+Id)∣ψ⟩∣0⟩∥≤βi∥ψ∥  whenever ⟨π∣ψ⟩=0.R_i|\pi\rangle|0\rangle=|\pi\rangle|0\rangle,\qquad \|(R_i+\mathrm{Id})|\psi\rangle|0\rangle\|\le\beta_i\|\psi\|\ \text{ whenever }\langle\pi|\psi\rangle=0 .Ri​∣π⟩∣0⟩=∣π⟩∣0⟩,∥(Ri​+Id)∣ψ⟩∣0⟩∥≤βi​∥ψ∥  whenever ⟨π∣ψ⟩=0.

On H⊗K1⊗⋯⊗KT\mathcal H\otimes K_1\otimes\cdots\otimes K_TH⊗K1​⊗⋯⊗KT​ the marked subspace M~\tilde{\mathcal M}M~ consists of states whose first register is marked, and ref(M~⊥)=Id−2ΠM~\mathrm{ref}(\tilde{\mathcal M}^\perp)=\mathrm{Id}-2\Pi_{\tilde M}ref(M~⊥)=Id−2ΠM~​.

Approximate RAA(i,γ)(i,\gamma)(i,γ) is the unitary AiA_iAi​ with A0=IdA_0=\mathrm{Id}A0​=Id and

Ai=Ai−1⋅Oi⋅Ai−1†⋅ref(M~⊥)⋅Ai−1,A_i=A_{i-1}\cdot O_i\cdot A_{i-1}^\dagger\cdot\mathrm{ref}(\tilde{\mathcal M}^\perp)\cdot A_{i-1},Ai​=Ai−1​⋅Oi​⋅Ai−1†​⋅ref(M~⊥)⋅Ai−1​,

where OiO_iOi​ multiplies by −1-1−1 every basis state in which some register KjK_jKj​, j<ij<ij<i, is not ∣0⟩|0\rangle∣0⟩, and otherwise applies RiR_iRi​ to H⊗Ki\mathcal H\otimes K_iH⊗Ki​. Write ∣φi⟩=Ai∣π⟩∣0S⟩|\varphi_i\rangle=A_i|\pi\rangle|0^S\rangle∣φi​⟩=Ai​∣π⟩∣0S⟩ and sin⁡ϕi=∥ΠM~∣φi⟩∥\sin\phi_i=\|\Pi_{\tilde M}|\varphi_i\rangle\|sinϕi​=∥ΠM~​∣φi​⟩∥.

Tolerant RAA(tmax⁡,γ)(t_{\max},\gamma)(tmax​,γ) first samples xxx (succeeding with probability pMp_MpM​); otherwise, for i=1,…,tmax⁡i=1,\dots,t_{\max}i=1,…,tmax​, it applies AiA_iAi​ to the state left over from the previous failed measurement, ∣ψi⟩=Ai∣νi−1⊥⟩|\psi_i\rangle=A_i|\nu^\perp_{i-1}\rangle∣ψi​⟩=Ai​∣νi−1⊥​⟩ with ∣ν0⊥⟩=∣π⟩∣0S⟩|\nu^\perp_0\rangle=|\pi\rangle|0^S\rangle∣ν0⊥​⟩=∣π⟩∣0S⟩, and measures {ΠM~,Id−ΠM~}\{\Pi_{\tilde M},\mathrm{Id}-\Pi_{\tilde M}\}{ΠM~​,Id−ΠM~​}; a failure collapses the state to ∣νi⊥⟩=ΠM~⊥∣ψi⟩/∥ΠM~⊥∣ψi⟩∥|\nu_i^\perp\rangle=\Pi_{\tilde M^\perp}|\psi_i\rangle/\|\Pi_{\tilde M^\perp}|\psi_i\rangle\|∣νi⊥​⟩=ΠM~⊥​∣ψi​⟩/∥ΠM~⊥​∣ψi​⟩∥.

Formalization targets

Goal: Lemma 2 (p. 15)

Let 0<γ≤1/400<\gamma\le1/400<γ≤1/40, let ε>0\varepsilon>0ε>0 satisfy pM≥εp_M\ge\varepsilonpM​≥ε whenever pM>0p_M>0pM​>0, and let tmax⁡t_{\max}tmax​ be the smallest non-negative integer with 3tmax⁡sin⁡−1ε∈[π/4,3π/4]3^{t_{\max}}\sin^{-1}\sqrt\varepsilon\in[\pi/4,3\pi/4]3tmax​sin−1ε​∈[π/4,3π/4]. The probability PsuccP_{\rm succ}Psucc​ that Tolerant RAA(tmax⁡,γ)(t_{\max},\gamma)(tmax​,γ) ends with a marked element satisfies

M=∅⇒Psucc=0,pM>0⇒Psucc≥112−3γ.M=\emptyset\Rightarrow P_{\rm succ}=0,\qquad p_M>0\Rightarrow P_{\rm succ}\ge\frac1{12}-3\gamma .M=∅⇒Psucc​=0,pM​>0⇒Psucc​≥121​−3γ.

Lemma 1 (p. 12)

With ttt the smallest non-negative integer such that 3tsin⁡−1pM∈[π/4,3π/4]3^t\sin^{-1}\sqrt{p_M}\in[\pi/4,3\pi/4]3tsin−1pM​​∈[π/4,3π/4], for every γ>0\gamma>0γ>0,

∥ΠM~At∣π⟩∣0S⟩∥≥12−γ.\|\Pi_{\tilde M}A_t|\pi\rangle|0^S\rangle\|\ge\frac1{\sqrt2}-\gamma .∥ΠM~​At​∣π⟩∣0S⟩∥≥2​1​−γ.

Milestones

In the order of the proofs: Fact 1 (the error operator Ei=Ai−1OiAi−1†−ref(φi−1)E_i=A_{i-1}O_iA_{i-1}^\dagger-\mathrm{ref}(\varphi_{i-1})Ei​=Ai−1​Oi​Ai−1†​−ref(φi−1​) kills ∣φi−1⟩|\varphi_{i-1}\rangle∣φi−1​⟩ and has norm ≤βi\le\beta_i≤βi​ on states with clean registers K≥iK_{\ge i}K≥i​); the one-level bound ∣sin⁡ϕi+1−sin⁡3ϕi∣≤βi+1∣sin⁡2ϕi∣|\sin\phi_{i+1}-\sin3\phi_i|\le\beta_{i+1}|\sin2\phi_i|∣sinϕi+1​−sin3ϕi​∣≤βi+1​∣sin2ϕi​∣; the two trigonometric inequalities on [0,π/4][0,\pi/4][0,π/4]; the surrogate bound e~i≤γϕˉi/π≤γ\tilde e_i\le\gamma\bar\phi_i/\pi\le\gammae~i​≤γϕˉ​i​/π≤γ; Lemma 1; the three terms of the drift recursion (5); and the accumulated drift δt=∥∣ψt⟩−∣φt⟩∥≤π/8+9γ/8\delta_t=\||\psi_t\rangle-|\varphi_t\rangle\|\le\pi/8+9\gamma/8δt​=∥∣ψt​⟩−∣φt​⟩∥≤π/8+9γ/8.

Significance

Lemma 2 turns any family of approximate reflections whose error decays like 1/i21/i^21/i2 into a search procedure that succeeds with constant probability, needs only a lower bound ε\varepsilonε on pMp_MpM​, and costs O(3tmax⁡)=O(1/ε)O(3^{t_{\max}})=O(1/\sqrt\varepsilon)O(3tmax​)=O(1/ε​) calls. Combined with the phase-estimation reflection of the paper's Theorem 6 it yields Theorem 3, the general quantum-walk search theorem that has become the standard tool for walk-based algorithms (element distinctness, triangle finding, group commutativity). Nothing in the lemma refers to Markov chains, so it applies to any setting with an approximate reflection about the initial state.

The results are proved in the paper. None of them is machine-checked: the platform holds a formal Grover search with one marked basis state and exact reflections, but no amplitude amplification with approximate or recursive reflections. A formal proof would also settle the steps the paper passes over quickly, notably that the trigonometric inequalities, claimed for angles in [0,π/4][0,\pi/4][0,π/4], are applied to the actual angles ϕi\phi_iϕi​, which may exceed π/4\pi/4π/4 by O(γ)O(\gamma)O(γ) at the last level.

Difficulty

The ideal analysis (every reflection exact, angle tripled at each level) is a two-dimensional rotation argument. With approximate reflections the state leaves the plane spanned by ∣μ0⟩|\mu_0\rangle∣μ0​⟩ and ∣μ0⊥⟩|\mu_0^\perp\rangle∣μ0⊥​⟩, and each level both triples the error already present and injects a new one; the errors stay bounded only because ∑iβi\sum_i\beta_i∑i​βi​ converges and the injection at level iii is weighted by sin⁡2ϕi\sin2\phi_isin2ϕi​. Fact 1 is not a restatement of the hypothesis on R(β)R(\beta)R(β): it holds only because step 4 flips the phase of states whose earlier registers are dirty, and because Ai−1A_{i-1}Ai−1​ never touches K≥iK_{\ge i}K≥i​. In Lemma 2 the attempts reuse the leftover state, not a fresh ∣π⟩∣0S⟩|\pi\rangle|0^S\rangle∣π⟩∣0S⟩, so the state at the decisive attempt ttt has drifted; bounding the drift needs the normalised unmarked parts ∣μk⊥⟩|\mu_k^\perp\rangle∣μk⊥​⟩ to move little from level to level, which again depends on the error bounds of Lemma 1.

Formalization scope

  • H⊗K1⊗⋯⊗KT\mathcal H\otimes K_1\otimes\cdots\otimes K_TH⊗K1​⊗⋯⊗KT​ is EuclideanSpace ℂ (X × X × ((j : Fin T) → κ (j+1))); operators are complex matrices. Registers are 0-based in Lean (index jjj is Kj+1K_{j+1}Kj+1​).
  • RiR_iRi​ is required only at the precisions βi\beta_iβi​ actually used, which is weaker than the paper's "for any β>0\beta>0β>0". Property 3 is stated in the homogeneous form ≤βi∥ψ∥\le\beta_i\|\psi\|≤βi​∥ψ∥.
  • "Undo" is the conjugate transpose. ttt and tmax⁡t_{\max}tmax​ are explicit naturals with "satisfies the condition and no smaller one does". sin⁡−1\sin^{-1}sin−1 is Real.arcsin; the interval is closed.
  • The success probability of Tolerant RAA is defined from the measurement rule, pM+(1−pM)(1−∏i=1tmax⁡(1−∥ΠM~∣ψi⟩∥2))p_M+(1-p_M)\big(1-\prod_{i=1}^{t_{\max}}(1-\|\Pi_{\tilde M}|\psi_i\rangle\|^2)\big)pM​+(1−pM​)(1−∏i=1tmax​​(1−∥ΠM~​∣ψi​⟩∥2)), with post-measurement states computed from the actual ∣ψi⟩|\psi_i\rangle∣ψi​⟩; registers are not reset. The classical sample succeeds with probability ∥ΠM∣π⟩∥2\|\Pi_M|\pi\rangle\|^2∥ΠM​∣π⟩∥2, which is ∑x∈Mπx\sum_{x\in M}\pi_x∑x∈M​πx​ in the paper's walk setting.
  • "MMM non-empty" in Lemma 2 is read as pM>0p_M>0pM​>0, as in the paper's proof. Edge-case hypotheses: ∥π∥=1\|\pi\|=1∥π∥=1; ϕi≤π/3\phi_i\le\pi/3ϕi​≤π/3 in the one-level bound (so sin⁡3ϕi≥0\sin3\phi_i\ge0sin3ϕi​≥0); pM<1p_M<1pM​<1 in the last drift term; 1≤i<t1\le i<t1≤i<t and T≥tT\ge tT≥t in the drift bounds.
  • Cost is not formalized: property 1 of R(β)R(\beta)R(β), the cost c2c_2c2​ of −ref(M)-\mathrm{ref}(M)−ref(M) and every "incurs a cost of order" clause are out of scope. The data-structure subscript ddd is omitted, as in the paper's own error analysis.
  • A formalization in which step 4 applies an exact reflection about ∣π⟩|\pi\rangle∣π⟩ or ∣φi−1⟩|\varphi_{i-1}\rangle∣φi−1​⟩, or in which the success probability is computed from ideal angles instead of the actual states, would make the lemmas statements about exact RAA; the definitions apply the given RiR_iRi​ and measure the actual states.

Contributions welcome: proofs of the trigonometric milestones and of e~i≤γϕˉi/π\tilde e_i\le\gamma\bar\phi_i/\pie~i​≤γϕˉ​i​/π (pure real analysis), Fact 1 (finite-dimensional linear algebra with a block structure on registers), and the vector inequality ∥u/∥u∥−v/∥v∥∥≤2∥u−v∥/∥v∥\|u/\|u\|-v/\|v\|\|\le2\|u-v\|/\|v\|∥u/∥u∥−v/∥v∥∥≤2∥u−v∥/∥v∥ that the drift bounds share. The register and controlled-unitary infrastructure is reusable for other recursive quantum algorithms.

Selected references

  • F. Magniez, A. Nayak, J. Roland, M. Santha, Search via Quantum Walk, SIAM J. Comput. 40(1), 2011; arXiv:quant-ph/0608026v4. https://arxiv.org/abs/quant-ph/0608026
  • P. Høyer, M. Mosca, R. de Wolf, Quantum search on bounded-error inputs, ICALP 2003. https://arxiv.org/abs/quant-ph/0304052
  • G. Brassard, P. Høyer, M. Mosca, A. Tapp, Quantum amplitude amplification and estimation, Contemp. Math. 305, 2002. https://arxiv.org/abs/quant-ph/0005055
  • L. K. Grover, A fast quantum mechanical algorithm for database search, STOC 1996. https://arxiv.org/abs/quant-ph/9605043
  • M. Szegedy, Quantum speed-up of Markov chain based algorithms, FOCS 2004. https://doi.org/10.1109/FOCS.2004.53
14 thms2 active usersReviewed
🏆Completed
Harmonic Analysis·Captain: marwahaha

Unbounded Violations of the Square-Root Degree BoundOpen Problem

Motivation

The linear Fourier coefficients measure a Boolean function’s correlation with individual inputs. The source studies whether their sum can be controlled solely by the square root of the function’s real polynomial degree. The source is OpenAI's September 2026 manuscript.

Setting

A Boolean function here takes values in {−1,1}\{-1,1\}{−1,1} on a finite sign cube. Fourier coefficients use the uniform distribution. The Fourier degree is the largest support size of a nonzero coefficient; it is unrelated to degree over a field of characteristic two.

Formalization targets

∀C>0 ∃f:∑if^({i})>Cdeg⁡f,{∑i∣f^({i})∣deg⁡f:deg⁡f>0} is unbounded above.\forall C>0\ \exists f:\quad\sum_i\widehat f(\{i\})>C\sqrt{\deg f},\qquad \left\{\frac{\sum_i|\widehat f(\{i\})|}{\sqrt{\deg f}}:\deg f>0\right\}\text{ is unbounded above}.∀C>0 ∃f:i∑​f​({i})>Cdegf​,{degf​∑i​∣f​({i})∣​:degf>0} is unbounded above.

Two things about real Fourier analysis on Boolean cubes, where a Boolean input is read as a sign (false is +1, true is -1), averages are uniform, and degree is the ordinary real Fourier degree, meaning the largest size of a subset s with nonzero Fourier coefficient, the coefficient being the average of f(x) times the product of the signs of the coordinates in s. First, SignedViolations holds: for every real C>0 there is a positive integer n and a function f from {false,true}^n to the reals that takes only the values -1 and 1, is nonconstant, and satisfies C·√(deg f) < Σᵢ f̂({i}), the plain signed sum of its degree-one Fourier coefficients over single coordinates. Second, the set of ratios (Σᵢ |f̂({i})|)/√(deg f), taken over all positive n and all Boolean-valued f on n coordinates with positive Fourier degree, is not bounded above in the reals, so the supremum of these ratios is infinite.

The goal is OAI.SquareRootDegree.main.

Significance

Both signed violations and unbounded absolute ratios are retained. The result concerns failure of every constant multiple, which is stronger than exhibiting one violation of a proposed constant-one inequality. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

A large ambient dimension is not itself a violation: the denominator depends on degree. The function must remain Boolean and nonconstant while its linear coefficient sum outgrows that denominator.

Formalization scope

Inputs are Fin n → Bool, with false interpreted as +1+1+1 and true as −1-1−1. The first clause requires positive dimension and a nonconstant function. The second restricts to positive Fourier degree and uses ¬ BddAbove, avoiding a real-valued infinity convention.

The shared definitions are supplied by SquareRootDegree. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, Unbounded Violations of the Square-Root Degree Bound, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
33 thms2 active usersReviewed
🏆Completed
Captain: marwahaha

An exponential state lower bound for two-way nondeterministic complementationOpen Problem

Motivation

Allowing a finite automaton to move its head in both directions complicates the state cost of language complement. A lower bound independent of alphabet size must handle alphabets that grow with the witness. The source manuscript presents the surrounding research claim.

Setting

A two-way nondeterministic automaton has a finite state set, two endmarkers and left/stay/right moves. Acceptance is the existence of a finite run reaching an accepting state. The witness alphabet consists of relations on Fin(n−2), and its language tests whether their ordered product is nonempty.

Formalization target

For every n≥4, construct one n-state witness A for that language such that every complement automaton B satisfies

∣QB∣≥12 2⌊(n−4)/127⌋−1.|Q_B|\ge\frac12\,2^{\lfloor(n-4)/127\rfloor}-1.∣QB​∣≥21​2⌊(n−4)/127⌋−1.

For n≥131, every deterministic automaton for the same language must satisfy the corresponding bound without the minus one.

The selected formal target is OAI.TwoWayComplementation.explicit_family_main.

Significance and status

Both bounds concern the same explicit-language witness. The goal includes determinization as well as complementation, while the companion target isolates the complement bound. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

The lower bound ranges over every finite state type and every competing automaton. Producing one inefficient complement construction would not establish it.

Formalization scope

Natural-number subtraction and division determine the exponent. Runs start on the left endmarker and may have length zero. Tape positions remain inside the marked input. The relation alphabet is finite but grows with n. Source groups redeclaring the automaton model remain independent.

Selected references

  • OpenAI, An exponential state lower bound for two-way nondeterministic complementation, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
51 thms2 active usersReviewed
🏆Completed
Analysis·Captain: marwahaha

Average sensitivity of polynomial threshold functionsOpen Problem

Motivation

Average sensitivity measures how often a Boolean decision changes after one coordinate flip. For polynomial threshold rules, a degree-sensitive estimate limits the total influence of all coordinates. The source manuscript presents the surrounding research claim.

Setting

A polynomial threshold function evaluates a real multilinear polynomial p on the uniform cube {−1,1}ⁿ, then applies sign with sign(0)=1. Average sensitivity is the sum, over coordinates, of the fraction of cube vertices whose output changes under that flip.

Formalization target

For n≥1 and 1≤d≤n, prove

AS⁡(sign⁡p)≤8dn\operatorname{AS}(\operatorname{sign}p)\le8d\sqrt nAS(signp)≤8dn​

for every multilinear p of total degree at most d.

The selected formal target is OAI.LeanBlast.GotsmanLinial.gotsmanLinialStatement.

Significance and status

The constant is uniform in both dimension and degree. The formal target is the asymptotic Gotsman–Linial estimate with its explicit coefficient eight. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

A separate estimate for fixed degree would not establish the bound uniformly as d varies with n. Zeros of p on the cube must respect the specified tie convention.

Formalization scope

The cube is Fin n→Bool and coordinates are converted to ±1. Multilinearity is a support predicate on Mathlib multivariate polynomials, and the degree condition is explicit. General polynomial reduction to multilinear form is not an additional attached theorem.

Selected references

  • OpenAI, Average sensitivity of polynomial threshold functions, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
20 thms2 active usersReviewed
Optimization·Captain: marwahaha

Additive hardness and unbounded configuration gaps in bin packingOpen Problem

Motivation

Configuration linear programs relax bin packing by allowing fractional combinations of feasible bins. The mission asks whether the integral optimum can stay within any universal additive constant of this relaxation. The source manuscript presents the surrounding research claim.

Setting

A bin-packing instance lists rational item sizes in (0,1]. Feasible bins have total load at most one. The formal development specifies both an individual-item configuration LP and a type-based configuration LP, plus binary encodings of instances, assignments and reductions.

Formalization target

For every natural c, construct I and B with 5B items of sizes strictly between 1/6 and 1 such that

LP⁡individual(I)=LP⁡type(I)=B,OPT⁡(I)>B+c.\operatorname{LP}_{individual}(I)=\operatorname{LP}_{type}(I)=B,\qquad\operatorname{OPT}(I)>B+c.LPindividual​(I)=LPtype​(I)=B,OPT(I)>B+c.

Also prove NP-hardness of every fixed additive packing gap, existence of a polynomial-time absolute-additive algorithm iff P=NP, and the specified exact algorithm consequences under P=NP.

The selected formal target is OAI.BinPackingGap.main_results.

Significance and status

The goal combines unbounded relaxation gaps with a complexity characterization of constant-additive approximation. Item sizes above 1/6 force every bin to hold at most five items. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

A large LP gap does not by itself supply NP-hardness. The reduction must have the stated completeness and soundness while preserving the explicit encoding and item-size constraints.

Formalization scope

Reductions are finite-alphabet polynomial-time machines from every encoded NP language. The P=NP consequence includes exact optimal bin count, the canonical empty-instance answer and rejection of malformed or invalid input. All clauses of main_results are retained.

Selected references

  • OpenAI, Additive hardness and unbounded configuration gaps in bin packing, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
6 thms2 active usersReviewed
Algorithmic Game Theory·Captain: marwahaha

Randomized quasipolynomial-time mean-payoff gamesOpen Problem

Motivation

Mean-payoff games ask which starting positions allow a player to guarantee a nonnegative long-run average reward. Binary-encoded weights make the bit cost of solving the complete winning set a central part of the question. The source manuscript presents the surrounding research claim.

Setting

A game is a finite nonempty directed multigraph with integer edge weights, an owner for each vertex and an outgoing edge everywhere. Winning means that a history-dependent maximizer strategy guarantees liminf average payoff at least zero against every opponent strategy.

Formalization target

Construct one randomized three-tape machine and C>0 such that every encoded game of length L has a time bound

T≤2C(log⁡2(L+2))2,T\le2^{C(\log_2(L+2))^2},T≤2C(log2​(L+2))2,

all T-bit random tapes halt by T, and at least 7/8 of them output the exact winning-set indicator, with all other output cells blank.

The selected formal target is OAI.randomized_quasipolynomial_mean_payoff.

Significance and status

The target makes the input encoding, computation model, success fraction and complete output explicit. It is an existence theorem for a uniform machine, not a separate solver for each game. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

The running time must hold on every random tape, while correctness holds on the specified fraction. Signed weights and the full binary input length cannot be replaced by unary magnitude bounds.

Formalization scope

The published definitions specify games, strategies, plays, liminf payoffs, serialization and tape transitions. The independent finite Truffet elimination counterexample is retained as contextual reference; it is not a prerequisite or an asserted proof of the randomized algorithm. The manuscript’s certification/always-correct consequence is not an additional attached goal.

Selected references

  • OpenAI, Randomized quasipolynomial-time mean-payoff games, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
4 thms2 active usersReviewed
Analysis·Captain: marwahaha

Tree Constructions for the l1 Distortion of Binary Edit DistanceOpen Problem

Motivation

Embedding edit distance into ℓ₁ would permit algorithms and geometric tools for that normed space. Distortion lower bounds quantify the loss any such representation must incur. The source manuscript presents the surrounding research claim.

Setting

Edit distance is the least number of unit insertions, deletions and substitutions, with unrestricted intermediate word lengths. For a finite equal-length binary set W, c₁(W) is the infimum over all injective maps into the full real sequence space ℓ₁ of the product of the two worst distance ratios.

Formalization target

Find an absolute c>0 and d₀ such that for every d≥d₀ there are 1≤n≤d and at least two binary words of length n with

c1(W)≥exp⁡ ⁣(clog⁡d log⁡log⁡d).c_1(W)\ge\exp\!\left(c\sqrt{\log d\,\log\log d}\right).c1​(W)≥exp(clogdloglogd​).

The selected formal target is OAI.TreeEdit.binary_lower_bound.

Significance and status

The witness exists for every sufficiently large length cap. The target bounds distortion against every injective ℓ₁ embedding, not only a particular algorithm. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

A bad map is not a lower bound for the infimum over all maps. The finite family must force distortion uniformly while preserving its common binary word length.

Formalization scope

The chosen target uses Word Bool n and Finset witnesses. A companion binary_torus formulation is retained as a reference to the same lower-bound endpoint. Its independent source group repeats edit-distance declarations and is not combined into one import. No companion upper embedding theorem is attached.

Selected references

  • OpenAI, Tree Constructions for the l1 Distortion of Binary Edit Distance, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
27 thms2 active usersReviewed
🏆Completed
Complexity TheoryQuantum Information·Captain: wurtle

Product-projection localization and the QAC0 parity lower boundResearch Paper

Motivation

Parity, PARITYn(x)=x1⊕⋯⊕xn\mathrm{PARITY}_n(x)=x_1\oplus\cdots\oplus x_nPARITYn​(x)=x1​⊕⋯⊕xn​, is the standard test of whether a shallow circuit can aggregate information from all of its inputs. Classically, constant-depth circuits with unbounded fan-in AND/OR gates (AC0\mathsf{AC}^0AC0) cannot compute it: Furst, Saxe and Sipser (Math. Systems Theory 1984) and Ajtai (APAL 1983) proved superpolynomial lower bounds, and Håstad's switching lemma gave nearly optimal exponential ones (STOC 1986). The quantum analogue QAC0\mathsf{QAC}^0QAC0 allows arbitrary one-qubit unitaries and Toffoli gates of unbounded arity, but gates in one layer must act on disjoint qubits, so a wire cannot control many simultaneous gates. Moore (arXiv:quant-ph/9903046, 1999) showed that coherent parity and quantum fanout are equivalent under Hadamard conjugation, and conjectured that neither is in QAC0\mathsf{QAC}^0QAC0. Because fanout makes constant-depth quantum circuits very powerful (Høyer–Špalek, ToC 2005), whether PARITY∉QAC0\mathrm{PARITY}\notin\mathsf{QAC}^0PARITY∈/QAC0 has been a central question about shallow quantum computation.

Background

  • 1999 — Moore introduces the quantum circuit classes and the parity/fanout conjecture.
  • 2002 — Green, Homer, Moore and Pollett develop quantum counting classes and modular-gate equivalences (QIC 2002).
  • 2006 — Fang, Fenner, Green, Homer and Zhang: depth Ω(log⁡(n/(a+1)))\Omega(\log(n/(a+1)))Ω(log(n/(a+1))) for exact clean parity with aaa ancillas (QIC 2006).
  • 2020–2021 — Padé, Fenner, Grier and Thierauf rule out exact clean parity at entangling depth two (arXiv:2005.12169); Rosenthal bounds approximate parity unitaries (ITCS 2021).
  • 2024–2025 — Pauli-spectrum lower bounds with restricted ancillas (Nadimpalli, Parham, Vasconcelos, Yuen, STOC 2024); no fixed parity advantage with barely superlinear ancillas (Anshu, Dong, Ou, Yao, STOC 2025), extended by Dong, Ou and Yao (arXiv:2510.00593).
  • 2026 — Joshi, Tal, Vasconcelos and Wright: exact parity lower bounds at entangling depth three without size restriction (STOC 2026); Gretta, Gupta and Joshi relate the question to Fourier concentration (arXiv:2604.02793).
  • September 2026 — Two OpenAI preprints claim the lower bound for every fixed depth and every polynomial number of qubits, by independent arguments: product-projection localization (source) and regular trajectories with pruning (source).

This mission asks for a formal proof of the parity lower bound stated as Theorem 1 of an OpenAI preprint dated September 24, 2026 (source). The preprint has not been peer reviewed and its claims have not been independently verified; on the platform the Lean goal is open.

Setting

A circuit acts on NNN qubits, with state space (C2)⊗N(\mathbb C^2)^{\otimes N}(C2)⊗N and computational basis indexed by bit strings y∈{0,1}Ny\in\{0,1\}^Ny∈{0,1}N. The allowed gates are arbitrary one-qubit unitaries and generalized Toffoli gates ∣z1,…,zt,b⟩↦∣z1,…,zt,b⊕z1⋯zt⟩|z_1,\dots,z_t,b\rangle\mapsto|z_1,\dots,z_t,b\oplus z_1\cdots z_t\rangle∣z1​,…,zt​,b⟩↦∣z1​,…,zt​,b⊕z1​⋯zt​⟩ on distinct control and target qubits. A layer is a set of gates with pairwise disjoint supports, and a depth-ddd circuit is a product W=Ld⋯L1W=L_d\cdots L_1W=Ld​⋯L1​ of at most ddd layers. Gates and their complex entries may depend on nnn but not on the input.

On input x∈{0,1}nx\in\{0,1\}^nx∈{0,1}n with n≤Nn\le Nn≤N, the circuit starts in ∣x⟩⊗∣0⟩⊗(N−n)|x\rangle\otimes|0\rangle^{\otimes(N-n)}∣x⟩⊗∣0⟩⊗(N−n). One designated output qubit is measured in the computational basis; all other qubits are discarded in arbitrary states, and the input need not be preserved. The success probability on xxx is

Pr⁡[output=PARITYn(x)]=∑y: yout=PARITYn(x)∣⟨y∣W∣x,0⟩∣2.\Pr[\text{output}=\mathrm{PARITY}_n(x)]=\sum_{y:\ y_{\mathrm{out}}=\mathrm{PARITY}_n(x)}\bigl|\langle y|W|x,0\rangle\bigr|^2 .Pr[output=PARITYn​(x)]=y: yout​=PARITYn​(x)∑​​⟨y∣W∣x,0⟩​2.

A circuit computes parity with worst-case advantage ε\varepsilonε if this probability is at least 1/2+ε1/2+\varepsilon1/2+ε for every xxx.

Formalization targets

Goal: the parity lower bound (Theorem 1, p. 1)

Fix an integer d≥0d\ge0d≥0, a real c≥1c\ge1c≥1 and 0<ε≤1/20<\varepsilon\le1/20<ε≤1/2. Then for all sufficiently large nnn, for every NNN with n≤N≤ncn\le N\le n^cn≤N≤nc, every circuit of depth at most ddd on NNN qubits and every choice of output qubit, there is an input x∈{0,1}nx\in\{0,1\}^nx∈{0,1}n with

Pr⁡[output=PARITYn(x)]<12+ε.\Pr[\text{output}=\mathrm{PARITY}_n(x)]<\tfrac12+\varepsilon .Pr[output=PARITYn​(x)]<21​+ε.

With ε=1/6\varepsilon=1/6ε=1/6 this is the usual bounded-error statement PARITY∉QAC0\mathrm{PARITY}\notin\mathsf{QAC}^0PARITY∈/QAC0 in the measured-output model.

Significance

The result itself. It answers Moore's question for every fixed depth and every polynomial bound on the total number of qubits, with arbitrary final garbage and any fixed positive advantage, whereas earlier results fixed the entangling depth or restricted the number of ancillas. Through Hadamard conjugation it also excludes constant-depth polynomial-size coherent fanout. The preprint derives further consequences (Section 7): state-preparation obstructions (Corollary 8, p. 14), a qualitative quantum LMN-type Fourier tail bound (Corollary 9, p. 16), and, via reductions of Xu and Li, lower bounds for majority and other symmetric functions (Corollaries 10–11, pp. 17–18). The structural Theorem 2 (p. 5), localization of conjugated product projections, is of independent interest.

Formalizing it. The statement is elementary (finite matrices, Born probabilities) while the proof is a two-level induction with polynomial approximation, so a formal proof would give a fully checked circuit lower bound in quantum complexity, an area with few machine-checked results. A companion OpenAI preprint gives an independent proof by regular trajectories and pruning.

Difficulty

Light-cone arguments fail at once: a single Toffoli gate may touch every qubit, so after one layer an output can depend on all inputs. Spectral and Pauli-weight methods previously needed ancilla bounds such as O~(n1+2−d)\tilde O(n^{1+2^{-d}})O~(n1+2−d). The preprint's route controls transitions from a product condition to states with many mismatches, ∥[M≥Nt] U [D=0] U† [M=0]∥≤e−Ns\bigl\|[M\ge N^t]\,U\,[D=0]\,U^\dagger\,[M=0]\bigr\|\le e^{-N^s}​[M≥Nt]U[D=0]U†[M=0]​≤e−Ns for all fixed 0≤s<t0\le s<t0≤s<t (Theorem 2, p. 5). The obstacle is that reflection expansions cost exponentially in the projection's support, and low-degree polynomial surrogates for a product projection are accurate only at low mismatch counts; the uncontrolled high-count error is handled by a second induction on thresholds that exchanges the roles of the two counts.

Formalization scope

  • Word N := Fin N → Fin 2; operators are complex matrices indexed by words. Gate.local q u is a one-qubit unitary tensored with identities; Gate.toffoli controls target is the permutation matrix flipping the target when all controls are 111 (an empty control set gives a NOT gate, itself a one-qubit unitary).
  • PhysicalLayer N is a list of gates whose supports are pairwise disjoint; its matrix is the product of the gate matrices. physicalCircuitMatrix layers applies the layers in list order (rightmost matrix acts first).
  • inputWord x pads xxx with zeros; successProbability W out x sums ∣Wy,(x,0)∣2|W_{y,(x,0)}|^2∣Wy,(x,0)​∣2 over all yyy whose output bit equals the parity of xxx, so final garbage is unrestricted.
  • The output qubit out : Fin N is arbitrary, including an input qubit. The quantifier order is: depth, size bound and advantage fixed first; then a threshold n0n_0n0​; then every n≥n0n\ge n_0n≥n0​, every NNN in range, every circuit and every output qubit.
  • No intermediate measurement, postselection or fanout gate is in the model; the statement is a pure statement about unitary matrices, with no complexity-class machinery.
  • ParityStatement takes the size bound as a real exponent: N≤ncN\le n^cN≤nc with c≥1c\ge1c≥1 real, n≤Nn\le Nn≤N, and depth layers.length ≤ d with d≥0d\ge0d≥0, exactly as in Theorem 1. Its conclusion is the negation of "for every xxx, success ≥1/2+ε\ge 1/2+\varepsilon≥1/2+ε".

Welcome contributions: a reusable Lean model of unitary circuits on qubits, spectral projections of commuting count operators, and Chebyshev-type polynomial approximation with coefficient bounds (Lemma 3, p. 6).

Selected references

  • OpenAI, Product-projection localization and the QAC0 parity lower bound, OpenAI Math Release preprint, September 24, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Product-projection-localization-and-the-QAC0-parity-lower-bound-September-24-2026/paper.pdf
  • OpenAI, Regular trajectories, pruning and quantum parity, OpenAI Math Release preprint, September 24, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Regular-trajectories-pruning-and-quantum-parity-September-24-2026/paper.pdf
  • C. Moore, Quantum circuits: fanout, parity, and counting, arXiv:quant-ph/9903046 (1999). https://arxiv.org/abs/quant-ph/9903046v3
  • M. Furst, J. B. Saxe, M. Sipser, Parity, circuits, and the polynomial-time hierarchy, Math. Systems Theory 17 (1984), 13–27. https://doi.org/10.1007/BF01744431
  • M. Ajtai, Σ11\Sigma^1_1Σ11​-formulae on finite structures, Ann. Pure Appl. Logic 24 (1983), 1–48. https://doi.org/10.1016/0168-0072(83)90038-6
  • J. Håstad, Almost optimal lower bounds for small depth circuits, STOC 1986. https://doi.org/10.1145/12130.12132
  • F. Green, S. Homer, C. Moore, C. Pollett, Counting, fanout and the complexity of quantum ACC, QIC 2 (2002). https://doi.org/10.26421/QIC2.1-3
  • P. Høyer, R. Špalek, Quantum fan-out is powerful, Theory of Computing 1 (2005). https://doi.org/10.4086/toc.2005.v001a005
  • M. Fang, S. Fenner, F. Green, S. Homer, Y. Zhang, Quantum lower bounds for fanout, QIC 6 (2006). https://doi.org/10.26421/QIC6.1-3
  • G. Rosenthal, Bounds on the QAC0 complexity of approximating parity, ITCS 2021. https://doi.org/10.4230/LIPIcs.ITCS.2021.32
  • S. Nadimpalli, N. Parham, F. Vasconcelos, H. Yuen, On the Pauli spectrum of QAC0, STOC 2024. https://doi.org/10.1145/3618260.3649662
  • M. R. Joshi, A. Tal, F. Vasconcelos, J. Wright, Improved lower bounds for QAC0, STOC 2026. https://doi.org/10.1145/3798129.3800922
  • L. Gretta, M. Gupta, M. R. Joshi, Parity ∉ QAC0 ⟺ QAC0 is Fourier-concentrated, arXiv:2604.02793 (2026). https://arxiv.org/abs/2604.02793v2
32 thms2 active usersReviewed
🏆Completed
CombinatoricsProbability·Captain: wurtle

Variance of the Random k-SAT Hitting TimeResearch Paper

Motivation

Add random clauses one at a time to a Boolean formula on nnn variables until it first becomes unsatisfiable. The index HnH_nHn​ of that first failure is the satisfiability hitting time of random kkk-SAT. Its mean, divided by nnn, converges to the satisfiability threshold; its variance measures the width of the transition window. Friedgut's sharp-threshold theorem shows the window is o(n)o(n)o(n), but quantitative widths have remained far from the n\sqrt nn​ scale suggested by lower bounds. This mission asks for the order of the variance of HnH_nHn​ for every fixed k≥3k\ge3k≥3.

Timeline

  • 1981. Efron and Stein prove their variance inequality, the basic tool for fluctuation bounds of functions of independent inputs (doi:10.1214/aos/1176345462).
  • 1999. Friedgut, with an appendix by Bourgain, proves a sharp threshold sequence for each fixed kkk (doi:10.1090/S0894-0347-99-00305-7).
  • 2002. Wilson proves an Ωk(n)\Omega_k(\sqrt n)Ωk​(n​) separation of central quantiles for the proper-clause model (doi:10.1002/rsa.10050).
  • 2005. Boucheron, Bousquet, Lugosi and Massart give moment inequalities for functions of independent variables (doi:10.1214/009117904000000856).
  • 2022. Ding, Sly and Sun prove the satisfiability conjecture for large kkk (doi:10.4007/annals.2022.196.1.1).
  • 2026. Carenini proves an Ok,η(n/log⁡n)O_{k,\eta}(n/\log n)Ok,η​(n/logn) window (ECCC TR26-145, arXiv:2609.26222) and then a polynomial window Ok,η(n1/2+1/k)O_{k,\eta}(n^{1/2+1/k})Ok,η​(n1/2+1/k) with variance Ok(n1+2/k)O_k(n^{1+2/k})Ok​(n1+2/k), resolving the satisfiability conjecture for every fixed k≥3k\ge3k≥3 (ECCC TR26-229, made public October 5, 2026); priority for that resolution belongs to Carenini. A companion OpenAI preprint gives an alternative proof of the limiting threshold.

The source of this mission is an OpenAI preprint dated September 27, 2026.

Setting

Fix k≥3k\ge3k≥3 and n≥kn\ge kn≥k. A proper kkk-clause is an OR of literals on kkk distinct variables; let C1,C2,…C_1,C_2,\dotsC1​,C2​,… be independent uniform choices among the 2k(nk)2^k\binom nk2k(kn​) signed proper clauses (signs fair, whole clauses may repeat). Put

Fm=C1∧⋯∧Cm,F0=true,Hn=min⁡{m≥1: Fm unsatisfiable},F_m=C_1\wedge\dots\wedge C_m,\qquad F_0=\text{true},\qquad H_n=\min\{m\ge1:\ F_m\ \text{unsatisfiable}\},Fm​=C1​∧⋯∧Cm​,F0​=true,Hn​=min{m≥1: Fm​ unsatisfiable},

and, for fixed B>0B>0B>0, the capped hitting time Tn,B=min⁡{Hn,⌊Bn⌋}T_{n,B}=\min\{H_n,\lfloor Bn\rfloor\}Tn,B​=min{Hn​,⌊Bn⌋}. Since each assignment survives a clause with probability 1−2−k1-2^{-k}1−2−k, HnH_nHn​ is a.s. finite with all moments. Write

ℓk(n)={log⁡(en),k=3,1,k≥4,Uk=log⁡2−log⁡(1−2−k).\ell_k(n)=\begin{cases}\log(en),&k=3,\\1,&k\ge4,\end{cases}\qquad U_k=\frac{\log2}{-\log(1-2^{-k})}.ℓk​(n)={log(en),1,​k=3,k≥4,​Uk​=−log(1−2−k)log2​.

Formalization targets

Goal: Theorem 1.1

There are constants Ck,ck>0C_k,c_k>0Ck​,ck​>0 with

Var⁡(Hn)≤Ck n ℓk(n)(n≥k),Var⁡(Hn)≥ckn(n large),\operatorname{Var}(H_n)\le C_k\,n\,\ell_k(n)\quad(n\ge k),\qquad \operatorname{Var}(H_n)\ge c_kn\quad(n\ \text{large}),Var(Hn​)≤Ck​nℓk​(n)(n≥k),Var(Hn​)≥ck​n(n large),

and for every fixed B>0B>0B>0 a constant Ck,BC_{k,B}Ck,B​ with Var⁡(Tn,B)≤Ck,B n ℓk(n)\operatorname{Var}(T_{n,B})\le C_{k,B}\,n\,\ell_k(n)Var(Tn,B​)≤Ck,B​nℓk​(n); if B>UkB>U_kB>Uk​ then also Var⁡(Tn,B)≥ckn\operatorname{Var}(T_{n,B})\ge c_knVar(Tn,B​)≥ck​n for large nnn. Hence Var⁡(Hn)=Θk(n)\operatorname{Var}(H_n)=\Theta_k(n)Var(Hn​)=Θk​(n) for k≥4k\ge4k≥4. Lean: OAI.RandomKSAT.variance_main, open on the platform.

Milestone: Propositions A.1–A.2 (optimality of exponents)

The killing-probability exponent β=k/(k−1)\beta=k/(k-1)β=k/(k−1) in the lifetime bound τk(S)qd(S)β≤Ckdβ\tau_k(S)q_d(S)^\beta\le C_kd^\betaτk​(S)qd​(S)β≤Ck​dβ (Proposition 2.3) cannot be decreased, and the block-error term g−(k−1)g^{-(k-1)}g−(k−1) in the replacement lemma cannot be improved to o(g−(k−1))o(g^{-(k-1)})o(g−(k−1)) uniformly. Lean: OAI.RandomKSAT.sharpness.

Significance

For k≥4k\ge4k≥4 the theorem determines the variance of the hitting time up to constants, so the transition window has width Θk(n)\Theta_k(\sqrt n)Θk​(n​) in the variance sense, matching Wilson's lower bound and improving Carenini's Ok(n1+2/k)O_k(n^{1+2/k})Ok​(n1+2/k) variance bound. For k=3k=3k=3 it leaves only a logarithmic gap, closed in a companion OpenAI preprint. Chebyshev's inequality then gives concentration of HnH_nHn​ about EHn\mathbb EH_nEHn​ at scale nℓk(n)\sqrt{n\ell_k(n)}nℓk​(n)​.

The results are proved in an OpenAI preprint; they have not been peer reviewed, and no machine-checked proof exists.

Difficulty

The Efron–Stein inequality reduces the upper bound to the expected squared delay caused by deleting one clause, which counts pairs of prefixes at which that clause is pivotal. Controlling this occupation time requires a uniform estimate relating how quickly a set of assignments is killed by shorter (k−1)(k-1)(k−1)-clauses to its lifetime under kkk-clauses, valid for every assignment set with no lower cutoff. Earlier arguments truncate the number of clauses incident to the deleted clause's variables at a logarithmic level, which costs a logarithm; keeping that number as a random parameter without destroying independence is the main obstacle. Appendix A shows the relevant exponents are sharp.

Formalization scope

  • Clause n k is a dependent pair of a kkk-element Finset (Fin n) and a sign vector on it; clauseLaw is uniform; streamLaw is the infinite product (Measure.infinitePi).
  • firstFailure ω is the least mmm with an unsatisfiable prefix, valued in ℕ∞; H = (firstFailure ω).toNat; T B ω = (min (firstFailure ω) ⌊Bn⌋).toNat. The infinite case has probability zero.
  • variance is ProbabilityTheory.variance under streamLaw n k; ell, U are as displayed.
  • In the milestone, blockKill u s S g is the probability that ggg independent proper sss-clauses kill SSS, and lifetime u k S =∑mP(S survives m clauses)=\sum_m\mathbb P(S\text{ survives }m\text{ clauses})=∑m​P(S survives m clauses) is τk(S)\tau_k(S)τk​(S).

Infrastructure: product measures on clause streams, Efron–Stein, conditioning on incidence patterns. Formalizations of Proposition 2.3 (lifetime from shorter-clause killing), Proposition 4.3 (conditional squared delay), Corollary 5.2 and Proposition 6.2 (linear variance lower bound) are welcome.

Selected references

  • OpenAI, Variance of the Random k-SAT Hitting Time, preprint, September 27, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Variance-of-the-Random-k-SAT-Hitting-Time-September-27-2026/article.pdf
  • OpenAI, A Limiting Satisfiability Threshold for Every Fixed Clause Size, preprint, September 25, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/A-Limiting-Satisfiability-Threshold-for-Every-Fixed-Clause-Size-September-25-2026/article.pdf
  • G. Carenini, A polynomial scaling window for random k-SAT and a proof of the satisfiability conjecture, ECCC TR26-229, 2026. https://eccc.weizmann.ac.il/report/2026/229/
  • G. Carenini, The scaling window of random k-SAT, ECCC TR26-145, 2026. https://arxiv.org/abs/2609.26222
  • E. Friedgut (appendix by J. Bourgain), Sharp thresholds of graph properties, and the k-SAT problem, J. Amer. Math. Soc., 1999. https://doi.org/10.1090/S0894-0347-99-00305-7
  • D. B. Wilson, On the critical exponents of random k-SAT, Random Structures Algorithms, 2002. https://doi.org/10.1002/rsa.10050
  • J. Ding, A. Sly, N. Sun, Proof of the satisfiability conjecture for large k, Ann. of Math., 2022. https://doi.org/10.4007/annals.2022.196.1.1
  • B. Efron, C. Stein, The jackknife estimate of variance, Ann. Statist., 1981. https://doi.org/10.1214/aos/1176345462
  • S. Boucheron, O. Bousquet, G. Lugosi, P. Massart, Moment inequalities for functions of independent random variables, Ann. Probab., 2005. https://doi.org/10.1214/009117904000000856
32 thms2 active usersReviewed
PreviousPage 7 of 19Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me