Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Theoretical Computer Science

464 missions · 237 completed

The mathematical foundations of computation: which problems can be solved, by what algorithms, and at what cost in time, space, or communication. Distinguished by its emphasis on rigor and unconditional lower bounds, it spans computational complexity, algorithm design, automata and computability, cryptography, and the analysis of Boolean functions.

Missions

Open227Completed237All464
🏆Completed
Captain: marwahaha

More Asymmetry Bound: omega < 2.37134Research Paper

Motivation

The matrix-multiplication exponent measures how the arithmetic complexity of multiplying square matrices grows with the ir dimension. Known upper bounds come from constructing large independent matrix products inside tensor powers whose asymptotic rank is controlled. Improving the extraction, rather than finding a lower-rank starting tensor, has driven several recent advances.

Alman, Duan, Vassilevska Williams, Xu, Xu, and Zhou improve the combination-loss analysis by allowing all three variable directions to be treated differently. Their original fourth-power computation gives the bound ω<2.371339\omega<2.371339ω<2.371339. The mission targets the slightly weaker rational endpoint 2.371342.371342.37134, keeping the historical result distinct from the later AlphaEvolve numerical improvement incorporated into the latest manuscript. More Asymmetry Yields Faster Matrix Multiplication, version 2, SODA 2025.

Setting

Fix an arbitrary field KKK. The matrix-multiplication tensor ⟨a,b,c⟩K\langle a,b,c\rangle_K⟨a,b,c⟩K​ represents multiplication of an a×ba\times ba×b matrix by a b×cb\times cb×c matrix. A tensor's rank is the least number of pure tensors summing to it. The existing Lean definition matMulExp K is the infimum of log⁡R(⟨n,n,n⟩K)/log⁡n\log R(\langle n,n,n\rangle_K)/\log nlogR(⟨n,n,n⟩K​)/logn for integer dimensions n≥2n\ge2n≥2, with value 333 at the excluded dimensions 000 and 111. This definition, and the existing equivalence with the Strassen-preorder exponent, remain unchanged.

The source tensor is the literal fourth power T=CW5⊗4T=CW_5^{\otimes4}T=CW5⊗4​ of the Coppersmith–Winograd tensor. The public parenthesization is (CW5⊗CW5)⊗(CW5⊗CW5)(CW_5\otimes CW_5)\otimes(CW_5\otimes CW_5)(CW5​⊗CW5​)⊗(CW5​⊗CW5​). Its asymptotic rank is at most 74=24017^4=240174=2401. Its canonical coarse components are indexed by triples (i,j,k)(i,j,k)(i,j,k) with i+j+k=8i+j+k=8i+j+k=8. This is the fourth-power, recursion-level-three specialization described in Section 7, not the eighth-power specialization used by the later optimization note. More Asymmetry, Section 7.

A complete split distribution records frequencies of entire fine-grade words, rather than only the marginal split at the next recursion step. At level ℓ≥1\ell\ge1ℓ≥1, these words have length 2ℓ−12^{\ell-1}2ℓ−1 over the alphabet {0,1,2}\{0,1,2\}{0,1,2}. Three such distributions describe the X-, Y-, and Z-variable blocks. A restricted constituent power keeps only blocks approximately consistent with those distributions, in maximum-coordinate distance at most a specified ε≥0\varepsilon\ge0ε≥0. An interface tensor is a tensor product of these restricted constituent powers. The approximation tolerance and all three distributions are part of the interface. More Asymmetry, Definitions 3.4–3.6 and 4.1.

Formalization targets

The goal is the unconditional field-uniform statement

∀K  [Field(K)],matMulExp⁡(K)<237134100000.\forall K\;[\mathrm{Field}(K)],\qquad \operatorname{matMulExp}(K)<\frac{237134}{100000}.∀K[Field(K)],matMulExp(K)<100000237134​.

Its binders and exponent definition match the existing Schönhage and Stothers goals; only the declaration name and endpoint differ. No optimizer result, characteristic condition, distribution, or assumed value surplus is a hypothesis of the root.

The compact proposal has four milestones and the root, totaling five review items. The milestones concern literal fine-to-coarse source restrictions; the fourth-power rank budget; an actual strict six-symmetrized value surplus at the chosen parameter; and the conditional implication from that surplus to the exponent bound. Existing proved source and rank theorems are reused. The open surplus target contains the new complete-split extraction and exact numerical obligations, which are described separately in the proof outline rather than hidden in an opaque certificate definition.

The chosen internal parameter is τ0=3952233/5000000\tau_0=3952233/5000000τ0​=3952233/5000000, so

2.371339<3τ0=2.3713398<2.37134.2.371339<3\tau_0=2.3713398<2.37134.2.371339<3τ0​=2.3713398<2.37134.

The substantive value target is the existence of a real V>2401V>2401V>2401 such that the actual source has six-symmetrized τ0\tau_0τ0​-value at least VVV in the existing finite-witness semantics. The strict slack leaves room to translate limiting extraction rates into strict lower bases. Neither the existence of that surplus nor a completed exact numerical certificate is claimed at proposal time.

Significance

This formalization would capture a new structural improvement, not a re-optimization of the same DWZ square data. Its distinguishing feature is sequentially obtaining the necessary ownership properties for X, then Y, then Z, while preserving more useful fine blocks. The resulting complete-split and interface-tensor theory is also the mathematical foundation for the later AlphaEvolve optimization. More Asymmetry, Sections 2, 4–6; Dupont et al., Section 2.

The known mathematical result is not an open conjecture. The open work is its machine-checked reconstruction. The earlier square and Stothers roots are marked Proved. The newer DWZ fourth-power root has an accepted reduction but remains Open. Its literal fourth source, rank budget, sixfold-symmetry bridge and entropy-certificate infrastructure can be reused independently of that unfinished endpoint. A proof of the numerical DWZ bound alone would not imply the smaller bound targeted here.

Difficulty

The old hashing interface guarantees both coarse X- and Y-block uniqueness. The new method initially requires only coarse X-block uniqueness. Fine Y-block compatibility and usefulness must then establish the ownership needed for the subsequent Z-stage. Applying a theorem whose hypotheses already demand coarse Y uniqueness would discard the new method's essential advantage. Six coordinate permutations create six regions whose parameters and output interfaces must remain consistent. More Asymmetry, Section 4.1 and Figure 1.

Removing incompatible fine blocks creates holes. The relevant repair theorem concerns holes in all three modes and a quantitative supply of broken interface copies. It cannot be replaced without proof by the older square-specific Z-only repair interface. The global and recursive stages also carry subexponential losses and approximation tolerances; their limiting order must be explicit. Numerical feasibility is a separate obligation: floating-point parameters and optimization success are not exact normalization, marginal, entropy, or logarithm proofs. More Asymmetry, Theorem 4.2, Theorems 5.3 and 6.4, and Section 7.

Formalization scope

The environment is pinned to Mathlib 777aaa61dcd2a1258d2b4962dbe983ede4d23b2e and Lean v4.29.0-rc3. The development reuses TensorObj, MMObj, restrictions, degenerations, tensor powers, existing tau-value predicates, and matMulExp. The root is uniform over arbitrary fields. Source relations remain target-first: a restriction of A from B is written Restrict A B. A collection of overlapping constituent restrictions must not be relabeled as an external direct sum.

Complete split distributions, simultaneous three-mode projections, interface tensors, region permutations, and explicit finite extraction maps form reusable infrastructure. Exact rational profiles require compatible lengths; approximate profiles require their stated tolerance and limiting argument. No constant-valued replacement for tensor value, vacuous witness hypothesis, or certificate that merely assumes the desired extraction is admissible.

The authors' released code and parameter archive is the provenance source for the original computation. Versioned archive and witness hashes belong to the companion source audit. The optimization program need not be formalized: an exact certificate checker must establish its own normalization, support, marginal and interval conditions. Contributions to complete-split interfaces, sequential ownership, three-mode repair, recursive extraction, entropy certificates, and finite source-to-exponent bridges all advance this mission.

Selected references

  • Josh Alman, Ran Duan, Virginia Vassilevska Williams, Yinzhan Xu, Zixuan Xu, and Renfei Zhou, More Asymmetry Yields Faster Matrix Multiplication, SODA 2025. Pinned version 2.
  • Authors' code and parameters for the original fourth-power bounds. OSF release.
  • Ran Duan, Hongxun Wu, and Renfei Zhou, Faster Matrix Multiplication via Asymmetric Hashing, FOCS 2023. Version 5.
  • Emilien Dupont et al., Improving the matrix multiplication exponent with modern optimization and AlphaEvolve, 2026 preprint. Version 1.
149 thms10 active usersReviewed
🏆Completed
Captain: marwahaha

Duan–Wu–Zhou Fourth-Power Bound: omega < 2.37193Research Paper

Motivation

The matrix-multiplication exponent measures how the arithmetic cost of multiplying square matrices grows with their dimension. An improvement in this exponent is relevant both to algebraic complexity and to algorithms whose running times depend on matrix multiplication. This mission formalizes a known improvement using the fourth power of the Coppersmith–Winograd tensor; it does not claim a new mathematical record.

Duan, Wu, and Zhou identify a loss that arises when constituent tensors are analyzed independently although some of their finer components can coexist inside a shared variable block. Their asymmetric-hashing method recovers part of this combination loss. The paper's headline result concerns the eighth power. Its separate fourth-power computation reports 2.3719192.3719192.371919 in Table 3, printed page 78. The present target is the slightly weaker exact rational endpoint 2.371932.371932.37193. Duan–Wu–Zhou, Faster Matrix Multiplication via Asymmetric Hashing.

Setting

Fix an arbitrary field KKK. The matrix-multiplication tensor ⟨a,b,c⟩K\langle a,b,c\rangle_K⟨a,b,c⟩K​ encodes multiplication of an a×ba\times ba×b matrix by a b×cb\times cb×c matrix. Its tensor rank is the smallest number of pure tensors whose sum is that tensor. The existing Lean definition matMulExp K takes the infimum of log⁡R(⟨n,n,n⟩K)/log⁡n\log R(\langle n,n,n\rangle_K)/\log nlogR(⟨n,n,n⟩K​)/logn over integers n≥2n\ge2n≥2, with the value 333 at the two excluded small dimensions. This definition is reused without alteration.

A restriction applies a linear map separately to each of a tensor's three variable spaces. A degeneration allows polynomial families of such maps and takes an appropriate leading coefficient. The order of the Lean relation is target first: Restrict A B means that AAA is obtained from BBB. A direct sum uses disjoint variable spaces; a collection of overlapping restrictions does not constitute a direct sum.

The Coppersmith–Winograd tensor CWqCW_qCWq​ has border rank at most q+2q+2q+2. This mission fixes q=5q=5q=5 and uses the literal tensor T=(CW5⊗CW5)⊗(CW5⊗CW5)T=(CW_5\otimes CW_5)\otimes(CW_5\otimes CW_5)T=(CW5​⊗CW5​)⊗(CW5​⊗CW5​), whose asymptotic-rank budget is 74=24017^4=240174=2401. Its standard coordinate partition has 45 coarse components TijkT_{ijk}Tijk​ indexed by nonnegative integers i+j+k=8i+j+k=8i+j+k=8. Each coarse component consists of ordered products of square components, whose grades sum to (i,j,k)(i,j,k)(i,j,k). Duan–Wu–Zhou, Sections 3 and 6–8.

A restricted-splitting value pair consists of a lower value bound and a prescribed distribution on finer Z-variable blocks. In a tensor power, Z-blocks with the wrong empirical split distribution are removed before measuring value. Sixfold symmetrization, using all permutations of the three modes, is part of this definition. Keeping the scalar and discarding the prescribed distribution loses information required by the recursion. Duan–Wu–Zhou, Definition 3.9, Equation (3), and Definition 8.1.

Formalization targets

The goal is precisely

∀K  [Field(K)],matMulExp⁡(K)<237193100000.\forall K\;[\mathrm{Field}(K)],\qquad \operatorname{matMulExp}(K)<\frac{237193}{100000}.∀K[Field(K)],matMulExp(K)<100000237193​.

It has the same field quantification and exponent definition as the completed Schönhage and Stothers goals. Only the name and rational endpoint change. No distribution, optimizer, characteristic restriction, or unproved value bound is a hypothesis of this goal.

The supporting targets concern the literal fourth-power source; prescribed-splitting component values; the recursive and global extraction inequalities of Equations (34) and (25); an exact certificate for the released fourth-power computation; and the value-to-exponent implication of Theorem 3.2. The proof outline distinguishes stable formal statements from source-level tasks whose complete Lean interfaces still require development. It does not turn an unspecified certificate into an assumption that the desired extraction exists.

The compact milestone list contains four precise statements: the literal fine-to-coarse product restriction; the fourth-power asymptotic-rank bound; existence of a strict six-symmetrized value surplus; and the conditional implication from that surplus to the goal. Together with the root, these are five review items. The first, second, and fourth milestones are marked Proved. The surplus remains Open. An accepted root reduction links the surplus to the proved capstone; it is a proof sketch, not a proof of the exponent bound. Recursive component extraction and exact numerical certification remain substantial work inside that open target.

The planned internal parameter is τ=790643/1000000\tau=790643/1000000τ=790643/1000000. Thus 3τ=2.371929<2.371933\tau=2.371929<2.371933τ=2.371929<2.37193. The substantive value obligation is a strict surplus over 240124012401 for the actual fourth-power source, with asymptotic losses absorbed by choosing strict lower rates. The exact certificate must establish this surplus; neither its existence nor its numerical slack is presently claimed as proved.

Significance

The result would extend the formalized Stothers endpoint 2.37372.37372.3737 to an asymmetric fourth-power bound. More importantly, it would provide restricted-splitting interfaces that can support subsequent higher-power and more-asymmetric analyses. The mathematical improvement is already established in the cited paper. The task here is to reconstruct its argument with machine-checked statements, concrete tensor maps, and exact numerical bounds.

The earlier square and Stothers mission roots are marked Proved. Reusable infrastructure includes polynomial degenerations, tensor powers, direct-sum value witnesses, hashing and hole-repair lemmas, the literal fourth-power grading, and the final exponent bridge. Two additional literal fourth-power support/restriction bridges and an additive entropy certificate with directed-log inputs are also marked Proved. These statuses do not imply that the new restricted-value recursion or numerical witness is already formalized.

Difficulty

The central difficulty is retaining the correct dependence between each value bound and its prescribed split distribution. The released fourth-power data contains consumer-specific copies of square value pairs. Equal coarse grades do not justify identifying their chosen distributions. The 21 positive fourth-power components use the six-region recursion, whereas the 24 components with a zero coordinate require the boundary merging argument. Duan–Wu–Zhou, Equation (34), Section 7.3, and released implementation.

Global hashing must additionally control competitors with the same marginals, shared Z-blocks, missing fine blocks, and subexponential losses. An isolated restriction into each constituent is insufficient to establish a simultaneous extraction. Numerical optimization presents a separate issue: floating-point normalization and approximate maximum-entropy computations are not exact feasibility or entropy proofs. Exact marginal constraints, positivity domains, and directed error bounds must all be checked.

Formalization scope

The environment is pinned to Mathlib 777aaa61dcd2a1258d2b4962dbe983ede4d23b2e and Lean v4.29.0-rc3. The development reuses TensorObj, MMObj, Degenerates, HasTauValueAtLeast, the six-symmetrized value infrastructure, and matMulExp. All endpoint theorems remain uniform over arbitrary fields. Finite profiles use exact integer counts; rational distributions must have compatible unbounded lengths before an asymptotic statement is invoked. Real limiting rates are represented with explicit strict slack where the existing finite-witness predicate does not guarantee endpoint attainment.

No constant-valued replacement for tensor value, opaque witness carrying its desired conclusion, or external direct sum substituted for overlapping source blocks is admissible. New definitions must specify the actual coordinate projections and restrictions they represent. The authors' optimizer is used to find candidate data, not trusted as a proof oracle. Contributions to restricted-power semantics, consumer-specific square pairs, boundary merging, recursive extraction, exact entropy bounds, and source-to-exponent bridges are all directly relevant to the goal.

Selected references

  • Ran Duan, Hongxun Wu, and Renfei Zhou, Faster Matrix Multiplication via Asymmetric Hashing, FOCS 2023. Full paper, version 5.
  • Duan–Wu–Zhou, accompanying optimization and verification code, including power4_dup_2.371919.mat. Authors' release.
  • A. M. Davie and A. J. Stothers, Improved Bound for Complexity of Matrix Multiplication, Proceedings of the Royal Society of Edinburgh Section A 143(2), 2013. DOI.
  • Arnold Schönhage, Partial and Total Matrix Multiplication, SIAM Journal on Computing 10(3), 1981. DOI.
125 thms10 active usersReviewed
🏆Completed
Formal VerificationMathematical Logic·Captain: Rizwan G Mir

The Cook-Levin Theorem: NP-Completeness of Boolean Satisfiability in Lean 4Research Paper

Introduction

The Cook-Levin theorem states that CNF SAT is NP-complete. This mission formalizes the theorem over a multi-tape Turing machine model in Lean 4.

Main Goal

Prove CookLevin.cook_levin_theorem:

NPCompleteSATNPComplete SATNPCompleteSAT

under the decider and reduction hypotheses.

175 thms9 active usersReviewed
🏆Completed
Captain: marwahaha

Davie–Stothers Fourth-Power Bound: omega < 2.3737Research Paper

Motivation

The matrix-multiplication exponent ω\omegaω measures the asymptotic arithmetic cost of multiplying square matrices. An upper bound ω<c\omega<cω<c means that, over the field under consideration, two n×nn\times nn×n matrices can be multiplied using O(nc+ε)O(n^{c+\varepsilon})O(nc+ε) field operations for every ε>0\varepsilon>0ε>0. It is a central benchmark in algebraic complexity and controls the exponent of many algorithms that use matrix multiplication as a subroutine.

Coppersmith and Winograd's 1990 analysis of the square of their tensor established ω<2.375477\omega<2.375477ω<2.375477. That number remained the record for roughly two decades. Stothers' 2010 thesis first obtained a smaller exponent by analyzing the fourth tensor power, and Davie and Stothers later supplied a self-contained journal treatment. Their Theorem 5.3 and numerical parameters give ω<2.373689703\omega<2.373689703ω<2.373689703; see Davie--Stothers, printed pp. 367--368. The result is the first historical step below the classical tensor-square barrier and is the natural next capstone after a formal proof of the 2.3754772.3754772.375477 bound.

This mission formalizes the Davie--Stothers fourth-power argument at the exact rational endpoint 2.37372.37372.3737. It concentrates on the new mathematical layer introduced by the fourth power: five non-matrix constituents, their recursive value estimates, and the two-dimensional same-marginal ambiguity in the final distribution count.

Setting

For a field KKK, an order-three tensor represents a bilinear map. The matrix-multiplication tensor

⟨a,b,c⟩K=∑i<a∑j<b∑k<cxij⊗yjk⊗zki\langle a,b,c\rangle_K =\sum_{i<a}\sum_{j<b}\sum_{k<c} x_{ij}\otimes y_{jk}\otimes z_{ki}⟨a,b,c⟩K​=i<a∑​j<b∑​k<c∑​xij​⊗yjk​⊗zki​

encodes multiplication of an a×ba\times ba×b matrix by a b×cb\times cb×c matrix. Restrictions apply linear maps to the three tensor legs; degenerations permit polynomial families of maps. A direct sum of matrix-multiplication tensors has disjoint variable blocks and can be converted into an exponent inequality by Schönhage's asymptotic sum inequality.

The Coppersmith--Winograd tensor CWqCW_qCWq​ has border rank at most q+2q+2q+2 and a three-class coordinate partition. Its square decomposes into fifteen coarse constituents φijk\varphi_{ijk}φijk​ with i+j+k=4i+j+k=4i+j+k=4. Davie--Stothers square this decomposition again. The fourth power has forty-five constituents with indices summing to eight, grouped into ten symmetry classes represented by

φ008, φ017, φ026, φ035, φ044, φ116, φ125, φ134, φ224, φ233.\varphi_{008},\ \varphi_{017},\ \varphi_{026},\ \varphi_{035},\ \varphi_{044}, \ \varphi_{116},\ \varphi_{125},\ \varphi_{134},\ \varphi_{224},\ \varphi_{233}.φ008​, φ017​, φ026​, φ035​, φ044​, φ116​, φ125​, φ134​, φ224​, φ233​.

The first five classes are rectangular matrix-multiplication tensors. The last five require recursive value bounds. With ρ∈[2,3]\rho\in[2,3]ρ∈[2,3], the paper writes

E=(2q)ρ,H=(q2+2)ρ,L=4qρ(qρ+2),E=(2q)^\rho,\qquad H=(q^2+2)^\rho,\qquad L=4q^\rho(q^\rho+2),E=(2q)ρ,H=(q2+2)ρ,L=4qρ(qρ+2),

and states the five lower bounds in Lemma 5.1. The final fourth-power extraction assigns frequencies to the ten symmetry classes. Their coordinate marginals are encoded by the 9×109\times109×10 matrix QQQ in Equation (5.2); its kernel is the two-dimensional space YYY displayed immediately after that equation.

The paper's bounds are limiting exponential rates and may carry subexponential losses in their finite Salem--Spencer extractions. Prove2Me's HasTauValueAtLeast predicate instead records a constant-relative finite witness. The source-faithful formal statements therefore assert attainment of every fixed nonnegative base strictly below each displayed limiting rate, rather than unjustified attainment of the limiting endpoint itself. This downward-closed form retains the complete asymptotic conclusion and is exactly what the final strict numerical surplus needs.

Formalization targets

Goal: the Davie--Stothers fourth-power bound

For every field KKK,

matMulExp⁡(K)<2373710000=2.3737.\operatorname{matMulExp}(K)<\frac{23737}{10000}=2.3737.matMulExp(K)<1000023737​=2.3737.

The source's computed endpoint 2.3736897032.3736897032.373689703 is strictly smaller, giving slack for an exact rational certificate. The Lean goal has exactly the same field quantification and matMulExp definition as the existing Coppersmith--Winograd mission; only the theorem identifier and endpoint change.

Source-level milestones

The mission records the canonical nine-grading of CW6⊗4CW_6^{\otimes4}CW6⊗4​ and the ten symmetry classes of Table 1. It formalizes all five clauses of Lemma 5.1 for φ116\varphi_{116}φ116​, φ125\varphi_{125}φ125​, φ134\varphi_{134}φ134​, φ224\varphi_{224}φ224​, and φ233\varphi_{233}φ233​ in every-strict-lower-base form; Equation (5.2) and the stated basis of ker⁡Q\ker QkerQ; Lemma 5.2's entropy minimization along that kernel; Theorem 5.3's downward-closed fourth-power value inequality; and the Table 2 numerical specialization. The final milestones connect the resulting tau-value surplus to the border-rank budget and transfer the Strassen-preorder exponent bound to matMulExp.

Significance

Mathematically, this theorem is the first improvement obtained by passing from the square to the fourth power of the Coppersmith--Winograd tensor. It establishes the recursive constituent pattern used by the later eighth-, sixteenth-, and higher-power analyses. In particular, the five formulas in Lemma 5.1 are the first complete catalogue of genuinely recursive fourth-power constituents.

For formalization, the mission creates a reusable representation of higher-power CW gradings and their symmetry orbits. It also forces a distinction between a locally chosen joint type and all other types with the same marginals. Lemma 5.2 is the exact finite-dimensional entropy correction needed when the marginal map has nontrivial kernel. That infrastructure can be reused by later refined-laser and complete-split missions.

The result is known mathematically. The open task is a machine-checked reconstruction. Prove2Me already contains the CW tensor, its characteristic-free border-rank degeneration, its canonical square grading and constituent restrictions, the Salem--Spencer layer, direct-sum tau-value witnesses, the asymptotic sum inequality, and the exponent bridge. The exact optimizer identity for the φ116\varphi_{116}φ116​ profile is also proved. The remaining frontier is to connect the literal fourth-power constituents to finite direct-sum extractions, then assemble all five value estimates and the final kernel-corrected distribution count.

Difficulty

The fourth power contains 225 ordered products before symmetry grouping. A formal proof must show that each claimed constituent is the literal block of CWq⊗4CW_q^{\otimes4}CWq⊗4​ and that its recursive decomposition uses the correct variable spaces. Replacing a sum of overlapping blocks by an external direct sum would make the value bound artificially strong.

The five non-matrix classes have different feasible frequency polytopes. Their optimizer formulas are valid only after the corresponding nonnegativity and normalization conditions are checked. The φ233\varphi_{233}φ233​ class already has a nontrivial same-marginal family. At the global level the map QQQ has a two-dimensional kernel, so marginal counts alone do not determine a unique joint distribution. Ignoring that kernel removes the entropy penalty and invalidates Theorem 5.3.

Finally, Table 2 contains decimal witnesses obtained numerically. A formal proof must replace floating-point evaluation by exact rational parameters and certified bounds for logarithms and real powers, while retaining strict slack at 23737/1000023737/1000023737/10000.

Formalization scope

The development uses environment 777aaa61dcd2a1258d2b4962dbe983ede4d23b2e and the existing TensorObj, MMObj, restriction, degeneration, HasTauValueAtLeast, tensorAsymptoticRank, matMulExp_strassen, and matMulExp declarations. Top-level theorems quantify over an arbitrary field. Finite block indices and symmetry classes use finite types; frequency vectors and entropy inequalities use real numbers; exact finite profiles use natural numbers before passing to cofinal asymptotics.

The capstone specializes to q=6q=6q=6 and the fourth tensor power. Generic grading, orbit, multinomial, entropy, and optimizer lemmas are welcome when they shorten later missions. Every value theorem must ultimately be backed by restrictions or degenerations to direct sums of concrete matrix-multiplication tensors. An opaque value functional, a constituent definition that is an external sum rather than the source block, or a numerical hypothesis that assumes the desired endpoint is outside scope.

Contributions are welcome for the literal nine-grading, symmetry-orbit classification, the five constituent extractions, exact address factorizations, optimizer feasibility, the kernel calculation and Lemma 5.2, exact Table 2 arithmetic, and the final exponent assembly.

Selected references

  • A. M. Davie and A. J. Stothers, Improved Bound for Complexity of Matrix Multiplication, Proceedings of the Royal Society of Edinburgh Section A: Mathematics 143(2), 2013, pp. 351--369. Author PDF and DOI 10.1017/S0308210511001646.
  • A. J. Stothers, On the Complexity of Matrix Multiplication, PhD thesis, University of Edinburgh, 2010. Edinburgh Research Archive.
  • Don Coppersmith and Shmuel Winograd, Matrix Multiplication via Arithmetic Progressions, Journal of Symbolic Computation 9, 1990, pp. 251--280. DOI 10.1016/S0747-7171(08)80013-2.
  • Arnold Schönhage, Partial and Total Matrix Multiplication, SIAM Journal on Computing 10(3), 1981, pp. 434--455. DOI 10.1137/0210032.
171 thms8 active usersReviewed
🏆Completed
CombinatoricsComplexity TheoryGraph Theory+1·Captain: mikedeng1

Scheduling Subject to Resource Constraints: Classification and Complexity II: Unit-Time Jobs on Two Uniform Machines with Unit Resources Are Strongly NP-hardResearch Paper

Motivation

Machine scheduling asks how to assign jobs to machines over time. In many applications a job also needs additional scarce resources while it runs: a tool, a skilled operator, a memory bank, a channel. Adding such resources can turn a problem with a polynomial algorithm into an NP-hard one. Błażewicz, Lenstra and Rinnooy Kan (DAM 1983) extended the standard three-field classification α ∣ β ∣ γ\alpha\,|\,\beta\,|\,\gammaα∣β∣γ of scheduling problems (Graham, Lawler, Lenstra and Rinnooy Kan 1979) with a resource field resλσρres\lambda\sigma\rhoresλσρ. They then drew the complete borderline between easy and hard problems for unit-time jobs, identical or uniform machines and the makespan criterion. Their Fig. 2 marks each problem type as polynomially solvable or NP-hard.

This mission formalizes the two hardness results of that classification that come from graph partition problems (Theorems 2 and 3, p. 15). Two identical machines are easy under any resource constraints (Theorem 1, after Garey and Johnson 1975). Theorems 2 and 3 show that a third identical machine, or two machines of different speeds, already makes the problem strongly NP-hard, once the number of unit resources is part of the input.

Setting

There are nnn jobs J1,…,JnJ_1,\dots,J_nJ1​,…,Jn​ and mmm machines M1,…,MmM_1,\dots,M_mM1​,…,Mm​. Each machine processes at most one job at a time, and each job runs on one machine without interruption. Machine MiM_iMi​ has a speed qi>0q_i>0qi​>0, and every job has unit execution requirement pj=1p_j=1pj​=1, so it takes time 1/qi1/q_i1/qi​ on MiM_iMi​. Identical machines (PPP) are the case qi=1q_i=1qi​=1; uniform machines (QQQ) allow arbitrary speeds.

There are lll resources R1,…,RlR_1,\dots,R_lR1​,…,Rl​. Resource RhR_hRh​ has a positive integer size shs_hsh​, the amount available at any time. Job JjJ_jJj​ needs a nonnegative integer amount rhjr_{hj}rhj​ of RhR_hRh​ throughout its execution. A schedule assigns each job a machine μ(j)\mu(j)μ(j) and a start time Sj≥0S_j\ge 0Sj​≥0. Its completion time is Cj=Sj+1/qμ(j)C_j=S_j+1/q_{\mu(j)}Cj​=Sj​+1/qμ(j)​, and it is being executed at every time ttt with Sj≤t<CjS_j\le t<C_jSj​≤t<Cj​. A schedule is feasible when:

  • jobs on the same machine do not overlap in time;
  • at every time ttt, the set StS_tSt​ of jobs being executed satisfies
∑j∈Strhj≤sh(h=1,…,l).\sum_{j\in S_t} r_{hj}\le s_h\qquad(h=1,\dots,l).j∈St​∑​rhj​≤sh​(h=1,…,l).

The makespan is Cmax⁡=max⁡jCjC_{\max}=\max_j C_jCmax​=maxj​Cj​.

The resource type res⋅11res{\cdot}11res⋅11 means three things: the number lll of resources is part of the input, every size is sh=1s_h=1sh​=1, and every requirement satisfies rhj≤1r_{hj}\le1rhj​≤1. A unit resource is therefore a conflict: two jobs that both need it can never run at the same time. The problems here have no precedence constraints. Pm ∣ res⋅11, pj=1 ∣ Cmax⁡Pm\,|\,res{\cdot}11,\,p_j=1\,|\,C_{\max}Pm∣res⋅11,pj​=1∣Cmax​ and Qm ∣ res⋅11, pj=1 ∣ Cmax⁡Qm\,|\,res{\cdot}11,\,p_j=1\,|\,C_{\max}Qm∣res⋅11,pj​=1∣Cmax​ ask for a feasible schedule of minimum makespan. Their decision versions ask, for a threshold yyy, whether a feasible schedule with Cmax⁡≤yC_{\max}\le yCmax​≤y exists.

The source problems are two graph problems on a graph G=(V,E)G=(V,E)G=(V,E) with ∣V∣=3t|V|=3t∣V∣=3t:

  • PARTITION INTO TRIANGLES: can VVV be partitioned into ttt triples of pairwise adjacent vertices?
  • PARTITION INTO PATHS OF LENGTH 2: can VVV be partitioned into ttt triples, each with at most one nonadjacent pair, that is, each spanning a path of length 2?

Both are NP-complete (Garey and Johnson 1979, problems GT11 and GT13).

The construction of p. 15 introduces one job per vertex and one unit resource R{j,k}R_{\{j,k\}}R{j,k}​ per nonadjacent pair {j,k}\{j,k\}{j,k}, required by JjJ_jJj​ and JkJ_kJk​ only.

Formalization targets

Goal: Theorem 3

Q2 ∣ res⋅11, pj=1 ∣ Cmax⁡ is NP-hard in the strong sense.Q2\,|\,res{\cdot}11,\,p_j=1\,|\,C_{\max}\ \text{is NP-hard in the strong sense.}Q2∣res⋅11,pj​=1∣Cmax​ is NP-hard in the strong sense.

Formally: if the language of PARTITION INTO PATHS OF LENGTH 2 is NP-hard, then the language of unary codes of yes-instances of the decision version of Q2 ∣ res⋅11, pj=1 ∣ Cmax⁡Q2\,|\,res{\cdot}11,\,p_j=1\,|\,C_{\max}Q2∣res⋅11,pj​=1∣Cmax​ is NP-hard. The two speeds are arbitrary positive integers.

Milestones

  1. The construction's key property (p. 15). In the constructed instance, two distinct jobs can be executed simultaneously if and only if their vertices are adjacent.
  2. The triangle equivalence (proof of Theorem 2). GGG has a partition into triangles if and only if the constructed instance on three identical machines has a feasible schedule with Cmax⁡≤tC_{\max}\le tCmax​≤t.
  3. Theorem 2. P3 ∣ res⋅11, pj=1 ∣ Cmax⁡P3\,|\,res{\cdot}11,\,p_j=1\,|\,C_{\max}P3∣res⋅11,pj​=1∣Cmax​ is NP-hard in the strong sense, given the NP-hardness of PARTITION INTO TRIANGLES.
  4. The paths equivalence (proof of Theorem 3). GGG has a partition into paths of length 2 if and only if the constructed instance on two uniform machines with speeds q1=2q_1=2q1​=2, q2=1q_2=1q2​=1 has a feasible schedule with Cmax⁡≤tC_{\max}\le tCmax​≤t.

Significance

The results. Theorems 2 and 3 are two of the minimal NP-hard problems in the paper's classification. Together with Theorem 1 they place the borderline exactly: with unit resources whose number is part of the input, two identical machines are polynomial, while three identical machines, or two machines of different speeds, are strongly NP-hard. Strong NP-hardness rules out pseudo-polynomial algorithms unless P = NP, and it carries over to every more general resource type and machine environment in Fig. 1 and Fig. 2. Section 4.1 of the paper also derives hardness for ∑Cj\sum C_j∑Cj​ and Lmax⁡L_{\max}Lmax​ from these instances.

Formalizing it. The results are classical and proved on paper, but the paper's proofs are one sentence each ("Clearly", "It is easily seen"). No machine-checked proof exists, and the platform has no model of resource-constrained scheduling with real-valued time. This mission produces that model. It also produces a precise statement of strong NP-hardness on top of Cook's Turing-machine definitions, and the first formal NP-hardness reductions from graph partition problems to scheduling.

Difficulty

The scheduling half of each equivalence depends on the real-time model. On two uniform machines of speeds 2 and 1, jobs take time 12\tfrac1221​ and 111, so jobs on the fast machine start at half-integers or anywhere else. The resource constraint must hold at every real time, not at a finite set of checkpoints. An argument that treats time as integer slots applies to the triangle case but does not transfer to the paths case.

The complexity half needs polynomial-time computability of the construction on Cook's one-tape Turing machines, on encoded strings that include malformed inputs. It also needs closure of polynomial-time reductions under composition, which the imported complexity layer states but does not prove.

Formalization scope

  • Time and schedules. Start times are nonnegative reals, execution intervals are half-open [Sj,Cj)[S_j,C_j)[Sj​,Cj​), and the resource constraints are imposed at every real time. Schedules are nonpreemptive.
  • Indices. Jobs, machines and resources are 0-based (Fin n, Fin m, Fin l), so q1,q2q_1,q_2q1​,q2​ are q 0, q 1.
  • Decision versions. "NP-hard" refers to the decision version with a threshold yyy. Thresholds are natural numbers and the Q2Q2Q2 speeds are positive integers. This restricted problem is a subproblem of the one with rational data, so its hardness is the stronger statement.
  • Encodings and strong NP-hardness. Instances are strings over a two-letter alphabet with every number in unary. Graphs are ttt in unary followed by the 3t×3t3t\times 3t3t×3t adjacency matrix, so ∣V∣=3t|V|=3t∣V∣=3t is part of the instance. Languages contain only codes of yes-instances. Strong NP-hardness is NP-hardness of the unary code language. With unary numbers, Max(I)≤Length(I)\mathrm{Max}(I)\le\mathrm{Length}(I)Max(I)≤Length(I), so this is equivalent to Garey and Johnson's definition. The complexity layer is the published module CookPvsNP_defs.
  • Cited hypothesis. Each hardness theorem takes as its only hypothesis the NP-hardness of its source problem, which the paper cites from Garey and Johnson rather than proves. The hypothesis is a true statement about a nonempty, non-universal language. The statements are not weakened to a reduction between languages, and they assume nothing about P versus NP.
  • Source problems. The paper's phrase "three vertices, at most two of which are nonadjacent" is read as "at most one nonadjacent pair", which is Garey and Johnson's GT13. Reading it as "at most two nonadjacent pairs" would admit triples with a single edge and change the problem. PARTITION INTO PATHS OF LENGTH 2 reuses the published definition CubicP3Partition.P3Factor, a spanning non-induced P3P_3P3​-factor.
  • Construction. Resources are indexed by the nonadjacent pairs j<kj<kj<k in lexicographic order, one per unordered pair and none for a pair {j,j}\{j,j\}{j,j}. A diagonal resource would make every job infeasible.
  • Not trivial. A model that checks resources only at integer times, or only at start times, would make the paths equivalence false. A hypothesis on the target problem would make the goal circular. The definitions rule out both.

Welcome contributions: proofs of the two equivalences, polynomial-time computability of the construction on Cook's machines, and a general composition lemma for polynomial-time reductions. The composition lemma is reusable for every hardness mission built on CookPvsNP_defs.

Selected references

  • J. Błażewicz, J. K. Lenstra, A. H. G. Rinnooy Kan, Scheduling subject to resource constraints: classification and complexity, Discrete Applied Mathematics 5 (1983) 11–24. https://doi.org/10.1016/0166-218X(83)90012-4
  • M. R. Garey, D. S. Johnson, Complexity results for multiprocessor scheduling under resource constraints, SIAM Journal on Computing 4 (1975) 397–411. https://doi.org/10.1137/0204035
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, Freeman, San Francisco, 1979, ISBN 0-7167-1045-5.
  • R. L. Graham, E. L. Lawler, J. K. Lenstra, A. H. G. Rinnooy Kan, Optimization and approximation in deterministic sequencing and scheduling: a survey, Annals of Discrete Mathematics 5 (1979) 287–326. https://doi.org/10.1016/S0167-5060(08)70356-X
  • S. Cook, The P versus NP problem, Clay Mathematics Institute Millennium Problems. https://www.claymath.org/wp-content/uploads/2022/06/pvsnp.pdf
41 thms7 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: hao jia

Immune High-Girth Bipartite Graphs (Feghali-Lucke-Paulusma-Ries 2025)Research Paper

Motivation

A matching cut is a vertex bipartition whose crossing edges form a matching. The property was introduced under the name decomposability and has links to graph algorithms, stable cutsets in line graphs, and several graph-labeling problems. An Open Problem Garden question asked whether sufficiently large girth forces a matching cut once average degree is bounded.

Feghali, Lucke, Paulusma, and Ries answered that question negatively. Their conference paper appeared at ISAAC 2023, and the version of record was published in Algorithmica in 2025. The paper proves NP-completeness for bipartite graphs of arbitrarily prescribed girth and bounded maximum degree. A central input, Lemma 5, is a stronger structural existence statement: for every girth threshold there is an immune 141414-regular bipartite graph of at least that girth, and it has a perfect matching.

This is therefore a ResearchPaper mission, not a new open-problem mission. Its goal is to formalize the published theorem and its graph-theoretic consequence. Repository candidate constructions and finite arithmetic audits remain separate and are not credited as solving the problem.

Setting

For a finite simple graph GGG and a vertex set A⊆V(G)A\subseteq V(G)A⊆V(G), the associated cut consists of all edges with one endpoint in AAA and one in V(G)∖AV(G)\setminus AV(G)∖A. The cut is nontrivial when both shores are nonempty. It is a matching cut when each vertex is incident with at most one crossing edge. A graph is called immune in the cited paper when it has no matching cut.

The girth is the length of a shortest simple cycle; forests have infinite girth. A graph is 141414-regular when every vertex has exactly fourteen neighbors. Bipartiteness is witnessed by a partition into two independent sides. A perfect matching pairs every vertex with one adjacent partner.

The original OPG wording has a literal one-vertex boundary ambiguity: with nonempty shores required, K1K_1K1​ has no matching cut, average degree zero, and infinite girth. The research-paper target avoids that vacuity by constructing connected graphs with at least two vertices, exact degree fourteen, and arbitrarily large finite girth.

Formalization targets

Lemma 5 — immune high-girth graphs

The main theorem follows the paper's structural lemma:

∀g≥3 ∃G,G is finite, connected, bipartite, and 14-regular,\forall g\ge3\ \exists G, \quad G\text{ is finite, connected, bipartite, and $14$-regular}, ∀g≥3 ∃G,G is finite, connected, bipartite, and 14-regular, girth⁡(G)≥g,G has no matching cut,G has a perfect matching. \operatorname{girth}(G)\ge g, \qquad G\text{ has no matching cut}, \qquad G\text{ has a perfect matching}.girth(G)≥g,G has no matching cut,G has a perfect matching.

The graph may depend on ggg. The existence quantifier does not request an efficient algorithm or a numerical order bound.

Negative OPG consequence

A supporting theorem removes the perfect-matching and bipartite fields and records the direct substantive counterexample family:

∀g≥3 ∃G,d‾(G)=14<15,girth⁡(G)≥g,G has no matching cut.\forall g\ge3\ \exists G, \qquad \overline d(G)=14<15, \quad \operatorname{girth}(G)\ge g, \quad G\text{ has no matching cut}.∀g≥3 ∃G,d(G)=14<15,girth(G)≥g,G has no matching cut.

Thus choosing d=15d=15d=15 refutes the intended universal assertion that some girth threshold works for every graph of average degree below ddd.

Significance

The theorem shows that large girth and bounded degree do not force matching cuts. The examples are highly nontrivial: they are connected, regular, bipartite, and can have arbitrarily large girth. This separates local tree-like structure from the global expansion that prevents a matching cut.

Within the paper, the immune graphs serve as gadgets for hardness reductions. The journal theorem states that, for every g≥3g\ge3g≥3, Matching Cut is NP-complete even for bipartite graphs of girth at least ggg and maximum degree at most 606060. Formalizing Lemma 5 supplies the graph-theoretic core needed to reconstruct that result without forcing this mission to formalize an entire complexity-theory reduction in its first stage.

Difficulty

Large girth alone makes bounded neighborhoods look like trees, and trees have many matching cuts. Immunity must therefore come from global expansion rather than short local cycles. The paper obtains the required family from Lubotzky–Phillips–Sarnak Ramanujan graphs and combines spectral and isoperimetric bounds to show that every nontrivial cut has too many crossing incidences to be a matching.

A formal proof must bridge several exact interfaces: existence of suitable primes, the finite Cayley-graph construction, bipartiteness and regularity, the girth lower bound, the spectral-to-isoperimetric inequality, and Hall's theorem for the perfect matching. None of these can be replaced by a finite sample or an asymptotic slogan.

Formalization scope

Graphs are finite and simple. Connectedness is nonempty mutual graph reachability. A simple cycle is a cyclic list of at least three distinct vertices; girth at least ggg means every such cycle has length at least ggg, so forests satisfy every threshold. A matching cut requires both shores nonempty and is encoded by the condition that every vertex has at most one crossing neighbor. A perfect matching is represented by an adjacent involution.

The main theorem explicitly requires at least two vertices, although exact 14-regularity already forces nontrivial order; the redundant bound documents exclusion of the K1K_1K1​ ambiguity. The mission does not claim that the frozen OPG contract was well-posed at order one. It formalizes the paper's substantive counterexample family and the consequence for the intended question.

Candidate files in the associated repository explore alternative bounded-degree constructions and integer counts. They are candidate_only and are not proof dependencies. Contributions should follow the published Lemma 5 and its cited inputs, or provide a separately sourced proof of the same declaration. The later maximum-degree-60 NP-completeness theorem is welcome as a future extension after the finite complexity framework is fixed.

Selected references

  • C. Feghali, F. Lucke, D. Paulusma, and B. Ries, Matching Cuts in Graphs of High Girth and H-Free Graphs, Algorithmica 87 (2025), 1199–1221. https://doi.org/10.1007/s00453-025-01318-8
  • C. Feghali, F. Lucke, D. Paulusma, and B. Ries, ISAAC 2023 version. https://drops.dagstuhl.de/entities/document/10.4230/LIPIcs.ISAAC.2023.31
  • A. Lubotzky, R. Phillips, and P. Sarnak, Ramanujan graphs, Combinatorica 8 (1988), 261–277. https://doi.org/10.1007/BF02126799
  • Open Problem Garden, Matching cut and girth. https://www.openproblemgarden.org/op/matching_cut_and_girth
20 thms6 active usersReviewed
🏆Completed
Captain: joe

The Sipser–Gács–Lautemann TheoremResearch Paper

Randomness appears to enlarge efficient computation, but the Sipser–Gács–Lautemann theorem places every bounded-error probabilistic polynomial-time language at the second level of the polynomial hierarchy, giving one of complexity theory’s foundational limits on the power of randomization.

66 thms6 active usersReviewed
🏆Completed
Machine LearningOperations Research·Captain: mikedeng1

The Weighted Majority Algorithm 8: With η Anomalies Every Deterministic Learner Can Be Forced to opt(F, 0) + 2η MistakesResearch Paper

Learning with anomalies

In the on-line prediction model studied by Littlestone and Warmuth (Inform. and Comput. 108, 1994), a learner receives instances one at a time, predicts a binary label for each, and is then told the correct label. No probabilistic assumption is made: performance is measured by the number of mistakes on a worst-case sequence. When every label is given by some function of a known target class FFF, the best attainable worst-case number of mistakes is a combinatorial invariant of FFF, characterized by Littlestone (Mach. Learn. 2, 1988) through mistake trees, now called the Littlestone dimension.

Real data are rarely labelled exactly by a member of the class. Littlestone and Warmuth measure the departure by the number of anomalies: the number of trials inconsistent with the best function in the class. Their Weighted Majority algorithm makes a number of mistakes that grows linearly in the number of anomalies, and the rate of growth can be pushed towards 222 mistakes per anomaly by the choice of the update factor β\betaβ. Theorem 8.1 of the paper shows that no deterministic learner does better: rate 222 is forced for every class with at least two members. This mission formalizes that lower bound.

Setting

Let XXX be an arbitrary set (the domain) and FFF a set of functions X→{0,1}X \to \{0,1\}X→{0,1}, possibly infinite. A trial is a pair (x,y)∈X×{0,1}(x,y) \in X \times \{0,1\}(x,y)∈X×{0,1}, and a sequence of trials S=((x1,y1),…,(xT,yT))\mathcal S = ((x_1,y_1),\dots,(x_T,y_T))S=((x1​,y1​),…,(xT​,yT​)) is finite; an instance may occur several times with different labels.

  • The number of anomalies of S\mathcal SS with respect to f:X→{0,1}f : X \to \{0,1\}f:X→{0,1} is anomf(S)=#{t≤T:f(xt)≠yt}\mathrm{anom}_f(\mathcal S) = \#\{t \le T : f(x_t) \ne y_t\}anomf​(S)=#{t≤T:f(xt​)=yt​}.
  • SηS_\etaSη​ is the collection of sequences with at most η\etaη anomalies with respect to FFF: those S\mathcal SS with min⁡f∈Fanomf(S)≤η\min_{f\in F} \mathrm{anom}_f(\mathcal S) \le \etaminf∈F​anomf​(S)≤η.
  • A deterministic on-line algorithm AAA maps the list of earlier trials and the current instance to a predicted label. MA(S)M_A(\mathcal S)MA​(S) is the number of trials ttt at which AAA's prediction, computed from (x1,y1),…,(xt−1,yt−1)(x_1,y_1),\dots,(x_{t-1},y_{t-1})(x1​,y1​),…,(xt−1​,yt−1​) and xtx_txt​, differs from yty_tyt​.
  • opt(F,η)=min⁡Asup⁡S∈SηMA(S)∈{0,1,… }∪{∞}\mathrm{opt}(F,\eta) = \min_A \sup_{\mathcal S \in S_\eta} M_A(\mathcal S) \in \{0,1,\dots\} \cup \{\infty\}opt(F,η)=minA​supS∈Sη​​MA​(S)∈{0,1,…}∪{∞}.

A complete kkk-mistake tree for FFF is a complete binary tree of height kkk whose internal nodes carry instances of XXX such that every labelling of a root-to-leaf path is realized by some f∈Ff \in Ff∈F; in Lean this is the predicate ShattersTree F k v.

Formalization targets

Goal: Theorem 8.1 (p. 250)

For every class FFF with ∣F∣>1|F| > 1∣F∣>1 and every η≥0\eta \ge 0η≥0,

opt(F,η) ≥ opt(F,0)+2η.\mathrm{opt}(F,\eta) \ \ge\ \mathrm{opt}(F,0) + 2\eta .opt(F,η) ≥ opt(F,0)+2η.

The constant 222 is the paper's, and the statement holds for infinite classes, including those with opt(F,0)=∞\mathrm{opt}(F,0) = \inftyopt(F,0)=∞.

Milestones

  1. The [Lit88, Lit89b] mistake tree (§8, p. 251): for any pool FFF there is a complete opt(F,0)\mathrm{opt}(F,0)opt(F,0)-mistake tree. This is published and proved on the platform as UnderstandingML.soa_mistake_bound (MSOA(F)≤Ldim(F)M_{\mathrm{SOA}}(F) \le \mathrm{Ldim}(F)MSOA​(F)≤Ldim(F)), referenced together with UnderstandingML.ldim_le_mistake_bound; together they identify opt(F,0)\mathrm{opt}(F,0)opt(F,0) with the Littlestone dimension.
  2. The first stage of the adversary (§8, p. 251): if FFF has a complete kkk-mistake tree with k≥1k \ge 1k≥1, then against any deterministic algorithm there are k−1k-1k−1 trials on which it errs every time, an instance xxx, and two functions f1,f2∈Ff_1, f_2 \in Ff1​,f2​∈F consistent with all these trials with f1(x)≠f2(x)f_1(x) \ne f_2(x)f1​(x)=f2​(x).

Significance

The theorem settles the optimal rate at which mistakes must grow with the number of anomalies for deterministic learners: 222 per anomaly, uniformly over all non-trivial classes. Together with the upper bounds of §2 of the paper, it shows that the deterministic Weighted Majority algorithm is within an arbitrarily small factor of optimal in its dependence on the anomalies, and it explains the factor of 222 that separates deterministic from randomized prediction (Theorem 8.2, a separate mission of this series, gives rate 111 for randomized learners).

The result is proved in the paper; to the best of a search of the platform it has not been formalized. The mission produces a machine-checked lower bound in a general setting: arbitrary domain, arbitrary (possibly infinite) class, extended-natural-valued optimal bounds. The noise-free side, the Littlestone dimension and the Standard Optimal Algorithm, is already published on the platform from Shalev-Shwartz and Ben-David's textbook, and this mission connects it to the noisy setting.

Difficulty

The obvious argument forces one mistake per trial and stops: an adversary that always contradicts the learner leaves no function of FFF with few anomalies once the trials outnumber the mistake tree. The difficulty is to spend the anomaly budget so that each anomaly buys two mistakes while the sequence stays in SηS_\etaSη​, and to do so against an arbitrary algorithm, which may behave adversarially itself. The definition of SηS_\etaSη​ through a minimum over the class (not a fixed target) and the possibility that opt(F,0)\mathrm{opt}(F,0)opt(F,0) is infinite both have to be handled.

Formalization scope

  • The domain is any type X; the class is F : Set (X → Bool); the hypothesis ∣F∣>1|F| > 1∣F∣>1 is F.Nontrivial, which is meaningful for infinite classes (a cardinality ncard would be 000 there).
  • Algorithms, histories and mistake counts are those of the published module UnderstandingML_Online (OnlineAlg X Bool, history, mistakes, ShattersTree); an algorithm is an arbitrary function of the history and the current instance, so every deterministic learner is covered.
  • Sequences are Fin T → X × Bool for every finite length T, with repeated instances and conflicting labels allowed.
  • opt F η : ℕ∞ is an infimum over algorithms of a supremum over sequences in SηS_\etaSη​; η\etaη is a natural number. Membership in SηS_\etaSη​ is "some f∈Ff \in Ff∈F has at most η\etaη anomalies", which is the paper's minimum over FFF.
  • Swapping the quantifiers (one sequence hard for all algorithms) or replacing opt\mathrm{opt}opt by a finite toNat truncation would give a different statement; neither is used.

Needed infrastructure: the identification opt(F,0)=min⁡AMA(F)\mathrm{opt}(F,0) = \min_A M_A(F)opt(F,0)=minA​MA​(F) (sequences with no anomaly are exactly the realizable ones), the existence of a shattered tree of depth opt(F,0)\mathrm{opt}(F,0)opt(F,0) from the published Littlestone-dimension results, and the two-stage adversary. Contributions of general lemmas about ShattersTree (subtrees, truncation to smaller depth) are reusable for the randomized mission and beyond.

Selected references

  • N. Littlestone, M. K. Warmuth, The Weighted Majority Algorithm, Information and Computation 108(2), 212–261, 1994. https://doi.org/10.1006/inco.1994.1009
  • N. Littlestone, Learning quickly when irrelevant attributes abound: a new linear-threshold algorithm, Machine Learning 2, 285–318, 1988. https://doi.org/10.1007/BF00116827
  • S. Shalev-Shwartz, S. Ben-David, Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press, 2014, Chapter 21. https://doi.org/10.1017/CBO9781107298019
6 thms5 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

Eigenvalues and Expanders: A Regular Bipartite Graph Is a Strong Expander If and Only If λ(G) Is Bounded Away from 0Research Paper

Motivation

Expander graphs are sparse graphs in which every set of vertices has many neighbours. Families of them with bounded degree and expansion bounded away from zero are a basic tool of theoretical computer science: they are the main component of the sorting network of Ajtai, Komlós and Szemerédi (AKS 1983), the building block of superconcentrators and other graphs with strong connectivity properties, and an ingredient of many later constructions in coding theory, derandomization and complexity.

Expansion is hard to certify. Checking that every set of vertices has many neighbours means looking at exponentially many sets, and computing the exact expansion of a graph is coNP-complete. A spectral quantity, by contrast, is computable in polynomial time. N. Alon's paper Eigenvalues and expanders (Combinatorica 6 (1986) 83–96) proves that for regular bipartite graphs the two notions are equivalent: a graph is a strong expander if and only if the second-smallest eigenvalue of its Laplacian is bounded away from 0, with explicit constants in both directions. This is a discrete counterpart of Cheeger's inequality for Riemannian manifolds.

Timeline.

  • 1983: Ajtai, Komlós and Szemerédi use bounded-degree bipartite expanders to build sorting networks of depth O(log⁡n)O(\log n)O(logn).
  • 1984: Tanner (SIAM J. Alg. Disc. Meth. 5) bounds the neighbourhood size of a set in a regular bipartite graph by its second eigenvalue, the direction "eigenvalue gap implies expansion".
  • 1985: Alon and Milman (J. Combin. Theory Ser. B 38) prove isoperimetric inequalities for graphs in terms of λ(G)\lambda(G)λ(G) and introduce enlargers.
  • 1986: Alon proves the converse direction, "expansion implies an eigenvalue gap" (Lemma 2.4 and Theorem 3.4 of the paper).

Setting

All graphs are finite and simple. For a graph G=(V,E)G = (V, E)G=(V,E) and a set X⊆VX \subseteq VX⊆V, N(X)={v∈V:vx∈E for some x∈X}N(X) = \{v \in V : vx \in E \text{ for some } x \in X\}N(X)={v∈V:vx∈E for some x∈X} is the set of neighbours of XXX; it may meet XXX.

The Laplacian of GGG is QG=diag(d(v))v∈V−AGQ_G = \mathrm{diag}(d(v))_{v \in V} - A_GQG​=diag(d(v))v∈V​−AG​, where AGA_GAG​ is the 0–1 adjacency matrix and d(v)d(v)d(v) the degree of vvv. It is symmetric with eigenvalues 0=λ0≤λ1≤⋯≤λn−10 = \lambda_0 \le \lambda_1 \le \dots \le \lambda_{n-1}0=λ0​≤λ1​≤⋯≤λn−1​, counted with multiplicity, and λ(G)=λ1\lambda(G) = \lambda_1λ(G)=λ1​ is its second-smallest eigenvalue. It is positive exactly when GGG is connected.

  • An (n,d,c)(n, d, c)(n,d,c)-magnifier is a graph on nnn vertices with maximal degree ddd in which every X⊆VX \subseteq VX⊆V with ∣X∣≤n/2|X| \le n/2∣X∣≤n/2 satisfies ∣N(X)−X∣≥c∣X∣|N(X) - X| \ge c|X|∣N(X)−X∣≥c∣X∣.
  • An (n,d,ε)(n, d, \varepsilon)(n,d,ε)-enlarger is a graph on nnn vertices with maximal degree ddd and λ(G)≥ε\lambda(G) \ge \varepsilonλ(G)≥ε.
  • A bipartite graph G=(I,O;E)G = (I, O; E)G=(I,O;E) has inputs III, outputs OOO and edges only between III and OOO. It is a strong (n,d,c)(n, d, c)(n,d,c)-expander if ∣I∣=∣O∣=n|I| = |O| = n∣I∣=∣O∣=n, the maximal degree is ddd, and for every X⊆IX \subseteq IX⊆I
∣N(X)∣≥(1+c(1−∣X∣n))∣X∣.|N(X)| \ge \Bigl(1 + c\Bigl(1 - \frac{|X|}{n}\Bigr)\Bigr)|X|.∣N(X)∣≥(1+c(1−n∣X∣​))∣X∣.

Formalization targets

Goal: Theorem 3.4

Let G=(I,O;E)G = (I, O; E)G=(I,O;E) be a ddd-regular bipartite graph with ∣I∣=∣O∣=n|I| = |O| = n∣I∣=∣O∣=n and λ=λ(G)\lambda = \lambda(G)λ=λ(G).

  1. If GGG is a strong (n,d,c)(n, d, c)(n,d,c)-expander then
λ≥c21024+2c2.\lambda \ge \frac{c^2}{1024 + 2c^2}.λ≥1024+2c2c2​.
  1. If λ≥ε\lambda \ge \varepsilonλ≥ε then GGG is a strong (n,d,c)(n, d, c)(n,d,c)-expander with
c=2dε−ε2d2.c = \frac{2d\varepsilon - \varepsilon^2}{d^2}.c=d22dε−ε2​.

Milestones, in the order of the paper

  • Lemma 2.2 (Alon–Milman, already on the platform): for disjoint sets A,BA, BA,B at distance ϱ>1\varrho > 1ϱ>1, b≤(1−a)/(1+(λ/d)aϱ2)b \le (1-a)/(1 + (\lambda/d)a\varrho^2)b≤(1−a)/(1+(λ/d)aϱ2).
  • Corollary 2.3: every (n,d,ε)(n, d, \varepsilon)(n,d,ε)-enlarger is an (n,d,2ε/(d+2ε))(n, d, 2\varepsilon/(d+2\varepsilon))(n,d,2ε/(d+2ε))-magnifier.
  • Eq. (2.1): if fff is an eigenvector of QGQ_GQG​ for λ(G)\lambda(G)λ(G) and ggg its positive part, then ∑uv∈E(g(u)−g(v))2≤λ∑vg2(v)\sum_{uv \in E}(g(u)-g(v))^2 \le \lambda \sum_v g^2(v)∑uv∈E​(g(u)−g(v))2≤λ∑v​g2(v).
  • Lemma 2.4: every (n,d,c)(n, d, c)(n,d,c)-magnifier has λ(G)≥c2/(4+2c2)\lambda(G) \ge c^2/(4 + 2c^2)λ(G)≥c2/(4+2c2).
  • Lemma 3.1: a strong (n,d,c)(n, d, c)(n,d,c)-expander is a (2n,d,c/16)(2n, d, c/16)(2n,d,c/16)-magnifier.
  • Proof of Lemma 3.3, spectrum: the two largest eigenvalues of CTCC^TCCTC, with CCC the I×OI \times OI×O biadjacency matrix, are d2d^2d2 and (d−λ)2(d - \lambda)^2(d−λ)2.
  • Proof of Lemma 3.3, Tanner's bound: ∣N(X)∣≥d2∣X∣/(α(d2−(d−λ)2)+(d−λ)2)|N(X)| \ge d^2|X| / \bigl(\alpha(d^2 - (d-\lambda)^2) + (d-\lambda)^2\bigr)∣N(X)∣≥d2∣X∣/(α(d2−(d−λ)2)+(d−λ)2) with α=∣X∣/n\alpha = |X|/nα=∣X∣/n.
  • Lemma 3.3: a ddd-regular bipartite graph is a strong (n,d,(2dλ−λ2)/d2)(n, d, (2d\lambda - \lambda^2)/d^2)(n,d,(2dλ−λ2)/d2)-expander.

Part (1) of the goal combines Lemmas 3.1 and 2.4; part (2) follows from Lemma 3.3.

Significance

The result. Theorem 3.4 makes expansion of regular bipartite graphs checkable in polynomial time up to a constant-factor loss. A random regular bipartite graph can be generated and its expansion certified by computing one eigenvalue. Lemma 2.4 is one of the first discrete Cheeger inequalities. Together with Corollary 2.3 it shows that magnifiers and enlargers are the same graphs up to the constants, and it underlies the later theory of spectral expanders, including the Alon–Boppana bound and Ramanujan graphs.

The formalization. The results are proved in the paper. The work is to formalize the known proofs. That includes Tanner's eigenvalue bound, which the paper only cites, and a max-flow min-cut argument, for which Mathlib has no general theorem. No machine-checked version of Lemma 2.4, Lemma 3.1, Lemma 3.3 or Theorem 3.4 is known to exist. Lemma 2.2 is already stated and proved on the platform as part of the Alon–Milman mission.

Difficulty

The direction "eigenvalue gap implies expansion" is a variational argument on the spectrum of CTCC^TCCTC. The converse is the hard one. A first attempt bounds λ(G)\lambda(G)λ(G) from below by testing the Rayleigh quotient on indicator vectors of sets. That only gives upper bounds on λ\lambdaλ: any one test vector does. A lower bound has to control every vector orthogonal to the constants at once. The paper first reduces to the positive part of an eigenvector (Eq. (2.1)). It then turns the combinatorial expansion of the graph into an analytic inequality for that function, using a network flow whose existence comes from the max-flow min-cut theorem. Step (ii) of the flow conditions printed on p. 87 is false as stated: the arcs (u,u)(u, u)(u,u) of the network absorb part of the flow. The flow argument has to be repaired before it can be formalized.

Lemma 3.1 has its own obstacle: one-sided expansion of inputs must be converted into expansion of arbitrary vertex sets that mix inputs and outputs. This needs the strong form of expansion; for ordinary expanders the lemma is false.

Formalization scope

Graphs are SimpleGraph V on a Fintype. A bipartite graph lives on the sum type I ⊕ O, and IsIOBipartite forbids edges inside I and inside O. Cardinalities ∣N(X)∣|N(X)|∣N(X)∣ are Set.ncard. "Maximal degree ddd" is read as G.maxDegree ≤ d; every statement is monotone in ddd or fixes ddd by regularity (G.IsRegularOfDegree d). The condition ∣X∣≤n/2|X| \le n/2∣X∣≤n/2 is written 2∣X∣≤n2|X| \le n2∣X∣≤n in N\mathbb{N}N. All constants are real, and every subtraction and division is taken in R\mathbb{R}R.

Reused published items:

  • λ(G)\lambda(G)λ(G) is AlonMilman.Diameter.lambda1, the second-smallest eigenvalue of G.lapMatrix ℝ, which is 000 by convention on fewer than two vertices.
  • N(X)N(X)N(X) is AKSSorting.Core.neighbours.
  • Lemma 2.2 is AlonMilman.Diameter.theorem_2_5, which carries Alon–Milman's standing hypotheses that GGG is connected and n≥2n \ge 2n≥2; outside them the inequality is trivial.

The page omits a few degenerate cases, and the following hypotheses are added for them. Each is necessary, with a counterexample recorded in the item's statement:

  • n≥1n \ge 1n≥1 and c≥0c \ge 0c≥0 in Theorem 3.4 (1);
  • ε>0\varepsilon > 0ε>0 in Theorem 3.4 (2);
  • n≥2n \ge 2n≥2 and c≥0c \ge 0c≥0 in Lemma 2.4;
  • n≥2n \ge 2n≥2 in Lemma 3.1 and in the CTCC^TCCTC statement;
  • d≥1d \ge 1d≥1 in Lemma 3.3;
  • ε≥0\varepsilon \ge 0ε≥0 in Corollary 2.3.

Eq. (2.1) is stated in multiplied form, so no quotient by ∑g2\sum g^2∑g2 appears.

The closing sentences of Theorem 2.5 and Theorem 3.4 ("Thus … one can prove efficiently …") are not formalized. Read as implications between expanders they reduce to monotonicity in ccc, because c′≤cc' \le cc′≤c; their content is algorithmic.

Several encodings would trivialize the mission and are excluded:

  • a λ\lambdaλ other than the published second-smallest Laplacian eigenvalue, in particular one defined as the best constant of a quotient;
  • expansion or magnifier conditions with a negative constant in a hypothesis;
  • ∣X∣≤n/2|X| \le n/2∣X∣≤n/2 with truncating natural-number division.

Contributions are welcome:

  • Tanner's bound in Lean, which is reusable for any regular bipartite graph;
  • a max-flow min-cut theorem for finite networks;
  • the corrected flow lemma behind Eqs. (2.2)–(2.3);
  • the spectral facts about λ(G)\lambda(G)λ(G) for bipartite graphs (λ≤d\lambda \le dλ≤d for n≥2n \ge 2n≥2, and λ=d−σ2(C)\lambda = d - \sigma_2(C)λ=d−σ2​(C)).

Selected references

  • N. Alon, Eigenvalues and expanders, Combinatorica 6 (1986) 83–96. https://doi.org/10.1007/BF02579166
  • N. Alon and V. D. Milman, λ₁, isoperimetric inequalities for graphs, and superconcentrators, J. Combin. Theory Ser. B 38 (1985) 73–88. https://doi.org/10.1016/0095-8956(85)90092-9
  • R. M. Tanner, Explicit concentrators from generalized N-gons, SIAM J. Algebraic Discrete Methods 5 (1984) 287–293. https://doi.org/10.1137/0605030
  • M. Ajtai, J. Komlós and E. Szemerédi, Sorting in c log n parallel steps, Combinatorica 3 (1983) 1–19. https://doi.org/10.1007/BF02579338
16 thms5 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

Competitive Randomized Algorithms for Nonuniform Problems III: The Optimal Randomized Two-Server Ratio on the 1-d-d Isosceles TriangleResearch Paper

Motivation

The k-server problem of Manasse, McGeoch and Sleator (J. Algorithms 11 (1990)) asks how kkk mobile servers in a metric space should respond, on-line, to a sequence of requests at points of the space, each of which must be covered by a server. It is the central model of on-line computation: paging is the special case of a uniform metric, and many caching and scheduling problems reduce to it. For two servers the deterministic picture is complete: the optimal competitive ratio is 222 on every metric space with at least three points.

Randomization changes the picture, and the smallest nontrivial case already shows how. On the equilateral triangle the optimal randomized ratio against an oblivious adversary is 3/23/23/2. Karlin, Manasse, McGeoch and Owicki (Algorithmica 11 (1994) 542–571) computed the exact optimal randomized ratio for several nonuniform triangles, where the distances differ, and showed that it depends on the geometry. Their Theorem 12 settles the whole family of isosceles triangles with edge lengths 111, ddd, ddd. These exact values are among the few known optimal randomized ratios for server problems.

Timeline:

  • 1990: Manasse, McGeoch and Sleator introduce the kkk-server problem and prove the deterministic two-server ratio is 222.
  • 1990–1994: Karlin, Manasse, McGeoch and Owicki submit this paper (received August 1990, revised September 1991) and publish it in Algorithmica in 1994, with the isosceles-triangle ratios of Theorem 12 and the 3-4-5 triangle ratio 1652/10691652/10691652/1069 of Theorem 13.
  • Later: Karloff, Rabani and Ravid extend the technique to Ω(log⁡log⁡k)\Omega(\log\log k)Ω(loglogk) and Ω(log⁡k)\Omega(\log k)Ω(logk) randomized lower bounds (cited on p. 564); Bubeck, Coester and Rabani (STOC 2023) refute the randomized kkk-server conjecture.

Setting

Fix an integer d≥1d\ge1d≥1. The isosceles triangle MMM has three points aaa, bbb, ccc with

dist⁡(a,b)=1,dist⁡(a,c)=dist⁡(b,c)=d.\operatorname{dist}(a,b)=1,\qquad \operatorname{dist}(a,c)=\operatorname{dist}(b,c)=d.dist(a,b)=1,dist(a,c)=dist(b,c)=d.

A configuration C:{0,1}→MC:\{0,1\}\to MC:{0,1}→M places two labelled servers on points of MMM. A deterministic on-line algorithm assigns to every finite request sequence σ=(r1,…,rn)\sigma=(r_1,\dots,r_n)σ=(r1​,…,rn​) a configuration, computed from σ\sigmaσ alone and covering the last request; its value on the empty sequence is its initial configuration. Its cost CA(σ)C_A(\sigma)CA​(σ) is the total distance its servers move while serving σ\sigmaσ request by request. The off-line optimum Copt(σ)C_{opt}(\sigma)Copt​(σ) from an initial configuration C0C_0C0​ is the least total movement of any schedule that starts at C0C_0C0​ and covers each request in turn, knowing σ\sigmaσ in advance.

A randomized algorithm is a probability distribution on deterministic on-line algorithms; its expected cost is ECA(σ)\mathbf{E}C_A(\sigma)ECA​(σ). It is ρ\rhoρ-competitive against an oblivious adversary from C0C_0C0​ if every algorithm in its support starts at C0C_0C0​ and there is a constant aaa such that

ECA(σ)≤ρ⋅Copt(σ)+afor every request sequence σ.\mathbf{E}C_A(\sigma)\le\rho\cdot C_{opt}(\sigma)+a\qquad\text{for every request sequence }\sigma.ECA​(σ)≤ρ⋅Copt​(σ)+afor every request sequence σ.

The request sequence is fixed in advance and does not react to the algorithm's coin flips.

Write ep=(1+1/p)pe_p=(1+1/p)^pep​=(1+1/p)p and

αd=e2d−1+1/4d(e2d−1−1)+1/2d,e2d−1=(2d2d−1)2d−1.\alpha_d=\frac{e_{2d-1}+1/4d}{(e_{2d-1}-1)+1/2d},\qquad e_{2d-1}=\left(\frac{2d}{2d-1}\right)^{2d-1}.αd​=(e2d−1​−1)+1/2de2d−1​+1/4d​,e2d−1​=(2d−12d​)2d−1.

In Lean this is NonuniformCompetitive.Isosceles.isoscelesRatio d.

Formalization targets

Goal: Theorem 12

For every d≥1d\ge1d≥1 and every initial configuration C0C_0C0​:

∀A, ∀ρ,A is ρ-competitive from C0 ⟹ ρ≥αd,\forall A,\ \forall\rho,\quad A\text{ is }\rho\text{-competitive from }C_0\ \Longrightarrow\ \rho\ge\alpha_d,∀A, ∀ρ,A is ρ-competitive from C0​ ⟹ ρ≥αd​, ∃A: A is αd-competitive from C0.\exists A:\ A\text{ is }\alpha_d\text{-competitive from }C_0.∃A: A is αd​-competitive from C0​.

The two claims are also milestones of their own (no_better_ratio, ratio_attained).

The phase LP (§5, pp. 565–566)

For free real π1,…,π2d−1\pi_1,\dots,\pi_{2d-1}π1​,…,π2d−1​ and real α\alphaα with

(πk)2d+∑i=1k(1−πi)≤αk  (1≤k<2d),2d+∑i=12d−1(1−πi)+12≤α⋅2d,(\pi_k)2d+\sum_{i=1}^k(1-\pi_i)\le\alpha k\ \ (1\le k<2d),\qquad 2d+\sum_{i=1}^{2d-1}(1-\pi_i)+\tfrac12\le\alpha\cdot2d,(πk​)2d+i=1∑k​(1−πi​)≤αk  (1≤k<2d),2d+i=1∑2d−1​(1−πi​)+21​≤α⋅2d,

one has α≥αd\alpha\ge\alpha_dα≥αd​ (lp_lower_bound); and πk=(αd−1)((2d/(2d−1))k−1)\pi_k=(\alpha_d-1)\big((2d/(2d-1))^k-1\big)πk​=(αd​−1)((2d/(2d−1))k−1), π2d=1\pi_{2d}=1π2d​=1 is nondecreasing from π1≥0\pi_1\ge0π1​≥0 to 111 and makes every constraint an equality (lp_attained).

The limit remark (§5, p. 566)

α1<α2<α3<⋯ ,lim⁡d→∞αd=ee−1\alpha_1<\alpha_2<\alpha_3<\cdots,\qquad \lim_{d\to\infty}\alpha_d=\frac{e}{e-1}α1​<α2​<α3​<⋯,d→∞lim​αd​=e−1e​

(ratio_increases_to_e_ratio).

Significance

The theorem gives an exact optimal randomized ratio for an infinite family of metric spaces. It shows that the optimal randomized two-server ratio is not a constant: it runs from 3/23/23/2 on the equilateral triangle to e/(e−1)≈1.582e/(e-1)\approx1.582e/(e−1)≈1.582 as the triangle becomes long and thin, where the problem resembles ski rental. With the deterministic ratio 222, it quantifies exactly how much randomization gains on these spaces.

The results are proved in the paper; none is formalized on Prove2Me, and no machine-checked proof of them is known. A formal proof would require the paper's phase framework (Theorems 1–3 and the appendix's Theorem 15) for server problems, which this mission does not state separately, and a concrete randomized algorithm as a measurable mixed strategy. Both would be reusable for Theorem 13 (the 3-4-5 triangle) and for other exact ratios on small metric spaces.

Difficulty

The phase LP milestones are finite real arithmetic. The difficulty is the passage between them and the goal. The lower bound must hold for every randomized algorithm, not only phase-based lazy ones: an arbitrary algorithm may condition on the whole history, move non-lazily, and randomize in ways that do not reduce to the probabilities πk\pi_kπk​. The paper handles this with Theorem 3, which says that the LP bound of phase-based algorithms bounds the competitive factor of all algorithms; its proof uses an averaging argument over histories that must be made rigorous. The upper bound needs a mixed strategy over infinitely many phases, with measurable costs, an explicit additive constant covering the first partial phase from an arbitrary initial configuration, and an accounting of CoptC_{opt}Copt​ across phase boundaries.

Formalization scope

The model is the platform's published KServer_model and KServer_randomized (reference items): labelled servers Fin 2 → M; a deterministic on-line algorithm as a map from request prefixes to configurations; a randomized algorithm as a probability measure over deterministic algorithms, with the cost of each fixed sequence measurable in the random outcome; expected cost as a lower Lebesgue integral in [0,∞][0,\infty][0,∞]; the off-line optimum as a real infimum over schedules from C0C_0C0​ (nonempty and bounded below by 000); and IsCompetitiveFrom A C₀ c with a real additive constant.

Committed conventions:

  • The triangle is any metric space whose points are exactly a,b,ca,b,ca,b,c at distances 1,d,d1,d,d1,d,d, with ddd a natural number and d≥1d\ge1d≥1. Every such space is isometric to the paper's triangle; at d=0d=0d=0 it would not be a triangle.
  • Both claims are stated for every initial configuration, including both servers on one point. The paper treats the initial state {a,b}\{a,b\}{a,b} separately and absorbs the first partial phase into the additive constant.
  • The lower bound quantifies over all randomized algorithms (deterministic ones are point masses), never over phase-based ones only.
  • In the LP milestones the πk\pi_kπk​ are free reals, as printed; no box 0≤πk≤10\le\pi_k\le10≤πk​≤1 is imposed.
  • "Grows" in the limit remark is read as strictly increasing.
  • The paper prints the recurrence on p. 565 as πk=α−1+(πk−1)2d−12d\pi_k=\frac{\alpha-1+(\pi_{k-1})2d-1}{2d}πk​=2dα−1+(πk−1​)2d−1​; the equations (∗)(*)(∗) give πk=α−1+2d πk−12d−1\pi_k=\frac{\alpha-1+2d\,\pi_{k-1}}{2d-1}πk​=2d−1α−1+2dπk−1​​. The recurrence is not used; the closed form printed on p. 566 is correct and is the one stated.

Without the measurability field of a randomized algorithm the lower integral would under-report expected cost and the attainment claim would become easier than the paper's; the published definition includes it. The lower bound is not vacuous: the triangle hypotheses are satisfiable for every d≥1d\ge1d≥1.

Welcome contributions: a formal version of the phase framework (Theorems 1–3, 15) for finite metric spaces, reusable across missions III and IV; a measurable construction of phase-based randomized algorithms; and proofs of the LP milestones.

Selected references

  • A. R. Karlin, M. S. Manasse, L. A. McGeoch, S. Owicki, Competitive Randomized Algorithms for Nonuniform Problems, Algorithmica 11 (1994) 542–571. https://doi.org/10.1007/BF01189993
  • M. S. Manasse, L. A. McGeoch, D. D. Sleator, Competitive Algorithms for Server Problems, J. Algorithms 11 (1990) 208–230. https://doi.org/10.1016/0196-6774(90)90003-W
  • H. Karloff, Y. Rabani, Y. Ravid, Lower Bounds for Randomized k-Server and Motion-Planning Algorithms, SIAM J. Comput. 23 (1994) 293–312. https://doi.org/10.1137/S0097539792224838
  • S. Bubeck, C. Coester, Y. Rabani, The Randomized k-Server Conjecture Is False!, STOC 2023. https://arxiv.org/abs/2211.05753
9 thms5 active usersReviewed
🏆Completed
Captain: xuanji

AlphaEvolve Eighth-Power Bound: omega < 2.371177Research Paper

Formalize ω<2.371177\omega < 2.371177ω<2.371177, the current record from Dupont, Eisenberger, Kozlovskii, Mehrabian, Ruiz, See, Zhou, Alman, Vassilevska Williams and Balog (arXiv:2608.16884, August 2026).

The paper applies the combination-loss laser method of Alman et al. (arXiv:2404.16349), formalized here as the ω<2.37134\omega < 2.37134ω<2.37134 entry, to CW5⊗8CW_5^{\otimes 8}CW5⊗8​. That is level ℓ∗=4\ell^* = 4ℓ∗=4 instead of 3, with an exact rational certificate of about 7⋅1067\cdot 10^67⋅106 parameters found by gradient-based optimization and AlphaEvolve. The authors state that the solution and verification code are being prepared for release.

9 thms5 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

Competitive Paging Algorithms IV: An Algorithm Competitive against Several Others Exists iff the Reciprocal Ratios Sum to at Most 1Research Paper

Motivation

Paging is the problem of managing a fast memory that holds kkk pages out of nnn: when a requested page is not in fast memory (a page fault), some resident page must be evicted, and the cost of an algorithm is its number of faults. Practitioners have many eviction rules. Least-recently-used (LRU) performs well on real workloads but can be kkk times worse than the optimal off-line schedule; the randomized marking algorithm of the same paper is 2Hk2H_k2Hk​-competitive and so has better worst-case guarantees. Fiat, Karp, Luby, McGeoch, Sleator and Young asked in 1991 whether one on-line algorithm can combine the advantages of several given ones, and answered the question exactly: the attainable combinations of ratios are characterized by one inequality (arXiv:cs/0205038, §6).

The question of combining on-line algorithms has since become a theme of its own: combining heuristics with worst-case-safe algorithms, and, more recently, combining machine-learned predictions with robust fallbacks, both ask for the same kind of guarantee against several reference algorithms at once.

Setting

A type (k,n)(k,n)(k,n) consists of kkk servers and a finite set MMM of nnn vertices with the uniform metric: two distinct vertices are at distance 111. This is paging: vertices are pages, the vertices covered by servers are the pages in fast memory, and a server move is a page fault.

A deterministic on-line algorithm AAA of type (k,n)(k,n)(k,n) has an initial configuration of its kkk servers and, after each request r∈Mr\in Mr∈M, moves servers so that some server covers rrr; its configuration after a request sequence depends only on that sequence. Its cost CA(σ)C_A(\sigma)CA​(σ) on a request sequence σ\sigmaσ is the total distance its servers travel, i.e. the number of server moves.

For algorithms AAA and BBB of the same type and a constant ccc, AAA is ccc-competitive against BBB if there is a constant aaa such that for every request sequence σ\sigmaσ

CA(σ)≤c⋅CB(σ)+a.C_A(\sigma)\le c\cdot C_B(\sigma)+a .CA​(σ)≤c⋅CB​(σ)+a.

A sequence c∗=(c(1),…,c(m))c^*=(c(1),\dots,c(m))c∗=(c(1),…,c(m)) of positive reals is realizable if for every type (k,n)(k,n)(k,n) and every mmm deterministic on-line algorithms B(1),…,B(m)B(1),\dots,B(m)B(1),…,B(m) of that type there is a deterministic on-line algorithm AAA of the same type that is c(i)c(i)c(i)-competitive against B(i)B(i)B(i) for every iii.

Formalization targets

Goal: Theorem 6

For m≥1m\ge1m≥1 and positive reals c(1),…,c(m)c(1),\dots,c(m)c(1),…,c(m),

c∗ is realizable  ⟺  ∑1≤i≤m1c(i)≤1.c^*\ \text{is realizable}\iff \sum_{1\le i\le m}\frac1{c(i)}\le 1 .c∗ is realizable⟺1≤i≤m∑​c(i)1​≤1.

Milestones

In the order of the paper's proof:

  1. Punishments are paid for. If AAA punishes BBB at a time step (an AAA-interval on a vertex vvv ends at that step and contains the end of a BBB-interval on vvv that began no later), then BBB has moved a server; the number of such steps is at most CB(σ)C_B(\sigma)CB​(σ).
  2. A fault leaves room to punish. If ∣SA∣=k|S_A|=k∣SA​∣=k, ∣SB∣≤k|S_B|\le k∣SB​∣≤k, x∈SBx\in S_Bx∈SB​ and x∉SAx\notin S_Ax∈/SA​, then some u∈SAu\in S_Au∈SA​ is not in SBS_BSB​.
  3. The greedy quota claim. If ∑i1/c(i)≤1\sum_i 1/c(i)\le 1∑i​1/c(i)≤1 and each unit of cost punishes the B(i)B(i)B(i) minimizing c(i)(PUN(i)+1)c(i)(\mathrm{PUN}(i)+1)c(i)(PUN(i)+1) (other algorithms may be punished incidentally), then after cost rrr every B(i)B(i)B(i) has been punished at least ⌊r/c(i)⌋\lfloor r/c(i)\rfloor⌊r/c(i)⌋ times.
  4. Shuttle algorithms. With 2m−12m-12m−1 servers on 2m2m2m vertices there are mmm algorithms, each keeping all vertices outside its own pair covered, no two of which move at the same step; in particular their total cost on any σ\sigmaσ is at most ∣σ∣|\sigma|∣σ∣.
  5. A forcing adversary. With 2m−12m-12m−1 servers on 2m2m2m vertices every algorithm can be forced to move at each of NNN steps, so CA(τ(N))≥NC_A(\tau(N))\ge NCA​(τ(N))≥N.

Significance

The result. Theorem 6 is an exact characterization, not a bound: the region of simultaneously attainable ratios against arbitrary deterministic paging algorithms is {c:∑1/c(i)≤1}\{c:\sum 1/c(i)\le 1\}{c:∑1/c(i)≤1}. For example, any two paging algorithms can be combined into one that is 222-competitive against each, and no better symmetric pair is possible in general. Combined with Theorem 7 of the same paper (not part of this mission), the same region is attainable against randomized algorithms, which is how LRU's practical behaviour and the marking algorithm's 2Hk2H_k2Hk​ worst-case guarantee can be obtained within constant factors by one algorithm.

Formalizing it. The theorem has been proved since 1991; no machine-checked proof is known. A formal proof produces a reusable notion of competitiveness of one on-line algorithm against another, built on the published KServer_model definitions, and a formal account of the scheduling fact at the core of the sufficiency proof.

Difficulty

Sufficiency looks like an averaging argument, but the combined algorithm cannot simulate the B(i)B(i)B(i) and follow one of them: switching between their configurations costs up to kkk per switch, which no additive constant absorbs. The accounting has to charge each of AAA's faults to a specific move of a specific B(i)B(i)B(i), and the charge must be injective; the paper's claim that CB(σ)C_B(\sigma)CB​(σ) is at least the number of punishments is where this happens, and it depends on how server intervals are matched. The allocation of faults to algorithms is then a deadline-scheduling problem whose feasibility is exactly ∑1/c(i)≤1\sum 1/c(i)\le 1∑1/c(i)≤1, and the floor functions make the counting delicate at the boundary. The paper's own definition of punishment only counts intervals that start with a move, so the first kkk faults of AAA (servers on their initial vertices) need separate treatment; they are absorbed by the additive constant.

Necessity needs the right family of hard instances: the mmm algorithms must never move at the same step, which pins the type to (2m−1,2m)(2m-1,2m)(2m−1,2m).

Formalization scope

The Lean development works in the namespace CompetitivePaging.Combining and imports the published KServer_model definitions: KServer.OnlineAlgorithm k M (a configuration map from request prefixes to Fin k → M with a serving condition) and OnlineAlgorithm.cost. Committed conventions:

  • a type (k,n)(k,n)(k,n) is any k : ℕ and any finite M : Type with a metric in which distinct points are at distance 111; realizability quantifies over all of them, never over one fixed type;
  • servers are labelled; each algorithm has its own initial configuration, and the additive constant aaa is chosen before the request sequence;
  • c(i)>0c(i)>0c(i)>0 and m≥1m\ge1m≥1 are hypotheses of the goal, as in the paper; without positivity, 1/0=01/0=01/0=0 in Lean would make a zero ratio free;
  • time ttt is the step processing the ttt-th request; the paper's PUN\mathrm{PUN}PUN counts time steps.

Trivializing encodings are ruled out: realizability is not stated for a single fixed type, the metric is not the metric of Fin n, and the competitive constant is not allowed to depend on the request sequence.

A complete proof needs the construction of the punishing algorithm as a KServer.OnlineAlgorithm (a lazy, injective algorithm whose moves depend on the prefix and on the B(i)B(i)B(i)'s configurations), the injective charging argument, the scheduling lemma, and the explicit shuttle algorithms. The scheduling lemma and the charging lemma are independent of paging and reusable. Proofs of any milestone are welcome, as are alternative statements of the sufficiency construction.

Selected references

  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive Paging Algorithms, J. Algorithms 12(4):685–699, 1991. doi:10.1016/0196-6774(91)90041-V; preprint arXiv:cs/0205038.
  • D. D. Sleator, R. E. Tarjan, Amortized efficiency of list update and paging rules, Comm. ACM 28(2):202–208, 1985. doi:10.1145/2786.2793
  • M. S. Manasse, L. A. McGeoch, D. D. Sleator, Competitive algorithms for server problems, J. Algorithms 11(2):208–230, 1990. doi:10.1016/0196-6774(90)90003-W
9 thms5 active usersReviewed
🏆Completed
CombinatoricsComplexity TheoryOperations Research·Captain: mikedeng1

Scheduling Subject to Resource Constraints: Classification and Complexity I: Unit-Time Chains on Two Identical Machines with One Unit Resource Are Strongly NP-hardResearch Paper

Resource constraints and the easy/hard borderline in scheduling

Machine scheduling asks how to assign jobs to machines over time so that a criterion such as the makespan Cmax⁡C_{\max}Cmax​, the time at which the last job completes, is as small as possible. In practice jobs also compete for scarce resources beyond the machines themselves: tools, operators, memory, power. Błażewicz, Lenstra and Rinnooy Kan (DAM 1983) extended the standard three-field classification α∣β∣γ\alpha\mid\beta\mid\gammaα∣β∣γ of Graham, Lawler, Lenstra and Rinnooy Kan (1979) by a resource field resλσρres\lambda\sigma\rhoresλσρ. They then settled the complexity of every problem with parallel identical or uniform machines, unit-time jobs, precedence constraints and the Cmax⁡C_{\max}Cmax​ criterion. Their Fig. 2 separates the maximal polynomially solvable problems from the minimal NP-hard ones, and it has been the reference map for resource-constrained scheduling since.

Brief timeline of the problems involved:

  • 1975. Garey and Johnson (SIAM J. Comput. 4) show that P2∣res⋯ ,pj=1∣Cmax⁡P2\mid res\cdots, p_j=1\mid C_{\max}P2∣res⋯,pj​=1∣Cmax​ is solvable in polynomial time via matchings, and that P3∣res1⋅⋅,pj=1∣Cmax⁡P3\mid res1\cdot\cdot, p_j=1\mid C_{\max}P3∣res1⋅⋅,pj​=1∣Cmax​ and P2∣res1⋅⋅,tree,pj=1∣Cmax⁡P2\mid res1\cdot\cdot, tree, p_j=1\mid C_{\max}P2∣res1⋅⋅,tree,pj​=1∣Cmax​ are NP-hard in the strong sense, by reduction from 3-PARTITION.
  • 1976. Ullman (Complexity of sequencing problems, in Coffman, ed., Computer & Job/Shop Scheduling Theory, Wiley) gives strong NP-hardness of P2∣res111,prec,pj=1∣Cmax⁡P2\mid res111, prec, p_j=1\mid C_{\max}P2∣res111,prec,pj​=1∣Cmax​ under arbitrary precedence constraints.
  • 1983. Błażewicz, Lenstra and Rinnooy Kan prove Theorem 7: chains suffice. Two identical machines, one resource of size one, requirements in {0,1}\{0,1\}{0,1} and chain-like precedence already give a strongly NP-hard problem. The result dominates both earlier two-machine results.

Setting

There are nnn jobs J1,…,JnJ_1,\dots,J_nJ1​,…,Jn​ and mmm machines M1,…,MmM_1,\dots,M_mM1​,…,Mm​. Every job has processing time 111 on every machine, each machine handles at most one job at a time, and jobs are not preempted. There are lll resources; resource RhR_hRh​ has a positive integer size shs_hsh​, the amount available at any time, and job JjJ_jJj​ has a nonnegative integer requirement rhjr_{hj}rhj​, the amount it holds throughout its execution. A directed acyclic graph HHH on the jobs gives the precedence constraints: if HHH has a path from jjj to kkk (Jj→JkJ_j\to J_kJj​→Jk​), then JjJ_jJj​ must complete before JkJ_kJk​ starts. The precedence is chain-like when every vertex of HHH has indegree and outdegree at most one.

A schedule gives each job a machine and a real start time SjS_jSj​; the job occupies [Sj,Sj+1)[S_j, S_j+1)[Sj​,Sj​+1) and completes at Cj=Sj+1C_j = S_j+1Cj​=Sj​+1. It is feasible if jobs on one machine do not overlap, precedence is respected, and at every time ttt the jobs running at ttt require at most shs_hsh​ of each resource RhR_hRh​. The makespan is Cmax⁡=max⁡jCjC_{\max} = \max_j C_jCmax​=maxj​Cj​.

The problem P2∣res111,chain,pj=1∣Cmax⁡P2\mid res111, chain, p_j=1\mid C_{\max}P2∣res111,chain,pj​=1∣Cmax​ restricts this to m=2m=2m=2, one resource (λ=1\lambda=1λ=1) of size 111 (σ=1\sigma=1σ=1), every requirement at most 111 (ρ=1\rho=1ρ=1), and chain-like precedence. The problem P3∣res1⋅⋅,pj=1∣Cmax⁡P3\mid res1\cdot\cdot, p_j=1\mid C_{\max}P3∣res1⋅⋅,pj​=1∣Cmax​ has m=3m=3m=3, one resource of arbitrary size and requirements, and no precedence.

3-PARTITION: given ttt, a positive integer bbb and positive integers a1,…,a3ta_1,\dots,a_{3t}a1​,…,a3t​ with ∑jaj=tb\sum_j a_j = tb∑j​aj​=tb and 14b<aj<12b\tfrac14 b<a_j<\tfrac12 b41​b<aj​<21​b, can {1,…,3t}\{1,\dots,3t\}{1,…,3t} be split into ttt disjoint 3-element sets SiS_iSi​ with ∑j∈Siaj=b\sum_{j\in S_i}a_j=b∑j∈Si​​aj​=b?

A problem is NP-hard in the strong sense if it remains NP-hard when every number of the instance is written in unary.

Formalization targets

Goal: Theorem 7

3-PARTITION is NP-hard in the strong sense  ⟹  P2∣res111, chain, pj=1∣Cmax⁡ is NP-hard in the strong sense.\text{3-PARTITION is NP-hard in the strong sense} \;\Longrightarrow\; P2\mid res111,\ chain,\ p_j=1\mid C_{\max}\ \text{is NP-hard in the strong sense.}3-PARTITION is NP-hard in the strong sense⟹P2∣res111, chain, pj​=1∣Cmax​ is NP-hard in the strong sense.

The hypothesis is Garey and Johnson's theorem on 3-PARTITION, which the paper cites and does not prove. The conclusion concerns the decision version: given an instance and y∈Ny\in\mathbb Ny∈N, is there a feasible schedule with Cmax⁡≤yC_{\max}\le yCmax​≤y?

Milestones

  1. Proof of Theorem 4, the saturation equivalence. For positive bbb, aja_jaj​ with ∑jaj=tb\sum_j a_j=tb∑j​aj​=tb, the P3∣res1⋅⋅P3\mid res1\cdot\cdotP3∣res1⋅⋅ instance with 3t3t3t unit jobs, resource size bbb and requirements aja_jaj​ has a feasible schedule with Cmax⁡≤tC_{\max}\le tCmax​≤t iff the 3-PARTITION instance has a solution.
  2. Theorem 4 (Garey and Johnson). Under the same hypothesis as the goal, P3∣res1⋅⋅,pj=1∣Cmax⁡P3\mid res1\cdot\cdot, p_j=1\mid C_{\max}P3∣res1⋅⋅,pj​=1∣Cmax​ is NP-hard in the strong sense.
  3. Proof of Theorem 7, "if". A 3-PARTITION solution yields a feasible schedule of the constructed two-machine instance with Cmax⁡=2tbC_{\max}=2tbCmax​=2tb.
  4. Proof of Theorem 7, "only if". A feasible schedule of the constructed instance with Cmax⁡≤2tbC_{\max}\le 2tbCmax​≤2tb yields a 3-PARTITION solution.

Significance

Theorem 7 is the sharpest hardness result of the paper's classification. Without resources, two-machine unit-time scheduling with arbitrary precedence is polynomial (Coffman and Graham, Acta Inform. 1972); without precedence, it is polynomial under arbitrary resources (Theorem 1 of the paper). The theorem shows that combining the weakest nontrivial versions of both constraints, chains and one unit resource, already crosses the borderline. The paper's §4.1 extends the same reduction to the ∑Cj\sum C_j∑Cj​ and Lmax⁡L_{\max}Lmax​ criteria.

On the formal side, the mission provides a machine-checked model of resource-constrained scheduling with real start times, a definition of NP-hardness in the strong sense on top of the platform's Turing-machine formalization of P\mathrm PP and NP\mathrm{NP}NP, and 3-PARTITION as a reusable source problem. As far as the platform's corpus shows, none of Theorems 4 and 7, 3-PARTITION, or strong NP-hardness has been formalized before. Both theorems are proved in the literature; what remains is to formalize the reductions and their polynomial running time.

Difficulty

The combinatorial heart is the "only if" direction: a schedule of length 2tb2tb2tb must be shown to be rigid. Start times are arbitrary reals, so the first obstacle is to show that both machines are busy throughout [0,2tb)[0,2tb)[0,2tb), that the chain LLL forces unit spacing, and that the primed jobs of the chains Kj′K'_jKj′​ can only run in the intervals the chain LLL leaves free of the resource. Only after this is established can the index sets SiS_iSi​ be read off. Arguing on integer time slots from the start is not enough: the model allows fractional start times, and ruling them out is part of the proof.

The second obstacle is the complexity layer. NP-hardness is stated with respect to polynomial-time many-one reductions computed by one-tape Turing machines. The reduction from 3-PARTITION therefore has to be implemented and its running time bounded on unary codes. The constructed instance has 4tb4tb4tb jobs, which is polynomial in the unary length of the 3-PARTITION instance; this is exactly why the reduction proves hardness in the strong sense.

Formalization scope

  • Model. Jobs are Fin n and machines Fin m, 0-based. Only identical machines with unit processing times are modelled. Start times are real, execution intervals are half-open, and the resource constraint is imposed at every real time. Precedence is the transitive closure of the arc list of HHH. Cmax⁡=0C_{\max}=0Cmax​=0 for an empty instance.
  • Decision version. Thresholds yyy are natural numbers; this narrower class makes the hardness statement stronger.
  • Encoding. An instance is described by its list of numbers (n,m,ln,m,ln,m,l, the sizes, the requirements row by row, the number of arcs and the arcs, then yyy). The unary language is the set of unary codes of yes-instances over a two-letter alphabet. No pairing function is used. The class conditions (two machines, one unit resource, requirements at most one, chain-like acyclic HHH) are part of the yes-predicate.
  • Strong sense. Strong NP-hardness is NP-hardness of the unary language. This is equivalent to Garey and Johnson's definition, which bounds the largest number by a polynomial in the instance length.
  • Cited hypothesis. The goal and Theorem 4 assume strong NP-hardness of 3-PARTITION (with 14b<aj<12b\tfrac14 b<a_j<\tfrac12 b41​b<aj​<21​b) and nothing else. Stating the goal as a bare reduction between the two languages, or adding P≠NP\mathrm P\ne\mathrm{NP}P=NP, would not be Theorem 7.
  • Constructions. The two scheduling instances built from a 3-PARTITION instance are explicit definitions following the page, not arbitrary instances with a property.
  • Reuse. The scheduling model and the strong-NP-hardness layer are shared with the other missions of this series; 3-PARTITION serves any strong NP-hardness proof by number partitioning.

Welcome contributions: proofs of the four milestones; a formalized polynomial-time implementation of the reduction on unary codes; general lemmas about composing polynomial-time reductions on the one-tape machine model.

Selected references

  • J. Błażewicz, J. K. Lenstra, A. H. G. Rinnooy Kan, Scheduling subject to resource constraints: classification and complexity, Discrete Applied Mathematics 5 (1983) 11–24. https://doi.org/10.1016/0166-218X(83)90012-4
  • M. R. Garey, D. S. Johnson, Complexity results for multiprocessor scheduling under resource constraints, SIAM J. Comput. 4 (1975) 397–411. https://doi.org/10.1137/0204035
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, Freeman, 1979.
  • R. L. Graham, E. L. Lawler, J. K. Lenstra, A. H. G. Rinnooy Kan, Optimization and approximation in deterministic sequencing and scheduling: a survey, Ann. Discrete Math. 5 (1979) 287–326. https://doi.org/10.1016/S0167-5060(08)70356-X
  • J. D. Ullman, Complexity of sequencing problems, in: E. G. Coffman, Jr., ed., Computer & Job/Shop Scheduling Theory, Wiley, 1976, 139–164.
  • E. G. Coffman, Jr., R. L. Graham, Optimal scheduling for two-processor systems, Acta Informatica 1 (1972) 200–213. https://doi.org/10.1007/BF00288685
  • S. Cook, The P versus NP problem, Clay Mathematics Institute official problem description.
11 thms5 active usersReviewed
🏆Completed
Machine LearningProbabilityStatistics·Captain: mikedeng1

Foundations of Machine Learning V: Kernel Methods and the Representer TheoremTextbook

Motivation

Linear methods like SVMs work only when the classes are linearly separable, but most real data is not. Chapter 6 shows how to get non-linear decision boundaries for free: replace the input space's inner product with a kernel KKK that implicitly computes an inner product in a (possibly very high- or infinite-dimensional) feature space, without ever explicitly computing the feature mapping. This works for any positive definite symmetric (PDS) kernel — and the chapter's central theorem shows that such a kernel always induces a genuine Hilbert space (the reproducing kernel Hilbert space, RKHS) in which the kernel is literally an inner product. The chapter's capstone, the representer theorem, then shows that a broad class of optimization problems over this (possibly infinite-dimensional) Hilbert space always has a solution expressible as a finite linear combination of kernel evaluations at the training points — turning an infinite-dimensional problem into a finite, mmm-dimensional one.

Setting

A kernel K:X×X→RK:X\times X\to\mathbb RK:X×X→R is PDS (Definition 6.3) if for every finite sample {x1,…,xm}⊆X\{x_1,\dots,x_m\}\subseteq X{x1​,…,xm​}⊆X, the Gram matrix [K(xi,xj)][K(x_i,x_j)][K(xi​,xj​)] is symmetric positive semidefinite. Theorem 6.8 shows every PDS kernel is an inner product K(x,x′)=⟨Φ(x),Φ(x′)⟩K(x,x')=\langle \Phi(x),\Phi(x')\rangleK(x,x′)=⟨Φ(x),Φ(x′)⟩ in some Hilbert space HHH (the RKHS), which further has the reproducing property h(x)=⟨h,K(x,⋅)⟩h(x)=\langle h,K(x,\cdot)\rangleh(x)=⟨h,K(x,⋅)⟩ for every h∈Hh\in Hh∈H — evaluating hhh at a point is itself an inner product with the kernel section at that point. Theorem 6.10 shows PDS kernels are closed under sum, product, tensor product, pointwise limit, and power-series composition, letting complex kernels (Gaussian, and many others) be built from simple ones (polynomial kernels) without re-verifying positive-semidefiniteness from scratch. Section 6.3's representer theorem (Theorem 6.11) then considers minimizing, over h∈Hh\in Hh∈H, an objective F(h)=G(∥h∥H)+L(h(x1),…,h(xm))F(h)=G(\|h\|_H)+L(h(x_1),\dots,h(x_m))F(h)=G(∥h∥H​)+L(h(x1​),…,h(xm​)) that depends on hhh only through its norm and its values at mmm fixed points.

Formalization targets

Theorem 6.8 (RKHS existence, milestone). For a PDS kernel KKK, there exist a Hilbert space HHH and Φ:X→H\Phi:X\to HΦ:X→H with K(x,x′)=⟨Φ(x),Φ(x′)⟩K(x,x')=\langle\Phi(x),\Phi(x')\rangleK(x,x′)=⟨Φ(x),Φ(x′)⟩, and HHH has the reproducing property h(x)=⟨h,K(x,⋅)⟩h(x)=\langle h,K(x,\cdot)\rangleh(x)=⟨h,K(x,⋅)⟩ for all h∈Hh\in Hh∈H, x∈Xx\in Xx∈X.

Theorem 6.10 (closure properties, milestone). PDS kernels are closed under sum, product, tensor product, pointwise limit, and power-series composition with non-negative coefficients.

Theorem 6.11 — the mission's goal. For any non-decreasing G:R→RG:\mathbb R\to\mathbb RG:R→R and any loss L:Rm→R∪{+∞}L:\mathbb R^m\to\mathbb R\cup\{+\infty\}L:Rm→R∪{+∞}, argminh∈HG(∥h∥H)+L(h(x1),…,h(xm))\mathrm{argmin}_{h\in H} G(\|h\|_H)+ L(h(x_1),\dots,h(x_m))argminh∈H​G(∥h∥H​)+L(h(x1​),…,h(xm​)) admits a solution h⋆=∑i=1mαiK(xi,⋅)h^\star=\sum_{i=1}^m\alpha_i K(x_i,\cdot)h⋆=∑i=1m​αi​K(xi​,⋅); if GGG is increasing, every solution has this form.

Significance

Theorem 6.11 is the chapter's payoff and one of the most widely used structural results in kernel methods: it explains, in one general statement covering SVMs, kernel ridge regression, Gaussian process MAP estimation and many other algorithms simultaneously, why the dual (finite, mmm-coefficient) formulation always suffices — the RKHS's infinite dimensionality never has to be confronted directly. Theorem 6.8 is the structural fact the whole chapter (and every later kernelized algorithm in the book, chapters 9-11, 15) depends on: without it, "PDS kernel" would be a purely combinatorial condition on Gram matrices with no guarantee it corresponds to any actual inner product. No prior art on the Prove2Me platform is faithful to any of this chapter's content: GET /theorems?q=Representer theorem and q=reproducing kernel return no faithful match (one unrelated hit concerns a Gaussian-measure reproducing kernel in a different, probabilistic context, not this chapter's PDS-kernel/RKHS construction). All six items are drafted fresh.

Difficulty

Theorem 6.8's proof is a genuine construction: define H0H_0H0​ as finite linear combinations of kernel sections Φ(x)=K(x,⋅)\Phi(x)=K(x,\cdot)Φ(x)=K(x,⋅), define an inner product on H0H_0H0​ using KKK itself, verify it is well-defined (independent of the representation), positive semidefinite (via the PDS hypothesis), and — via the Cauchy-Schwarz-for-PDS-kernels lemma (Lemma 6.7) — actually positive definite, then complete H0H_0H0​ to a genuine Hilbert space HHH in which it is dense, and finally extend the reproducing property from the dense subspace H0H_0H0​ to all of HHH by a continuity argument. This is substantial analysis, not a restatement. Theorem 6.11's proof uses the orthogonal decomposition H=H1⊕H1⊥H=H_1\oplus H_1^\perpH=H1​⊕H1⊥​ (where H1=span{K(xi,⋅)}H_1=\mathrm{span}\{K(x_i, \cdot)\}H1​=span{K(xi​,⋅)}) and the reproducing property to show the orthogonal component h⊥h^\perph⊥ never helps and, when GGG is strictly increasing, strictly hurts — a short argument, but one that depends essentially on Theorem 6.8's reproducing property holding for the specific HHH constructed, not just any Hilbert space with the kernel as its inner product.

Formalization scope

IsPDS uses the book's own second SPSD characterization (c^T K c ≥ 0 for every finite sample and coefficient vector c) rather than the non-negative-eigenvalues characterization, avoiding spectral theory for a Prop-valued definition; the book states the two are equivalent. IsRKHSOf and IsMinimizer are formalization scaffolding, not book-numbered definitions: IsRKHSOf packages Theorem 6.8's own two displayed equations (6.8, 6.9) as a reusable predicate shared between Theorem 6.8 (its conclusion) and Theorem 6.11 (its "H its corresponding RKHS" hypothesis), using an explicit evaluation map ev : H → X → ℝ to stand in for "elements of H are functions on X," since Mathlib's abstract Hilbert spaces are not themselves spaces of functions; IsMinimizer packages argmin. Both X in Theorem 6.8's existential and Theorem 6.11's ambient type are plain Type rather than Type*, avoiding universe-polymorphic quantification over the constructed Hilbert space's own type — a harmless simplification, since every application in this book instantiates X at a concrete, small type (typically RN\mathbb R^NRN or a finite set). Theorem 6.11's loss codomain ℝ ∪ {+∞} is WithTop ℝ, not EReal (which would also admit -∞, an unstated generalization the book's own display does not license, since EReal's ⊤+⊥=⊥ collapse is a genuine faithfulness risk the book's own L:\mathbb R^m\to\mathbb R\cup\{+\infty\} avoids by construction). WithTop ℝ on its own does not avoid every collapse, though: an unconstrained L may be the constant function ⊤ (a legal instance of ℝ∪\{+\infty\}), forcing the objective identically ⊤ and every point to vacuously minimize it, which would make the theorem's second conjunct false. An added hypothesis, ∃ h₀, F h₀ ≠ ⊤, makes explicit the book's own implicit assumption that the objective is finite somewhere — see the Formalization scope note below. Theorem 6.11's two clauses are otherwise kept exactly as distinct as the book states them: existence needs only Monotone G (non-decreasing); "any solution has this form" needs StrictMono G (increasing) as an added hypothesis on the second conjunct only — per this chunk's own BRIEF.md, the crux of the theorem, and the trap this mission is most careful to avoid collapsing. Theorem 6.10's five closure clauses are stated as one conjunction (matching the book's single theorem, not five separate items); the power-series clause keeps the book's own radius-of-convergence domain restriction and adds an explicit summability hypothesis guarding the ∑' term.

Not formalized: Theorem 6.2 (Mercer's condition) — not needed by the goal's own proof chain (it is an equivalent characterization of PDS mentioned before the RKHS construction, not a premise Theorem 6.8's or 6.11's proof invokes) and its own hypotheses (compact X⊂RNX\subset \mathbb R^NX⊂RN, continuous KKK, an eigenfunction expansion of a compact self-adjoint integral operator) are real analytic content this mission's budget does not include; Lemma 6.7 (Cauchy-Schwarz for PDS kernels) and Lemma 6.9 (normalized PDS kernels) — supporting lemmas for Theorem 6.8's proof, not independently numbered results the goal cites; Theorem 6.12/Corollary 6.13 (Rademacher complexity/margin bounds for kernel-based hypotheses) — the chapter's optional further milestone, connecting to chunks 03/05's machinery, cut for budget; §6.5-6.8 (sequence kernels, weighted transducers, rational kernels, Bochner's theorem, approximate feature maps) — explicitly out of scope per this chunk's own BRIEF.md, a distinct, applications-heavy topic.

Selected references

  • M. Mohri, A. Rostamizadeh, A. Talwalkar, Foundations of Machine Learning, 2nd ed., MIT Press, 2018, Chapter 6, §6.1-6.4.
  • B. Schölkopf, R. Herbrich, A. J. Smola, "A generalized representer theorem," COLT 2001, Lecture Notes in Computer Science 2111, 2001, 416-426.
  • N. Aronszajn, "Theory of reproducing kernels," Transactions of the American Mathematical Society 68(3), 1950, 337-404.
7 thms5 active users
🏆Completed
Captain: marwahaha

Coppersmith–Winograd Bound: omega < 2.376Research Paper

AI generated but i think correct. I think the milestones make it really annoying but the central theorem looks correct.

Motivation

The matrix-multiplication exponent measures the asymptotic number of field operations needed to multiply two square matrices. A bound ω<c\omega<cω<c means that, for every ε>0\varepsilon>0ε>0, two n×nn\times nn×n matrices can be multiplied using O(nc+ε)O(n^{c+\varepsilon})O(nc+ε) arithmetic operations. Matrix multiplication is a central benchmark in algebraic complexity and a primitive for many algorithms in linear algebra, graph theory, and symbolic computation.

After Strassen showed that ω<3\omega<3ω<3, a sequence of tensor constructions reduced the exponent further. Schönhage's asymptotic sum inequality made it possible to exploit simultaneous matrix products rather than a single square product. In 1990, Don Coppersmith and Shmuel Winograd combined an explicit low-border-rank tensor with a block extraction argument based on Salem--Spencer sets. Their basic analysis gave ω<2.38719\omega<2.38719ω<2.38719; coupling the random weights in the tensor square sharpened this to ω<2.375477\omega<2.375477ω<2.375477, hence the exact rational consequence ω<2.376\omega<2.376ω<2.376.

This mission formalizes that historical Coppersmith--Winograd result. It follows the source tensor and its actual block restrictions, while excluding placeholder “laser values” that are not backed by extracted direct sums of matrix-multiplication tensors.

Setting

For a field KKK, an order-three tensor is represented by three finite-dimensional KKK-vector spaces and an element of their tensor product. The matrix-multiplication tensor

⟨a,b,c⟩K=∑i<a∑j<b∑k<cxij⊗yjk⊗zki\langle a,b,c\rangle_K =\sum_{i<a}\sum_{j<b}\sum_{k<c} x_{ij}\otimes y_{jk}\otimes z_{ki}⟨a,b,c⟩K​=i<a∑​j<b∑​k<c∑​xij​⊗yjk​⊗zki​

encodes multiplication of an a×ba\times ba×b matrix by a b×cb\times cb×c matrix. A restriction applies one linear map to each tensor leg. A degeneration permits those maps to depend polynomially on a formal parameter and selects their first nonzero coefficient. Thus a degeneration from the diagonal tensor IrI_rIr​ is a border-rank certificate R‾(T)≤r\underline R(T)\le rR​(T)≤r.

The Coppersmith--Winograd tensor with parameter qqq is

Tq=∑i=1q(x0yizi+xiy0zi+xiyiz0)+x0y0zq+1+x0yq+1z0+xq+1y0z0.T_q= \sum_{i=1}^{q} (x_0y_i z_i+x_i y_0z_i+x_i y_i z_0) +x_0y_0z_{q+1}+x_0y_{q+1}z_0+x_{q+1}y_0z_0.Tq​=i=1∑q​(x0​yi​zi​+xi​y0​zi​+xi​yi​z0​)+x0​y0​zq+1​+x0​yq+1​z0​+xq+1​y0​z0​.

It has border rank at most q+2q+2q+2. Its coordinates carry three classes, indexed by 0,1,20,1,20,1,2, and its six nonzero block types are

(0,1,1), (1,0,1), (1,1,0), (0,0,2), (0,2,0), (2,0,0).(0,1,1),\ (1,0,1),\ (1,1,0),\ (0,0,2),\ (0,2,0),\ (2,0,0).(0,1,1), (1,0,1), (1,1,0), (0,0,2), (0,2,0), (2,0,0).

The first three blocks are matrix-multiplication tensors with dimensions (1,1,q)(1,1,q)(1,1,q), (q,1,1)(q,1,1)(q,1,1), and (1,q,1)(1,q,1)(1,q,1); the other three are scalar products. Tensor powers therefore contain many typed rectangular matrix products. The laser method selects a large family with disjoint coordinate blocks and applies Schönhage's asymptotic sum inequality to all surviving products simultaneously.

Formalization targets

Goal: the 1990 Coppersmith--Winograd bound

For every field KKK,

matMulExp⁡(K)<297125=2.376.\operatorname{matMulExp}(K)<\frac{297}{125}=2.376.matMulExp(K)<125297​=2.376.

The Lean goal has the same quantified proposition and the same matMulExp definition as the existing Schönhage-bound mission; only the theorem identifier and rational endpoint change.

Tensor and block foundations

The development records the characteristic-free order-three degeneration

Tq⊴Iq+2T_q\unlhd I_{q+2}Tq​⊴Iq+2​

and the exact matrix-product dimensions associated with every supported type sequence in Tq⊗NT_q^{\otimes N}Tq⊗N​. These statements identify the algebraic input before any asymptotic counting is used.

Coupled-weight extraction

For q=6q=6q=6, the tensor-square grading and the coupled-weight pruning must produce the direct sums and asymptotic inequality stated in Section 8 and in the coupled-constituent lemma on journal pp. 270--272. The final numerical milestone certifies the rational endpoint 297/125297/125297/125 from exact inequalities, rather than treating the decimal 2.3754772.3754772.375477 as a proof object.

Significance

The result was the strongest matrix-multiplication bound for roughly two decades and introduced the tensor family that underlies the classical laser-method line of work. A formal proof supplies a checked bridge from an explicit border-rank identity to an exponent bound whose combinatorial extraction is substantially more delicate than the earlier Schönhage examples.

The formalization also produces reusable infrastructure. The order-three CW degeneration is an explicit polynomial-family test case over arbitrary fields. The six block identifications and type-count formulas can be reused in analyses of tensor powers. A faithful extraction predicate, stated through actual restrictions to direct sums of MMObj tensors, separates sound laser arguments from formulas that count incompatible or coordinate-sharing blocks as independent.

The mathematical bound is known. The open work is its machine-checked reconstruction in Lean. The border-rank theorem, per-type matrix-product restriction layer, tensor-square support invariant, balanced block calculation, Salem--Spencer set theorem, and exact q=6q=6q=6 numerical endpoint are already proved. The unrestricted value/rank bridge, the coupled-constituent extraction, and the full Section 8 auxiliary inequality remain the substantive frontier.

Difficulty

The main difficulty is not expanding TqT_qTq​ or evaluating a decimal logarithm. A tensor power contains exponentially many typed terms, but most share variables. They cannot all be placed in a direct sum, and counting all joint type sequences overestimates the usable matrix products. The source hashes coordinate blocks into a large progression-free set and prunes collisions so that the surviving blocks are genuinely independent.

The 2.3762.3762.376 improvement adds a second layer. It begins with Tq⊗2T_q^{\otimes2}Tq⊗2​, regroups variables into five classes, couples weights that were independent in the simpler analysis, and estimates a nontrivial central block by a further extraction. A formal proof must track the direction of every restriction, the exact multiplicities of all block types, and the loss introduced by pruning. Replacing exponential surviving-block counts by a polynomial number of blocks, or using joint entropy without the marginal compatibility constraints, changes the mathematical claim and is outside the mission.

Formalization scope

The mission uses the existing TensorObj, MMObj, TensorObj.Restrict, Degenerates, tensorAsymptoticRank, matMulExp, and matMulExp_strassen declarations in the Mathlib environment pinned by the earlier matrix-multiplication mission. Tensor dimensions and type counts are natural numbers; exponent and optimization inequalities are real-valued. All top-level bounds quantify over an arbitrary field, matching the integral polynomial identities used by the construction.

Laser statements must exhibit, directly or through a faithful reusable predicate, restrictions from a tensor power to a finite direct sum of concrete matrix-multiplication tensors. The number and dimensions of the summands remain part of the witness. A constant-valued “laser functional,” a vacuous witness hypothesis, or a capacity definition that discards the exponential number of surviving blocks does not satisfy the mission.

Welcome contributions include restriction composition lemmas, tensor-power block equivalences, multinomial and entropy estimates with all marginal constraints, formal Salem--Spencer pruning, exact real-inequality certificates, and the coupled central-block value lemma. Every milestone should cite the corresponding equation, table, or lemma in the primary paper.

Selected references

  • Don Coppersmith and Shmuel Winograd, Matrix Multiplication via Arithmetic Progressions, Journal of Symbolic Computation 9, 1990, pp. 251--280. ScienceDirect.
  • Arnold Schönhage, Partial and Total Matrix Multiplication, SIAM Journal on Computing 10(3), 1981, pp. 434--455. DOI 10.1137/0210032.
  • Avi Wigderson and Jeroen Zuiddam, Asymptotic Spectra: Theory, Applications and Extensions, 2023, for the tensor restriction and asymptotic-rank framework used by the Lean development. Author manuscript.
72 thms5 active usersReviewed
🏆Completed
Machine LearningOperations Research·Captain: mikedeng1

The Weighted Majority Algorithm 9: With η Anomalies Every Randomized Learner Can Be Forced to ½ opt(F, 0) + η Expected MistakesResearch Paper

Motivation

Prediction with expert advice asks a learner to predict a binary label on each of a sequence of trials, after seeing the predictions of a pool of candidate functions, and to make few more mistakes than the best member of the pool. Littlestone and Warmuth's The Weighted Majority Algorithm (Inform. and Comput. 108, 1994) gave the deterministic algorithm WM and its randomized variant WMR, and proved worst-case bounds that hold for every sequence of trials, with no probabilistic assumption on the data. Their §8 asks how good such bounds can possibly be when the data contain anomalies: disagreements with a candidate function, counted relative to the best-fitting member of the pool. Such disagreements can arise from noise in the instances or labels, or from instances that do not determine the label.

For the randomized algorithm WMR the expected number of mistakes grows, by Corollary 6.1 of the paper, at rate ln⁡(1/β)/(1−β)\ln(1/\beta)/(1-\beta)ln(1/β)/(1−β) per anomaly, which tends to 111 as β→1\beta \to 1β→1. Theorem 8.2 shows that no randomized learner, however it is built, can do better than rate 111: an adversary who fixes the sequence in advance can force half the noise-free optimum plus one expected mistake per anomaly. Together with the deterministic counterpart, Theorem 8.1 (rate 222), it locates the cost of label noise in online learning exactly. Mistake-bound lower bounds of this kind are a standard reference point for the analysis of online classification and of the expert-advice algorithms descended from WM (Cesa-Bianchi and Lugosi, Prediction, Learning, and Games, 2006).

Timeline: Littlestone (1988) characterized the optimal noise-free mistake bound opt(F,0)\mathrm{opt}(F,0)opt(F,0) by complete mistake trees (the Littlestone dimension); Littlestone and Warmuth (FOCS 1989; journal version 1994) introduced WM and WMR and proved Theorems 8.1 and 8.2.

Setting

Let XXX be an arbitrary domain and FFF a pool of functions X→{0,1}X \to \{0,1\}X→{0,1}, finite or infinite. A trial is a pair (x,y)(x,y)(x,y) with x∈Xx\in Xx∈X and y∈{0,1}y\in\{0,1\}y∈{0,1}; a sequence of trials is a finite list S=((x1,y1),…,(xT,yT))\mathcal S = ((x_1,y_1),\dots,(x_T,y_T))S=((x1​,y1​),…,(xT​,yT​)), in which an instance may repeat with different labels. The number of anomalies of S\mathcal SS with respect to fff is #{t:f(xt)≠yt}\#\{t : f(x_t)\ne y_t\}#{t:f(xt​)=yt​}, and SηS_\etaSη​ is the collection of sequences for which some f∈Ff\in Ff∈F has at most η\etaη anomalies.

A deterministic algorithm maps the past trials and the current instance to a predicted label; MA(S)M_A(\mathcal S)MA​(S) counts its wrong predictions, and

opt(F,η)=inf⁡Asup⁡S∈SηMA(S).\mathrm{opt}(F,\eta) = \inf_A \sup_{\mathcal S\in S_\eta} M_A(\mathcal S).opt(F,η)=Ainf​S∈Sη​sup​MA​(S).

A randomized algorithm uses random choices independent of the sequence. On a fixed sequence its behaviour at trial ttt is summarized by pt∈[0,1]p_t\in[0,1]pt​∈[0,1], the probability that it predicts 111 given the preceding instances and labels and the current instance; its expected number of mistakes is ∑t∣pt−yt∣\sum_t |p_t - y_t|∑t​∣pt​−yt​∣, and

optRAND(F,η)=inf⁡Asup⁡S∈Sη∑t=1T∣pt−yt∣,\mathrm{opt}_{\mathrm{RAND}}(F,\eta) = \inf_A \sup_{\mathcal S\in S_\eta} \sum_{t=1}^T |p_t-y_t|,optRAND​(F,η)=Ainf​S∈Sη​sup​t=1∑T​∣pt​−yt​∣,

the infimum ranging over all maps AAA from (past trials, current instance) to pt∈[0,1]p_t \in [0,1]pt​∈[0,1].

Formalization targets

Goal: Theorem 8.2 (p. 252)

For every pool FFF with ∣F∣>1|F|>1∣F∣>1 and every integer η≥0\eta\ge 0η≥0,

optRAND(F,η) ≥ 12 opt(F,0)+η.\mathrm{opt}_{\mathrm{RAND}}(F,\eta)\ \ge\ \tfrac12\,\mathrm{opt}(F,0)+\eta .optRAND​(F,η) ≥ 21​opt(F,0)+η.

Both sides live in [0,∞][0,\infty][0,∞]; when opt(F,0)=∞\mathrm{opt}(F,0)=\inftyopt(F,0)=∞ the statement says optRAND(F,η)=∞\mathrm{opt}_{\mathrm{RAND}}(F,\eta)=\inftyoptRAND​(F,η)=∞.

Milestone: complete mistake trees (§8, p. 251)

"For any pool of functions FFF there exists a complete opt(F,0)\mathrm{opt}(F,0)opt(F,0)-mistake tree" ([Lit88]). On the platform this is the proved Lemma 21.7 of Shalev-Shwartz and Ben-David, MSOA(F)≤Ldim(F)M_{\mathrm{SOA}}(F)\le \mathrm{Ldim}(F)MSOA​(F)≤Ldim(F), together with Lemma 21.6, Ldim(F)≤MA(F)\mathrm{Ldim}(F) \le M_A(F)Ldim(F)≤MA​(F) for every AAA; a tree shattered by FFF is a complete mistake tree.

Significance

The theorem shows that the expected-mistake bound of WMR is optimal in its dependence on the number of anomalies: its coefficient of η\etaη approaches 111, and no randomized learner achieves a smaller one on every pool with two or more functions. It also quantifies the advantage of randomization: the deterministic rate is 222 (Theorem 8.1), the randomized rate is 111, and the noise-free term halves. The lower bound is obliviously adversarial, since the sequence is chosen before any coin is tossed, so it applies equally to the stronger model in which the adversary adapts to the learner's predictions.

The result has been proved since 1994. To our knowledge it has no machine-checked proof; the platform holds the Littlestone-dimension characterization of the noise-free optimum (Shalev-Shwartz and Ben-David, Chapter 21) but no statement about anomalies or randomized lower bounds. This mission formalizes the definitions of anomalies, opt(F,η)\mathrm{opt}(F,\eta)opt(F,η) and optRAND(F,η)\mathrm{opt}_{\mathrm{RAND}}(F,\eta)optRAND​(F,η), and the theorem.

Difficulty

An adversary against a randomized learner cannot react to its predictions: the whole sequence, instances and labels, must be fixed in advance, so the adaptive adversary that proves the deterministic bound is not directly available. The lower bound must instead come from the learner's prediction probabilities, which depend only on the sequence prefix; the content of the theorem is that this information is enough to construct, for every learner, one fixed sequence that stays inside SηS_\etaSη​ while forcing the stated expected count. Taking the infimum over learners inside an extended-real supremum over sequences of every length adds bookkeeping when opt(F,0)\mathrm{opt}(F,0)opt(F,0) is infinite.

Formalization scope

Sequences are Fin T → X × Bool for every T : ℕ. Deterministic algorithms, the mistake count, shattered trees and the Littlestone dimension are reused from the published definition UnderstandingML_Online (OnlineAlg, mistakes, ShattersTree, ldim, soa); randomized algorithms are its OnlineAlgR X := List (X × Bool) → X → ℝ restricted by IsRandAlg to values in [0,1][0,1][0,1], and the expected mistake count is its cumLoss. η\etaη is a natural number. opt(F,η)\mathrm{opt}(F,\eta)opt(F,η) takes values in ℕ∞ and optRAND(F,η)\mathrm{opt}_{\mathrm{RAND}}(F,\eta)optRAND​(F,η) in ℝ≥0∞; the paper's "minimum" is read as an infimum. ∣F∣>1|F|>1∣F∣>1 is F.Nontrivial, which admits infinite pools.

The reduction of randomized algorithms to probability maps is the main modelling choice: on a fixed sequence the expected number of mistakes of any algorithm whose randomization is independent of the sequence equals ∑t∣pt−yt∣\sum_t|p_t-y_t|∑t​∣pt​−yt​∣, and every map with values in [0,1][0,1][0,1] is realized by such an algorithm, so the two infima coincide. Dropping the constraint pt∈[0,1]p_t\in[0,1]pt​∈[0,1], or quantifying only over deterministic algorithms, gives a different quantity and is ruled out.

Needed: the definitions above, and the existence of a complete opt(F,0)\mathrm{opt}(F,0)opt(F,0)-mistake tree, available through the proved platform theorems on ldim and soa. Lemmas relating mistakes along a path of a shattered tree to ldim, and a reusable statement that an oblivious adversary can force expected loss 12\tfrac1221​ per trial, would serve other lower bounds in the Littlestone–Warmuth series and in online learning generally. Contributions of such lemmas are welcome.

Selected references

  • N. Littlestone, M. K. Warmuth, The Weighted Majority Algorithm, Information and Computation 108(2):212–261, 1994. https://doi.org/10.1006/inco.1994.1009
  • N. Littlestone, Learning Quickly When Irrelevant Attributes Abound: A New Linear-Threshold Algorithm, Machine Learning 2:285–318, 1988. https://doi.org/10.1007/BF00116827
  • S. Shalev-Shwartz, S. Ben-David, Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press, 2014, Chapter 21. https://doi.org/10.1017/CBO9781107298019
  • N. Cesa-Bianchi, G. Lugosi, Prediction, Learning, and Games, Cambridge University Press, 2006. https://doi.org/10.1017/CBO9780511546921
7 thms4 active usersReviewed
🏆Completed
CombinatoricsMachine LearningOperations Research·Captain: mikedeng1

The Weighted Majority Algorithm 7: On a Class Shattered by Its Domain, Every Deterministic Learner's Mistake Bounds Satisfy Σ 2^(−M_i) < 2Research Paper

Motivation

An online learner predicts a binary label for each instance before seeing that instance's correct label. Its guarantee is usually measured by its worst possible number of mistakes against a target function. Such guarantees can differ greatly across target functions: an algorithm might learn one target quickly while taking much longer on another. Littlestone and Warmuth's analysis of the Weighted Majority Algorithm asks which collections of individual mistake guarantees can coexist for one deterministic learner. In Section 7 of their 1994 paper, they isolate a condition under which these guarantees obey a strict numerical constraint. The condition concerns how the target functions vary together over the instance domain, so the result applies without a probability distribution on instances or labels.

The theorem also supports the paper's comparison between arbitrary deterministic learners and Weighted Majority. Given individual mistake bounds, its inequality is the numerical condition that makes a suitable initial weighting of the target functions possible in Theorem 7.1 and Corollary 7.1 of the same paper. The present mission centers on the inequality itself, which is independent of a particular implementation of Weighted Majority.

Setting

Let XXX be an instance domain, possibly finite or infinite, and let φ1,…,φn:X→{0,1}\varphi_1,\ldots,\varphi_n:X\to\{0,1\}φ1​,…,φn​:X→{0,1} be a finite family of target functions. A trial presents an instance x∈Xx\in Xx∈X to a learner, asks it to predict either 000 or 111, and then reveals a label. A finite sequence is consistent with φi\varphi_iφi​ when each revealed label equals φi(x)\varphi_i(x)φi​(x) at that trial's instance. The learner may use the current instance and the complete history of earlier labeled trials when predicting; it does not see the current label first. No sampling or independence assumption is made.

The family is shattered by its domain when every pattern b=(b1,…,bn)∈{0,1}nb=(b_1,\ldots,b_n)\in\{0,1\}^nb=(b1​,…,bn​)∈{0,1}n appears as the vector of function values at some instance:

∀b∈{0,1}n∃x∈X∀i∈{1,…,n}, φi(x)=bi.\forall b\in\{0,1\}^n\quad\exists x\in X\quad\forall i\in\{1,\ldots,n\},\ \varphi_i(x)=b_i.∀b∈{0,1}n∃x∈X∀i∈{1,…,n}, φi​(x)=bi​.

This is a dual notion of shattering. The familiar VC condition asks whether a class of functions realizes every labeling of chosen instances. Here the domain realizes every joint value pattern of a chosen family of functions. The two conditions should not be interchanged.

Let AAA be any deterministic online learner. Write MiM_iMi​ for the supremum of the number of mistakes made by AAA over every finite sequence consistent with φi\varphi_iφi​. Since mistake counts are natural numbers, a finite supremum is an attained natural-number maximum. The theorem assumes each MiM_iMi​ is finite. In the Lean representation, this is a separate finiteness condition on each target's extended-natural mistake bound.

Formalization targets

Strict constraint on individual mistake bounds

The goal is Theorem 7.2 of Littlestone and Warmuth, pp. 244–245. For every domain, every finite family shattered by that domain, and every deterministic online learner with finite individual mistake bounds,

∑i=1n2−Mi<2.\sum_{i=1}^{n}2^{-M_i}<2.i=1∑n​2−Mi​<2.

The inequality is strict. Replacing it by a weak inequality would lose the stated result and the threshold used in the paper's later comparison with Weighted Majority. The theorem quantifies over the learner itself; it does not select a specially behaved learning rule.

Arithmetic milestones

Lemma 7.1 concerns positive real numbers with integral adjacent quotients. When a positive target sss is no larger than their sum and s/r1s/r_1s/r1​ is integral, some prefix sums exactly to sss. Lemma 7.2 concerns positive powers of two with integer exponents. If a power 2ℓ2^\ell2ℓ lies at least as high as each individual weight and at most as high as the total weight, some subset sums exactly to 2ℓ2^\ell2ℓ. Both statements and their exact source wording are recorded as the mission's milestones; they are the numbered arithmetic results used in Theorem 7.2.

Significance

The theorem limits the set of claims that one deterministic learner can make simultaneously. Small MiM_iMi​ contribute large terms to the sum, so a learner cannot have arbitrarily small worst-case mistake counts for all members of a domain-shattered family. This is a worst-case statement about every finite consistent trial sequence, rather than an average-case statement about a chosen data distribution. The paper's Corollary 7.1 uses the resulting inequality to select initial weights for a Weighted Majority comparison, but that later algorithmic statement is outside this mission's goal.

Formalizing this result adds a reusable dual-shattering predicate and an exact constraint on per-target online mistake bounds to the existing online-learning definitions. The paper proves the theorem, while the mission's Lean goal and its two milestone lemmas are open proof obligations. The separate published online-learning module provides the definitions of deterministic predictors, trial histories, mistake counts, and extended-natural worst-case bounds; it does not already prove this theorem.

Difficulty

For a single target, an arbitrary learner may have a small finite mistake bound. The difficulty is relating those bounds across different targets without placing extra restrictions on the learner. Domain shattering gives the adversary control over the simultaneous predictions of all functions at an instance, but the labels of one trial sequence must still remain consistent with a target. A simple count of targets or of possible patterns does not directly produce the strict weighted sum, particularly when the different MiM_iMi​ are unequal. The two arithmetic lemmas address exact sums of structured weights; the main theorem must also connect such weights to the learner's worst-case mistakes.

Formalization scope

The function family is indexed by Fin n, with zero-based Lean indices corresponding to the paper's 1,…,n1,\ldots,n1,…,n. The domain XXX is an arbitrary type and may be infinite. Labels and predictions are Bool. ShatteredByDomain states that every Boolean pattern is realized by some domain point. The published UnderstandingML_Online definition gives OnlineAlg X Bool, finite trial histories, mistakes, and mistakeBound. The latter is valued in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞} and ranges over all finite sequences labeled by the target. Each MiM_iMi​ is converted to a natural number only after assuming its bound is finite. The powers 2−Mi2^{-M_i}2−Mi​ and their finite sum are real numbers. The n=0n=0n=0 conclusion is the empty sum 0<20<20<2; the shattering predicate itself then requires an instance to realize the unique empty pattern.

The two milestones use real-valued weights. Lemma 7.1 assumes n≥1n\ge1n≥1 because the source refers to r1r_1r1​. Lemma 7.2 represents the source's integral base-two logarithms by equations ri=2kir_i=2^{k_i}ri​=2ki​ with integer kik_iki​, which also enforce positivity. Its maximum hypothesis is written pointwise, so an empty family is harmless: the other inequality 2ℓ≤02^\ell\le02ℓ≤0 cannot hold. A coordinate family on X={0,1}nX=\{0,1\}^nX={0,1}n is verified locally to satisfy the shattering predicate, ruling out a vacuous encoding of that central assumption. Contributions proving either arithmetic milestone or the main theorem within these exact definitions are in scope.

Selected references

  • Nick Littlestone and Manfred K. Warmuth, The Weighted Majority Algorithm, Information and Computation 108(2), 212–261, 1994. DOI: 10.1006/inco.1994.1009.
  • Shai Shalev-Shwartz and Shai Ben-David, Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press, 2014, Chapter 21. DOI: 10.1017/CBO9781107298019.
5 thms4 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchProbability·Captain: mikedeng1

An Optimal Algorithm for On-line Bipartite Matching 1: RANKING Finds a Matching of Expected Size at Least n(1 − 1/e) − o(n) on Every Graph with a Perfect MatchingResearch Paper

Motivation

Online matching describes allocation when requests must be answered as they arrive. A matching decision uses only the edges revealed so far and cannot be revised when later requests appear. In the bipartite setting studied by Karp, U. Vazirani, and V. Vazirani, the arriving vertices are girls and the possible partners are boys. Even when the full graph has a perfect matching, a fixed greedy priority can leave many girls unmatched. The paper introduced RANKING, which randomly chooses the boys' priority order once and then uses that order for every arrival.

The question is quantitative: how many pairs does RANKING guarantee in expectation against a graph and an arrival order chosen before its random ranking? The paper's target is a fraction approaching 1−1/e1-1/e1−1/e of the nnn pairs in a perfect matching. Its printed Theorem 1 concerns an auxiliary algorithm called EARLY; the RANKING statement follows the intended chain through Lemmas 3 and 5. The original EARLY analysis has a gap for general upper-triangular matrices, so this mission states the RANKING target and the earlier, unaffected lemmas separately. This distinction matters because an assertion about EARLY would be a different formalization target.

Setting

A bipartite graph has a boy side UUU and a girl side VVV, each with nnn vertices. An edge (u,v)(u,v)(u,v) means that boy uuu may be paired with girl vvv. A matching is a collection of edges in which no boy or girl occurs twice. The standing hypothesis for the performance guarantee is that the graph has a perfect matching: some bijection from boys to girls selects an edge for every boy. The graph is otherwise arbitrary.

Girls arrive in a predetermined order. When girl vvv arrives, only her incident edges are revealed. RANKING first chooses a uniformly random permutation π\piπ of the boys. For each arriving girl, it selects the highest-ranked adjacent boy who is still unmatched, if one exists. Write MR(G,π)M_{\mathrm R}(G,\pi)MR​(G,π) for the final matching. The expected size is the finite average over all n!n!n! rankings. The guarantee must hold for every graph and every predetermined arrival order; relabeling girls lets the formal statement fix their order to n,n−1,…,1n,n-1,\ldots,1n,n−1,…,1.

The paper also uses a dual rows-arrive view. Boys arrive in an order and choose among eligible girls, whose priority order is fixed. This is the same greedy rule with the sides exchanged. For its triangular reduction, the columns are numbered 1,…,n1,\ldots,n1,…,n and column nnn has highest priority. An upper-triangular matrix with unit diagonal is a graph with every edge (i,i)(i,i)(i,i) and with an edge (i,j)(i,j)(i,j) only when i≤ji\le ji≤j. On such a graph, the auxiliary algorithm EARLY declines to match row iii if column iii is already covered by EARLY's own matching. For any matching MMM, D(M)D(M)D(M) denotes the indices for which both row iii and column iii are covered.

Formalization targets

RANKING guarantee

For every ε>0\varepsilon>0ε>0, one threshold NNN must work for every size n≥Nn\ge Nn≥N and every graph GGG with a perfect matching:

Eπ∼Unif(Sn)∣MR(G,π)∣≥(1−e−1−ε)n.\mathbb E_{\pi\sim\mathrm{Unif}(S_n)}|M_{\mathrm R}(G,\pi)| \ge (1-e^{-1}-\varepsilon)n.Eπ∼Unif(Sn​)​∣MR​(G,π)∣≥(1−e−1−ε)n.

This is the uniform lower-bound reading of the paper's n(1−1/e)−o(n)n(1-1/e)-o(n)n(1−1/e)−o(n) target. It does not prescribe a finite-nnn additive constant. The mission goal is the RANKING assertion drawn from the paper's Theorem 1 and Lemmas 3 and 5. The six milestones formalize the paper's Lemmas 1–5 and the corollary to Lemma 4, in their source order. They cover the side-exchange identity, arbitrary refusal algorithms, the triangular reduction, the matching-count identity, its expected form, and the pointwise comparison with EARLY.

Significance

The guarantee gives a concrete worst-case floor for a simple randomized allocation rule: as the graph size grows, RANKING matches at least an asymptotic 1−1/e1-1/e1−1/e fraction of the pairs available in a perfect matching, in expectation. The order is selected before the random permutation, matching the paper's performance measure. The lower bound remains meaningful on sparse graphs and does not rely on a density assumption. The original paper also studies the limit on what any randomized online algorithm can guarantee; that upper-bound result is treated in a separate mission.

A formal development here would provide reusable finite definitions for online greedy matching, arbitrary state-dependent refusal, fixed-order duality, and uniform expectation over permutations. The goal is a theorem statement awaiting a machine-checked proof; compiling the draft declarations verifies their Lean syntax and types, not their truth. The local mission separates the valid early structural statements from later statements whose published EARLY argument does not justify them on general upper-triangular graphs.

Difficulty

The random permutation does not make the fate of different vertices independent. Matching one girl removes a boy who might be essential to a later girl, so a per-arrival probability estimate cannot simply be added across all arrivals. The dual and triangular views capture useful structure, but turning that structure into a uniform bound for every graph is the main obstacle. In particular, reasoning about EARLY as if its matched-column set had the same monotonicity as unrestricted RANKING fails on some upper-triangular matrices. A proof of the goal must establish the RANKING guarantee without treating those later EARLY statements as available facts.

Formalization scope

Boys and girls are both Fin n; an adjacency matrix is a relation between them. A published predicate represents a perfect matching as an edge-preserving bijection. The generic greedy run processes arrival times in increasing order and interprets a smaller priority index as higher rank. It makes a new matching decision only from the current matching and the arriving vertex. RANKING's returned edges are consistently ordered as (boy, girl), even though girls arrive. The dual run has rows arriving in an arbitrary permutation and takes column n−1n-1n−1 as highest priority in Lean's zero-based numbering. EARLY's refusal test consults the matching constructed by EARLY itself.

All expectations are finite averages over Equiv.Perm (Fin n), scaled by 1/n!1/n!1/n!. The formal o(n)o(n)o(n) claim is ∀ε>0, ∃N, ∀n≥N, ∀G\forall\varepsilon>0,\ \exists N,\ \forall n\ge N,\ \forall G∀ε>0, ∃N, ∀n≥N, ∀G with a perfect matching, the displayed lower bound. Placing NNN before GGG preserves the worst-case meaning. The perfect-matching condition is essential: the empty graph cannot satisfy a positive linear guarantee. The triangular matrix in Lemma 3 retains every diagonal edge, so a zero matrix cannot witness the reduction. These conventions rule out vacuous versions of the goal and reduction.

The definitions of partial matching, covered vertices, greedy run, RANKING, EARLY, and uniform average are part of the mission. A complete proof may build further finite counting and permutation machinery; such lemmas can be shared beyond this paper. Contributions toward the six milestone statements, the goal, and faithful supporting results are in scope. Lemmas 6–12 and the printed EARLY Theorem 1 are outside this mission because their analysis depends on claims that fail for some matrices allowed by their surrounding assumptions.

Selected references

  • Richard M. Karp, Umesh V. Vazirani, and Vijay V. Vazirani, An Optimal Algorithm for On-line Bipartite Matching, Proceedings of the 22nd Annual ACM Symposium on Theory of Computing, 1990, pp. 352–358. DOI: 10.1145/100216.100262.
10 thms4 active usersReviewed
🏆Completed
Captain: wurtle

Subset Sum is NP-completeResearch Paper

Prove that subset sum is NP-complete by reducing the existing 3-SAT language, to it. Given a list of positive integers and a nonnegative target, decide whether some selection of entries sums exactly to the target. Integers are encoded in binary.

References:

  • Richard M. Karp. Reducibility Among Combinatorial Problems. Complexity of Computer Computations, 85–103, 1972. Binary encoding convention, p. 89; Main Theorem, problem 18, pp. 94–95; original Exact Cover reduction, p. 100.
24 thms4 active usersReviewed
🏆Completed
Captain: wurtle

k-SAT is NP-HardResearch Paper

Prove that kkk-SAT is NP-complete for every fixed k≥3k\ge3k≥3, with at most kkk literal occurrences per clause.

Construct the reductions and certificate verifier using the existing WordRAM definitions. We reuse proved polynomial backend and Cook–Levin SAT completeness.

References:

  • Richard M. Karp. Reducibility Among Combinatorial Problems. Complexity of Computer Computations, 85–103, 1972. Main Theorem, problem 11; reduction, p. 98.
  • Stephen A. Cook and Robert A. Reckhow. Time Bounded Random Access Machines. Journal of Computer and System Sciences 7(4), 354–375, 1973.
  • Torben Hagerup. Sorting and Searching on the Word RAM. STACS 1998, 366–398.
15 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

Competitive Randomized Algorithms for Nonuniform Problems IV: The Optimal Randomized Two-Server Ratio 1652/1069 on the 3-4-5 TriangleResearch Paper

Motivation

The kkk-server problem is a basic model of on-line decision making. kkk mobile servers move in a metric space, requests for points arrive one at a time, and each request has to be covered by a server before the next one arrives. The cost is the total distance the servers move. The problem includes paging, caching and disk-head scheduling as special cases (Manasse, McGeoch, Sleator 1990). An on-line algorithm is judged by its competitive factor: how much its cost can exceed that of an off-line algorithm that knows the whole request sequence in advance.

For randomized algorithms against an oblivious adversary (one that fixes the whole request sequence before the algorithm flips any coins), the best-understood case is paging, which is the kkk-server problem on a uniform metric space. There the optimal factor is the harmonic number Hk=∑i=1k1/iH_k=\sum_{i=1}^k 1/iHk​=∑i=1k​1/i. Fiat et al. proved the lower bound (1991) and McGeoch and Sleator the matching upper bound (1991). Karlin, Manasse, McGeoch and Owicki (Algorithmica 11, 1994, §5) asked whether HkH_kHk​-competitive algorithms also exist when the metric space is not uniform. They answered no, already for two servers on three points: on certain triangles the optimal randomized factor is strictly larger than H2=3/2H_2 = 3/2H2​=3/2. This mission formalizes their Theorem 13, which gives the exact optimal factor on the triangle with edge lengths 3, 4 and 5.

Timeline:

  • 1990: Manasse, McGeoch and Sleator introduce the kkk-server problem; kkk is the deterministic optimum for k=2k=2k=2.
  • 1991: Fiat, Karp, Luby, McGeoch, Sleator and Young prove the HkH_kHk​ lower bound for randomized paging. McGeoch and Sleator give an HkH_kHk​-competitive paging algorithm.
  • 1994: Karlin, Manasse, McGeoch and Owicki determine the optimal randomized two-server factors on the isosceles triangles 111-ddd-ddd (Theorem 12) and on the 3-4-5 triangle (Theorem 13, the ratio 1652/10691652/10691652/1069). Both exceed 3/23/23/2.

Setting

Let MMM be a metric space with exactly three points a,b,ca, b, ca,b,c, where d(a,b)=3d(a,b)=3d(a,b)=3, d(a,c)=5d(a,c)=5d(a,c)=5 and d(b,c)=4d(b,c)=4d(b,c)=4. A configuration CCC gives the positions of two labelled servers in MMM. A request sequence σ\sigmaσ is a finite list of points of MMM.

A deterministic on-line algorithm assigns to each prefix of a request sequence a configuration, in which the last request is covered. Its configuration after a prefix therefore cannot depend on later requests. Its initial configuration is the one it assigns to the empty prefix, and its cost CA(σ)C_A(\sigma)CA​(σ) on σ\sigmaσ is the total distance its servers move while serving σ\sigmaσ request by request.

The optimal off-line cost Copt(σ)C_{opt}(\sigma)Copt​(σ) from an initial configuration C0C_0C0​ is the infimum, over all schedules that start at C0C_0C0​ and cover each request of σ\sigmaσ in turn, of the total distance moved.

A randomized on-line algorithm AAA is a probability distribution over deterministic on-line algorithms, all starting at C0C_0C0​. The cost on each fixed σ\sigmaσ is required to be measurable in the random choice, and ECA(σ)\mathbf{E}C_A(\sigma)ECA​(σ) is the expected cost. AAA is ρ\rhoρ-competitive against an oblivious adversary if there is a constant aaa such that for every request sequence σ\sigmaσ,

ECA(σ)≤ρ⋅Copt(σ)+a.\mathbf{E}C_A(\sigma) \le \rho\cdot C_{opt}(\sigma) + a .ECA​(σ)≤ρ⋅Copt​(σ)+a.

These are the definitions of p. 543 of the paper. They are the platform's published KServer_model and KServer_randomized, which this mission reuses unchanged: KServer.RandomizedAlgorithm 2 M and A.IsCompetitiveFrom C₀ ρ.

Formalization targets

Goal: Theorem 13

For every initial configuration C0C_0C0​ of the two servers,

(∀A, ∀ρ, A is ρ-competitive from C0⇒ρ≥16521069) ∧ (∃A, A is 16521069-competitive from C0).\Big(\forall A,\ \forall \rho,\ A \text{ is } \rho\text{-competitive from } C_0 \Rightarrow \rho \ge \tfrac{1652}{1069}\Big)\ \wedge\ \Big(\exists A,\ A \text{ is } \tfrac{1652}{1069}\text{-competitive from } C_0\Big).(∀A, ∀ρ, A is ρ-competitive from C0​⇒ρ≥10691652​) ∧ (∃A, A is 10691652​-competitive from C0​).

The first claim is quantified over all randomized algorithms, so it also covers deterministic ones (point masses). The second claim asks for one algorithm. Together they say that 1652/1069≈1.5451652/1069 \approx 1.5451652/1069≈1.545 is the exact optimal randomized factor on this triangle.

Milestones

  1. The phase LP lower bound (p. 568). Twelve linear constraints in nine probabilities π1,…,π9\pi_1,\dots,\pi_9π1​,…,π9​, three potentials Φab,Φac,Φbc\Phi_{ab},\Phi_{ac},\Phi_{bc}Φab​,Φac​,Φbc​ and a ratio α\alphaα, one constraint for each possible phase of the request sequence, of the form
A’s cost≤α⋅(opt’s cost)+Φinitial−Φfinal.\text{A's cost} \le \alpha\cdot(\text{opt's cost}) + \Phi_{\text{initial}} - \Phi_{\text{final}}.A’s cost≤α⋅(opt’s cost)+Φinitial​−Φfinal​.

Every real solution has α≥1652/1069\alpha \ge 1652/1069α≥1652/1069. 2. The LP attainment (p. 568). The paper's printed probabilities lie in [0,1][0,1][0,1], and with suitable potentials they satisfy all twelve constraints at α=1652/1069\alpha = 1652/1069α=1652/1069. 3. Theorem 13, first claim: the lower bound for every randomized algorithm. 4. Theorem 13, second claim: a 1652/10691652/10691652/1069-competitive randomized algorithm exists.

Significance

The result. Theorem 13 shows that the HkH_kHk​ behaviour of randomized paging does not carry over to general metric spaces. Two servers on a three-point space already force a factor above 3/23/23/2. The value is exact, which makes this triangle a test case for any general theory of randomized kkk-server algorithms on small metric spaces. With Theorem 12 (the isosceles triangles, a companion mission of this series), it is one of the few non-uniform metric spaces with a known optimal randomized factor.

Formalizing it. The result has been proved since 1994. To our knowledge there is no machine-checked proof. The paper derives both bounds from two framework theorems for phase-based algorithms: Theorem 3 (an LP lower bound for phase-based algorithms bounds every algorithm) and Theorem 2 (a lazy phase-based algorithm with LP bound α\alphaα is α\alphaα-competitive). The phase tables themselves (which phases can occur and what they cost) are stated without detailed proof. A formal proof has to supply both framework arguments for this space and verify the phase tables, as well as the finite linear algebra of milestones 1 and 2. The milestones isolate the exact-arithmetic core so that it can be closed independently of the probabilistic part.

Difficulty

The two LP milestones are finite exact-arithmetic facts. The hard part is linking them to Theorem 13.

For the lower bound, an algorithm need not be phase-based at all. Its probabilities may depend on the whole history, not only on the current phase, and it may leave the configuration of the off-line optimum at the end of a phase. The obvious attempt is to fix one hard request sequence and compare costs, but that cannot work: randomization defeats any single sequence. The reduction from arbitrary algorithms to phase-based ones (the paper's Theorem 3) is the substantive step.

For the upper bound, the printed probabilities describe the algorithm's marginal position after each prefix of a phase. They have to be realized as a single probability distribution over deterministic on-line algorithms that is lazy (it moves only to serve a request) and whose expected cost per phase equals the table's entry. On top of this, the LP accounting has to be turned into a bound on arbitrary request sequences, including partial phases and a start away from the optimum's configuration.

Formalization scope

  • Model. The platform definitions KServer_model and KServer_randomized are used unchanged. Servers are labelled (Config 2 M = Fin 2 → M). A deterministic algorithm is a function of the request prefix, which makes it on-line by construction. A randomized algorithm is a mixed strategy with a probability measure and a measurability field, and its expected cost is the lower Lebesgue integral of the nonnegative cost. The off-line optimum is a real infimum over schedules from C0C_0C0​; the set is nonempty and bounded below by 000. Competitiveness allows any real additive constant.
  • The triangle is given by hypotheses on an arbitrary metric space: every point equals aaa, bbb or ccc, and d(a,b)=3d(a,b)=3d(a,b)=3, d(a,c)=5d(a,c)=5d(a,c)=5, d(b,c)=4d(b,c)=4d(b,c)=4. These hypotheses are satisfiable (3+4≥53+4\ge53+4≥5) and force three distinct points.
  • Initial configuration. Both claims are stated for every initial configuration C0C_0C0​, including both servers on one point. The paper does not fix the start; the additive constant absorbs it.
  • LP milestones. The thirteen LP variables are free reals, with no box 0≤πi≤10\le\pi_i\le 10≤πi​≤1, exactly as the paper permits. This makes milestone 1 stronger than the boxed version; the minimum is the same either way. The twelve constraints are written out one per hypothesis, in the table's order, with the potential difference Φinitial−Φfinal\Phi_{\text{initial}} - \Phi_{\text{final}}Φinitial​−Φfinal​ on the right. In milestone 2 the potentials are existentially quantified, since the paper names none.
  • Not stated. The paper's Theorems 2 and 3 (the phase framework) and the phase tables are not separate milestones. Milestone 1 feeds the first claim through Theorem 3, and milestone 2 feeds the second claim through Theorem 2. Contributions formalizing phase-based algorithms, laziness and the LP-bound reduction for finite metric spaces would be reusable for Theorem 12 and Theorem 14 of the same paper.
  • Ruled out. The lower bound is not restricted to deterministic or to phase-based algorithms, and it is not stated as "one sequence defeats every algorithm". The constant is exactly 1652/10691652/10691652/1069, not an approximation, and the attainment claim is not weakened to "for some initial configuration".

Selected references

  • A. R. Karlin, M. S. Manasse, L. A. McGeoch, S. Owicki, Competitive Randomized Algorithms for Nonuniform Problems, Algorithmica 11 (1994) 542–571. https://doi.org/10.1007/BF01189993
  • M. S. Manasse, L. A. McGeoch, D. D. Sleator, Competitive Algorithms for Server Problems, Journal of Algorithms 11 (1990) 208–230. https://doi.org/10.1016/0196-6774(90)90003-W
  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive Paging Algorithms, Journal of Algorithms 12 (1991) 685–699. https://doi.org/10.1016/0196-6774(91)90041-V
  • L. A. McGeoch, D. D. Sleator, A Strongly Competitive Randomized Paging Algorithm, Algorithmica 6 (1991) 816–825. https://doi.org/10.1007/BF01759073
7 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

Competitive Randomized Algorithms for Nonuniform Problems I: Optimal Competitiveness of Randomized Block Snoopy CachingResearch Paper

Motivation

In a shared-memory multiprocessor, each processor keeps copies of memory blocks in its own cache, and all caches listen ("snoop") on a common bus. Every bus cycle spent keeping these copies consistent is a cycle not available for useful work, so the protocol that decides when a block is shared by several caches and when it is private to one cache directly controls bus traffic. The decision has to be made on-line, without knowing which processor will touch the block next.

Karlin, Manasse, Rudolph and Sleator (Algorithmica 1988) introduced competitive analysis for this problem and gave a deterministic algorithm with competitive ratio 222, which is optimal among deterministic algorithms. Karlin, Manasse, McGeoch and Owicki (Algorithmica 1994) showed that randomization helps: against an oblivious adversary the optimal ratio for block snoopy caching is ep/(ep−1)e_p/(e_p-1)ep​/(ep​−1), where ppp is the cost of transferring a block. The same paper develops a general method for "nonuniform" problems, in which some state transitions are much more expensive than others, and the snoopy-caching result is its first application.

Setting

Fix nnn processors and one memory block BBB holding p−1p-1p−1 variables; transferring BBB over the bus costs ppp bus cycles. The block is in one of n+1n+1n+1 states: shared between all caches, or private to the cache of processor iii.

A request is a read Ri\mathrm{R}_iRi​ or a write Wi\mathrm{W}_iWi​ by processor iii. Moving from a private state to any other state costs ppp; moving from the shared state is free. A read Ri\mathrm{R}_iRi​ costs 000 if BBB is shared or private to iii and +∞+\infty+∞ otherwise. A write Wi\mathrm{W}_iWi​ costs 000 if BBB is private to iii, 111 if BBB is shared (one bus cycle broadcasts the new value), and +∞+\infty+∞ otherwise.

Before request jjj the system is in state sj−1s_{j-1}sj−1​. A read is a look-ahead-one request: the algorithm may change state at the moment of the request, after seeing it. A write is a look-ahead-zero request: it is served in whatever state the system is in. After either kind, the algorithm may move again. The cost of a request is the cost of the move to the serving state, plus the task cost there, plus the cost of the move afterwards. Every write is preceded by a read to the same block, so in an admissible sequence each write Wi\mathrm{W}_iWi​ directly follows Ri\mathrm{R}_iRi​ or Wi\mathrm{W}_iWi​.

The off-line optimum Copt(s0,σ)C_{opt}(s_0,\sigma)Copt​(s0​,σ) is the least total cost of serving σ\sigmaσ from the initial state s0s_0s0​ with full knowledge of σ\sigmaσ. A randomized on-line algorithm AAA is a probability distribution over deterministic on-line algorithms; its expected cost on σ\sigmaσ is ECA(σ)\mathbf{E}C_A(\sigma)ECA​(σ). AAA is ccc-competitive against an oblivious adversary from s0s_0s0​ if there is a constant aaa with

ECA(σ)≤c⋅Copt(s0,σ)+a\mathbf{E}C_A(\sigma)\le c\cdot C_{opt}(s_0,\sigma)+aECA​(σ)≤c⋅Copt​(s0​,σ)+a

for every admissible σ\sigmaσ. Put

ep=(1+1p)p.e_p=\left(1+\frac1p\right)^p .ep​=(1+p1​)p.

Formalization targets

Goal: Theorem 4

For n≥2n\ge 2n≥2, p≥1p\ge 1p≥1 and every initial state s0s_0s0​:

(∀A ∀c: A is c-competitive from s0⇒c≥epep−1) ∧ ∃A: A is epep−1-competitive from s0.\Big(\forall A\ \forall c:\ A \text{ is } c\text{-competitive from } s_0 \Rightarrow c\ge \tfrac{e_p}{e_p-1}\Big)\ \wedge\ \exists A:\ A \text{ is } \tfrac{e_p}{e_p-1}\text{-competitive from } s_0 .(∀A ∀c: A is c-competitive from s0​⇒c≥ep​−1ep​​) ∧ ∃A: A is ep​−1ep​​-competitive from s0​.

The two conjuncts are milestones of their own: the lower bound (Theorem 4, first claim) and attainment (Theorem 4, second claim).

The phase linear program (§3.2, pp. 552–554)

For p≥1p\ge1p≥1, real π1,…,πp+1\pi_1,\dots,\pi_{p+1}π1​,…,πp+1​ with πp+1=1\pi_{p+1}=1πp+1​=1, and real α\alphaα with

πk+1p+∑i=1k(1−πi)≤αk(k=0,…,p),\pi_{k+1}p+\sum_{i=1}^{k}(1-\pi_i)\le\alpha k\qquad(k=0,\dots,p),πk+1​p+i=1∑k​(1−πi​)≤αk(k=0,…,p),

one has α≥ep/(ep−1)\alpha\ge e_p/(e_p-1)α≥ep​/(ep​−1). Conversely, at α=ep/(ep−1)\alpha=e_p/(e_p-1)α=ep​/(ep​−1) the choice πk=(α−1)(((p+1)/p)k−1−1)\pi_k=(\alpha-1)\big(((p+1)/p)^{k-1}-1\big)πk​=(α−1)(((p+1)/p)k−1−1) satisfies πp+1=1\pi_{p+1}=1πp+1​=1, 0≤π1≤⋯≤πp+10\le\pi_1\le\dots\le\pi_{p+1}0≤π1​≤⋯≤πp+1​, and makes every constraint an equality.

Significance

The theorem settles the randomized competitive ratio of block snoopy caching exactly: 222 at p=1p=1p=1, 9/59/59/5 at p=2p=2p=2, decreasing to e/(e−1)≈1.582e/(e-1)\approx1.582e/(e−1)≈1.582 as p→∞p\to\inftyp→∞, against the deterministic optimum 222. The same ratio e/(e−1)e/(e-1)e/(e−1) is the randomized optimum for the continuous ski-rental and spin-block problems treated later in the paper, and the snoopy-caching case is its discrete counterpart with ratio ep/(ep−1)e_p/(e_p-1)ep​/(ep​−1). The phase-LP method used here recurs in the paper's two-server results.

The result is proved in the paper; to our knowledge it has no machine-checked proof. This mission produces a formal model of the snoopy-caching task system with look-ahead-zero requests, of randomized algorithms against an oblivious adversary with infinite task costs allowed, and of the off-line optimum, together with the exact optimal ratio. The platform's fractional ski-rental result (PrimalDualOnline.SkiRental.fractional_competitive) proves an eB/(eB−1)e_B/(e_B-1)eB​/(eB​−1) bound for a different model: one deterministic fractional algorithm, with no lower bound over randomized algorithms. It is related work, not a special case.

Difficulty

The linear program is elementary. The gap is between the LP and the algorithms. The paper's lower bound reduces arbitrary randomized algorithms to phase-based ones, whose state distribution at the end of each phase agrees with the optimal algorithm's known state, and whose behaviour inside a phase depends only on the number of writes so far. This reduction (Theorems 1 and 3 of the paper, pp. 545–549) is where the argument is not routine. An algorithm may keep the block private to a processor that is not the active one, may randomize over histories rather than over phase lengths, and the off-line optimum is not a sum of per-phase costs at the ends of the sequence. The obvious approach, bounding a single adversarial phase, does not suffice, because an algorithm may pay more in one phase and recover it in the next; the additive constant aaa and the infinite horizon have to be handled. For attainment, the mixture of threshold algorithms must be written as a genuine distribution over on-line algorithms, with the initial phase from a private state absorbed into the additive constant.

Formalization scope

Everything lives in the namespace NonuniformCompetitive.Snoopy. States are Option (Fin n) (none = shared). Costs are in ℝ≥0∞; +∞+\infty+∞ is a genuine outcome, so an algorithm that ever pays +∞+\infty+∞ with positive probability on an admissible sequence is not competitive. A deterministic on-line algorithm is a pair of functions of the request prefix (the state at the moment of the last request, and the state after it), with the look-ahead-zero rule as a field. Moves "immediately before" a request are made without knowledge of it and are recorded as moves after the previous request. A randomized algorithm is a probability space with a measurable cost on every sequence, and its expected cost is a lower Lebesgue integral. The off-line optimum is an infimum in ℝ≥0∞ over schedules starting in s0s_0s0​; it is finite on admissible sequences.

Conventions added to the printed statement, all from the paper's setting: (i) n≥2n\ge2n≥2, since with one processor the block can stay private for free; (ii) one block, since the proof of Theorem 4 splits a multi-block system into independent blocks (p. 551); (iii) admissibility in the form "each write of iii directly follows a read or write of iii", the reading of "every write is preceded by a read to the same block" that the proof uses; without it every algorithm is defeated by a write from a processor whose block copy was invalidated; (iv) p∈Np\in\mathbb{N}p∈N, p≥1p\ge1p≥1; (v) both claims from every initial state, with an additive constant depending on nnn, ppp, s0s_0s0​.

The lower bound is over all randomized algorithms, not over phase-based or deterministic ones; a statement restricted to phase-based algorithms, or the LP alone in place of the goal, would not be Theorem 4. The LP variables are free, as in the paper.

Welcome contributions: a formal version of the phase reduction (Theorems 1 and 3 of the paper) for this task system, which is reusable for the paper's other nonuniform problems; the threshold algorithms and their mixture; and a proof that the off-line optimum decomposes by write runs up to a bounded error.

Selected references

  • A. R. Karlin, M. S. Manasse, L. A. McGeoch, S. Owicki, Competitive Randomized Algorithms for Nonuniform Problems, Algorithmica 11 (1994), 542–571. https://doi.org/10.1007/BF01189993
  • A. R. Karlin, M. S. Manasse, L. Rudolph, D. D. Sleator, Competitive Snoopy Caching, Algorithmica 3 (1988), 79–119. https://doi.org/10.1007/BF01762111
  • A. Borodin, R. El-Yaniv, Online Computation and Competitive Analysis, Cambridge University Press, 1998.
8 thms4 active usersReviewed
🏆Completed
Combinatorics·Captain: mikedeng1

Three Partition Refinement Algorithms 2: Refining by the Smaller HalfResearch Paper

Motivation

Many equivalence problems on finite structures reduce to computing the coarsest partition of a finite set that is compatible with a relation. Deciding whether two states of a finite labelled transition system are bisimilar, testing congruence of finite-state processes in Milner's calculus of communicating systems (CCS), and minimizing a deterministic finite automaton are all instances. Kanellakis and Smolka studied the relational version in connection with CCS equivalence and gave an O(mn)O(mn)O(mn)-time algorithm, conjecturing that O(mlog⁡n)O(m \log n)O(mlogn) was possible. Paige and Tarjan's 1987 paper answers that conjecture with an algorithm that has since become the standard method for bisimulation minimization in model checkers and process-algebra tools.

Timeline:

  • 1971 — Hopcroft gives an O(nlog⁡n)O(n \log n)O(nlogn) algorithm for minimizing deterministic finite automata, i.e. for the coarsest partition stable with respect to one or more functions, using the rule "process the smaller half".
  • 1983/1990 — Kanellakis and Smolka give an O(mn)O(mn)O(mn)-time, O(m+n)O(m + n)O(m+n)-space algorithm for the relational problem, and O(c2nlog⁡n)O(c^2 n \log n)O(c2nlogn) when every element has at most ccc successors; they conjecture an O(mlog⁡n)O(m \log n)O(mlogn) algorithm.
  • 1987 — Paige and Tarjan combine Hopcroft's smaller-half strategy with refinement by unions of blocks and obtain O(mlog⁡n)O(m \log n)O(mlogn) time and O(m+n)O(m + n)O(m+n) space for the relational problem.

Setting

Let UUU be a finite set with n=∣U∣n = |U|n=∣U∣ elements and let E⊆U×UE \subseteq U \times UE⊆U×U be a binary relation on UUU; write xEyxEyxEy for (x,y)∈E(x, y) \in E(x,y)∈E and m=∣E∣m = |E|m=∣E∣. For S⊆US \subseteq US⊆U the preimage of SSS is

E−1(S)={x∈U∣∃y∈S, xEy}.E^{-1}(S) = \{x \in U \mid \exists y \in S,\ xEy\}.E−1(S)={x∈U∣∃y∈S, xEy}.

A partition of UUU is a family of nonempty, pairwise disjoint subsets of UUU, its blocks, whose union is UUU. A partition RRR is a refinement of a partition PPP if every block of RRR lies inside a block of PPP.

A set B⊆UB \subseteq UB⊆U is stable with respect to S⊆US \subseteq US⊆U if B⊆E−1(S)B \subseteq E^{-1}(S)B⊆E−1(S) or B∩E−1(S)=∅B \cap E^{-1}(S) = \emptysetB∩E−1(S)=∅: either every element of BBB has an EEE-successor in SSS, or none does. A partition is stable with respect to SSS if all its blocks are, and a partition is stable if it is stable with respect to each of its own blocks.

Given EEE and an initial partition PPP, the coarsest stable refinement of PPP is a stable partition QQQ refining PPP such that every stable partition refining PPP is a refinement of QQQ. The relational coarsest partition problem asks for it.

The algorithms refine by the operation split(S,Q)\mathrm{split}(S, Q)split(S,Q), which replaces each block BBB of QQQ that meets both E−1(S)E^{-1}(S)E−1(S) and its complement by the two blocks B∩E−1(S)B \cap E^{-1}(S)B∩E−1(S) and B−E−1(S)B - E^{-1}(S)B−E−1(S). The set SSS is a splitter of QQQ if split(S,Q)≠Q\mathrm{split}(S, Q) \neq Qsplit(S,Q)=Q.

  • The naïve algorithm starts from Q=PQ = PQ=P and, while possible, picks a splitter SSS of QQQ that is a union of blocks of QQQ and replaces QQQ by split(S,Q)\mathrm{split}(S, Q)split(S,Q).
  • The improved algorithm also maintains a partition XXX, initially {U}\{U\}{U}, of which QQQ is a refinement. While Q≠XQ \neq XQ=X, it picks a block S∈XS \in XS∈X that is not a block of QQQ and a block B∈QB \in QB∈Q with B⊆SB \subseteq SB⊆S and ∣B∣≤∣S∣/2|B| \le |S|/2∣B∣≤∣S∣/2, replaces SSS in XXX by BBB and S−BS - BS−B, and replaces QQQ by split(S−B,split(B,Q))\mathrm{split}(S - B, \mathrm{split}(B, Q))split(S−B,split(B,Q)).

The improved algorithm is analysed under the standing assumption ∣E({x})∣≥1|E(\{x\})| \ge 1∣E({x})∣≥1 for all x∈Ux \in Ux∈U: every element has at least one successor. (The paper reduces the general case to this one by a preprocessing step.)

Formalization targets

Goal: the improved algorithm

For every run (Q0,X0)=(P,{U}),…,(QK,XK)(Q_0, X_0) = (P, \{U\}), \dots, (Q_K, X_K)(Q0​,X0​)=(P,{U}),…,(QK​,XK​) of the improved algorithm with refining blocks B0,…,BK−1B_0, \dots, B_{K-1}B0​,…,BK−1​:

  1. at every stage QjQ_jQj​ and XjX_jXj​ are partitions, QjQ_jQj​ refines XjX_jXj​, and QjQ_jQj​ is stable with respect to every block of XjX_jXj​;
  2. if QK=XKQ_K = X_KQK​=XK​, then QKQ_KQK​ is the coarsest stable refinement of PPP;
  3. if QK≠XKQ_K \neq X_KQK​=XK​, another step applies;
  4. K≤n−1K \le n - 1K≤n−1;
  5. every x∈Ux \in Ux∈U satisfies
#{ j<K∣x∈Bj }≤log⁡2n+1.\#\{\, j < K \mid x \in B_j \,\} \le \log_2 n + 1.#{j<K∣x∈Bj​}≤log2​n+1.

Items 1–4 are the correctness of the improved algorithm, which the paper deduces from that of the naïve one. Item 5 is the counting fact on which the O(mlog⁡n)O(m \log n)O(mlogn) bound rests.

Milestones

  • §3, p. 978: SSS is a splitter of QQQ if and only if QQQ is unstable with respect to SSS.
  • Properties (1)–(3), p. 978: stability is inherited under refinement and under union; split\mathrm{split}split is monotone in its second argument.
  • §3, p. 979: a stable partition is stable with respect to every union of its blocks.
  • Lemma 2, p. 979: every stable refinement of PPP refines each partition produced by the naïve algorithm.
  • Theorem 2, p. 979: the naïve algorithm stops after at most n−1n - 1n−1 steps at the unique coarsest stable refinement.
  • Property (4), p. 978: split\mathrm{split}split is commutative, and split(S,split(Q,P))\mathrm{split}(S, \mathrm{split}(Q, P))split(S,split(Q,P)) is the coarsest refinement of PPP stable with respect to both SSS and QQQ.
  • Lemma 3, p. 980: the three-way split of a block DDD into D11D_{11}D11​, D12D_{12}D12​ and D2D_2D2​, including D12=D1∩(E−1(B)−E−1(S−B))D_{12} = D_1 \cap (E^{-1}(B) - E^{-1}(S - B))D12​=D1​∩(E−1(B)−E−1(S−B)).

Significance

The coarsest stable refinement of the partition of states by their labels is the bisimilarity relation of a finite transition system, so the goal certifies, for any sequence of choices, the correctness of the refinement loop at the core of bisimulation minimization. The halving count is the combinatorial half of the O(mlog⁡n)O(m \log n)O(mlogn) bound: once the implementation charges O(∣B∣+∑y∈B∣E−1({y})∣)O(|B| + \sum_{y \in B} |E^{-1}(\{y\})|)O(∣B∣+∑y∈B​∣E−1({y})∣) per refining block BBB, the count bounds the total work.

The results are proved in the paper, some by one-line arguments and the elementary properties (1)–(4) not at all ("stated without proof"). No machine-checked proof of the Paige–Tarjan algorithm's correctness or of its halving count is known to be available in Lean or Mathlib. The mission produces a checked account of the invariant, the final correctness and the counting argument for every run, not only for a particular implementation.

Difficulty

The correctness of the improved algorithm is not a special case of the naïve one read off directly. An improved step refines by BBB and by S−BS - BS−B, and S−BS - BS−B is a union of blocks of QQQ only because QQQ refines XXX. The invariant that QQQ is stable with respect to every block of XXX is what makes Q=XQ = XQ=X a stopping condition, and it holds initially only under the standing assumption. The naive idea of reusing Hopcroft's argument fails: for relations, stability with respect to SSS and BBB does not imply stability with respect to S−BS - BS−B, which is why both refinements are performed. For the halving count, the refining blocks that contain a fixed element must be shown to be nested across steps, which requires tracking how blocks of XXX are replaced.

Formalization scope

  • UUU is a Fintype with decidable equality, EEE a decidable relation U → U → Prop. Partitions are Finset (Finset U) with an explicit predicate IsPartition (nonempty, pairwise disjoint blocks covering UUU); blocks are required to be nonempty, which the paper leaves implicit.
  • "Coarsest" means: every stable partition refining PPP refines it. The paper's "every other stable partition" is read this way, since a stable partition that does not refine PPP need not refine the answer.
  • Algorithms are step relations; a run is a finite sequence of states indexed by Fin (K + 1), with the choices Sj,BjS_j, B_jSj​,Bj​ recorded. Every statement holds for every run, so no choice rule is fixed.
  • Added hypotheses: UUU nonempty (so {U}\{U\}{U} is a partition and "at most n−1n - 1n−1 steps" is meaningful); the standing assumption ∀x ∃y, xEy\forall x\, \exists y,\ xEy∀x∃y, xEy for the goal only. Lemma 2 is stated for every stable refinement of PPP, which is what its proof gives and what Theorem 2 uses; it implies the printed form.
  • Explicit forms: ∣B∣≤∣S∣/2|B| \le |S|/2∣B∣≤∣S∣/2 is 2 * B.card ≤ S.card, K≤n−1K \le n - 1K≤n−1 is K + 1 ≤ n, log⁡2\log_2log2​ is Real.logb 2 of nnn cast to R\mathbb{R}R. The termination bound for the improved algorithm is not printed in the paper and is derived as in the proof of Theorem 2. Running times (O(mn)O(mn)O(mn), O(mlog⁡n)O(m \log n)O(mlogn)) and the data structures of the implementation are out of scope.
  • A trivializing reading is ruled out: the goal quantifies over all runs from (P,{U})(P, \{U\})(P,{U}) with every side condition of the step (in particular S∉QS \notin QS∈/Q and the half-size condition), and the conclusion is a full correctness statement, not the existence of some stable partition; the discrete partition is stable but is not the answer in general.
  • Reusable beyond this mission: preimage, stability, split\mathrm{split}split and its algebra (properties (1)–(4)), which apply to Hopcroft's algorithm and to bisimulation minimization in general. Contributions proving the elementary properties first, then Lemma 2 and Theorem 2, are the natural attack order.

Selected references

  • R. Paige, R. E. Tarjan, Three Partition Refinement Algorithms, SIAM Journal on Computing 16(6):973–989, 1987. https://doi.org/10.1137/0216062
  • P. C. Kanellakis, S. A. Smolka, CCS expressions, finite state processes, and three problems of equivalence, Information and Computation 86(1):43–68, 1990. https://doi.org/10.1016/0890-5401(90)90025-D
  • J. E. Hopcroft, An n log n algorithm for minimizing states in a finite automaton, in Theory of Machines and Computations, Academic Press, 1971, pp. 189–196. https://doi.org/10.1016/B978-0-12-417750-5.50022-1
  • A. V. Aho, J. E. Hopcroft, J. D. Ullman, The Design and Analysis of Computer Algorithms, Addison-Wesley, 1974.
12 thms4 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Competitive Paging Algorithms I: The Marking Algorithm Is 2H_k-CompetitiveResearch Paper

Motivation

Paging is the problem of managing a two-level memory: a fast cache holds kkk pages out of an address space of nnn pages, requests to pages arrive one at a time, and a request to a page outside the cache (a page fault) forces the algorithm to bring that page in and, when the cache is full, to evict another. The cost is the number of faults. An on-line algorithm decides which page to evict without knowing future requests. The comparison of paging policies with the optimal off-line policy is where competitive analysis began.

Sleator and Tarjan showed that LRU and FIFO are within a factor kkk of the off-line optimum and that no deterministic on-line algorithm does better than kkk (Sleator–Tarjan 1985). Randomization changes the picture: Fiat, Karp, Luby, McGeoch, Sleator and Young introduced the marking algorithm and proved that its expected cost is within a factor 2Hk2H_k2Hk​ of the optimum, where Hk=1+12+⋯+1k≈ln⁡kH_k = 1 + \frac12 + \dots + \frac1k \approx \ln kHk​=1+21​+⋯+k1​≈lnk (arXiv:cs/0205038).

Timeline.

  • 1985: Sleator and Tarjan: LRU and FIFO are kkk-competitive; no deterministic algorithm beats kkk.
  • 1988: Karlin, Manasse, Rudolph and Sleator coin "competitive" and analyse flush-when-full (Algorithmica 3).
  • 1990: Manasse, McGeoch and Sleator introduce the kkk-server problem and define competitiveness for randomized algorithms (J. Algorithms 11).
  • 1991: Fiat et al.: the marking algorithm is 2Hk2H_k2Hk​-competitive, and Hn−1H_{n-1}Hn−1​-competitive when k=n−1k = n-1k=n−1; no randomized paging algorithm beats HkH_kHk​.
  • 1991: McGeoch and Sleator give an HkH_kHk​-competitive randomized paging algorithm (Algorithmica 6).
  • 2000: Achlioptas, Chrobak and Noga determine the exact competitive ratio of the marking algorithm, 2Hk−12H_k - 12Hk​−1 (Theoret. Comput. Sci. 234).

Setting

The paper works in the uniform kkk-server problem, which is isomorphic to paging. There is a set MMM of nnn vertices, enumerated e(0),…,e(n−1)e(0), \dots, e(n-1)e(0),…,e(n−1), and moving a server between two distinct vertices costs 111. There are kkk servers, 1≤k≤n1 \le k \le n1≤k≤n. A request is a vertex, and after each request some server must be on it. Cached pages are covered vertices; a fault is a server move.

The marking algorithm starts with its servers on e(0),…,e(k−1)e(0), \dots, e(k-1)e(0),…,e(k−1) and keeps a set of marked vertices, initially the covered ones. On a request to rrr:

  1. Marking. rrr is marked; the moment k+1k+1k+1 vertices are marked, all marks except the one on rrr are erased.
  2. Serving. If rrr is covered, nothing moves. Otherwise a server is chosen uniformly at random among the covered unmarked vertices and moved to rrr.

The marks are updated before the server is chosen. For a finite request sequence σ\sigmaσ, CM(σ)C_M(\sigma)CM​(σ) is the algorithm's expected number of server moves. OPT(σ)\mathrm{OPT}(\sigma)OPT(σ) is the least number of moves with which kkk servers, starting from the same configuration C0C_0C0​ and knowing σ\sigmaσ in advance, can serve σ\sigmaσ.

A randomized algorithm is ccc-competitive if there is a constant aaa such that CM(σ)≤c⋅CB(σ)+aC_M(\sigma) \le c \cdot C_B(\sigma) + aCM​(σ)≤c⋅CB​(σ)+a for every request sequence σ\sigmaσ and every algorithm BBB.

The marks divide σ\sigmaσ into phases. A new phase begins at the request that would make k+1k+1k+1 vertices marked. A vertex is clean in a phase if it was not requested in the previous phase and not yet in this one, and stale if it was requested in the previous phase but not yet in this one.

Formalization targets

Goal: Theorem 1

∃ a∈R  ∀σ:CM(σ)  ≤  2Hk⋅OPT(σ)+a.\exists\, a \in \mathbb R\ \ \forall \sigma:\qquad C_M(\sigma) \;\le\; 2H_k \cdot \mathrm{OPT}(\sigma) + a .∃a∈R  ∀σ:CM​(σ)≤2Hk​⋅OPT(σ)+a.

The constant aaa may depend on nnn, kkk and the enumeration, never on σ\sigmaσ.

Milestones (proof of Theorem 1, pp. 4–5)

  1. Without loss of generality the adversary is lazy: no move on a covered request, exactly one move otherwise (reference item, already proved on the platform).
  2. At the start of every phase the marked vertices are exactly the covered ones, and the first request of a phase is unmarked.
  3. In a phase with lll clean requests, a lazy adversary pays CA≥l−dC_A \ge l - dCA​≥l−d, where ddd counts its servers off the marking algorithm's servers at the start of the phase.
  4. It also pays CA≥d′C_A \ge d'CA​≥d′, where d′d'd′ counts its servers off the final marked set at the end of the phase.
  5. Hence CA≥max⁡(l−d,d′)≥12(l−d+d′)C_A \ge \max(l-d, d') \ge \tfrac12(l - d + d')CA​≥max(l−d,d′)≥21​(l−d+d′).
  6. A request to a stale vertex is a fault with probability c/sc/sc/s (ccc clean vertices requested so far, sss stale vertices left).
  7. The marking algorithm's expected cost in a phase is at most l(Hk−Hl+1)≤lHkl(H_k - H_l + 1) \le lH_kl(Hk​−Hl​+1)≤lHk​.

Companions

  • Theorem 2: for k=n−1k = n-1k=n−1, CM(σ)≤Hn−1⋅OPT(σ)+aC_M(\sigma) \le H_{n-1} \cdot \mathrm{OPT}(\sigma) + aCM​(σ)≤Hn−1​⋅OPT(σ)+a.
  • Tightness remark (pp. 5–6): for k=2k = 2k=2, n=4n = 4n=4 there is no aaa with CM(σ)≤H2⋅OPT(σ)+aC_M(\sigma) \le H_2 \cdot \mathrm{OPT}(\sigma) + aCM​(σ)≤H2​⋅OPT(σ)+a for all σ\sigmaσ.

Significance

The result. Theorem 1 was the first proof that randomization beats the deterministic barrier kkk for paging, bringing the ratio down to O(log⁡k)O(\log k)O(logk). Together with the paper's lower bound HkH_kHk​ for every randomized algorithm, it determines the randomized competitive ratio of paging up to a factor 222. Its phase and clean/stale accounting is reused throughout the analysis of randomized caching.

Formalizing it. The theorem is proved (1991). As far as is known it has no machine-checked proof. Formalizing it requires a probabilistic model of a randomized on-line algorithm, an off-line optimum, and a phase decomposition with an exchangeability argument, and these are the first such objects in this library. Theorem 2 and the k=2k = 2k=2, n=4n = 4n=4 example use the same definitions and also check that the formal algorithm is the paper's. The sharp ratio 2Hk−12H_k - 12Hk​−1 is a natural follow-up.

Difficulty

The comparison is between a random process and a deterministic adversary, and each side has its own obstacle.

On the algorithm's side, the configuration inside a phase is random, and the fault probability of a stale request depends on the whole history of the phase. The claim that the ccc uncovered stale vertices form a uniformly random subset of the sss stale ones is an exchangeability property of the process, and must be established from the step-by-step uniform choice. The worst-case ordering of the requests within a phase then has to be justified as a bound, not assumed.

On the adversary's side, the per-phase bound max⁡(l−d,d′)\max(l-d, d')max(l−d,d′) does not sum directly. The ddd and d′d'd′ terms telescope across phases only because the configuration of the marking algorithm at each phase boundary is deterministic. The first phase, which begins after an initial run of requests to e(0),…,e(k−1)e(0), \dots, e(k-1)e(0),…,e(k−1), and the last, incomplete phase have to be absorbed into the additive constant.

Formalization scope

The vertex set is an abstract metric space MMM with e:Fin n≃Me : \mathrm{Fin}\,n \simeq Me:Finn≃M and dist(x,y)=1\mathrm{dist}(x,y) = 1dist(x,y)=1 for x≠yx \ne yx=y. The natural metric ∣i−j∣|i - j|∣i−j∣ on Fin n\mathrm{Fin}\,nFinn is deliberately not used. The configurations and the off-line optimum OPT\mathrm{OPT}OPT are the published KServer definitions (KServer.Config, KServer.offlineCost), with OPT\mathrm{OPT}OPT taken from the marking algorithm's initial configuration. An off-line algorithm starting elsewhere changes the cost by at most kkk, which is absorbed into aaa.

The marking algorithm is a Markov chain on pairs (covered set, marked set). Each step is a PMF, with the eviction drawn by PMF.uniformOfFinset from the covered unmarked vertices. The expected cost is the sum over requests of the probability that the request is not covered, which is exact because the algorithm moves exactly one server per fault. Harmonic numbers are Mathlib's harmonic, cast to R\mathbb RR. Phases, clean counts and lazy off-line schedules are defined once, in the mission's definition file, and all milestones use them.

A trivializing formalization is ruled out as follows. The additive constant is quantified before σ\sigmaσ, so a per-sequence constant cannot be used. The comparison is with the optimum over all off-line schedules, not a particular one. The random choice is among the covered unmarked vertices, with marks updated first. The hypothesis 1≤k≤n1 \le k \le n1≤k≤n excludes the degenerate case k=0k = 0k=0, where H0=0H_0 = 0H0​=0.

Proofs of individual milestones are welcome. The laziness reduction for off-line schedules, the exchangeability lemma for the uniform eviction process, and the harmonic-sum identity ∑j=l+1kl/j=l(Hk−Hl)\sum_{j=l+1}^{k} l/j = l(H_k - H_l)∑j=l+1k​l/j=l(Hk​−Hl​) are reusable beyond this mission.

Selected references

  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive Paging Algorithms, J. Algorithms 12(4):685–699, 1991; arXiv:cs/0205038v1. https://arxiv.org/abs/cs/0205038
  • D. D. Sleator, R. E. Tarjan, Amortized Efficiency of List Update and Paging Rules, Comm. ACM 28(2):202–208, 1985. https://doi.org/10.1145/2786.2793
  • A. R. Karlin, M. S. Manasse, L. Rudolph, D. D. Sleator, Competitive Snoopy Caching, Algorithmica 3:79–119, 1988. https://doi.org/10.1007/BF01762111
  • M. S. Manasse, L. A. McGeoch, D. D. Sleator, Competitive Algorithms for Server Problems, J. Algorithms 11(2):208–230, 1990. https://doi.org/10.1016/0196-6774(90)90003-W
  • L. A. McGeoch, D. D. Sleator, A Strongly Competitive Randomized Paging Algorithm, Algorithmica 6:816–825, 1991. https://doi.org/10.1007/BF01759073
  • D. Achlioptas, M. Chrobak, J. Noga, Competitive Analysis of Randomized Paging Algorithms, Theoret. Comput. Sci. 234:203–218, 2000. https://doi.org/10.1016/S0304-3975(98)00116-9
10 thms4 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research+1·Captain: mikedeng1

An Analysis of Several Heuristics for the Traveling Salesman Problem I: Nearest Neighbor Tours Can Be Far from OptimalResearch Paper

Motivation

The traveling salesman problem with the triangle inequality asks for a shortest closed tour through nnn points whose distances form a metric. It is NP-hard, so in practice tours are built by fast construction heuristics, and the natural question is how far such a tour can be from optimal in the worst case. Rosenkrantz, Stearns and Lewis (SIAM J. Comput. 6(3), 1977) gave the first systematic worst-case analysis of the standard heuristics. Their results are reproduced in textbooks on approximation algorithms and combinatorial optimization, and they are the reference point against which later guarantees (Christofides' 3/23/23/2 algorithm, the double-tree 222-approximation) are compared.

The simplest heuristic studied is the nearest neighbor algorithm (Bellmore and Nemhauser, 1968; the "next best method" of Gavett, 1965): from the current node, always move to the closest node not yet visited, and return to the start at the end. The paper shows that this greedy rule is never worse than logarithmic (Theorem 1) and that the logarithm cannot be removed (Theorem 2). This mission is about Theorem 2, the lower bound.

Setting

A traveling salesman graph on nnn nodes is a complete graph with a distance d(a,b)∈Rd(a,b)\in\mathbb Rd(a,b)∈R that is symmetric, d(a,b)=d(b,a)d(a,b)=d(b,a)d(a,b)=d(b,a), nonnegative, d(a,b)≥0d(a,b)\ge 0d(a,b)≥0, and satisfies the triangle inequality d(a,c)≤d(a,b)+d(b,c)d(a,c)\le d(a,b)+d(b,c)d(a,c)≤d(a,b)+d(b,c). A tour lists the nodes in a visiting order τ(0),…,τ(n−1)\tau(0),\dots,\tau(n-1)τ(0),…,τ(n−1) and returns to τ(0)\tau(0)τ(0); its length is the sum of the nnn distances along it. OPTIMAL is the least length of a tour.

The nearest neighbor algorithm starts at an arbitrary node τ(0)\tau(0)τ(0); having reached τ(k)\tau(k)τ(k), it moves to a node τ(k+1)\tau(k+1)τ(k+1) that minimizes d(τ(k),⋅)d(\tau(k),\cdot)d(τ(k),⋅) over the nodes not yet visited, breaking ties arbitrarily; after the last node it returns to τ(0)\tau(0)τ(0). The length of the resulting tour is written NEARNEIBER. Because the start node and the ties are free, one instance has in general several nearest-neighbor tours. A lower bound needs only one of them; an upper bound must hold for all.

The instances of the proof are built from a recursive family of weighted graphs. With li=16(4⋅2i−(−1)i+3)l_i=\frac16(4\cdot 2^i-(-1)^i+3)li​=61​(4⋅2i−(−1)i+3) (so l1,l2,l3,l4=2,3,6,11l_1,l_2,l_3,l_4=2,3,6,11l1​,l2​,l3​,l4​=2,3,6,11), the graph F1F_1F1​ is a triangle with unit weights, and Fi+1F_{i+1}Fi+1​ consists of two copies of FiF_iFi​ joined through one new node by two edges of length 111 and two edges of length lil_ili​. Each FiF_iFi​ has 2i+1−12^{i+1}-12i+1−1 nodes and a path PiP_iPi​ from its start node to its middle node through every node, of length LiL_iLi​ with L1=2L_1=2L1​=2, Li+1=2Li+2liL_{i+1}=2L_i+2l_iLi+1​=2Li​+2li​. The graph GiG_iGi​ adds two closing edges to FiF_iFi​, and Gˉi\bar G_iGˉi​ is the complete graph on the same nodes whose distance is the shortest-path distance of GiG_iGi​.

Formalization targets

Goal: Theorem 2 (p. 566)

For each m>3m>3m>3 there is a traveling salesman graph with n=2m−1n=2^m-1n=2m−1 nodes and a nearest-neighbor tour on it such that

NEARNEIBEROPTIMAL>13lg⁡(n+1)+49.\frac{\mathrm{NEARNEIBER}}{\mathrm{OPTIMAL}}>\frac13\lg(n+1)+\frac49 .OPTIMALNEARNEIBER​>31​lg(n+1)+94​.

The statement is existential in both the instance and the run of the algorithm, exactly as in the paper.

Milestones, in the order the proof uses them

  1. (2.12): the difference equation Li+1=2Li+2liL_{i+1}=2L_i+2l_iLi+1​=2Li​+2li​, L1=2L_1=2L1​=2, has the solution Li=19(6 i 2i+8⋅2i+(−1)i−9)L_i=\frac19(6\,i\,2^i+8\cdot2^i+(-1)^i-9)Li​=91​(6i2i+8⋅2i+(−1)i−9).
  2. Gˉi\bar G_iGˉi​ is a traveling salesman graph: the shortest-path distance of GiG_iGi​ is symmetric, nonnegative and satisfies the triangle inequality.
  3. (2.13)–(2.17): the shortest-path distances in Fi+1F_{i+1}Fi+1​ between the seven named nodes A,…,GA,\dots,GA,…,G of Fig. 1, e.g. AG‾=li+2−2\overline{AG}=l_{i+2}-2AG=li+2​−2.
  4. Property a): every edge of GiG_iGi​ is a shortest path between its endpoints.
  5. Property b): the nearest neighbor algorithm started at the start node of Gˉi\bar G_iGˉi​ can follow PiP_iPi​ and return along the edge of length li−1l_i-1li​−1.
  6. The optimal tour: OPTIMAL(Gˉi)=2i+1−1\mathrm{OPTIMAL}(\bar G_i)=2^{i+1}-1OPTIMAL(Gˉi​)=2i+1−1.
  7. The exact ratio: the tour along PiP_iPi​ has length Li+li−1L_i+l_i-1Li​+li​−1, so its ratio is (Li+li−1)/n(L_i+l_i-1)/n(Li​+li​−1)/n.
  8. The inequality: (Li+li−1)/n>13lg⁡(n+1)+49(L_i+l_i-1)/n>\frac13\lg(n+1)+\frac49(Li​+li​−1)/n>31​lg(n+1)+94​ for i≥3i\ge3i≥3.

The instance for mmm is Gˉm−1\bar G_{m-1}Gˉm−1​.

Significance

Theorem 1 of the same paper shows NEARNEIBER/OPTIMAL≤12⌈lg⁡n⌉+12\mathrm{NEARNEIBER}/\mathrm{OPTIMAL}\le\frac12\lceil\lg n\rceil+\frac12NEARNEIBER/OPTIMAL≤21​⌈lgn⌉+21​ for every nearest-neighbor tour on every traveling salesman graph. Theorem 2 shows that this bound has the right order: no constant-factor guarantee holds for the nearest neighbor rule, and the gap between the two constants (13\frac1331​ against 12\frac1221​) is all that remains. This separates the nearest neighbor rule from the insertion rules analysed later in the same paper, of which nearest and cheapest insertion are within a factor 222 of optimal. It is the standard example of a natural greedy heuristic whose approximation ratio grows with nnn.

The upper bound, Theorem 1, is already on Prove2Me with a machine-checked proof (SupplyChainTheory.nearest_neighbor_bound); its statement notes that the lower-bound instances are not formalized there. This mission supplies them: an explicit recursive family of metric instances, the shortest-path computations that certify it, and the arithmetic of its ratio. The result is proved in the paper; to our knowledge it has not been formalized in any proof assistant. The construction (a recursively defined weighted graph with a closed-form shortest-path table) is also a reusable pattern for other worst-case lower bounds of greedy heuristics.

Difficulty

The arithmetic ((2.12) and the final inequality) is routine. The content is in properties a) and b). A shortest-path distance is an infimum over all walks, and property a) asks that no detour through the recursive structure is shorter than the direct edge, at every level of the recursion. The paper handles this by an induction on (2.13)–(2.17) that tracks only seven nodes per level, and argues that distances inside a copy of FiF_iFi​ are not shortened by embedding it into Fi+1F_{i+1}Fi+1​. Property b) then needs that at each step of PiP_iPi​ the chosen node is at least as close as every unvisited node, including nodes in the other copy and nodes reached through the start or right nodes; ties occur, and the claim is only that some resolution of them follows PiP_iPi​. Checking small cases by computer does not give either property for all iii.

Formalization scope

Nodes of an instance are Fin n, a tour is a permutation of Fin n, the tour length is the sum over consecutive pairs including the closing edge, and OPTIMAL is a minimum over the finite set of permutations. The model is the paper's: symmetric, nonnegative distances with the triangle inequality. The distance structure also carries d(a,a)=0d(a,a)=0d(a,a)=0, a normalization not in the paper; the diagonal never enters a tour length. A nearest-neighbor tour is a permutation in which each step goes to a node at least as close as every unvisited node, from an arbitrary start with arbitrary ties.

Ratios are multiplied out: the goal is (13log⁡2(n+1)+49)⋅OPTIMAL<NEARNEIBER(\frac13\log_2(n+1)+\frac49)\cdot\mathrm{OPTIMAL}<\mathrm{NEARNEIBER}(31​log2​(n+1)+94​)⋅OPTIMAL<NEARNEIBER together with OPTIMAL>0\mathrm{OPTIMAL}>0OPTIMAL>0, the paper's standing assumption (1.1). lg⁡(n+1)\lg(n+1)lg(n+1) is Real.logb 2 of n+1n+1n+1, as printed. Because of the strict inequality and the conjunct OPTIMAL>0\mathrm{OPTIMAL}>0OPTIMAL>0, the all-zero distance does not satisfy the goal, so the statement cannot be met by a degenerate instance.

In the construction the nodes of FiF_iFi​, GiG_iGi​, Gˉi\bar G_iGˉi​ are numbered 0,…,2i+1−20,\dots,2^{i+1}-20,…,2i+1−2 from left to right (start node 000, middle node 2i−12^i-12i−1, right node 2i+1−22^{i+1}-22i+1−2); in Fi+1F_{i+1}Fi+1​ the left copy comes first, then the new node, then the right copy. Graphs are edge lists with real weights and lil_ili​ is defined in R\mathbb RR exactly as in (2.11). The shortest-path distance is the infimum of walk weights over an inductive walk predicate; it would be 000 for two nodes with no connecting walk, a case that does not arise because every GiG_iGi​ and FiF_iFi​ is connected. LiL_iLi​ is defined by its difference equation; its identification with the length of the tour along PiP_iPi​ is milestone 7. All construction statements assume i≥1i\ge1i≥1.

A complete development needs a small library for shortest-path distances of finite weighted edge lists (symmetry, triangle inequality, attainment, behaviour under relabelling and under gluing two graphs at a few nodes); this part is reusable beyond the mission. Contributions welcome: proofs of any milestone, and such general shortest-path lemmas as separate theorems. Theorem 1 is not part of this mission.

Selected references

  • D. J. Rosenkrantz, R. E. Stearns, P. M. Lewis II, An Analysis of Several Heuristics for the Traveling Salesman Problem, SIAM J. Comput. 6(3):563–581, 1977. https://doi.org/10.1137/0206041
  • M. Bellmore, G. L. Nemhauser, The Traveling Salesman Problem: A Survey, Operations Research 16(3):538–558, 1968. https://doi.org/10.1287/opre.16.3.538
  • J. W. Gavett, Three Heuristic Rules for Sequencing Jobs to a Single Production Facility, Management Science 11(8):B166–B176, 1965. https://doi.org/10.1287/mnsc.11.8.B166
  • N. Christofides, Worst-Case Analysis of a New Heuristic for the Travelling Salesman Problem, Report 388, Graduate School of Industrial Administration, Carnegie Mellon University, 1976.
12 thms4 active usersReviewed
PreviousPage 1 of 10Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me