Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Theoretical Computer Science

464 missions · 238 completed

The mathematical foundations of computation: which problems can be solved, by what algorithms, and at what cost in time, space, or communication. Distinguished by its emphasis on rigor and unconditional lower bounds, it spans computational complexity, algorithm design, automata and computability, cryptography, and the analysis of Boolean functions.

Missions

Open226Completed238All464
Discrete GeometryGraph Theory·Captain: wurtle

Planar Graph Metrics Embed into L1 with Constant DistortionResearch Paper

Motivation: cut metrics, flows and the planar embedding conjecture

A finite metric space embeds into L1L_1L1​ exactly when its metric is a nonnegative combination of cut metrics δS(x,y)=∣1S(x)−1S(y)∣\delta_S(x,y)=|\mathbf 1_S(x)-\mathbf 1_S(y)|δS​(x,y)=∣1S​(x)−1S​(y)∣. For this reason the least distortion with which a graph metric embeds into L1L_1L1​ governs the gap between multicommodity flow and sparsest cut: Linial, London and Rabinovich (1995) and Aumann and Rabani (1998) connected metric embeddings to the approximate max-flow/min-cut theorem, and Gupta, Newman, Rabinovich and Sinclair (2004) proved that the worst flow–cut gap on a fixed graph equals the worst L1L_1L1​ distortion of its weighted shortest-path metrics. They conjectured (the GNRS conjecture) that every proper minor-closed graph family embeds into L1L_1L1​ with uniformly bounded distortion. The planar case has been the central open instance.

Timeline

  • 1981 — Okamura and Seymour: multicommodity flows in planar graphs with all terminals on one face (JCTB 1981), giving isometric L1L_1L1​ representations of one-face metrics.
  • 1993 — Klein, Plotkin and Rao: decompositions of graphs excluding a fixed minor (STOC 1993).
  • 1999 — Rao: every nnn-vertex planar metric embeds into L1L_1L1​ (via Euclidean space) with distortion O(log⁡n)O(\sqrt{\log n})O(logn​) (SoCG 1999).
  • 2003 — Newman and Rabinovich: series-parallel metrics may need Ω(log⁡n)\Omega(\sqrt{\log n})Ω(logn​) distortion into Euclidean space, so the Euclidean route cannot give a constant (DCG 2003).
  • 2004 — Gupta, Newman, Rabinovich and Sinclair: constant distortion for series-parallel graphs, and the GNRS conjecture (Combinatorica 2004).
  • 2006 — Chekuri, Gupta, Newman, Rabinovich and Sinclair: kkk-outerplanar graphs, with a bound exponential in kkk (SIDMA 2006).
  • 2008–2010 — Chakrabarti, Jaffe, Lee and Vincent: sharp bound 222 for series-parallel graphs (FOCS 2008); Lee and Raghavendra: matching lower bound (DCG 2010). Lee and Sidiropoulos relate the planar case to the full conjecture (STOC 2009).
  • 2013 — Sidiropoulos: constant distortion for planar metrics realized in nonpositively curved simply connected surfaces (FOCS 2013).
  • 2019–2025 — Face-cover bounds by Krauthgamer, Lee and Rika (SODA 2019) and Filtser (TALG 2025); Abraham, Filtser, Gupta and Neiman recover Rao's bound via shortest-path decompositions (SICOMP 2022).
  • 2026 — An OpenAI preprint, Planar Graph Metrics Embed into L1L_1L1​ with Constant Distortion (OpenAI Math Release, September 23, 2026), claims the planar case of the GNRS conjecture. The preprint has not been peer reviewed, and its main theorem is not formally verified.

Setting

Let GGG be a finite connected simple graph on vertex set V={0,…,n−1}V=\{0,\dots,n-1\}V={0,…,n−1} with symmetric edge lengths ℓ(u,v)=ℓ(v,u)>0\ell(u,v)=\ell(v,u)>0ℓ(u,v)=ℓ(v,u)>0 on edges. The graph metric dG(x,y)d_G(x,y)dG​(x,y) is the infimum of ∑ℓ(e)\sum\ell(e)∑ℓ(e) over walks from xxx to yyy. GGG is planar if it has a drawing in R2\mathbb R^2R2: distinct points for vertices and, for each edge, an injective arc between its endpoints whose interior avoids every vertex and meets the interior of no other edge.

A map f:V→L1(Ω,μ)f:V\to L_1(\Omega,\mu)f:V→L1​(Ω,μ) into the real L1L_1L1​ space of some measure space has distortion at most CCC if dG(x,y)≤∥f(x)−f(y)∥1≤C dG(x,y)d_G(x,y)\le\|f(x)-f(y)\|_1\le C\,d_G(x,y)dG​(x,y)≤∥f(x)−f(y)∥1​≤CdG​(x,y) for all x,yx,yx,y.

Formalization targets

Goal: Theorem 1.1 (planar graph metrics in L1L_1L1​)

There is a constant C≥1C\ge1C≥1 such that for every nnn, every connected planar graph GGG on nnn vertices and every symmetric positive edge-length function ℓ\ellℓ, there are a measure space (Ω,F,μ)(\Omega,\mathcal F,\mu)(Ω,F,μ) and f:V→L1(Ω,F,μ;R)f:V\to L_1(\Omega,\mathcal F,\mu;\mathbb R)f:V→L1​(Ω,F,μ;R) with

dG(x,y)  ≤  ∥f(x)−f(y)∥1  ≤  C dG(x,y)(x,y∈V).d_G(x,y)\;\le\;\|f(x)-f(y)\|_1\;\le\;C\,d_G(x,y)\qquad(x,y\in V).dG​(x,y)≤∥f(x)−f(y)∥1​≤CdG​(x,y)(x,y∈V).

The constant is not fixed: the goal asserts only existence, so any improvement of the constant is compatible with it. The goal statement is published on the platform with status Open: no machine-checked proof exists yet.

Significance

The result itself. The theorem settles the planar case of the GNRS conjecture. By the Gupta–Newman–Rabinovich–Sinclair equivalence it gives a universal constant bound on the fractional flow–cut gap for arbitrary demands in planar graphs. With the bounded-treewidth companion preprint it also yields constant distortion for the fixed-parameter almost-embeddable families of Lee and Sidiropoulos (Corollary 10.1 of the source). The general clique-sum closure needed for the full GNRS conjecture is not established.

Formalizing it. The statement is elementary (finite graphs, arcs in the plane, an L1L^1L1 space), yet the proof combines a geometric column model of planar graphs, random multiscale cut constructions and packing estimates. A formal proof would certify every scale-combination step, where errors in uniformity are easy to make.

Difficulty

Standard random-partition methods for planar graphs separate pairs at each distance scale with good probability, but naive summation over scales costs a factor proportional to the number of scales, which is unbounded when edge lengths vary. Embedding first into Euclidean space cannot work: Newman–Rabinovich show Ω(log⁡n)\Omega(\sqrt{\log n})Ω(logn​) Euclidean distortion is necessary already for series-parallel graphs. The difficulty is to combine separations at different scales while keeping a single uniform upper bound on every edge.

Formalization scope

  • Vertices are Fin n; the graph is a SimpleGraph (Fin n) with G.Connected (so n≥1n\ge1n≥1). Singletons are allowed.
  • IsPlanar G asks for an injective vertex placement in ℝ × ℝ and, for each ordered adjacent pair, an injective continuous arc on the unit interval with the right endpoints, whose interior avoids all vertex points and meets the interior of another arc only if it is the same unoriented edge.
  • Edge lengths are a function Fin n → Fin n → ℝ, symmetric, and positive on adjacent pairs; values on non-adjacent pairs are irrelevant. graphDistance is the sInf of walk lengths; for a connected graph with nonnegative edge lengths the set of walk lengths is nonempty and bounded below, so the infimum is the genuine shortest-path distance.
  • The target space is MeasureTheory.Lp Ω ℝ 1 μ for an existentially chosen measure space, and the inequalities are stated without a rescaling factor (the rescaling is absorbed into fff).
  • Infrastructure needed: plane drawings and their combinatorial consequences (rotation systems, noncrossing column models), cut-metric representations of L1L_1L1​ metrics, and the probabilistic multiscale construction. Plane-drawing and cut-metric infrastructure is reusable.

Selected references

  • N. Linial, E. London, Y. Rabinovich, The geometry of graphs and some of its algorithmic applications, Combinatorica 15 (1995). https://doi.org/10.1007/BF01200757
  • Y. Aumann, Y. Rabani, An O(log⁡k)O(\log k)O(logk) approximate min-cut max-flow theorem and approximation algorithm, SIAM J. Comput. (1998). https://doi.org/10.1137/S0097539794285983
  • A. Gupta, I. Newman, Y. Rabinovich, A. Sinclair, Cuts, trees and ℓ1\ell_1ℓ1​-embeddings of graphs, Combinatorica (2004). https://doi.org/10.1007/s00493-004-0015-x
  • S. Rao, Small distortion and volume preserving embeddings for planar and Euclidean metrics, SoCG 1999. https://doi.org/10.1145/304893.304983
  • I. Newman, Y. Rabinovich, A lower bound on the distortion of embedding planar metrics into Euclidean space, Discrete Comput. Geom. (2003). https://doi.org/10.1007/s00454-002-2813-5
  • C. Chekuri, A. Gupta, I. Newman, Y. Rabinovich, A. Sinclair, Embedding kkk-outerplanar graphs into ℓ1\ell_1ℓ1​, SIAM J. Discrete Math. (2006). https://doi.org/10.1137/S0895480102417379
  • A. Chakrabarti, A. Jaffe, J. R. Lee, J. Vincent, Embeddings of topological graphs: lossy invariants, linearization, and 2-sums, FOCS 2008. https://doi.org/10.1109/FOCS.2008.79
  • J. R. Lee, A. Sidiropoulos, On the geometry of graphs with a forbidden minor, STOC 2009. https://doi.org/10.1145/1536414.1536450
  • A. Sidiropoulos, Non-positive curvature and the planar embedding conjecture, FOCS 2013. https://doi.org/10.1109/FOCS.2013.27
  • I. Abraham, A. Filtser, A. Gupta, O. Neiman, Metric embedding via shortest path decompositions, SIAM J. Comput. (2022). https://doi.org/10.1137/19M1296021
  • A. Filtser, A face cover perspective to ℓ1\ell_1ℓ1​ embeddings of planar graphs, ACM Trans. Algorithms (2025). https://doi.org/10.1145/3686800
  • OpenAI, Planar Graph Metrics Embed into L1L_1L1​ with Constant Distortion, OpenAI Math Release preprint, September 23, 2026 (source of the goal; Theorem 1.1, p. 2). https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Planar-Graph-Metrics-Embed-into-L1-with-Constant-Distortion-September-23-2026/paper.pdf
2 thms1 active userReviewed
Complexity TheoryMachine LearningProbability·Captain: mikedeng1

What Can We Learn Privately? V: Masked Parity Is Learnable by Adaptive but Not by Nonadaptive Statistical Queries Under the Uniform DistributionResearch Paper

Motivation

In the local model of differential privacy, each individual randomizes their own data before handing it to an untrusted learner. Local protocols are the deployed form of private data collection, and in practice every round of interaction with the population is expensive: the learner must broadcast new instructions and wait for new reports. Kasiviswanathan, Lee, Nissim, Raskhodnikova and Smith, What Can We Learn Privately? (arXiv:0803.0924v3, published in SIAM J. Comput. 40(3) (2011) 793–826, DOI 10.1137/090756090; theorem numbers below are those of arXiv v3) show that local learning is equivalent to learning with statistical queries (SQ) in the sense of Kearns (1998), and that the equivalence maps noninteractive local learners to nonadaptive SQ learners. The question whether interaction is ever necessary in the local model therefore becomes the question whether adaptivity is ever necessary for SQ learning.

This mission formalizes the paper's answer (§5.3, Theorem 5.16): a concept class, MASKED-PARITY, that an adaptive SQ learner learns exactly with d+1d+1d+1 queries in two rounds, while every nonadaptive SQ learner with fewer than exponentially many queries fails against a specific valid oracle, under the uniform distribution on examples.

Setting

Fix ddd, a power of two. The domain is D={0,1}d×{0,1}log⁡d×{0,1}D=\{0,1\}^d\times\{0,1\}^{\log d}\times\{0,1\}D={0,1}d×{0,1}logd×{0,1}, with points u=(x,i,b)u=(x,i,b)u=(x,i,b), and examples are drawn from the uniform distribution D\mathcal DD on DDD. For r∈{0,1}dr\in\{0,1\}^dr∈{0,1}d and a∈{0,1}a\in\{0,1\}a∈{0,1}, the concept cr,a:D→{+1,−1}c_{r,a}:D\to\{+1,-1\}cr,a​:D→{+1,−1} is

cr,a(x,i,b)={(−1)r⊙x+ab=0,(−1)rib=1,c_{r,a}(x,i,b)=\begin{cases}(-1)^{r\odot x+a}&b=0,\\(-1)^{r_i}&b=1,\end{cases}cr,a​(x,i,b)={(−1)r⊙x+a(−1)ri​​b=0,b=1,​

where r⊙xr\odot xr⊙x is the inner product modulo 2. MASKED-PARITY is the class {cr,a}\{c_{r,a}\}{cr,a​}: on the half b=0b=0b=0 it is the parity rrr or its negation, according to the mask aaa; on the half b=1b=1b=1 it reveals the bit rir_iri​.

A statistical query is a function g(u,y)g(u,y)g(u,y) of an example and a label together with a tolerance τ\tauτ. The SQ oracle for the target ccc answers with any real vvv such that ∣v−Eu∼D[g(u,c(u))]∣≤τ|v-\mathbb E_{u\sim\mathcal D}[g(u,c(u))]|\le\tau∣v−Eu∼D​[g(u,c(u))]∣≤τ; the learner must succeed for every such answer. An SQ learner is nonadaptive if it fixes all its queries before receiving any answer, and adaptive otherwise. Write ⟨f,h⟩=Eu∼D[f(u)h(u)]\langle f,h\rangle=\mathbb E_{u\sim\mathcal D}[f(u)h(u)]⟨f,h⟩=Eu∼D​[f(u)h(u)] and err(f,h)=Pr⁡u∼D[f(u)≠h(u)]\mathrm{err}(f,h)=\Pr_{u\sim\mathcal D}[f(u)\ne h(u)]err(f,h)=Pru∼D​[f(u)=h(u)].

The lower bound uses the decomposition of a query into fg(u)=g(u,1)−g(u,−1)2f_g(u)=\frac{g(u,1)-g(u,-1)}2fg​(u)=2g(u,1)−g(u,−1)​ and Cg=12E[g(u,1)+g(u,−1)]C_g=\frac12\mathbb E[g(u,1)+g(u,-1)]Cg​=21​E[g(u,1)+g(u,−1)], the restrictions cr,asc^s_{r,a}cr,as​, fgsf^s_gfgs​ of cr,ac_{r,a}cr,a​ and fgf_gfg​ to the half b=sb=sb=s (equation (6)), and the oracle

Ocr,a,D(g,τ)={Cg+⟨fg1,cr,a1⟩if ∣⟨fg0,cr,a0⟩∣<τ,E[g(u,cr,a(u))]otherwise.\mathcal O_{c_{r,a},\mathcal D}(g,\tau)=\begin{cases}C_g+\langle f^1_g,c^1_{r,a}\rangle&\text{if }|\langle f^0_g,c^0_{r,a}\rangle|<\tau,\\ \mathbb E[g(u,c_{r,a}(u))]&\text{otherwise.}\end{cases}Ocr,a​,D​(g,τ)={Cg​+⟨fg1​,cr,a1​⟩E[g(u,cr,a​(u))]​if ∣⟨fg0​,cr,a0​⟩∣<τ,otherwise.​

Formalization targets

Goal: Theorem 5.16 (p. 27)

  1. There is a two-round SQ learner (ddd queries, then one), with {0,1}\{0,1\}{0,1}-valued queries of tolerance at least 14d+1\frac1{4d+1}4d+11​, that outputs cr,ac_{r,a}cr,a​ for every target and every valid answers.
  2. O\mathcal OO is a valid SQ oracle, and every nonadaptive learner making ttt queries with values ±1\pm1±1 and tolerance at least 2−d/32^{-d/3}2−d/3, run against O\mathcal OO on a uniformly random target, satisfies
Pr⁡crˉ,aˉ[err(crˉ,aˉ,h)≥14]≥12−t2d/3+2.\Pr_{c_{\bar r,\bar a}}\Bigl[\mathrm{err}(c_{\bar r,\bar a},h)\ge\tfrac14\Bigr]\ge\frac12-\frac t{2^{d/3+2}}.crˉ,aˉ​Pr​[err(crˉ,aˉ​,h)≥41​]≥21​−2d/3+2t​.

Milestones

  • Proposition 5.18 (p. 28): the learner AMP\mathcal A_{\mathrm{MP}}AMP​ recovers r^=r\hat r=rr^=r and a^=a\hat a=aa^=a from every valid answers.
  • Equation (7) (p. 29): E[g(u,cr,a(u))]=Cg+⟨fg0,cr,a0⟩+⟨fg1,cr,a1⟩\mathbb E[g(u,c_{r,a}(u))]=C_g+\langle f^0_g,c^0_{r,a}\rangle+\langle f^1_g,c^1_{r,a}\rangleE[g(u,cr,a​(u))]=Cg​+⟨fg0​,cr,a0​⟩+⟨fg1​,cr,a1​⟩.
  • The oracle (p. 30): O\mathcal OO is valid and answers identically on cr,0c_{r,0}cr,0​ and cr,1c_{r,1}cr,1​ when ∣⟨fg0,cr,00⟩∣<τ|\langle f^0_g,c^0_{r,0}\rangle|<\tau∣⟨fg0​,cr,00​⟩∣<τ.
  • Orthogonality (p. 30): ⟨cr,a0,cr′,a0⟩\langle c^0_{r,a},c^0_{r',a}\rangle⟨cr,a0​,cr′,a0​⟩ is 1/21/21/2 if r=r′r=r'r=r′ and 000 otherwise.
  • Bessel bound (p. 30): ∑(r,a)2⟨fg0,cr,a0⟩2≤1\sum_{(r,a)}2\langle f^0_g,c^0_{r,a}\rangle^2\le1∑(r,a)​2⟨fg0​,cr,a0​⟩2≤1 for ±1\pm1±1-valued ggg.
  • Counting (p. 30): at most 22d/3−12^{2d/3-1}22d/3−1 pairs (r,a)(r,a)(r,a) have ∣⟨fg0,cr,a0⟩∣≥2−d/3|\langle f^0_g,c^0_{r,a}\rangle|\ge2^{-d/3}∣⟨fg0​,cr,a0​⟩∣≥2−d/3.
  • Pr⁡[Good]≥1−t/2d/3+2\Pr[\mathit{Good}]\ge1-t/2^{d/3+2}Pr[Good]≥1−t/2d/3+2 (p. 30).

Significance

The result. Combined with the paper's equivalence between local and SQ learning (Theorem 5.14), Theorem 5.16 shows that interaction is sometimes necessary in local differential privacy: there is a class learnable by an interactive local protocol with polynomially many examples, but not by any noninteractive one with fewer than exponentially many (Corollary 5.17). The separation concerns strong learning under a fixed distribution; the paper notes that adaptive and nonadaptive SQ learning coincide for weak learning, and that a distribution-free separation was left open.

Formalizing it. The result is proved in the paper and has, to our knowledge, no machine-checked proof. The mission produces a self-contained Lean model of statistical query learning with labelled queries and adversarial oracles, a finite Fourier calculus for parities on {0,1}d\{0,1\}^d{0,1}d (orthogonality and a Bessel inequality for ±1\pm1±1-valued functions), and the counting and union-bound argument of SQ lower bounds. The proof of part (2) contains several printed slips (listed below); a formal proof settles the corrected argument.

Difficulty

The upper bound is a direct computation. The difficulty is in part (2): the learner's hypothesis may be any function, not a concept of the class, and the lower bound must hold for every nonadaptive strategy at once. A naive argument that each query "reveals little about aaa" fails, because the true answer to a query does depend on aaa; the argument needs an oracle that is valid (within tolerance of the truth) and yet independent of aaa on most targets, and a quantitative bound on how many targets any single ±1\pm1±1-valued query can correlate with on the half b=0b=0b=0. That bound is an L2L^2L2 statement over all 2d+12^{d+1}2d+1 concepts, not a pointwise one.

Formalization scope

  • Domain and distribution. The index i∈{0,1}log⁡di\in\{0,1\}^{\log d}i∈{0,1}logd is encoded as Fin d, and every theorem assumes d=2md=2^md=2m (implicit in the paper). Vectors are Fin d → ZMod 2, with 0-based bits. Expectations are averages over the finite domain; probabilities over the target are counts of pairs (r,a)(r,a)(r,a) divided by 2d+12^{d+1}2d+1.
  • Values. Concepts, hypotheses and queries are real-valued; labels ±1\pm1±1 are reals. Queries in part (1) take values in {0,1}\{0,1\}{0,1}, as AMP\mathcal A_{\mathrm{MP}}AMP​'s do; queries in part (2) take values ±1\pm1±1 on labels ±1\pm1±1, as in the paper's proof. The paper allows non-Boolean queries (p. 19); a version of part (2) for real queries with values in [−1,1][-1,1][−1,1] is a true strengthening that the same argument supports, and is not stated.
  • Oracles. An SQ oracle is adversarial within the tolerance: the upper bound holds for every valid answer. Part (2) exhibits the paper's oracle O\mathcal OO and asserts its validity for every τ>0\tau>0τ>0. Without that conjunct an "oracle" that ignores the tolerance would make part (2) trivial; the statement rules this out.
  • Learners. Learners are deterministic structures (a nonadaptive learner is a list of queries and tolerances plus an output map; a two-round learner's second-round queries are functions of the first-round answers). A randomized learner is a mixture over its coins and the bounds hold coin by coin. "Efficient" is not modelled. The informal "with a polynomial number of queries" is formalized through its quantitative "Specifically" sentence.
  • Real powers. 2d/32^{d/3}2d/3, 22d/3−12^{2d/3-1}22d/3−1 and 2d/3+22^{d/3+2}2d/3+2 are real powers; no natural-number division is used.
  • Corrections of the proof (not of the theorem). The event Good\mathit{Good}Good on p. 30 is printed with crˉ,aˉc_{\bar r,\bar a}crˉ,aˉ​ and ≤\le≤; the milestone uses crˉ,aˉ0c^0_{\bar r,\bar a}crˉ,aˉ0​ and the strict <<<, which is what the counting display and the oracle's test require. The quotient 22d/3−1/2d+12^{2d/3-1}/2^{d+1}22d/3−1/2d+1 is printed as 2−d/32^{-d/3}2−d/3 and equals 2−d/3−22^{-d/3-2}2−d/3−2; "cr,00=−cr,00c^0_{r,0}=-c^0_{r,0}cr,00​=−cr,00​" should read cr,10=−cr,00c^0_{r,1}=-c^0_{r,0}cr,10​=−cr,00​. The final display of the proof gives 12(1−t/2d/3+2)\frac12(1-t/2^{d/3+2})21​(1−t/2d/3+2), which is at least the theorem's bound.

Contributions welcome: the Fourier facts for {0,1}d\{0,1\}^d{0,1}d (reusable for any parity-based SQ lower bound), the general decomposition (7), and the probability bound of part (2) from the milestones.

Selected references

  • S. P. Kasiviswanathan, H. K. Lee, K. Nissim, S. Raskhodnikova, A. Smith, What Can We Learn Privately?, SIAM J. Comput. 40(3) (2011) 793–826. arXiv:0803.0924v3, DOI 10.1137/090756090.
  • M. Kearns, Efficient noise-tolerant learning from statistical queries, J. ACM 45(6) (1998) 983–1006. DOI 10.1145/293347.293351.
  • A. Blum, M. Furst, J. Jackson, M. Kearns, Y. Mansour, S. Rudich, Weakly learning DNF and characterizing statistical query learning using Fourier analysis, STOC 1994. DOI 10.1145/195058.195147.
  • N. Bshouty, V. Feldman, On using extended statistical queries to avoid membership queries, J. Mach. Learn. Res. 2 (2002) 359–395. JMLR.
11 thms1 active userReviewed
Machine LearningProbability·Captain: mikedeng1

What Can We Learn Privately? IV: Any ε-Local Algorithm Is Simulated by a Statistical Query Algorithm with O(t·e^ε) Expected Queries up to Statistical Difference βResearch Paper

Motivation

In the local model of differential privacy, no trusted curator holds the data: each individual randomizes their own record before handing it to the analyst. This is the model of randomized response in survey statistics and of the privacy-preserving telemetry deployed by large software vendors. Kasiviswanathan, Lee, Nissim, Raskhodnikova and Smith, What Can We Learn Privately? (arXiv:0803.0924v3, published in SIAM J. Comput. 40(3) (2011) 793–826, DOI 10.1137/090756090), asked which learning tasks remain possible in this model. Their answer (§5) is that local algorithms are exactly as powerful as statistical query (SQ) algorithms in the sense of Kearns (J. ACM 1998), up to polynomial factors. This mission formalizes one direction of that equivalence: every local algorithm run on i.i.d. data can be simulated by an SQ algorithm.

This is the fourth of five missions on the paper. Mission III formalizes the converse direction (Theorem 5.7). All theorem numbers refer to arXiv:0803.0924v3.

Setting

A database is z=(z1,…,zn)∈Dnz=(z_1,\dots,z_n)\in D^nz=(z1​,…,zn​)∈Dn. Here its entries are drawn i.i.d. from a probability distribution PPP on DDD.

  • An ε\varepsilonε-local randomizer (Definition 5.1) is a randomized map R:D→WR:D\to WR:D→W to a discrete set WWW such that Pr⁡[R(u)=w]≤eεPr⁡[R(u′)=w]\Pr[R(u)=w]\le e^{\varepsilon}\Pr[R(u')=w]Pr[R(u)=w]≤eεPr[R(u′)=w] for all u,u′∈Du,u'\in Du,u′∈D and w∈Ww\in Ww∈W.
  • An ε\varepsilonε-local algorithm AAA making ttt queries (Definitions 5.2, 5.3) sees the database only through an LR oracle. At its kkk-th call it names an index iki_kik​ and an εk\varepsilon_kεk​-local randomizer RkR_kRk​, both possibly depending on its earlier answers, and receives a fresh sample of Rk(zik)R_k(z_{i_k})Rk​(zik​​). For each index iii the budgets of the calls on iii sum to at most ε\varepsilonε. AAA is noninteractive if its calls do not depend on earlier answers. Its output is a function of the ttt answers. Its output distribution is taken over z∼Pnz\sim P^nz∼Pn and the randomizers' coins.
  • An SQ oracle for PPP (Definition 5.4) answers a query (g,τ)(g,\tau)(g,τ), with g:D→[−1,1]g:D\to[-1,1]g:D→[−1,1] and tolerance τ\tauτ, with any number vvv such that ∣v−Eu∼P[g(u)]∣≤τ|v-\mathbb E_{u\sim P}[g(u)]|\le\tau∣v−Eu∼P​[g(u)]∣≤τ. It may choose its answers adversarially and adaptively.
  • An SQ algorithm BBB (Definition 5.5) accesses PPP only through such an oracle. It may use its own coins, and the number of queries it makes may be random and unbounded.
  • The statistical difference of two distributions on a discrete space (p. 8) is max⁡S∣μ(S)−ν(S)∣\max_S|\mu(S)-\nu(S)|maxS​∣μ(S)−ν(S)∣.

Formalization targets

Goal: Lemma 5.8 (p. 21)

There is an absolute constant CCC such that for every ε\varepsilonε-local algorithm AAA making ttt queries there is an SQ algorithm BBB with the following properties against every distribution PPP and every valid oracle:

τ=β3e2εt,E[#queries of B]≤C t eε,SD(B, A(z), z∼Pn)≤β.\tau=\frac{\beta}{3e^{2\varepsilon}t},\qquad \mathbb E[\#\text{queries of }B]\le C\,t\,e^{\varepsilon},\qquad \mathrm{SD}\bigl(B,\ A(z),\ z\sim P^n\bigr)\le\beta .τ=3e2εtβ​,E[#queries of B]≤Cteε,SD(B, A(z), z∼Pn)≤β.

The constant CCC is the paper's O(⋅)O(\cdot)O(⋅). The tolerance is the proof's own choice.

Milestones

  1. Display (5) (p. 22): a single query estimates p(w)=Pr⁡zi∼P[R(zi)=w]p(w)=\Pr_{z_i\sim P}[R(z_i)=w]p(w)=Przi​∼P​[R(zi​)=w] within a factor 1±β/(3t)1\pm\beta/(3t)1±β/(3t), whatever valid answer the oracle gives.
  2. One rejection-sampling iteration (p. 23): every iteration terminates with probability at least 1−φ1+φe−ε\frac{1-\varphi}{1+\varphi}e^{-\varepsilon}1+φ1−φ​e−ε. Conditioned on terminating, it outputs www with probability in (1±3φ)p(w)(1\pm3\varphi)p(w)(1±3φ)p(w).
  3. The interactive estimate (p. 24): two queries estimate the conditional probability of the next answer given earlier answers on the same entry, within a factor 1±3e2ετ1\pm3e^{2\varepsilon}\tau1±3e2ετ.
  4. Claim 5.9 (p. 22): the noninteractive case, with the explicit bound 2t eε2t\,e^{\varepsilon}2teε on the expected number of queries.

Significance

The result. Lemma 5.8, combined with Theorem 5.7, shows that a concept class is learnable by a locally private algorithm if and only if it is learnable with statistical queries (Theorem 5.14). Every SQ lower bound therefore becomes a lower bound for local privacy. For instance, parity functions are privately learnable by a centralized algorithm (Theorem 4.4) but not by a local one, because parities need exponentially many statistical queries (Corollary 5.15, which also uses the SQ lower bound of Blum et al., STOC 1994).

Formalizing it. The result is proved on paper. As far as we know it has no machine-checked proof. The paper's proof is a few paragraphs and leaves the model implicit: what an SQ algorithm with a random number of queries is, how an adversarial oracle interacts with it, and in what sense the per-randomizer errors add up over ttt adaptively chosen randomizers. The formal statement makes each of these explicit. The milestones isolate the estimates the proof uses, so they can be proved independently of the composition argument.

Difficulty

The estimates in the milestones are elementary inequalities. The difficulty is in the goal. First, the oracle's answers, and therefore the estimates p~(w)\tilde p(w)p~​(w), change from iteration to iteration, so the simulated distribution is not a fixed rejection sampler: the output law must be controlled iteration by iteration against an adversary. Second, the SQ algorithm has no bound on its number of steps. Its output law is a limit over an unbounded run, and its query count is an expectation that is finite only because every iteration terminates with probability bounded away from zero. Third, in the interactive case the randomizers applied to one entry are correlated through the entry. The simulation must sample from the conditional law given earlier answers on that entry, while the errors of all ttt steps combine along adaptively chosen histories.

Formalization scope

  • Local randomizers have discrete output: R u : PMF W. The simulation uses the point probabilities Pr⁡[R(zi)=w]\Pr[R(z_i)=w]Pr[R(zi​)=w]. Every map u↦Pr⁡[R(u)=w]u\mapsto\Pr[R(u)=w]u↦Pr[R(u)=w] is required to be measurable.
  • A local algorithm makes exactly ttt calls. Its index, randomizer and budget at call kkk are functions of the earlier answers. The budget is required along every answer sequence. Its own coins are calls to 000-local randomizers.
  • An SQ algorithm is a state machine with a random start, random transitions depending on the answer, and an output on stopping. Its output law is a sub-probability mass function. Its expected query count lies in [0,∞][0,\infty][0,∞] and counts every query, including those in rejected iterations.
  • The oracle is an arbitrary deterministic function of the whole state trajectory, constrained only by Definition 5.4. The conclusions must hold for every valid oracle, not for the exact-mean oracle alone.
  • BBB is quantified before PPP and sees PPP only through answers, and every query of BBB is a measurable [−1,1][-1,1][−1,1]-valued function with tolerance exactly β/(3e2εt)\beta/(3e^{2\varepsilon}t)β/(3e2εt). Without these two constraints the statement would be trivial: BBB could hard-code PPP, or rescale a query to shrink its effective tolerance.
  • The constant CCC is quantified outside every other object.
  • The implicit hypotheses ε>0\varepsilon>0ε>0 (the queries divide by eε−e−εe^{\varepsilon}-e^{-\varepsilon}eε−e−ε), 0<β≤10<\beta\le10<β≤1 and t≥1t\ge1t≥1 (so that φ=β/(3t)≤1/3\varphi=\beta/(3t)\le1/3φ=β/(3t)≤1/3 and τ\tauτ is defined) are stated. The paper's reference input 0\mathbf 00 is an arbitrary point u0∈Du_0\in Du0​∈D.
  • Claim 5.9 states "t⋅eεt\cdot e^{\varepsilon}t⋅eε queries". Its proof gives at most 2t eε2t\,e^{\varepsilon}2teε, which is the bound stated.
  • The paper's refinement "noninteractive AAA yields nonadaptive BBB" is not formalized. The simulation decides from each answer whether to stop, and so which randomizer the next query belongs to. It therefore does not prepare its queries before receiving answers in the sense of Definition 5.5. The goal is the adaptive statement for all local algorithms, which contains the noninteractive case. Claim 5.10, whose statement coincides with this goal, is represented by its estimate (milestone 3) rather than restated.
  • The statistical difference is valued in [0,∞][0,\infty][0,∞], which avoids junk values of a real supremum.

Reusable beyond this mission: the SQ-algorithm state machine with expected query count, the statistical difference of sub-probability mass functions, and the model of interactive local algorithms. Welcome contributions include proofs of the estimate milestones, a general lemma bounding the statistical difference of sequentially composed approximate samplers, and the termination and expected-runtime analysis of rejection sampling with varying acceptance probabilities.

Selected references

  • S. P. Kasiviswanathan, H. K. Lee, K. Nissim, S. Raskhodnikova, A. Smith, What Can We Learn Privately?, SIAM J. Comput. 40(3) (2011) 793–826; cited from arXiv:0803.0924v3. https://arxiv.org/abs/0803.0924 · https://doi.org/10.1137/090756090
  • M. Kearns, Efficient noise-tolerant learning from statistical queries, J. ACM 45(6) (1998) 983–1006. https://doi.org/10.1145/293347.293351
  • A. Blum, M. Furst, J. Jackson, M. Kearns, Y. Mansour, S. Rudich, Weakly learning DNF and characterizing statistical query learning using Fourier analysis, STOC 1994, 253–262. https://doi.org/10.1145/195058.195147
  • C. Dwork, F. McSherry, K. Nissim, A. Smith, Calibrating noise to sensitivity in private data analysis, TCC 2006. https://doi.org/10.1007/11681878_14
  • S. L. Warner, Randomized response: a survey technique for eliminating evasive answer bias, J. Amer. Statist. Assoc. 60 (1965) 63–69. https://doi.org/10.1080/01621459.1965.10480775
9 thms1 active userReviewed
Discrete GeometryNumber Theory·Captain: mikedeng1

On Lattices, Learning with Errors, Random Linear Codes, and Cryptography 6: The Smoothing Parameter Satisfies η_ε(L) ≥ √(ln(1/ε)/π)/λ₁(L*) ≥ √(ln(1/ε)/π)·λ_n(L)/nResearch Paper

Motivation

The learning with errors (LWE) problem underlies much of post-quantum public-key cryptography, and its hardness rests on Regev's reduction from worst-case lattice problems to LWE (Regev, J. ACM 2009). Every step of that reduction is calibrated by the smoothing parameter ηϵ(L)\eta_\epsilon(L)ηϵ​(L) of Micciancio and Regev (SIAM J. Comput. 2007): the Gaussian width above which a discrete Gaussian on a lattice behaves like a continuous one. The approximation factors of the reduction are stated in terms of ηϵ(L)\eta_\epsilon(L)ηϵ​(L), and they are converted into factors for the standard lattice problems (GapSVP, SIVP) by comparing ηϵ(L)\eta_\epsilon(L)ηϵ​(L) with the successive minima of LLL and of its dual.

Upper bounds on ηϵ(L)\eta_\epsilon(L)ηϵ​(L) (Lemmas 2.11 and 2.12 of the paper, from Micciancio–Regev) say the smoothing parameter is not too large. Claim 2.13 is the matching lower bound: the smoothing parameter cannot be much smaller than 1/λ1(L∗)1/\lambda_1(L^*)1/λ1​(L∗), and hence than λn(L)/n\lambda_n(L)/nλn​(L)/n. The second comparison goes through Banaszczyk's transference theorem (Banaszczyk, Math. Ann. 296 (1993)), 1≤λ1(L)λn(L∗)≤n1 \le \lambda_1(L)\lambda_n(L^*) \le n1≤λ1​(L)λn​(L∗)≤n, which relates the geometry of a lattice to that of its dual.

This mission formalizes Claim 2.13 from the published J. ACM article (Article 34, 2009), together with the steps of its proof and the transference theorem it cites. The paper's main theorem, Theorem 3.1, is a quantum reduction about efficient algorithms; it is outside this series of missions.

Setting

Work in Rn\mathbb{R}^nRn, n≥1n \ge 1n≥1, with the Euclidean norm ∥⋅∥\|\cdot\|∥⋅∥ and inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩. A lattice L⊂RnL \subset \mathbb{R}^nL⊂Rn is the set of integer combinations of nnn linearly independent vectors. Its dual is

L∗={y∈Rn:⟨x,y⟩∈Z for all x∈L},L^* = \{y \in \mathbb{R}^n : \langle x, y\rangle \in \mathbb{Z} \text{ for all } x \in L\},L∗={y∈Rn:⟨x,y⟩∈Z for all x∈L},

again a lattice, with (L∗)∗=L(L^*)^* = L(L∗)∗=L.

The successive minima used here are λ1(L)\lambda_1(L)λ1​(L), the length of a shortest nonzero vector of LLL, and λn(L)\lambda_n(L)λn​(L), the least rrr such that LLL contains nnn linearly independent vectors of length at most rrr.

For s>0s > 0s>0 the Gaussian function is ρs(x)=exp⁡(−π∥x/s∥2)\rho_s(x) = \exp(-\pi\|x/s\|^2)ρs​(x)=exp(−π∥x/s∥2) (Eq. (4)), and for a countable set AAA, ρs(A)=∑x∈Aρs(x)\rho_s(A) = \sum_{x\in A}\rho_s(x)ρs​(A)=∑x∈A​ρs​(x). In particular ρ1/s(y)=exp⁡(−πs2∥y∥2)\rho_{1/s}(y) = \exp(-\pi s^2\|y\|^2)ρ1/s​(y)=exp(−πs2∥y∥2).

For ϵ>0\epsilon > 0ϵ>0 the smoothing parameter ηϵ(L)\eta_\epsilon(L)ηϵ​(L) is the smallest sss such that ρ1/s(L∗∖{0})≤ϵ\rho_{1/s}(L^*\setminus\{0\}) \le \epsilonρ1/s​(L∗∖{0})≤ϵ (Definition 2.10).

Formalization targets

Goal: Claim 2.13 (p. 34:20)

For any lattice LLL and any ϵ>0\epsilon > 0ϵ>0,

ηϵ(L)  ≥  ln⁡1/ϵπ⋅1λ1(L∗)  ≥  ln⁡1/ϵπ⋅λn(L)n.\eta_\epsilon(L) \;\ge\; \sqrt{\frac{\ln 1/\epsilon}{\pi}}\cdot\frac{1}{\lambda_1(L^*)} \;\ge\; \sqrt{\frac{\ln 1/\epsilon}{\pi}}\cdot\frac{\lambda_n(L)}{n}.ηϵ​(L)≥πln1/ϵ​​⋅λ1​(L∗)1​≥πln1/ϵ​​⋅nλn​(L)​.

Both inequalities of the chain are part of the goal. The asymptotic "In particular" sentence of the claim (ϵ(n)=o(1)\epsilon(n) = o(1)ϵ(n)=o(1), large enough nnn) is not.

Milestones, in attack order

  1. The remark after Definition 2.10 (p. 34:19). The map s↦ρ1/s(L∗∖{0})s \mapsto \rho_{1/s}(L^*\setminus\{0\})s↦ρ1/s​(L∗∖{0}) is continuous and strictly decreasing on (0,∞)(0,\infty)(0,∞), tends to ∞\infty∞ as s→0s \to 0s→0 and to 000 as s→∞s \to \inftys→∞, and ϵ↦ηϵ(L)\epsilon \mapsto \eta_\epsilon(L)ϵ↦ηϵ​(L) is its inverse; in particular ρ1/ηϵ(L)(L∗∖{0})=ϵ\rho_{1/\eta_\epsilon(L)}(L^*\setminus\{0\}) = \epsilonρ1/ηϵ​(L)​(L∗∖{0})=ϵ.
  2. The display of the proof of Claim 2.13 (p. 34:20). For s=ηϵ(L)s = \eta_\epsilon(L)s=ηϵ​(L) and v∈L∗v \in L^*v∈L∗ of length λ1(L∗)\lambda_1(L^*)λ1​(L∗),
ϵ=ρ1/s(L∗∖{0})≥ρ1/s(v)=exp⁡(−π(sλ1(L∗))2).\epsilon = \rho_{1/s}(L^*\setminus\{0\}) \ge \rho_{1/s}(v) = \exp\bigl(-\pi(s\lambda_1(L^*))^2\bigr).ϵ=ρ1/s​(L∗∖{0})≥ρ1/s​(v)=exp(−π(sλ1​(L∗))2).
  1. Lemma 2.3, Banaszczyk's transference theorem (p. 34:18). For any nnn-dimensional lattice LLL,
1≤λ1(L)⋅λn(L∗)≤n.1 \le \lambda_1(L)\cdot\lambda_n(L^*) \le n .1≤λ1​(L)⋅λn​(L∗)≤n.

Significance

The result. Claim 2.13 shows that the smoothing parameter for a negligible ϵ\epsilonϵ exceeds every constant multiple of 1/λ1(L∗)1/\lambda_1(L^*)1/λ1​(L∗) and of λn(L)/n\lambda_n(L)/nλn​(L)/n. Together with the upper bound ηϵ(L)≤ln⁡(2n(1+1/ϵ))/π λn(L)\eta_\epsilon(L) \le \sqrt{\ln(2n(1+1/\epsilon))/\pi}\,\lambda_n(L)ηϵ​(L)≤ln(2n(1+1/ϵ))/π​λn​(L) of Lemma 2.12, it locates ηϵ(L)\eta_\epsilon(L)ηϵ​(L) within a polynomial factor of λn(L)\lambda_n(L)λn​(L). This is what lets the reduction's guarantees, phrased in ηϵ(L)\eta_\epsilon(L)ηϵ​(L), be read as approximation factors for SIVP and GapSVP. The transference theorem is used throughout the geometry of numbers and in lattice-based cryptography to pass between a lattice and its dual.

Formalizing it. The claim and its proof are classical and short, but neither is machine-checked. The mission produces formal definitions of the dual lattice, the successive minima λ1\lambda_1λ1​, λn\lambda_nλn​ and the smoothing parameter on EuclideanSpace ℝ (Fin n), a proof that Definition 2.10 is well posed, and a statement of Banaszczyk's transference theorem. The upper bound of the transference theorem is a substantial result in its own right (the paper cites it without proof), and a formal proof of it would be reusable well beyond this mission.

Difficulty

The first inequality of the goal is elementary once the smoothing parameter is known to be attained, with ρ1/η(L∗∖{0})=ϵ\rho_{1/\eta}(L^*\setminus\{0\}) = \epsilonρ1/η​(L∗∖{0})=ϵ exactly. That step is not a formality: it needs the continuity and strict monotonicity of an infinite lattice sum in the scale parameter, and the fact that a shortest nonzero dual vector exists, both of which rest on the discreteness of L∗L^*L∗.

The second inequality is a single line in the paper, "by Lemma 2.3", but it uses the upper bound of Banaszczyk's theorem, applied to the dual lattice. The easy lower bound 1≤λ1(L)λn(L∗)1 \le \lambda_1(L)\lambda_n(L^*)1≤λ1​(L)λn​(L∗) does not suffice, and a Minkowski-type argument gives a bound worse than linear in nnn. Applying the lemma to L∗L^*L∗ also needs L∗L^*L∗ to be a lattice with dual LLL.

Formalization scope

  • Rn\mathbb{R}^nRn is EuclideanSpace ℝ (Fin n). A lattice is L : Submodule ℤ _ with [DiscreteTopology L] [IsZLattice ℝ L]. The dual is LinearMap.BilinForm.dualSubmodule (innerₗ _) L.
  • Every theorem assumes 0<n0 < n0<n: the paper's lattices are nnn-dimensional with n≥1n \ge 1n≥1. This is the only added hypothesis.
  • Gaussian sums are real tsums. They are summable over discrete subgroups, so no summability hypotheses are added.
  • ηϵ(L)\eta_\epsilon(L)ηϵ​(L), λ1\lambda_1λ1​ and λn\lambda_nλn​ are infima (sInf). The paper's "smallest" is the attainment proved in milestones 1 and 2, not built into the definition. λ1\lambda_1λ1​ and λn\lambda_nλn​ are defined for every Z\mathbb{Z}Z-submodule, so they apply to L∗L^*L∗ without extra instances.
  • For ϵ≥1\epsilon \ge 1ϵ≥1 the paper's ln⁡(1/ϵ)/π\sqrt{\ln(1/\epsilon)/\pi}ln(1/ϵ)/π​ is the square root of a non-positive number; Lean's Real.sqrt gives 000 there and the goal reduces to true statements. No hypothesis ϵ<1\epsilon < 1ϵ<1 is added, since the page says "any ϵ>0\epsilon > 0ϵ>0".
  • The goal is a conjunction of both inequalities of the chain, not only the outer comparison ηϵ(L)≥ln⁡(1/ϵ)/π λn(L)/n\eta_\epsilon(L) \ge \sqrt{\ln(1/\epsilon)/\pi}\,\lambda_n(L)/nηϵ​(L)≥ln(1/ϵ)/π​λn​(L)/n, which would be weaker. Lemma 2.3 states both bounds; stating only the easy lower bound would leave the goal's second inequality without its milestone.
  • No printed statement needed correction.

Contributions welcome: the attainment of λ1\lambda_1λ1​ and λn\lambda_nλn​ for IsZLattice (and for the dual), the identity (L∗)∗=L(L^*)^* = L(L∗)∗=L in this setting, continuity and monotonicity of Gaussian lattice sums, and above all Banaszczyk's transference theorem.

Selected references

  • O. Regev, On Lattices, Learning with Errors, Random Linear Codes, and Cryptography, J. ACM 56(6), Article 34, 2009. https://doi.org/10.1145/1568318.1568324
  • W. Banaszczyk, New bounds in some transference theorems in the geometry of numbers, Math. Ann. 296, 625–635, 1993. https://doi.org/10.1007/BF01445125
  • D. Micciancio, O. Regev, Worst-case to average-case reductions based on Gaussian measures, SIAM J. Comput. 37(1), 267–302, 2007. https://doi.org/10.1137/S0097539705447360
7 thms1 active userReviewed
Dynamical SystemsOperations ResearchStochastic Systems·Captain: mikedeng1

The Power of Two Choices in Randomized Load Balancing I: In the Limiting Supermarket System the Expected Time Converges to T_d(λ) = Σ λ^((d^i−d)/(d−1))Research Paper

Motivation

Randomized load balancing asks how much a dispatcher gains from a little information. In the supermarket model, jobs arrive at nnn servers and each job inspects a few servers chosen at random before joining one. With one random choice every server is an independent M/M/1 queue, and the expected time a job spends in the system is 1/(1−λ)1/(1-\lambda)1/(1−λ) at load λ\lambdaλ. With two choices it is exponentially smaller as λ→1−\lambda \to 1^-λ→1−. This "power of two choices" underlies the design of distributed schedulers, hashing schemes and server farms, where querying every server is too expensive but querying two is cheap.

Timeline:

  • 1994/1999. Azar, Broder, Karlin and Upfal proved the static version, balanced allocations: throwing nnn balls into nnn bins with d≥2d \ge 2d≥2 choices per ball gives a maximum load of log⁡log⁡n/log⁡d+O(1)\log\log n/\log d + O(1)loglogn/logd+O(1) w.h.p., against Θ(log⁡n/log⁡log⁡n)\Theta(\log n/\log\log n)Θ(logn/loglogn) for one choice (SIAM J. Comput. 1999).
  • 1996. Vvedenskaya, Dobrushin and Karpelevich derived the dynamic limiting equations for d=2d = 2d=2 and showed convergence of their trajectories to the fixed point, without a rate (Problems of Information Transmission 32(1), 1996).
  • 1996/2001. Mitzenmacher, independently, introduced the limiting system for general ddd, proved doubly exponential tails along every trajectory and exponential convergence to the fixed point in a weighted L1L_1L1​ potential, and derived the limiting expected time Td(λ)T_d(\lambda)Td​(λ) (IEEE TPDS 2001). This mission formalizes Section 2 of that paper.

Setting

Customers arrive as a Poisson stream of rate λn\lambda nλn, 0<λ<10<\lambda<10<λ<1, at nnn FIFO servers. Each customer chooses ddd servers independently and uniformly at random with replacement and joins the one holding the fewest customers; service times are exponential with mean 111. Let si(t)s_i(t)si​(t) be the fraction of servers holding at least iii customers at time ttt.

A state is a sequence s=(s0,s1,s2,… )s = (s_0, s_1, s_2, \dots)s=(s0​,s1​,s2​,…) of reals with s0=1s_0 = 1s0​=1, si≥0s_i \ge 0si​≥0 and s0≥s1≥s2≥⋯s_0 \ge s_1 \ge s_2 \ge \cdotss0​≥s1​≥s2​≥⋯. The empty state has s0=1s_0 = 1s0​=1 and si=0s_i = 0si​=0 for i≥1i \ge 1i≥1. As n→∞n \to \inftyn→∞ the tails follow the limiting system

dsidt=λ (si−1d−sid)−(si−si+1)(i≥1),s0=1.(1)\frac{ds_i}{dt} = \lambda\,(s_{i-1}^d - s_i^d) - (s_i - s_{i+1}) \quad (i \ge 1), \qquad s_0 = 1. \tag{1}dtdsi​​=λ(si−1d​−sid​)−(si​−si+1​)(i≥1),s0​=1.(1)

A trajectory is a map t↦s(t)t \mapsto s(t)t↦s(t), t≥0t \ge 0t≥0, whose values are states and whose coordinates satisfy (1) (from the right at t=0t = 0t=0). Throughout, d≥2d \ge 2d≥2 is an integer.

The fixed point is πi=λ(di−1)/(d−1)\pi_i = \lambda^{(d^i - 1)/(d - 1)}πi​=λ(di−1)/(d−1), so π0=1\pi_0 = 1π0​=1, π1=λ\pi_1 = \lambdaπ1​=λ, π2=λ1+d\pi_2 = \lambda^{1+d}π2​=λ1+d. A customer arriving in state sss becomes the iii-th customer of its queue with probability si−1d−sids_{i-1}^d - s_i^dsi−1d​−sid​ and then waits for iii services, so the expected time it spends in the system is

E(s)=∑i=1∞i (si−1d−sid).E(s) = \sum_{i=1}^{\infty} i\,(s_{i-1}^d - s_i^d).E(s)=i=1∑∞​i(si−1d​−sid​).

The target constant is

Td(λ)=∑i=1∞λdi−dd−1.T_d(\lambda) = \sum_{i=1}^{\infty} \lambda^{\frac{d^i - d}{d-1}}.Td​(λ)=i=1∑∞​λd−1di−d​.

Formalization targets

Goal: Corollary 2

For d≥2d \ge 2d≥2 and 0<λ<10 < \lambda < 10<λ<1, Td(λ)<∞T_d(\lambda) < \inftyTd​(λ)<∞, and:

if sj(0)=0 for some j, then E(s(t))→t→∞Td(λ);if s(0) is empty, then E(s(t))≤Td(λ)  ∀t≥0.\text{if } s_j(0) = 0 \text{ for some } j, \text{ then } E(s(t)) \xrightarrow[t\to\infty]{} T_d(\lambda);\qquad \text{if } s(0) \text{ is empty, then } E(s(t)) \le T_d(\lambda) \ \ \forall t \ge 0.if sj​(0)=0 for some j, then E(s(t))t→∞​Td​(λ);if s(0) is empty, then E(s(t))≤Td​(λ)  ∀t≥0.

The hypothesis sj(0)=0s_j(0) = 0sj​(0)=0 holds for every initial state that comes from a finite system.

Milestones, in the order the proof uses them

  • Lemma 2. π\piπ is the unique fixed point of (1) with ∑i≥1si<∞\sum_{i\ge1} s_i < \infty∑i≥1​si​<∞.
  • Theorem 2. If sj(0)=0s_j(0) = 0sj​(0)=0 for some jjj, there are constants N≥1N \ge 1N≥1, 0<α<10<\alpha<10<α<1, β>1\beta>1β>1, γ>0\gamma>0γ>0, independent of ttt, with si(t)≤γ αβis_i(t) \le \gamma\,\alpha^{\beta^i}si​(t)≤γαβi for all i≥Ni \ge Ni≥N, t≥0t \ge 0t≥0. From the empty state, si(t)≤πis_i(t) \le \pi_isi​(t)≤πi​ for all iii and t≥0t \ge 0t≥0.
  • Theorem 3. There are weights wi≥1w_i \ge 1wi​≥1 such that Φ(t)=∑i≥1wi∣si(t)−πi∣\Phi(t) = \sum_{i\ge1} w_i |s_i(t) - \pi_i|Φ(t)=∑i≥1​wi​∣si​(t)−πi​∣ satisfies Φ(t)≤c0e−δt\Phi(t) \le c_0 e^{-\delta t}Φ(t)≤c0​e−δt (δ>0\delta > 0δ>0) whenever Φ(0)<∞\Phi(0) < \inftyΦ(0)<∞, and in particular whenever sj(0)=0s_j(0) = 0sj​(0)=0 for some jjj.
  • Corollary 1. Under the conditions of Theorem 3 (weights wi≥1w_i \ge 1wi​≥1 fixed before the trajectory, with Φ(0)<∞\Phi(0) < \inftyΦ(0)<∞, or sj(0)=0s_j(0) = 0sj​(0)=0 for some jjj), ∑i≥1∣si(t)−πi∣≤c0e−δt\sum_{i\ge1} |s_i(t) - \pi_i| \le c_0 e^{-\delta t}∑i≥1​∣si​(t)−πi​∣≤c0​e−δt.
  • Proof of Corollary 2, display. ∑i≥1i(si−1d−sid)=∑i≥0sid\sum_{i\ge1} i(s_{i-1}^d - s_i^d) = \sum_{i\ge0} s_i^d∑i≥1​i(si−1d​−sid​)=∑i≥0​sid​ for a state with si→0s_i \to 0si​→0.
  • Lemma 4. The drift of (1) is Lipschitz in ℓ1\ell^1ℓ1 on states, with constant 2+2dλ2 + 2d\lambda2+2dλ.

Significance

The comparison T1(λ)=1/(1−λ)T_1(\lambda) = 1/(1-\lambda)T1​(λ)=1/(1−λ) against Td(λ)T_d(\lambda)Td​(λ) is the quantitative content of the power of two choices: the companion mission shows Td(λ)/log⁡T1(λ)→1/log⁡dT_d(\lambda)/\log T_1(\lambda) \to 1/\log dTd​(λ)/logT1​(λ)→1/logd as λ→1−\lambda \to 1^-λ→1−, an exponential improvement. Corollary 2 is what connects that number to the dynamics: it says the fixed point's expected time is actually reached from realistic initial states, and is an upper bound from an empty start. Theorem 2's comparison argument and Theorem 3's weighted potential are reused across the mean-field analysis of load-balancing variants (threshold policies, heterogeneous servers, work stealing), so the formal statements here are templates for that literature.

All results are proved in the paper (Theorem 3's proof is written out for d=2d = 2d=2 with a remark that it extends). None has a machine-checked proof that we know of. The work is formalizing the known arguments for all d≥2d \ge 2d≥2, including the parts the paper delegates to a citation: quasimonotone comparison for countable ODE systems in Theorem 2, and the upper right Dini derivative handling of ∣ϵi∣|\epsilon_i|∣ϵi​∣ in Theorem 3.

Difficulty

The system is infinite-dimensional, so standard finite-dimensional ODE comparison and Lyapunov theorems do not apply as stated. Theorem 2 rests on a monotonicity property (raising the initial tails raises them for all time) that the paper justifies by a coupling intuition and a citation to a comparison theorem for quasimonotone systems; that theorem must be supplied for ℓ∞\ell^\inftyℓ∞-bounded countable systems. The plain L1L_1L1​ distance is nonincreasing along trajectories but does not decay exponentially by a direct estimate; the weights wiw_iwi​ must be built so that every coordinate's contribution to dΦ/dtd\Phi/dtdΦ/dt is dominated by −δwi∣ϵi∣-\delta w_i |\epsilon_i|−δwi​∣ϵi​∣, while staying geometrically bounded so that Φ(0)<∞\Phi(0) < \inftyΦ(0)<∞ under the doubly exponential tails of Theorem 2. Exchanging t→∞t \to \inftyt→∞ with the infinite sum defining EEE needs uniform tail control, which is again Theorem 2.

Formalization scope

  • Namespace PowerTwoChoices.Limit; λ is lam : ℝ, d:Nd : ℕd:N with 2≤d2 \le d2≤d, 0<λ<10 < \lambda < 10<λ<1 in every theorem.
  • A state is x : ℕ → ℝ with x 0 = 1, nonnegative and antitone. A trajectory is s : ℝ → ℕ → ℝ, a state for every t≥0t \ge 0t≥0, with HasDerivWithinAt on Set.Ici 0 for each coordinate i≥1i \ge 1i≥1: right derivative at t=0t = 0t=0, two-sided for t>0t > 0t>0.
  • Exponents are natural numbers: πi=λ∑k<idk\pi_i = \lambda^{\sum_{k<i} d^k}πi​=λ∑k<i​dk, and TdT_dTd​'s iii-th term is λ∑1≤k<idk\lambda^{\sum_{1\le k<i} d^k}λ∑1≤k<i​dk.
  • Φ\PhiΦ, the L1L_1L1​ distance, EEE and TdT_dTd​ are sums in [0,∞][0,\infty][0,∞], so a divergent series is ∞\infty∞, never a default 000. "Converges exponentially" (Definition 2) means Φ(t)≤c0e−δt\Phi(t) \le c_0 e^{-\delta t}Φ(t)≤c0​e−δt for all t≥0t \ge 0t≥0 with real c0c_0c0​ and δ>0\delta > 0δ>0; δ\deltaδ may depend on the trajectory. The paper's d(t)d(t)d(t) is renamed l1Dist.
  • Time is real and t→∞t \to \inftyt→∞ is Filter.atTop.
  • Every theorem quantifies over trajectories; existence of a trajectory from a given state (Picard iteration, cited by the paper) is not part of the mission. The class is nonempty: the constant trajectory at π\piπ is one.
  • Ruled out: summing EEE or TdT_dTd​ as a real tsum (a divergent series would make the upper bound free and the limit attainable by a junk 000), dropping the summability condition in Lemma 2 ((1,1,… )(1,1,\dots)(1,1,…) is also a fixed point), choosing Theorem 3's weights after the trajectory, and stating anything for d=2d = 2d=2 only.
  • Needed infrastructure: comparison principles for quasimonotone countable ODE systems, Dini-derivative Grönwall estimates, and interchange of limits and ℓ1\ell^1ℓ1 sums. All of these are reusable beyond this mission, and contributions of such lemmas as separate theorems are welcome.

Selected references

  • M. Mitzenmacher, The Power of Two Choices in Randomized Load Balancing, IEEE Transactions on Parallel and Distributed Systems 12(10), 2001, pp. 1094–1104. https://doi.org/10.1109/71.963420
  • Y. Azar, A. Z. Broder, A. R. Karlin, E. Upfal, Balanced Allocations, SIAM Journal on Computing 29(1), 1999, pp. 180–200. https://doi.org/10.1137/S0097539795288490
  • N. D. Vvedenskaya, R. L. Dobrushin, F. I. Karpelevich, Queueing System with Selection of the Shortest of Two Queues: An Asymptotic Approach, Problems of Information Transmission 32(1), 1996, pp. 15–27.
  • T. G. Kurtz, Approximation of Population Processes, SIAM, 1981. https://doi.org/10.1137/1.9781611970333
8 thms1 active userReviewed
CombinatoricsProbability·Captain: mikedeng1

On Lattices, Learning with Errors, Random Linear Codes, and Cryptography 4: A Random Subset Sum of l Uniform Elements of a Finite Abelian Group Is on Average Within √(|G|/2^l) of UniformResearch Paper

Motivation

Regev's On Lattices, Learning with Errors, Random Linear Codes, and Cryptography (J. ACM 56(6), 2009, Article 34; doi:10.1145/1568318.1568324) introduced the Learning with Errors (LWE) problem and built a public-key cryptosystem on it. The source for this mission is that published J. ACM article. The paper's main theorem, a quantum reduction from worst-case lattice problems to LWE, is outside this series; this mission formalizes a self-contained piece of finite combinatorics from §5.

In the cryptosystem the public key is a list of mmm LWE samples, and a bit is encrypted by adding up a uniformly random subset of them. Semantic security rests on one fact: if the public key were truly uniform, the sum of a random subset of it would be close to uniform, so the ciphertext would carry no information about the bit. Claim 5.3 (p. 34:36) makes this precise for an arbitrary finite abelian group GGG. It is a special case of the leftover hash lemma of Impagliazzo and Zuckerman (1989), in which the family of functions b↦∑ibigib \mapsto \sum_i b_i g_ib↦∑i​bi​gi​ indexed by g∈Glg \in G^lg∈Gl is a universal hash family. Variants of the same statement appear in the security proofs of most lattice-based encryption schemes that use random subset sums, including the dual-Regev and GPV-style constructions.

Setting

Let GGG be a finite abelian group, written additively, with ∣G∣|G|∣G∣ elements, and let l≥0l \ge 0l≥0 be an integer. For g=(g1,…,gl)∈Glg = (g_1, \dots, g_l) \in G^lg=(g1​,…,gl​)∈Gl and b=(b1,…,bl)∈{0,1}lb = (b_1, \dots, b_l) \in \{0,1\}^lb=(b1​,…,bl​)∈{0,1}l the subset sum ∑ibigi\sum_i b_i g_i∑i​bi​gi​ is the sum of the gig_igi​ with bi=1b_i = 1bi​=1 (the empty subset gives 000). The distribution of the sum of a uniformly random subset of g1,…,glg_1, \dots, g_lg1​,…,gl​ is

Pg(h)=12l ∣{ b∈{0,1}l∣∑ibigi=h }∣,h∈G.P_g(h) = \frac{1}{2^l}\,\bigl|\{\, b \in \{0,1\}^l \mid \textstyle\sum_i b_i g_i = h \,\}\bigr|, \qquad h \in G.Pg​(h)=2l1​​{b∈{0,1}l∣∑i​bi​gi​=h}​,h∈G.

The paper defines the statistical distance of two densities as ∫∣φ1−φ2∣\int |\varphi_1 - \varphi_2|∫∣φ1​−φ2​∣, with range [0,2][0,2][0,2], and notes that the same definition applies to discrete random variables (p. 34:14). The distance of PgP_gPg​ from the uniform distribution on GGG is therefore

Δ(g)=∑h∈G∣Pg(h)−1∣G∣∣,\Delta(g) = \sum_{h \in G} \Bigl| P_g(h) - \frac{1}{|G|} \Bigr|,Δ(g)=h∈G∑​​Pg​(h)−∣G∣1​​,

with no factor 12\tfrac1221​. Expectations and probabilities over ggg refer to a uniform choice of g1,…,gl∈Gg_1, \dots, g_l \in Gg1​,…,gl​∈G, that is, the uniform distribution on all ∣G∣l|G|^l∣G∣l tuples, repetitions allowed: Expg[F(g)]=∣G∣−l∑g∈GlF(g)\mathrm{Exp}_g[F(g)] = |G|^{-l}\sum_{g \in G^l} F(g)Expg​[F(g)]=∣G∣−l∑g∈Gl​F(g).

In Lean these objects are RegevLWE.SubsetSum.subsetSum, P, statDistUniform and expectG.

Formalization targets

Goal: Claim 5.3

Expg[Δ(g)]≤∣G∣2landPr⁡g[Δ(g)>∣G∣/2l4]≤∣G∣2l4.\mathop{\mathrm{Exp}}_g\bigl[\Delta(g)\bigr] \le \sqrt{\frac{|G|}{2^l}} \qquad\text{and}\qquad \Pr_g\Bigl[\Delta(g) > \sqrt[4]{|G|/2^l}\Bigr] \le \sqrt[4]{\frac{|G|}{2^l}}.Expg​[Δ(g)]≤2l∣G∣​​andgPr​[Δ(g)>4∣G∣/2l​]≤42l∣G∣​​.

Both sentences of the claim are in the goal. The second is what the security proof (Lemma 5.4, p. 34:37) uses: for all but a ∣G∣/2l4\sqrt[4]{|G|/2^l}4∣G∣/2l​ fraction of public keys, the random subset sum is within ∣G∣/2l4\sqrt[4]{|G|/2^l}4∣G∣/2l​ of uniform. The constants are exactly as printed.

Milestones

  1. The ℓ2\ell_2ℓ2​ norm as a collision probability (p. 34:36). For every ggg, with b,b′b, b'b,b′ independent and uniform in {0,1}l\{0,1\}^l{0,1}l,
∑hPg(h)2=Pr⁡b,b′[∑ibigi=∑ibi′gi]≤12l+Pr⁡b,b′[∑ibigi=∑ibi′gi∣b≠b′].\sum_{h} P_g(h)^2 = \Pr_{b,b'}\Bigl[\textstyle\sum_i b_i g_i = \sum_i b'_i g_i\Bigr] \le \frac{1}{2^l} + \Pr_{b,b'}\Bigl[\textstyle\sum_i b_i g_i = \sum_i b'_i g_i \Bigm| b \neq b'\Bigr].h∑​Pg​(h)2=b,b′Pr​[∑i​bi​gi​=∑i​bi′​gi​]≤2l1​+Prb,b′​[∑i​bi​gi​=∑i​bi′​gi​​b=b′].
  1. Collisions of distinct subsets (p. 34:37). For any b≠b′b \neq b'b=b′, Pr⁡g[∑ibigi=∑ibi′gi]=1/∣G∣\Pr_g[\sum_i b_i g_i = \sum_i b'_i g_i] = 1/|G|Prg​[∑i​bi​gi​=∑i​bi′​gi​]=1/∣G∣.
  2. Expected ℓ2\ell_2ℓ2​ norm (p. 34:37). Expg[∑hPg(h)2]≤1/2l+1/∣G∣\mathrm{Exp}_g[\sum_h P_g(h)^2] \le 1/2^l + 1/|G|Expg​[∑h​Pg​(h)2]≤1/2l+1/∣G∣.
  3. Cauchy–Schwarz and the ℓ2\ell_2ℓ2​ identity (p. 34:37), pointwise in ggg:
∑h∣Pg(h)−1∣G∣∣≤∣G∣1/2(∑h(Pg(h)−1∣G∣)2)1/2,∑h(Pg(h)−1∣G∣)2=∑hPg(h)2−1∣G∣.\sum_h \Bigl|P_g(h) - \frac{1}{|G|}\Bigr| \le |G|^{1/2}\Bigl(\sum_h \Bigl(P_g(h) - \frac{1}{|G|}\Bigr)^2\Bigr)^{1/2}, \qquad \sum_h \Bigl(P_g(h) - \frac{1}{|G|}\Bigr)^2 = \sum_h P_g(h)^2 - \frac{1}{|G|}.h∑​​Pg​(h)−∣G∣1​​≤∣G∣1/2(h∑​(Pg​(h)−∣G∣1​)2)1/2,h∑​(Pg​(h)−∣G∣1​)2=h∑​Pg​(h)2−∣G∣1​.

Significance

The result. Claim 5.3 is the step in the security proof of Regev's cryptosystem that removes the public key from the picture: once the key is replaced by uniform samples (by the LWE assumption), the claim shows that an encryption is statistically close to uniform, independently of the encrypted bit. The parameter choice m≥(1+ϵ)(n+1)log⁡pm \ge (1+\epsilon)(n+1)\log pm≥(1+ϵ)(n+1)logp of Lemma 5.4 is exactly what makes ∣G∣/2m|G|/2^m∣G∣/2m negligible for G=Zpn×ZpG = \mathbb{Z}_p^n \times \mathbb{Z}_pG=Zpn​×Zp​. Without the claim the cryptosystem would have a hardness assumption but no reduction from it.

Formalizing it. The claim is proved, with a complete argument in the paper; nothing here is open. To our knowledge no machine-checked proof of this statement, or of the leftover hash lemma for subset-sum hash families over a general finite abelian group, exists in Mathlib or on the platform. A formal proof gives a reusable, constant-exact statement of the subset-sum leftover hash lemma with the paper's normalization of statistical distance. The four milestones are standard facts about finite averages and collision probabilities that recur in many cryptographic security proofs.

Difficulty

There is no deep step; the work is in organizing finite counting arguments without loss. Two points need care. The collision fact Pr⁡g[∑ibigi=∑ibi′gi]=1/∣G∣\Pr_g[\sum_i b_i g_i = \sum_i b'_i g_i] = 1/|G|Prg​[∑i​bi​gi​=∑i​bi′​gi​]=1/∣G∣ holds for every pair b≠b′b \neq b'b=b′ only because the coefficients bi−bi′b_i - b'_ibi​−bi′​ lie in {−1,0,1}\{-1, 0, 1\}{−1,0,1}: for a general linear form over a group with torsion, a nonzero coefficient vector need not give a uniformly distributed sum, so an argument that treats the coefficients as arbitrary integers fails. And passing from the ℓ2\ell_2ℓ2​ bound to the expected ℓ1\ell_1ℓ1​ distance requires the exchange of expectation and square root in the right direction (concavity), which is easy to misapply. The bound must hold for every finite abelian group and every lll, including l=0l = 0l=0 and ∣G∣=1|G| = 1∣G∣=1, with no asymptotic slack.

Formalization scope

  • GGG is any type with [AddCommGroup G] [Fintype G] [DecidableEq G]; l:Nl : ℕl:N, and l=0l = 0l=0 is allowed (then PgP_gPg​ is the point mass at 000 and the claim holds). No hypothesis is added to the paper's statement: ∣G∣≥1|G| \ge 1∣G∣≥1 holds for every group.
  • {0,1}l\{0,1\}^l{0,1}l is encoded as Fin l → Bool; ggg ranges over all functions Fin l → G, so the uniform choice of ggg is over all ∣G∣l|G|^l∣G∣l tuples with repetition, not over lll-element subsets of GGG.
  • Every expectation and probability is an exact finite average with real values: Expg[F]=∣G∣−l∑gF(g)\mathrm{Exp}_g[F] = |G|^{-l}\sum_g F(g)Expg​[F]=∣G∣−l∑g​F(g), and Pr⁡g[E]\Pr_g[E]Prg​[E] is the number of tuples satisfying EEE divided by ∣G∣l|G|^l∣G∣l. Probabilities over (b,b′)(b, b')(b,b′) are counts over the (2l)2(2^l)^2(2l)2 pairs; the conditional probability given b≠b′b \neq b'b=b′ divides by (2l)2−2l(2^l)^2 - 2^l(2l)2−2l. At l=0l = 0l=0 the paper's conditional probability is undefined; Lean's convention 0/0=00/0 = 00/0=0 makes milestone 1 read 1≤11 \le 11≤1 there, which is consistent with the paper.
  • The statistical distance is ∑h∣Pg(h)−1/∣G∣∣\sum_h |P_g(h) - 1/|G||∑h​∣Pg​(h)−1/∣G∣∣, without 12\tfrac1221​. A formalization with the 12\tfrac1221​-normalized total variation distance would state a weaker result (half the bound) and is excluded. "More than" in the second sentence is strict, "at most" is ≤\le≤. The fourth root is Real.sqrt (Real.sqrt x).
  • Milestone 4 states only the first two steps of the paper's final chain (the Cauchy–Schwarz inequality and the identity), pointwise in ggg; the remaining two steps (Jensen for the square root and the substitution of milestone 3) are part of the goal. Its milestone text quotes the whole chain for context.
  • No definitions beyond the four above are needed, and no measure theory. Proofs of the milestones, and alternative proofs of the goal (for instance via Fourier analysis on GGG), are welcome.

Selected references

  • O. Regev, On Lattices, Learning with Errors, Random Linear Codes, and Cryptography, Journal of the ACM 56(6), Article 34, 2009. doi:10.1145/1568318.1568324
  • R. Impagliazzo and D. Zuckerman, How to Recycle Random Bits, Proc. 30th IEEE FOCS, 248–253, 1989. doi:10.1109/SFCS.1989.63486
  • J. Håstad, R. Impagliazzo, L. A. Levin and M. Luby, A Pseudorandom Generator from any One-way Function, SIAM Journal on Computing 28(4), 1364–1396, 1999. doi:10.1137/S0097539793244708
6 thms1 active userReviewed
CombinatoricsGraph TheoryLinear Optimization+1·Captain: mikedeng1

Approximating Minimum Bounded Degree Spanning Trees to within One of Optimal 2: Under Lower and Upper Degree Bounds, Iterative Rounding Finds a Connecting Tree of LP Cost within A_v − 1 and B_v + 1Research Paper

Motivation

Network design problems often ask for a cheap spanning tree in which no vertex is overloaded: in multicast and overlay networks the degree of a node bounds the number of copies it must forward, and in physical networks it bounds the number of ports. The minimum bounded degree spanning tree problem asks for a minimum-cost spanning tree whose degrees respect given bounds. Deciding whether a graph has a spanning tree of maximum degree 2 is already the Hamiltonian path problem, so exact solutions are out of reach, and the question becomes how little the bounds and the cost must be relaxed.

Some problems also impose lower bounds: a vertex that must serve as a hub, or a leaf-avoidance requirement, asks for degree at least AvA_vAv​. Singh and Lau (STOC 2007) showed that the iterative rounding method they used for upper bounds extends to both kinds at once: a spanning tree of cost at most the LP optimum whose degree at every vertex lies in [Av−1, Bv+1][A_v-1,\,B_v+1][Av​−1,Bv​+1].

Timeline. Fürer and Raghavachari (1994) found a spanning tree of maximum degree at most Δ∗+1\Delta^*+1Δ∗+1 in the unweighted case. For costs, Goemans (FOCS 2006) obtained cost at most OPT with degrees at most Bv+2B_v+2Bv​+2. Singh and Lau (STOC 2007) improved this to Bv+1B_v+1Bv​+1, which is the best possible additive violation unless P = NP, and gave the extension to lower and upper bounds formalized here. The journal version appeared in J. ACM 62(1), 2015.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite simple graph with edge costs ce∈Rc_e\in\mathbb Rce​∈R; no sign or triangle inequality is assumed. Let FFF be a forest on VVV with no edge in common with EEE. A set H⊆EH\subseteq EH⊆E is an FFF-tree if H∪FH\cup FH∪F is a spanning tree of VVV, and dH(v)d_H(v)dH​(v) is the number of edges of HHH at vvv. Integer lower bounds AvA_vAv​ are given on U⊆VU\subseteq VU⊆V and integer upper bounds BvB_vBv​ on W⊆VW\subseteq VW⊆V. The minimum bounded degree connecting tree problem asks for a cheapest FFF-tree with Av≤dH(v)A_v\le d_H(v)Av​≤dH​(v) on UUU and dH(v)≤Bvd_H(v)\le B_vdH​(v)≤Bv​ on WWW; with F=∅F=\varnothingF=∅ it is the spanning-tree problem.

The supernodes are the vertex sets of the components of (V,F)(V,F)(V,F), isolated vertices included, and I(F)\mathcal I(F)I(F) is the family of unions of supernodes. For S⊆VS\subseteq VS⊆V, E(S)E(S)E(S) and F(S)F(S)F(S) are the edges with both endpoints in SSS, δ(S)\delta(S)δ(S) the edges with exactly one endpoint in SSS, and x(D)=∑e∈Dxex(D)=\sum_{e\in D}x_ex(D)=∑e∈D​xe​. The linear relaxation LP-MBDCT(G,A,B,U,W,F)(G,\mathcal A,\mathcal B,U,W,F)(G,A,B,U,W,F) minimizes ∑ecexe\sum_e c_ex_e∑e​ce​xe​ subject to

x(E(V))=∣V∣−∣F(V)∣−1,x(E(S))≤∣S∣−∣F(S)∣−1 (S∈I(F)),Av≤x(δ(v)) (v∈U),x(δ(v))≤Bv (v∈W),x≥0.x(E(V))=|V|-|F(V)|-1,\quad x(E(S))\le|S|-|F(S)|-1\ (S\in\mathcal I(F)),\quad A_v\le x(\delta(v))\ (v\in U),\quad x(\delta(v))\le B_v\ (v\in W),\quad x\ge0.x(E(V))=∣V∣−∣F(V)∣−1,x(E(S))≤∣S∣−∣F(S)∣−1 (S∈I(F)),Av​≤x(δ(v)) (v∈U),x(δ(v))≤Bv​ (v∈W),x≥0.

MBDCT Algorithm2 (Figure 5 of the paper) repeats: if FFF is a spanning tree, stop; otherwise take a basic optimal solution x∗x^*x∗, delete the edges with xe∗=0x^*_e=0xe∗​=0, move one edge with xe∗=1x^*_e=1xe∗​=1 (if any) into FFF and lower AAA and BBB by one at its endpoints, and otherwise remove from UUU and WWW one vertex whose support degree is at most two.

Formalization targets

Goal: Theorem 5.2

For every well-formed instance whose LP is feasible, MBDCT Algorithm2

  1. has a terminating run;
  2. makes at most ∣V∣−∣F∣−1+∣U∪W∣|V|-|F|-1+|U\cup W|∣V∣−∣F∣−1+∣U∪W∣ iterations on every run;
  3. returns only FFF-trees H⊆EH\subseteq EH⊆E with
c(H)≤∑e∈Ecexe for every feasible x,Av−1≤dH(v) (v∈U),dH(v)≤Bv+1 (v∈W).c(H)\le\sum_{e\in E}c_ex_e\ \text{for every feasible }x,\qquad A_v-1\le d_H(v)\ (v\in U),\qquad d_H(v)\le B_v+1\ (v\in W).c(H)≤e∈E∑​ce​xe​ for every feasible x,Av​−1≤dH​(v) (v∈U),dH​(v)≤Bv​+1 (v∈W).

The statement fixes no constants beyond the paper's ±1\pm1±1, and it is uniform over every choice of basic optimal solution, 1-edge and removed vertex.

Milestones

In the order the proof uses them: Lemma 5.3 (a basic solution is determined by a laminar family of tight sets and tight lower and upper degree rows, with ∣E∗∣=∣L∣+∣TU∣+∣TW∣|E^*|=|\mathcal L|+|T_U|+|T_W|∣E∗∣=∣L∣+∣TU​∣+∣TW​∣); Claims 5.4, 5.7, 5.8 and 5.9 (special supernodes, cut sizes, the value x∗(D(S))=r−1x^*(D(S))=r-1x∗(D(S))=r−1 on the edges between the rrr members of SSS, and when a set is special); Lemma 5.6 (every set of L\mathcal LL keeps at least three tokens, exactly three only if it is special or VVV); and Lemma 5.1 (a basic solution has an edge with xe∗=1x^*_e=1xe∗​=1 or a vertex of U∪WU\cup WU∪W with support degree two).

Significance

The theorem gives, in one algorithm, a tree that is no more expensive than the LP lower bound and whose degrees miss both bounds by at most one. For the pure upper-bound problem it implies the (1,Bv+1)(1,B_v+1)(1,Bv​+1) guarantee, which cannot be improved to BvB_vBv​ unless P = NP, since a Hamiltonian path is the case Bv≡2B_v\equiv 2Bv​≡2. With lower bounds it also covers prescribed minimum degrees.

The result is proved in the paper; no machine-checked proof of it, or of any iterative rounding analysis, is known to exist. No platform item treats bounded-degree spanning trees or iterative rounding; the nearest related item is the open Williamson–Shmoys minimum-degree spanning tree local-search goal, which concerns a different, unweighted problem. Formalizing this mission requires the extreme-point structure of the spanning tree polytope with degree constraints (uncrossing to a laminar family), the token counting argument, and the induction over the algorithm's recursion, all of which are reusable for other iterative rounding results.

Difficulty

The obvious argument rounds an optimal LP solution once. It fails: an optimal vertex may be entirely fractional, and no single rounding keeps both the cost and the degrees. The algorithm instead re-solves the LP after each change, and its correctness rests on Lemma 5.1, that every extreme point of the current LP has an integral edge or a vertex with support degree two. That lemma is a counting statement about extreme points: the rank bound ∣E∗∣=∣L∣+∣TU∣+∣TW∣|E^*|=|\mathcal L|+|T_U|+|T_W|∣E∗∣=∣L∣+∣TU​∣+∣TW​∣ from a laminar basis must be contradicted by a token distribution. With upper bounds only, every set of the laminar family can collect four tokens. With lower bounds a set may collect only three, and the proof must characterize those sets (special sets, Definition 5.5) and show by linear independence that the remaining cases cannot occur. A second difficulty is that the guarantee concerns the final tree after many iterations, so the degree accounting must survive the changes of AAA, BBB, UUU, WWW and FFF along the run.

Formalization scope

Vertices form a Fintype; edges are elements of Sym2 V with no loops, and EEE, FFF are finite sets of edges with FFF acyclic and disjoint from EEE. LP vectors are functions on Sym2 V that vanish off EEE. Right-hand sides are computed in R\mathbb RR, degree bounds are integers, and the subtour rows range over nonempty S∈I(F)S\in\mathcal I(F)S∈I(F) (at S=∅S=\varnothingS=∅ the literal row 0≤−10\le-10≤−1 would make the LP empty). A basic solution is a feasible xxx that is the only vector on EEE satisfying with equality every constraint tight at xxx, including the tight rows xe=0x_e=0xe​=0. Supernodes are never contracted: the paper's contraction of a supernode with one active vertex is a proof device, and all of §5.1's notions are stated on the original instance.

The paper's loose phrases are made explicit as follows.

  • "Polynomial time" becomes the iteration bound; the LP is solved by an oracle that returns any basic optimal solution. The ellipsoid method and the separation oracle are out of scope.
  • "The algorithm returns" becomes three claims: a run exists, every run is bounded, and every returned set satisfies the guarantee. The guarantee alone would hold vacuously for a relation that can get stuck.
  • "Cost at most the cost of the optimal LP solution" becomes c(H)≤c⋅xc(H)\le c\cdot xc(H)≤c⋅x for every feasible xxx.
  • "Distribute the tokens" (Lemma 5.6) becomes a counting inequality on the surplus of tokens.
  • Claim 5.9's "contains exactly three special members" means that SSS has exactly three members, all of them special.
  • Figure 5's Step 4 is guarded by "no edge was picked in Step 3", as the paper's text under Lemma 5.1 states.
  • "FFF is not a spanning tree" and LP feasibility are explicit hypotheses where the paper leaves them implicit.

Two trivializations are ruled out. Existence of a cheap tree with degrees in [Av−1,Bv+1][A_v-1,B_v+1][Av​−1,Bv​+1] is not the target: the statement is about the algorithm's outputs and quantifies over all of them. And a run that never terminates does not satisfy the goal, which requires a run to exist and every run to be bounded.

Contributions are welcome at every level: the laminar uncrossing argument (Lemma 5.3), which is reusable for any spanning-tree LP with degree rows; the counting claims; and the invariants of the recursion.

Selected references

  • M. Singh, L. C. Lau, Approximating minimum bounded degree spanning trees to within one of optimal, STOC 2007, pp. 661–670. https://doi.org/10.1145/1250790.1250887
  • M. Singh, L. C. Lau, Approximating minimum bounded degree spanning trees to within one of optimal, J. ACM 62(1), 2015. https://doi.org/10.1145/2629366
  • M. X. Goemans, Minimum bounded degree spanning trees, FOCS 2006, pp. 273–282. https://doi.org/10.1109/FOCS.2006.48
  • M. Fürer, B. Raghavachari, Approximating the minimum-degree Steiner tree to within one of optimal, J. Algorithms 17(3), 1994, pp. 409–423. https://doi.org/10.1006/jagm.1994.1042
12 thms1 active userReviewed
Operations ResearchOptimization·Captain: mikedeng1

A Scheduling Model for Reduced CPU Energy: For P(s) = s², the Average Rate Heuristic Has Competitive Ratio Between 4 and 8Research Paper

Why processor speed changes the scheduling problem

A processor can save energy by running slowly when work is light, but a deadline may force it to run faster. Yao, Demers, and Shenker formulated this tradeoff as an offline and online scheduling problem for a variable-speed processor in their 1995 FOCS paper. Their Average Rate Heuristic (AVR) uses only each job's arrival, deadline, and required work to set speed. This mission formalizes their quadratic-power analysis: AVR's worst-case energy is at least four and at most eight times the minimum possible energy. The authors prove these bounds in Theorem 2, rather than an exact value.

The question matters when an online scheduler must choose speed before seeing later jobs. Deadline feasibility alone does not measure energy: processing the same number of cycles at twice the speed for half as long can cost more when power grows superlinearly. The paper's model isolates that dependence in a power function P(s)P(s)P(s), so the competitive guarantee measures the energy price of AVR's speed choices. The initial motivation, model, and heuristic are in §§1–4 of the paper.

Jobs, schedules, and the average-rate rule

Fix a nondegenerate time window [t0,t1][t_0,t_1][t0​,t1​]. A finite job instance JJJ assigns each job jjj an arrival time aja_jaj​, deadline bj>ajb_j>a_jbj​>aj​, and nonnegative required work RjR_jRj​ in CPU cycles. Every job window [aj,bj][a_j,b_j][aj​,bj​] lies inside [t0,t1][t_0,t_1][t0​,t1​]. A schedule S=(s,job⁡)S=(s,\operatorname{job})S=(s,job) has nonnegative processor speed s(t)s(t)s(t) and selects at most one job at each time. Speed and job selection are constant between finitely many breakpoints. The schedule is feasible if each job receives its full work inside its own window:

∫ajbjs(t) 1{job⁡(t)=j} dt=Rjfor every j.\int_{a_j}^{b_j}s(t)\,\mathbf 1\{\operatorname{job}(t)=j\}\,dt=R_j \qquad\text{for every }j.∫aj​bj​​s(t)1{job(t)=j}dt=Rj​for every j.

For a power function PPP, its energy is EP(S)=∫t0t1P(s(t)) dtE_P(S)=\int_{t_0}^{t_1}P(s(t))\,dtEP​(S)=∫t0​t1​​P(s(t))dt. An optimal schedule minimizes this quantity among feasible schedules. These definitions follow §2, p. 375. The intensity of an interval [z,z′][z,z'][z,z′] is the total work of jobs whose full windows it contains, divided by z′−zz'-zz′−z. An interval with maximum intensity is critical; Theorem 1 identifies the processor speed on that interval in an optimal schedule §3, p. 375.

Each job's density is dj=Rj/(bj−aj)d_j=R_j/(b_j-a_j)dj​=Rj​/(bj​−aj​), extended as a step function equal to djd_jdj​ on [aj,bj][a_j,b_j][aj​,bj​] and zero elsewhere. AVR runs at speed ∑jdj(t)\sum_j d_j(t)∑j​dj​(t) and chooses the earliest-deadline available job. For quadratic power, its energy is

AVR⁡(J)=∫t0t1(∑jdj(t))2dt.\operatorname{AVR}(J)=\int_{t_0}^{t_1}\left(\sum_jd_j(t)\right)^2dt.AVR(J)=∫t0​t1​​(j∑​dj​(t))2dt.

The competitive ratio is the least upper bound of AVR⁡(J)/OPT⁡(J)\operatorname{AVR}(J)/\operatorname{OPT}(J)AVR(J)/OPT(J) over instances, where OPT⁡(J)\operatorname{OPT}(J)OPT(J) is the least feasible energy §4, p. 376, Eq. (2).

Formalization targets

The goal is the paper's Theorem 2, p. 381:

4≤r≤8(P(s)=s2).4\le r\le 8\qquad(P(s)=s^2).4≤r≤8(P(s)=s2).

The upper bound compares AVR with every feasible schedule. The lower bound says that every constant strictly below four is exceeded by the AVR-to-feasible-energy ratio on some instance. This formulation does not claim that one finite instance attains four.

The milestone path follows the paper: Theorem 1 characterizes optimal speed; Lemma 5.1 reduces to jobs of type A or B; Eq. (5) splits their costs; Lemma 5.2 and Eq. (7) control the A contribution; Lemmas 5.3–5.6 reduce the analysis to canonical instances; Lemma 5.8 supplies a matrix bound; Lemma 5.7 gives FA≤4OPT⁡AF_A\le4\operatorname{OPT}_AFA​≤4OPTA​ and FB≤4OPT⁡BF_B\le4\operatorname{OPT}_BFB​≤4OPTB​; Example 2 approaches the lower constant. These statements and their order come from §5, pp. 378–381. The paper also states a higher-power result, Theorem 3, for real p≥2p\ge2p≥2:

pp≤rp≤2p−1pp.p^p\le r_p\le 2^{p-1}p^p.pp≤rp​≤2p−1pp.

That result is a companion item. The extended abstract leaves its full proof to a longer paper §6, pp. 381–382.

What the bounds provide

The upper bound guarantees that AVR's energy is controlled by a fixed multiple of the offline optimum for every finite job set, even though AVR sets speed from individual job densities. The lower family rules out a guarantee below four for this heuristic. Together they delimit the performance of AVR under quadratic power; they do not give its exact worst-case ratio. The A/B reductions and the tree-induced matrix estimate are useful mathematical interfaces for later analyses of interval-structured schedules.

The paper proves Theorem 2 in the mathematical sense. This mission supplies machine-checkable statements and definitions, with proofs left open for solvers. Closing it requires formal proofs of the reduction steps, the matrix estimate, and the limiting example, plus an explicit connection from the optimal-schedule analysis to comparison with every feasible schedule. No completed Lean proof is claimed here.

The main difficulty

The simple calculation (∑jdj(t))2\left(\sum_j d_j(t)\right)^2(∑j​dj​(t))2 exposes overlap between job windows but does not say how that overlap compares with an optimal schedule. An optimal schedule may run jobs in a different order and may preempt them. The paper therefore changes the instance while preserving the optimal speed profile: it first separates cumulative execution into two types, then reduces to single execution intervals and specially aligned, nested windows. The matrix inequality controls the resulting expression. A pointwise comparison of AVR speed with optimal speed cannot replace these reductions, because an optimal schedule can concentrate work on critical intervals while AVR spreads each job's density across its entire window §5, pp. 377–381.

Formalization scope

Jobs use Fin n, allowing the empty instance. The instance requires t0<t1t_0<t_1t0​<t1​, aj<bja_j<b_jaj​<bj​, containment in the window, and Rj≥0R_j\ge0Rj​≥0. A schedule uses real-valued speed and an optional job label; none denotes no assigned job. Its piecewise-constant requirement is witnessed by finitely many increasing breakpoints. Values at breakpoints are unrestricted by the piecewise-constant clauses, and speed comparisons in the theorems are almost-everywhere statements. Job windows are closed, as printed; endpoints do not affect the integrals. A schedule may have positive speed while no job is assigned, since the source does not equate idleness with zero speed.

Every energy expression is a real interval integral. The schedule conditions ensure the integrands in theorem hypotheses are piecewise constant away from finitely many points. Density denominators are positive. An execution-speed quotient for a zero-work job can have zero denominator, in which case Lean returns zero; such a job contributes no executed work. The goal uses quantified comparisons with feasible schedules rather than a real infimum, and Lemma 5.6 uses all upper bounds on a nonempty canonical family rather than a real supremum. The lower bounds quantify over every smaller constant, avoiding a false attainment claim. These choices guard against default values for empty or unbounded extrema.

Theorem 1's printed convexity hypothesis is strengthened to strict convexity and nondecreasing power on nonnegative speeds: its stated speed uniqueness fails for a linear power function, and a decreasing power function rewards idle speed. This repair is explicit in that item's description. Existence of a quadratic optimum is included as a milestone from the algorithm of §3, although it is not a separately numbered theorem. Example 2 includes the variable exponent e≥1e\ge1e≥1, the limiting ratios at e=1e=1e=1 and e=3/2e=3/2e=3/2, and an eventual upper bound of four across the family. The A-job order resolves exact ties by index. For canonical and tree-induced nesting, intervals that meet only at an endpoint count as disjoint; this admits the paper's displayed four-interval matrix.

The development needs Mathlib's real interval integrals, finite sums, measures of intervals, matrix eigenvalues, and real-power limits. The finite schedule model, canonical-instance data, and tree-induced matrix interface can be reused beyond this particular ratio bound. Contributions may establish these interfaces' elementary properties, the paper's milestone theorems, or independent proofs of the goal, provided they preserve the stated job and schedule classes.

Selected references

  • Frances Yao, Alan Demers, and Scott Shenker, A Scheduling Model for Reduced CPU Energy, Proceedings of the 36th IEEE Symposium on Foundations of Computer Science, 1995, pp. 374–382. DOI 10.1109/SFCS.1995.492493.
19 thms1 active userReviewed
CombinatoricsGraph TheoryLinear Optimization+1·Captain: mikedeng1

Approximating Minimum Bounded Degree Spanning Trees to within One of Optimal 1: Iterative Rounding Finds a Spanning Tree of Cost at Most the LP Optimum with Every Degree at Most B_v + 1Research Paper

Motivation

A network designer may need a cheap connection that keeps the number of links at each site within a local capacity. The minimum bounded-degree spanning tree problem asks for the cheapest spanning tree of a weighted, undirected graph whose vertex degrees respect prescribed upper bounds. The capacity constraints matter in settings where a low-cost tree alone can overload a few hubs. They also make the optimization problem difficult: even with unit edge weights and a bound of two at every vertex, feasibility includes the Hamiltonian path problem. Singh and Lau study the useful relaxation in which the returned tree may exceed each degree bound by one while its cost stays no greater than the best tree satisfying every original bound Singh–Lau 2007.

The weighted result settled the bounded-degree form of a conjecture discussed in their paper. Goemans had obtained a cost-preserving degree guarantee of Bv+2B_v+2Bv​+2; an earlier unweighted local-search result attained a +1+1+1 degree allowance but did not cover arbitrary real costs. Singh and Lau's Theorem 1.2 gives the +1+1+1 allowance in the weighted setting, without assuming nonnegative costs or triangle inequalities Singh–Lau 2007, pp. 661–662. The platform's open WilliamsonShmoys.minimum_degree_tree_local_search_approximation concerns the related unweighted minimum-degree local-search problem, with a different objective and guarantee.

Setting

Let VVV be a finite vertex set and EEE a finite set of unordered, non-loop edges. A spanning tree T⊆ET\subseteq ET⊆E connects every vertex without a cycle. Every edge eee has a real cost cec_ece​, so c(T)=∑e∈Tcec(T)=\sum_{e\in T}c_ec(T)=∑e∈T​ce​. Each vertex vvv has an integer upper bound BvB_vBv​ on its tree degree dT(v)d_T(v)dT​(v). A feasible original solution has dT(v)≤Bvd_T(v)\le B_vdT​(v)≤Bv​ for all vvv.

The paper studies a broader connecting-tree problem. A forest FFF is already selected; its connected components, including isolated vertices, are supernodes. The remaining graph has edges EEE disjoint from FFF. A set H⊆EH\subseteq EH⊆E is an FFF-tree if H∪FH\cup FH∪F is a spanning tree. Degree bounds are active only at vertices in W⊆VW\subseteq VW⊆V, and dH(v)d_H(v)dH​(v) counts edges of HHH, not edges of FFF. The initial spanning-tree problem is the case F=∅F=\varnothingF=∅ and W=VW=VW=V Singh–Lau 2007, p. 665.

For an edge set QQQ and vertex set SSS, write Q(S)Q(S)Q(S) for edges of QQQ with both endpoints in SSS, and δE(v)\delta_E(v)δE​(v) for edges of EEE incident to vvv. The LP-MBDCT relaxation has a nonnegative variable xex_exe​ for each e∈Ee\in Ee∈E. It requires x(E)=∣V∣−∣F∣−1x(E)=|V|-|F|-1x(E)=∣V∣−∣F∣−1, requires x(E(S))≤∣S∣−∣F(S)∣−1x(E(S))\le |S|-|F(S)|-1x(E(S))≤∣S∣−∣F(S)∣−1 for every nonempty union SSS of supernodes, and requires x(δE(v))≤Bvx(\delta_E(v))\le B_vx(δE​(v))≤Bv​ for v∈Wv\in Wv∈W. Its objective is ∑e∈Ecexe\sum_{e\in E}c_ex_e∑e∈E​ce​xe​. At F=∅F=\varnothingF=∅, W=VW=VW=V, this is the spanning-tree LP in equations (1)–(5) Singh–Lau 2007, pp. 662, 665.

Formalization targets

Theorem 1.2: bounded-degree spanning trees

For every feasible initial LP, the paper's Figure 4 algorithm has a terminating run. Every possible run returns a spanning tree TTT satisfying

dT(v)≤Bv+1(v∈V),c(T)≤∑e∈Ecexefor every LP-feasible x.d_T(v)\le B_v+1\quad(v\in V),\qquad c(T)\le\sum_{e\in E}c_ex_e\quad\text{for every LP-feasible }x.dT​(v)≤Bv​+1(v∈V),c(T)≤e∈E∑​ce​xe​for every LP-feasible x.

In particular, c(T)c(T)c(T) is at most the cost of every spanning tree satisfying the original bounds, and thus at most the original optimum. Every run has at most 2∣V∣−12|V|-12∣V∣−1 iterations. The cost comparison against every LP-feasible vector states the stronger bound used by Theorem 4.2 Singh–Lau 2007, pp. 661, 666.

Theorem 4.2 and its milestones

The connecting-tree theorem makes the same cost and degree guarantee for an arbitrary feasible state (E,B,W,F)(E,B,W,F)(E,B,W,F), with dH(v)≤Bv+1d_H(v)\le B_v+1dH​(v)≤Bv​+1 only for v∈Wv\in Wv∈W. The attack path follows the paper's numbered results: Lemma 4.3 describes tight constraints by a laminar family, Claim 4.5 classifies vertices with one excess token, Lemma 4.6 bounds tokens inside a laminar subtree, and Lemma 4.1 says each nonterminal basic solution has either a unit-valued edge or a removable degree constraint. Theorem 4.2 then supplies the general guarantee Singh–Lau 2007, pp. 666–667.

Significance

The result allows one unit of violation at each local degree bound while preserving the cost benchmark exactly. It applies even when negative edge costs make standard multiplicative cost ratios awkward. The connecting-tree statement is useful beyond the initial instance because it covers a forest already accumulated and a subset of degree constraints still active.

This mission formalizes the known 2007 result as an open Lean proof target; the paper proves the mathematics, while the declarations here currently have no machine-checked proofs. A completed development would provide a reusable account of a spanning-tree LP with forest contraction, basic solutions defined by tight rows, and a finite relational algorithm with all choices exposed. These objects could support the paper's lower-and-upper-bound extension and other iterative-rounding results.

Difficulty

Rounding an arbitrary fractional edge upward can increase cost beyond the LP benchmark. Restricting the algorithm to edges with value exactly one protects that benchmark, but a nonterminal basic solution need not present a unit-valued edge. The central structural question is then whether some active degree constraint can be removed with only a one-unit effect on the final degree. The tight subtour rows and degree rows overlap, so counting edges from the support alone is insufficient; Lemmas 4.3–4.6 resolve the dependency and token-counting issues that make the direct argument fail Singh–Lau 2007, pp. 666–667.

Formalization scope

Lean represents edges as Sym2 V in finite sets, excluding diagonal edges. It represents LP vectors on all unordered pairs but requires zero values outside the current edge set. A forest is acyclic on the full vertex set. A compatible subtour set is a union of its connected components. Subtour right-hand sides are real numbers, so subtraction does not truncate at zero; the empty set is excluded because the literal row would make the LP infeasible. Degree bounds are integers so the algorithm's decrements are total. A basic feasible solution is determined uniquely by its tight equality rows among vectors supported on the current edge set. Linear independence in Lemma 4.3 is checked on the positive support.

Figure 4 is a relation because the LP optimum, a unit-valued edge, and a qualifying vertex may each be chosen in several ways. Its edge and vertex tests are mandatory when their conditions hold. The vertex test uses the support before deleting the selected edge and bounds after decrementing its endpoints, following the printed order. “The algorithm returns” is represented by existence of a run, an iteration bound on every step chain, and guarantees for every returned set. “Cost at most the LP optimum” means cost no greater than the objective at every feasible LP vector. “Polynomial time” is represented by the iteration count; the ellipsoid LP solver and separation-oracle complexity are outside this mission. Lemma 4.6's token distribution is expressed as its explicit counting inequality.

The goal asserts the Figure 4 output and its LP cost guarantee. Bare existence of a tree with cost at most the optimum and degrees at most Bv+1B_v+1Bv​+1 would be witnessed by an original optimal tree and would lose the algorithmic theorem. A return guarantee without run existence would hold vacuously for a stuck relation. Contributions that prove the stated structural lemmas, establish the LP oracle's basic-optimum availability, or close the algorithm invariant are within scope. No existing platform item treats this bounded-degree LP and iterative-rounding algorithm under these conventions; the plain minimum-spanning-tree LP definition uses a different edge representation and no forest or degree constraints.

Selected references

  • Mohit Singh and Lap Chi Lau, Approximating Minimum Bounded Degree Spanning Trees to within One of Optimal, Proceedings of the 39th ACM Symposium on Theory of Computing (STOC), 2007, pp. 661–670. DOI: 10.1145/1250790.1250887.
8 thms1 active userReviewed
Graph TheoryLinear Optimization·Captain: mikedeng1

Multicommodity Max-Flow Min-Cut Theorems and Their Use in Designing Approximation Algorithms IV: A Uniform Flow of Size Ω(𝒮/log n) on Paths of Length O(C_max log n/(n𝒮))Research Paper

Motivation

Communication networks must route many source–destination demands through shared edges. A multicommodity flow describes how much of each demand can be carried simultaneously without exceeding an edge's capacity. In an undirected network, a cut bounds the traffic that can pass between two groups of vertices, but many commodities can interfere even when no single cut is obviously restrictive. Leighton and Rao showed that the uniform concurrent flow is within a logarithmic factor of the corresponding sparsest-cut bound Leighton and Rao, 1999.

For routing, flow value alone is incomplete: a feasible flow can use long detours. Section 2.5 of the same paper establishes that a flow of the guaranteed size can be carried on paths whose number of edges is also controlled. The result supports the paper's discussion of low-congestion, low-dilation routing in communication networks, where a long route can increase latency or complicate scheduling even if every edge has sufficient capacity Leighton and Rao, 1999, §2.5.

Setting

Let VVV be a finite set of n≥2n\ge2n≥2 vertices. An undirected capacitated network has a symmetric capacity C(u,v)≥0C(u,v)\ge0C(u,v)≥0 for each pair, with C(u,u)=0C(u,u)=0C(u,u)=0. A pair is an edge when its capacity is positive. Parallel physical edges can be combined by adding their capacities. The network is connected: every nonempty proper subset U⊊VU\subsetneq VU⊊V has positive cut capacity C(U,Uˉ)=∑u∈U,v∉UC(u,v)C(U,\bar U)=\sum_{u\in U,v\notin U}C(u,v)C(U,Uˉ)=∑u∈U,v∈/U​C(u,v), where Uˉ=V∖U\bar U=V\setminus UUˉ=V∖U.

The uniform multicommodity flow problem gives one unit of demand to each unordered pair of distinct vertices. Equivalently, it gives demand 1/21/21/2 to each ordered pair (s,t)(s,t)(s,t) with s≠ts\ne ts=t Leighton and Rao, 1999, footnote 2. A concurrent flow of value λ\lambdaλ routes the fraction λ\lambdaλ of every demand. Traffic in both directions of an undirected edge shares that edge's capacity. The demand crossing UUU is ∣U∣ ∣Uˉ∣|U|\,|\bar U|∣U∣∣Uˉ∣, so the uniform min-cut, also called the sparsest-cut value, is

S=min⁡∅≠U⊊VC(U,Uˉ)∣U∣ ∣Uˉ∣.\mathcal S=\min_{\varnothing\ne U\subsetneq V}\frac{C(U,\bar U)}{|U|\,|\bar U|}.S=∅=U⊊Vmin​∣U∣∣Uˉ∣C(U,Uˉ)​.

For a flow path, length means its number of edges. A separate nonnegative symmetric distance function ddd assigns lengths to edges; its total weight is W=∑eC(e)d(e)W=\sum_e C(e)d(e)W=∑e​C(e)d(e). Given a hop budget LLL, let dL(u,v)d_L(u,v)dL​(u,v) be the smallest ddd-length of a walk from uuu to vvv using at most LLL edges. The value is ∞\infty∞ if no such walk exists. The maximum capacity incident to one vertex is Cmax⁡=max⁡v∑uC(v,u)C_{\max}=\max_v\sum_u C(v,u)Cmax​=maxv​∑u​C(v,u). The paper uses log⁡n=log⁡2n\log n=\log_2nlogn=log2​n and ln⁡n\ln nlnn for the natural logarithm Leighton and Rao, 1999, footnote 3.

Formalization targets

A large uniform flow with short paths

Theorem 18 asserts the existence of absolute constants c1,c2>0c_1,c_2>0c1​,c2​>0 such that every network in the setting above admits a concurrent uniform flow of value λ\lambdaλ whose every route has at most LLL edges, with

λ≥c1Slog⁡2n,L≤c2Cmax⁡log⁡2nnS.\lambda\ge c_1\frac{\mathcal S}{\log_2 n},\qquad L\le c_2\frac{C_{\max}\log_2 n}{n\mathcal S}.λ≥c1​log2​nS​,L≤c2​nSCmax​log2​n​.

The constants precede the choice of network: they cannot depend on its size or capacities. The goal gives an actual flow and integer hop limit, not only a lower bound on a supremum Leighton and Rao, 1999, Theorem 18.

The dual and geometric estimates

The short-path linear-programming dual uses dLd_LdL​ in its distance constraint, 12∑u,vdL(u,v)≥1\frac12\sum_{u,v}d_L(u,v)\ge121​∑u,v​dL​(u,v)≥1, and minimizes WWW. Lemma 19 partitions a network into components with both edge-radius at most ΔC/W\Delta C/WΔC/W and distance-radius at most Δ\DeltaΔ, while the capacity between components is at most 4Wlog⁡2n/Δ4W\log_2n/\Delta4Wlog2​n/Δ. Corollary 20 finds a component with at least 2n/32n/32n/3 vertices when 0<W≤S/(36log⁡2n)0<W\le\mathcal S/(36\log_2n)0<W≤S/(36log2​n). Lemma 21 bounds the sum of L/4L/4L/4-restricted distances from any such large set to its complement by 6W/(nS)6W/(n\mathcal S)6W/(nS), provided L≥12Cmax⁡ln⁡n/(nS)L\ge12C_{\max}\ln n/(n\mathcal S)L≥12Cmax​lnn/(nS). These are the mission's milestones, in source order Leighton and Rao, 1999, pp. 808–809.

Significance

Theorem 18 places simultaneous lower and upper guarantees on a routing solution: it carries a substantial fraction of every uniform demand, while each route uses a bounded number of edges. Its hop guarantee is stronger than simply knowing that the unconstrained maximum flow is large. The result is one of the paper's inputs for reasoning about routing paths with low congestion and dilation; the paper also says analogous short-path results extend to product and directed flow problems, without presenting all their details Leighton and Rao, 1999, p. 811.

The known mathematical result has a published proof; this mission asks for machine-checked statements and proofs. A complete development would establish the hop-indexed flow model, the restricted shortest-path duality, and the two-radius partition estimates in Lean. The network, proper-cut, and extended-distance interfaces can be reused in later work on sparse cuts and length-constrained routing. No machine-checked proof of this exact theorem is claimed here.

Difficulty

The ordinary approximate max-flow/min-cut theorem controls the amount of concurrent traffic but does not bound the number of edges on each route. Restricting routes changes the dual: a shortest path that exceeds the hop budget is unavailable, and some vertex pairs have no allowed path at all. Assigning such a pair distance zero would alter the dual constraint. The geometric estimates must control both hop count and ddd-length on the same connecting paths, since bounds witnessed by two unrelated paths cannot be combined into one short route Leighton and Rao, 1999, §2.5.

Formalization scope

The vertex type is finite and has at least two members. Capacities are real, symmetric and nonnegative; zero-capacity pairs are absent from the graph. Connectivity is the paper's standing cut assumption. The min-cut ranges over nonempty proper subsets, so no expression divides by a zero cardinality. Demands use the paper's ordered-pair 1/21/21/2 convention. A short flow is a nonnegative commodity–hop–arc array whose equations inject, conserve and absorb traffic; the capacity constraint combines both directions and all hops. The maximum flow is a supremum over feasible values. Its use is confined to the positive-demand finite setting, where the feasible set is nonempty and bounded.

Restricted distances take values in extended nonnegative reals, so an empty family of allowed walks has value ∞\infty∞. The radius predicate requires one walk inside a component to meet both bounds. log⁡2\log_2log2​ appears in Theorem 18, Lemma 19 and Corollary 20; Lemma 21's threshold uses ln⁡\lnln. For expressions dividing by WWW, the formal statements require W>0W>0W>0; this makes the printed radius meaningful. The explicit companion theorem uses the hop limit ⌊L⌋\lfloor L\rfloor⌊L⌋ for the paper's real LLL, which is what "at most LLL edges" means; Lemma 21 keeps LLL real. The polynomial-time search claim is outside this existence formalization. A definition making every restricted distance zero, or quantifying its asymptotic constants after the network, would make the goal a different theorem.

Contributions may include finite-flow and linear-programming duality, path decomposition for the hop-indexed formulation, the partition estimate, the large-component corollary, or the restricted-distance estimate. The same finite graph and extended-distance definitions may serve subsequent missions.

Selected references

  • T. Leighton and S. Rao, Multicommodity max-flow min-cut theorems and their use in designing approximation algorithms, Journal of the ACM 46(6):787–832, 1999. DOI: 10.1145/331524.331526.
7 thms1 active userReviewed
Information TheoryProbability·Captain: mikedeng1

Fuzzy Extractors: How to Generate Strong Keys from Biometrics and Other Noisy Data 1: Every [n, k, 2t+1] Code Gives an Average-Case Hamming Fuzzy Extractor with ℓ = m + kf − nf − 2 log(1/ε) + 2Research Paper

Motivation

Cryptographic keys must be uniformly random and reproducible exactly. Many secrets people actually possess are neither: a biometric reading (an iris code, a fingerprint template), a long passphrase recalled with typos, or the correlated bits two parties obtain from a quantum channel are noisy, so two readings of the same secret differ in a few positions, and they are not uniform. Fuzzy extractors, introduced by Dodis, Ostrovsky, Reyzin and Smith (arXiv:cs/0602007; SIAM J. Comput. 38(1), 2008), turn such a secret into a nearly uniform key that can be regenerated from any sufficiently close reading, using public helper data that does not compromise the key.

The construction for the Hamming metric is the one most used in practice and in later work on biometric key derivation and physically unclonable functions. Its history is short. Juels and Wattenberg's fuzzy commitment (CCS 1999) shifted an error-correcting code onto the secret but was analysed only for uniform inputs. The syndrome of a linear code had been used for information reconciliation in quantum key agreement (Bennett, Bessette, Brassard, Salvail and Smolin, J. Cryptology 1992). Dodis et al. defined secure sketches and fuzzy extractors for arbitrary entropy distributions, introduced average min-entropy to handle side information, and proved the bound formalized here. This mission is the first of four drawn from that paper.

Setting

All logarithms are base 2. A random variable is identified with its law. For a random variable AAA, the min-entropy is H∞(A)=−log⁡max⁡aPr⁡[A=a]\mathbf H_\infty(A) = -\log \max_a \Pr[A=a]H∞​(A)=−logmaxa​Pr[A=a]. For a pair (A,B)(A,B)(A,B), the average min-entropy of AAA given BBB is

H~∞(A∣B)=−log⁡Eb←B[max⁡aPr⁡[A=a∣B=b]],\tilde{\mathbf H}_\infty(A\mid B) = -\log \mathbb E_{b\leftarrow B}\big[\max_a \Pr[A=a\mid B=b]\big],H~∞​(A∣B)=−logEb←B​[amax​Pr[A=a∣B=b]],

the adversary's chance of guessing AAA after seeing BBB, on a log scale. The statistical distance is SD(A,B)=12∑v∣Pr⁡(A=v)−Pr⁡(B=v)∣\mathbf{SD}(A,B)=\tfrac12\sum_v|\Pr(A=v)-\Pr(B=v)|SD(A,B)=21​∑v​∣Pr(A=v)−Pr(B=v)∣, and UℓU_\ellUℓ​ is uniform on {0,1}ℓ\{0,1\}^\ell{0,1}ℓ.

The space is M=Fn\mathcal M=\mathcal F^nM=Fn, where F\mathcal FF is a finite additive group with FFF elements, f=log⁡Ff=\log Ff=logF, and dis(w,w′)\mathrm{dis}(w,w')dis(w,w′) is the Hamming distance, the number of positions where www and w′w'w′ differ. A code C⊆FnC\subseteq\mathcal F^nC⊆Fn with KKK codewords is an [n,k,2t+1]F[n,k,2t+1]_{\mathcal F}[n,k,2t+1]F​ code if distinct codewords are at distance at least 2t+12t+12t+1; its dimension is k=log⁡FKk=\log_F Kk=logF​K, so kf=log⁡Kkf=\log Kkf=logK.

A secure sketch (SS,Rec)(\mathsf{SS},\mathsf{Rec})(SS,Rec) is a pair of randomized procedures with Rec(w′,SS(w))=w\mathsf{Rec}(w',\mathsf{SS}(w))=wRec(w′,SS(w))=w whenever dis(w,w′)≤t\mathrm{dis}(w,w')\le tdis(w,w′)≤t. It is an average-case (M,m,m~,t)(\mathcal M,m,\tilde m,t)(M,m,m~,t)-secure sketch if H~∞(W∣(SS(W),I))≥m~\tilde{\mathbf H}_\infty(W\mid(\mathsf{SS}(W),I))\ge\tilde mH~∞​(W∣(SS(W),I))≥m~ for every pair (W,I)(W,I)(W,I) with H~∞(W∣I)≥m\tilde{\mathbf H}_\infty(W\mid I)\ge mH~∞​(W∣I)≥m. A fuzzy extractor (Gen,Rep)(\mathsf{Gen},\mathsf{Rep})(Gen,Rep) has Gen(w)=(R,P)\mathsf{Gen}(w)=(R,P)Gen(w)=(R,P) with R∈{0,1}ℓR\in\{0,1\}^\ellR∈{0,1}ℓ, and Rep(w′,P)=R\mathsf{Rep}(w',P)=RRep(w′,P)=R whenever dis(w,w′)≤t\mathrm{dis}(w,w')\le tdis(w,w′)≤t. It is an average-case (M,m,ℓ,t,ε)(\mathcal M,m,\ell,t,\varepsilon)(M,m,ℓ,t,ε)-fuzzy extractor if

SD((R,P,I),(Uℓ,P,I))≤εwheneverH~∞(W∣I)≥m.\mathbf{SD}\big((R,P,I),(U_\ell,P,I)\big)\le\varepsilon \quad\text{whenever}\quad \tilde{\mathbf H}_\infty(W\mid I)\ge m .SD((R,P,I),(Uℓ​,P,I))≤εwheneverH~∞​(W∣I)≥m.

A family {Hx}x∈X\{H_x\}_{x\in X}{Hx​}x∈X​ of functions into {0,1}ℓ\{0,1\}^\ell{0,1}ℓ is universal if Pr⁡x[Hx(a)=Hx(b)]=2−ℓ\Pr_{x}[H_x(a)=H_x(b)]=2^{-\ell}Prx​[Hx​(a)=Hx​(b)]=2−ℓ for all a≠ba\ne ba=b.

Formalization targets

Goal: Theorem 5.2 (p. 17)

For every [n,k,2t+1]F[n,k,2t+1]_{\mathcal F}[n,k,2t+1]F​ code, every mmm, every ε>0\varepsilon>0ε>0 and every natural number

ℓ  ≤  m+kf−nf−2log⁡(1/ε)+2,\ell\;\le\;m+kf-nf-2\log(1/\varepsilon)+2,ℓ≤m+kf−nf−2log(1/ε)+2,

there is an average-case (Fn,m,ℓ,t,ε)(\mathcal F^n,m,\ell,t,\varepsilon)(Fn,m,ℓ,t,ε)-fuzzy extractor.

The sketch branch

  • Lemma 2.2(b): publishing a value with at most 2λ2^\lambda2λ possibilities lowers average min-entropy by at most λ\lambdaλ.
  • Lemma 3.1: a correct sketch with at most 2λ2^\lambda2λ outputs is an average-case secure sketch with entropy loss λ\lambdaλ.
  • Lemma 4.5: the sketch for transitive metric spaces (Construction 1) loses at most log⁡∣Π∣−log⁡Γ−log⁡K\log|\Pi|-\log\Gamma-\log Klog∣Π∣−logΓ−logK.
  • §5, p. 17: at most one word within distance ttt of w′w'w′ has a given syndrome.
  • Theorem 5.1: the code-offset sketch is an average-case (Fn,m,m−(n−k)f,t)(\mathcal F^n,m,m-(n-k)f,t)(Fn,m,m−(n−k)f,t)-secure sketch; for a linear code, the syndrome sketch is deterministic, n−kn-kn−k symbols long, with the same loss.

The extractor branch

  • Lemma 2.1 and Lemma 2.4: the leftover hash lemma and its average-case generalization, SD((HX(W),X,I),(Uℓ,X,I))≤122−H~∞(W∣I)2ℓ\mathbf{SD}\big((H_X(W),X,I),(U_\ell,X,I)\big)\le\frac12\sqrt{2^{-\tilde{\mathbf H}_\infty(W\mid I)}2^\ell}SD((HX​(W),X,I),(Uℓ​,X,I))≤21​2−H~∞​(W∣I)2ℓ​.
  • Lemma 4.1 (average-case form): an average-case sketch plus an average-case strong extractor gives an average-case fuzzy extractor.
  • Lemma 4.3 (average-case form): with universal hashing, any ℓ≤m~−2log⁡(1/ε)+2\ell\le\tilde m-2\log(1/\varepsilon)+2ℓ≤m~−2log(1/ε)+2 is achievable.

Significance

Theorem 5.2 says that the only costs of tolerating ttt Hamming errors are the redundancy of the code, (n−k)f(n-k)f(n−k)f bits, and the 2log⁡(1/ε)2\log(1/\varepsilon)2log(1/ε) bits that any extractor loses. Appendix C of the paper shows the redundancy term cannot be avoided for uniform inputs, so for optimal codes the construction is optimal there. The average-case form matters for composition: it remains valid when the adversary holds side information correlated with the secret, which is the situation of every protocol that uses the key afterwards or reuses the reading.

Formalizing it produces machine-checked versions of the leftover hash lemma in its average-case form, the basic calculus of average min-entropy, and the code-offset and syndrome sketches. These are the standard tools of information-theoretic cryptography, used well beyond fuzzy extraction (privacy amplification, randomness extraction, information reconciliation). All results are proved in the paper; as far as is known, none of them has a formal proof in Lean or on this platform.

Difficulty

The obvious route bounds the leakage of the sketch with min-entropy and then applies an extractor to WWW conditioned on each sketch value. That fails: conditioned on a particular sketch value, WWW may have far less min-entropy than average, so a worst-case extractor has nothing to work with on some values, and paying for those bad values costs an extra error term (Corollary 4.2). The average-case notions exist to avoid this loss, and the chain must be kept average-case at every step. In Lean the work is in the probability bookkeeping: computing laws of pairs and triples formed by independent coin flips, rearranging them, and bounding sums of maxima over possibly infinite auxiliary types, together with the leftover hash lemma itself, which Mathlib does not provide.

Formalization scope

Random variables are their laws, Mathlib PMFs; pairs are joint laws and randomized procedures are kernels whose coins are independent of everything else. Average min-entropy is written in the equivalent joint form −log⁡∑bmax⁡aPr⁡[A=a∧B=b]-\log\sum_b\max_a\Pr[A=a\wedge B=b]−log∑b​maxa​Pr[A=a∧B=b], which needs no conditioning on null events. The auxiliary variable III ranges over every type, not only finite ones. Logarithms are Real.logb 2; {0,1}ℓ\{0,1\}^\ell{0,1}ℓ is Fin ℓ → Bool; Fn\mathcal F^nFn is Fin n → F with Mathlib's hammingDist.

Explicit choices:

  • Efficiency is dropped. Every "efficient" and polynomial-time clause (Definitions 1–5, Lemma 4.5, Theorems 5.1 and 5.2) is omitted; there is no complexity substrate, and no vacuous predicate stands in for it.
  • ℓ\ellℓ is a natural number with ℓ≤m+kf−nf−2log⁡(1/ε)+2\ell\le m+kf-nf-2\log(1/\varepsilon)+2ℓ≤m+kf−nf−2log(1/ε)+2 as a real inequality; the printed ℓ\ellℓ is a real expression.
  • ε>0\varepsilon>0ε>0 is stated wherever log⁡(1/ε)\log(1/\varepsilon)log(1/ε) appears.
  • "Min-entropy mmm" means H∞(W)≥m\mathbf H_\infty(W)\ge mH∞​(W)≥m; minimum distance 2t+12t+12t+1 means at least 2t+12t+12t+1; kf=log⁡Kkf=\log Kkf=logK, so non-linear codes are covered.
  • F\mathcal FF is any finite additive commutative group (the paper's additive cyclic group is a special case); the syndrome is any linear map onto Fn−k\mathcal F^{n-k}Fn−k with kernel CCC.
  • Extractor domains are arbitrary finite sets with arbitrary finite nonempty seed sets, instead of {0,1}n\{0,1\}^n{0,1}n and {0,1}r\{0,1\}^r{0,1}r.
  • Γ\GammaΓ in Lemma 4.5 is read as "for each www and bbb there are at least Γ≥1\Gamma\ge1Γ≥1 permutations with π(w)=b\pi(w)=bπ(w)=b"; symmetry of the distance is an explicit hypothesis there.
  • Theorem 5.1 is stated for the code-offset and syndrome constructions themselves, not as a bare existence claim.

A trivializing formalization is ruled out: the security clause quantifies over every auxiliary type and every joint law meeting the entropy bound, ε\varepsilonε and ℓ\ellℓ are constrained exactly as in the paper, and the universal hash family is constructed inside the goal (a supporting item states that universal families exist), never assumed.

Contributions welcome: proofs of any milestone; general lemmas on PMF marginals, statistical distance and average min-entropy, which are reusable across all four missions of this paper and in other information-theoretic cryptography; and the leftover hash lemma as a standalone result.

Selected references

  • Y. Dodis, R. Ostrovsky, L. Reyzin, A. Smith, Fuzzy Extractors: How to Generate Strong Keys from Biometrics and Other Noisy Data, SIAM J. Comput. 38(1):97–139, 2008. arXiv:cs/0602007v4. https://arxiv.org/abs/cs/0602007 , https://doi.org/10.1137/060651380
  • A. Juels, M. Wattenberg, A Fuzzy Commitment Scheme, ACM CCS 1999. https://doi.org/10.1145/319709.319714
  • J. L. Carter, M. N. Wegman, Universal Classes of Hash Functions, J. Comput. System Sci. 18(2):143–154, 1979. https://doi.org/10.1016/0022-0000(79)90044-8
  • J. Håstad, R. Impagliazzo, L. Levin, M. Luby, A Pseudorandom Generator from any One-way Function, SIAM J. Comput. 28(4):1364–1396, 1999. https://doi.org/10.1137/S0097539793244708
  • C. H. Bennett, F. Bessette, G. Brassard, L. Salvail, J. Smolin, Experimental Quantum Cryptography, J. Cryptology 5(1):3–28, 1992. https://doi.org/10.1007/BF00191318
12 thms1 active userReviewed
CombinatoricsComplexity TheoryProbability·Captain: mikedeng1

Software Protection and Simulation on Oblivious RAMs: Every Oblivious Simulation of t Steps Makes max{|y|, Ω(t log t)} AccessesResearch Paper

Motivation

Programs often reveal information through the memory locations they touch, even when the contents of those locations are hidden. An oblivious RAM simulation aims to conceal this access pattern. Goldreich and Ostrovsky studied the cost of doing so for arbitrary RAM programs and showed that the access sequence itself imposes a lower bound on simulation overhead. Their 1996 paper gives an upper-bound construction as well as the lower-bound theorem targeted here. The issue matters when a storage observer can see which addresses are accessed but must learn nothing about the program's private requests.

Theorem 6.1 of the paper states that simulating ttt steps requires at least the initial memory size and, asymptotically, a multiple of tlog⁡tt\log ttlogt accesses. Its proof introduces a simpler ball-and-cell game that grants the player more information and freedom than the RAM simulation. The mission formalizes that game and its lower bound. This makes the combinatorial content of the published argument a precise theorem about randomized behavior and visible observations. The paper's earlier Theorem 1.2.2 on p. 437 is labeled informal and has a different explicit bound; the target here is Theorem 6.1 on pp. 469–470.

Setting

There are mmm numbered balls and mmm numbered cells. Cell iii initially contains ball iii, and a player's hand is empty. Each cell can hold at most one ball and the hand can hold at most bbb balls. In one access, the player names a cell and secretly takes its ball into a nonfull hand, places one held ball into an empty cell, or leaves the cell unchanged. Taking from an empty cell and placing into an occupied cell are illegal. The observer sees the named cell at each access but not the hidden operation. A run of qqq accesses is written a=((v1,h1),…,(vq,hq))a=((v_1,h_1),\ldots,(v_q,h_q))a=((v1​,h1​),…,(vq​,hq​)), and its visible sequence is V(a)=(v1,…,vq)V(a)=(v_1,\ldots,v_q)V(a)=(v1​,…,vq​).

A request sequence r=(r1,…,rt)r=(r_1,\ldots,r_t)r=(r1​,…,rt​) names a ball for each of ttt rounds. A run satisfies rrr if it is legal and there are indices 1≤j1≤⋯≤jt=q1\le j_1\le\cdots\le j_t=q1≤j1​≤⋯≤jt​=q such that ball rir_iri​ is in the player's hand after the first jij_iji​ accesses. Equal indices are permitted: several rounds may finish after the same access. The player may know the entire request sequence in advance. That assumption is part of the paper's game, and the paper notes that its lower bound does not require an online player.

A randomized player assigns each request sequence a probability distribution over finite runs. It is correct if every run with positive probability satisfies its requests. It is oblivious if the distribution of V(a)V(a)V(a) is identical for every pair of request sequences of length ttt. Thus the observer cannot infer the requested balls from the accessed cells, even statistically. These conditions quantify over all request sequences, not a selected input or a single deterministic access pattern.

Formalization targets

Theorem 6.1: access lower bound

For every correct oblivious player and every run in the support of its response, the mission targets

q≥m(t≥1),q≥cbtlog⁡t(m=t, t≥Tb),q\ge m\quad(t\ge1),\qquad q\ge c_b t\log t\quad(m=t,\ t\ge T_b),q≥m(t≥1),q≥cb​tlogt(m=t, t≥Tb​),

where cb>0c_b>0cb​>0 and TbT_bTb​ depend only on the fixed hand size bbb. This is the paper's max⁡{m,Ω(tlog⁡t)}\max\{m,\Omega(t\log t)\}max{m,Ω(tlogt)} form, with mmm representing the number ∣y∣|y|∣y∣ of initially occupied memory words. It asserts a bound on every possible run, rather than only on average access count. No numerical constant is prescribed by the paper.

Intermediate counting targets

The milestones record the first-round mmm bound, the at-most-(b+2)q(b+2)^q(b+2)q count of legal hidden action sequences compatible with a visible sequence, and the implication from obliviousness that one visible sequence can serve every request sequence. They then state the corrected finite counting bounds

∣{r:a⊨r}∣≤multichoose⁡(q,t)bt,mt≤(b+2)qmultichoose⁡(q,t)bt.|\{r:a\models r\}|\le\operatorname{multichoose}(q,t)b^t, \qquad m^t\le(b+2)^q\operatorname{multichoose}(q,t)b^t.∣{r:a⊨r}∣≤multichoose(q,t)bt,mt≤(b+2)qmultichoose(q,t)bt.

These preserve the paper's non-strict round ends. The milestone source text records the published formulas, while the formal statements and descriptions identify the corrections.

Significance

The result limits how cheaply a simulator can hide a program's memory access pattern when the observer sees addresses. In the game, a player is even allowed to remember the entire ball placement without cost, know the future requests, and randomize its actions. A lower bound under these permissive conditions applies to the more constrained access-pattern problem that motivated the game, subject to the paper's reduction from simulation to the game. The mmm term also accounts for the initially occupied memory, independently of the asymptotic term.

The theorem is a published mathematical result, but the mission's Lean declarations are statements with proof holes until solvers supply machine-checked proofs. Formalizing the game creates reusable definitions for legal hidden operations, request satisfaction, randomized players, and visible distributions. Formalizing the corrected counting targets also makes explicit a discrepancy in the printed proof rather than silently relying on an invalid intermediate inequality.

Difficulty

The main difficulty is accounting for requests when several rounds end at the same access. The paper's observation that a fixed qqq-access run serves at most bqb^qbq request sequences is false under its own non-strict indices. A run that fetches every ball it can hold may answer many later rounds without making another access. Likewise, the alternative binomial count in footnote 29 assumes distinct completion points and fails when t>qt>qt>q. The final asymptotic result still has a valid corrected counting target, but a proof cannot quote the published intermediate formulas literally. Randomized behavior adds another precise requirement: equality of visible distributions must support conclusions about runs with positive probability for each request sequence.

Formalization scope

The Lean carrier is the paper's ball-and-cell game from §6, rather than the interactive RAM machine model of §2. The game relaxes the simulation by giving the player free memory of ball locations and advance knowledge of requests. Balls, cells, and rounds use finite types Fin m and Fin t; these are zero-based encodings of the paper's [m][m][m] and round labels. Action steps are counted from one, with the initial state at step zero. PMF represents the player's discrete probability distributions, and equality of PMF.map visible represents observer independence. Every positive-probability run must be legal and satisfy its requests. The visible and hidden sequences have the same finite length qqq.

The two printed estimates bqb^qbq and bq(b+2)q>mtb^q(b+2)^q>m^tbq(b+2)q>mt are false: with m=b=q=2m=b=q=2m=b=q=2 and t=7t=7t=7, taking both balls in two accesses satisfies all 27=1282^7=12827=128 request sequences, while the printed product is 646464. Footnote 29's (qt)bt\binom qt b^t(tq​)bt also vanishes in this example. The formal milestones use Nat.multichoose q t to accommodate repeated round ends; at q=t=0q=t=0q=t=0 its value is defined directly, so no negative binomial upper index is used. The logarithm in the goal is the natural logarithm, and a threshold TbT_bTb​ handles small ttt.

Correctness and legality are part of the player type, so an unrestricted sequence of cell names cannot satisfy the mission by bypassing the hand and cell rules. Obliviousness uses equality of full distributions, and the goal quantifies over every supported run. The required development includes finite-state transition reasoning, finite combinatorial counts, PMF support and mapping, and real logarithm estimates. These components, especially the game interface and support lemmas, can be reused by later access-pattern formalizations.

Selected references

  • Oded Goldreich and Rafail Ostrovsky, Software protection and simulation on oblivious RAMs, Journal of the ACM 43(3):431–473, 1996. DOI: 10.1145/233551.233553. Theorem 6.1 and its proof are on pp. 469–470; the informal Theorem 1.2.2 is on p. 437.
7 thms1 active userReviewed
CombinatoricsGraph TheoryOperations Research+1·Captain: mikedeng1

Inapproximability of Edge-Disjoint Paths and Low Congestion Routing on Undirected Graphs: A Random Hypergraph Instance Gives the Flow Relaxation an Integrality Gap of β₁/(4c) at Congestion c − 1Research Paper

Motivation

In the edge-disjoint paths problem (EDP) one is given an undirected graph and a list of source–sink pairs, and asks how many pairs can be connected simultaneously by paths that share no edge. Its relaxation EDP with congestion (EDPwC) allows every edge to carry up to a fixed number of paths. Both are central problems of network routing and of approximation algorithms, and the standard algorithmic tool for them is the multicommodity flow relaxation: a linear program that may split each pair's unit of demand fractionally over many paths. Rounding this LP is how most approximation algorithms for routing work, so the ratio between its optimum and the best integral routing, the integrality gap, bounds what any LP-based algorithm can achieve.

Without congestion the gap of this relaxation can be as large as Ω(V)\Omega(\sqrt V)Ω(V​) (Chekuri–Khanna–Shepherd 2006), and the question is how much a small congestion helps. Andrews, Chuzhoy, Guruswami, Khanna, Talwar and Zhang (Combinatorica 2010) proved hardness of approximation for EDPwC (their Theorems 1 and 2) and, independently and unconditionally, that the gap of the relaxation remains (log⁡V)Ω(1/c)(\log V)^{\Omega(1/c)}(logV)Ω(1/c) even when the integral solution may use congestion c−1c-1c−1 (their Theorem 5). In particular, for every fixed integer iii the gap between (1/i)(1/i)(1/i)-integral and fractional multicommodity flow in undirected graphs is superconstant. This mission formalizes Theorem 5 for EDPwC.

Setting

Fix integers n≥1n\ge1n≥1 and c≥2c\ge2c≥2. Write log⁡\loglog for log⁡2\log_2log2​ and ln⁡\lnln for the natural logarithm, and set

β1=14(log⁡n150(log⁡log⁡n)2)1/c,β2=6(2β1)c−1ln⁡β1.\beta_1=\frac14\Big(\frac{\log n}{150(\log\log n)^2}\Big)^{1/c},\qquad \beta_2=6(2\beta_1)^{c-1}\ln\beta_1 .β1​=41​(150(loglogn)2logn​)1/c,β2​=6(2β1​)c−1lnβ1​.

A random ccc-uniform hypergraph HHH on the vertex set {0,…,n−1}\{0,\dots,n-1\}{0,…,n−1} has m=⌊β2n⌋m=\lfloor\beta_2 n\rfloorm=⌊β2​n⌋ hyperedges h0,…,hm−1h_0,\dots,h_{m-1}h0​,…,hm−1​, chosen independently, each uniformly among the ccc-element subsets of the vertices.

From HHH one builds a graph G=G(H)G=G(H)G=G(H). For every hyperedge hih_ihi​ it has two vertices ℓi,ri\ell_i,r_iℓi​,ri​ joined by a special edge; for every vertex vvv of HHH it has a source s(v)s(v)s(v) and a sink t(v)t(v)t(v). If vvv lies in the hyperedges hi1,…,hikh_{i_1},\dots,h_{i_k}hi1​​,…,hik​​ with i1<⋯<iki_1<\dots<i_ki1​<⋯<ik​, the regular edges (s(v),ℓi1)(s(v),\ell_{i_1})(s(v),ℓi1​​), (rij,ℓij+1)(r_{i_j},\ell_{i_{j+1}})(rij​​,ℓij+1​​) for 1≤j<k1\le j<k1≤j<k, and (rik,t(v))(r_{i_k},t(v))(rik​​,t(v)) are added. The canonical path of vvv is P(v)=(s(v),ℓi1,ri1,…,ℓik,rik,t(v))P(v)=(s(v),\ell_{i_1},r_{i_1},\dots,\ell_{i_k},r_{i_k},t(v))P(v)=(s(v),ℓi1​​,ri1​​,…,ℓik​​,rik​​,t(v)); it crosses the special edge of every hyperedge containing vvv. The EDP instance has one pair (s(v),t(v))(s(v),t(v))(s(v),t(v)) for each vvv.

A feasible fractional solution puts flow f(P)∈[0,1]f(P)\in[0,1]f(P)∈[0,1] on s(v)s(v)s(v)–t(v)t(v)t(v) paths PPP, with routed amount xv=∑Pf(P)≤1x_v=\sum_P f(P)\le1xv​=∑P​f(P)≤1 for each pair and at most one unit of flow through each edge; its value is ∑vxv\sum_v x_v∑v​xv​. An integral routing with congestion at most c−1c-1c−1 connects a set of pairs, each by one path, so that every edge lies on at most c−1c-1c−1 of these paths; its value is the number of connected pairs.

The analysis uses three events of HHH: E1\mathcal E_1E1​, that some set of n/β1n/\beta_1n/β1​ vertices contains no hyperedge; E2\mathcal E_2E2​, that more than n/β1n/\beta_1n/β1​ vertices lie in more than 10β2c10\beta_2c10β2​c hyperedges; and E3(g)\mathcal E_3(g)E3​(g), that the graph G′G'G′ obtained from GGG by contracting every special edge has more than (6β2c2)g+1(6\beta_2c^2)^{g+1}(6β2​c2)g+1 cycles of length at most ggg.

Formalization targets

Goal: Theorem 5 for EDPwC, in the explicit form of Section 2

There are absolute constants α>0\alpha>0α>0 and N0N_0N0​ such that for all n≥N0n\ge N_0n≥N0​ and all integers ccc with 2≤c≤αlog⁡log⁡n/log⁡log⁡log⁡n2\le c\le\alpha\log\log n/\log\log\log n2≤c≤αloglogn/logloglogn some hypergraph HHH as above satisfies

∃ fractional solution of G(H) of value ncandevery congestion-(c−1) routing of G(H) routes ≤4nβ1 pairs,\exists\ \text{fractional solution of } G(H)\ \text{of value } \frac nc\qquad\text{and}\qquad \text{every congestion-}(c-1)\text{ routing of } G(H)\ \text{routes}\ \le\frac{4n}{\beta_1}\ \text{pairs},∃ fractional solution of G(H) of value cn​andevery congestion-(c−1) routing of G(H) routes ≤β1​4n​ pairs,

so the integrality gap is at least β1/(4c)\beta_1/(4c)β1​/(4c). The paper's Theorem 5 states this as Ω(1c(log⁡V/(log⁡log⁡V)2)1/(c+1))\Omega\big(\frac1{c}(\log V/(\log\log V)^2)^{1/(c+1)}\big)Ω(c1​(logV/(loglogV)2)1/(c+1)) for congestion ccc and VVV vertices; the goal keeps the paper's own Section 2 parameters, which fix the instance and leave the constants α,N0\alpha,N_0α,N0​ open.

Milestones

Lemma 6, Lemma 7 and Lemma 8 (Pr⁡[E1],Pr⁡[E2],Pr⁡[E3(g)]≤14\Pr[\mathcal E_1],\Pr[\mathcal E_2],\Pr[\mathcal E_3(g)]\le\frac14Pr[E1​],Pr[E2​],Pr[E3​(g)]≤41​); the joint good event of Section 2.4; the fractional solution of value n/cn/cn/c; and the three bounds of the gap analysis, ∣P1∣≤n/β1|\mathcal P_1|\le n/\beta_1∣P1​∣≤n/β1​ (canonical paths), ∣P2∣≤n/β1|\mathcal P_2|\le n/\beta_1∣P2​∣≤n/β1​ (long non-canonical paths), ∣P3∣≤n/β1+2gc(6β2c2)2g+2|\mathcal P_3|\le n/\beta_1+2gc(6\beta_2c^2)^{2g+2}∣P3​∣≤n/β1​+2gc(6β2​c2)2g+2 (short non-canonical paths), combined into ∣P′∣≤4n/β1|\mathcal P'|\le4n/\beta_1∣P′∣≤4n/β1​.

Significance

The result shows that the multicommodity flow relaxation cannot certify a constant-factor approximation for undirected EDPwC with any constant congestion: against integral solutions of congestion c−1c-1c−1 its gap is at least (log⁡V)Ω(1/c)(\log V)^{\Omega(1/c)}(logV)Ω(1/c). Any algorithm that compares its output with this LP inherits the bound. It complements the paper's hardness results, which hold only under a complexity assumption. The instance is a short explicit construction from a random hypergraph, so the theorem is also a statement in probabilistic combinatorics: random sparse uniform hypergraphs are, with constant probability, simultaneously "covering" (no large hyperedge-free set), of bounded degree, and nearly free of short cycles.

The result is proved in the paper; to our knowledge it has no machine-checked proof. The mission produces one: a formal model of the path LP and of congestion-bounded integral routings on simple graphs, reusable for other routing gaps; a formal random-hypergraph model with first-moment and Chernoff-type estimates; and the deterministic gap analysis. Variants with better constants, or the stronger statement that at least a quarter of all hypergraphs work, are welcome as additional results.

Difficulty

The fractional side and the bound on canonical routings are short. The difficulty lies in two places. First, Lemma 8 bounds the expected number of short cycles of G′G'G′; the adjacency of G′G'G′ depends on all hyperedges at once (consecutiveness along each vertex's sequence), and the obvious estimate through the intersection graph of HHH fails, because many hyperedges through a common vertex form a clique there. What keeps the count small is the order structure of each vertex's hyperedge sequence, which the intersection graph forgets. Second, the bound on short non-canonical paths requires turning two distinct routing paths of a pair into a short cycle of the contracted graph and charging it with the congestion constraint. Finally, the closing estimate 2gc(6β2c2)2g+2≤n/β12gc(6\beta_2c^2)^{2g+2}\le n/\beta_12gc(6β2​c2)2g+2≤n/β1​ holds only for large nnn in the stated range of ccc, and the printed chain for it is not literally correct, so the asymptotics have to be done afresh.

Formalization scope

Vertices of HHH are Fin n, hyperedges are indexed by Fin m with m=⌊β2n⌋m=\lfloor\beta_2n\rfloorm=⌊β2​n⌋, and HHH is an element of Fin m → {s : Finset (Fin n) // s.card = c}; probabilities are normalized counts over this finite set (uniform measure, which is independence of the hyperedges). The conventions are:

  • log⁡=log⁡2\log=\log_2log=log2​ and ln⁡\lnln is natural; β1\beta_1β1​ uses a real 1/c1/c1/c-th power.
  • The paper's integers β2n\beta_2nβ2​n, n/β1n/\beta_1n/β1​ (bad-set size) and g=3β1β2c2g=3\beta_1\beta_2c^2g=3β1​β2​c2 are ⌊β2n⌋\lfloor\beta_2n\rfloor⌊β2​n⌋, ⌈n/β1⌉\lceil n/\beta_1\rceil⌈n/β1​⌉ and ⌈3β1β2c2⌉\lceil3\beta_1\beta_2c^2\rceil⌈3β1​β2​c2⌉; the thresholds n/β1n/\beta_1n/β1​, 4n/β14n/\beta_14n/β1​, 10β2c10\beta_2c10β2​c, (6β2c2)g+1(6\beta_2c^2)^{g+1}(6β2​c2)g+1 stay real.
  • "For sufficiently large nnn" and c≤O(log⁡log⁡n/log⁡log⁡log⁡n)c\le O(\log\log n/\log\log\log n)c≤O(loglogn/logloglogn) become absolute constants N0N_0N0​ and α\alphaα, quantified before nnn and ccc. Lemma 8 and the deterministic bounds carry instead the explicit inequalities on β1,β2\beta_1,\beta_2β1​,β2​ their arguments use.
  • G(H)G(H)G(H) is a simple graph (coinciding regular edges are one edge). A vertex in no hyperedge gets the edge (s(v),t(v))(s(v),t(v))(s(v),t(v)), the k=0k=0k=0 case of its canonical path; the page leaves this case out.
  • KgK_gKg​ counts cycles of G′G'G′, each once as an edge set; the paper's definition says "in GGG", its proof and use say G′G'G′.
  • Routing paths are paths (no repeated vertex); lengths count edges of G(H)G(H)G(H); canonicity is equality of vertex sequences.

The goal cannot be met by an unrelated graph: the instance must be G(H)G(H)G(H) for a hypergraph with exactly ⌊β2n⌋\lfloor\beta_2n\rfloor⌊β2​n⌋ hyperedges of size ccc on nnn vertices, the fractional solution must respect xv≤1x_v\le1xv​≤1 and capacity 111, and the integral bound is over all routings of congestion c−1c-1c−1.

Not in scope: the ANFwC half of Theorem 5, the remark on a superconstant gap at c=Θ(log⁡log⁡V/(log⁡log⁡log⁡V)2)c=\Theta(\log\log V/(\log\log\log V)^2)c=Θ(loglogV/(logloglogV)2), and the hardness results of Sections 3–5 (Theorems 1 and 2, Corollaries 3 and 4).

A complete development needs Chernoff and Markov bounds for counting measures, binomial-coefficient estimates, cycle extraction from two distinct paths in a simple graph, and the asymptotic estimates for β1,β2\beta_1,\beta_2β1​,β2​. The routing and LP definitions and the cycle-extraction lemma are reusable beyond this mission.

Selected references

  • M. Andrews, J. Chuzhoy, V. Guruswami, S. Khanna, K. Talwar, L. Zhang, Inapproximability of Edge-Disjoint Paths and Low Congestion Routing on Undirected Graphs, Combinatorica 30(5), 485–520, 2010. https://doi.org/10.1007/s00493-010-2455-9
  • C. Chekuri, S. Khanna, F. B. Shepherd, An O(n)O(\sqrt n)O(n​) approximation and integrality gap for disjoint paths and unsplittable flow, Theory of Computing 2, 137–146, 2006. https://doi.org/10.4086/toc.2006.v002a007
12 thms1 active userReviewed
Computational GeometryDiscrete Geometry·Captain: mikedeng1

An Optimal Algorithm for Approximate Nearest Neighbor Searching in Fixed Dimensions: Priority Search in a BBD-Tree Visits at Most ⌈1 + 6d/ε⌉^d Leaf CellsResearch Paper

Motivation

Nearest neighbor searching asks for a data structure that stores nnn points S⊂RdS\subset\mathbb R^dS⊂Rd and, given a query point qqq, returns a point of SSS closest to qqq. It underlies classification, vector quantization, data compression, pattern recognition and similarity search in databases. In dimension d≥3d\ge 3d≥3, exact methods either use space growing like n⌈d/2⌉n^{\lceil d/2\rceil}n⌈d/2⌉ or answer queries in time close to linear in nnn, so practical systems settle for an approximate answer: a point whose distance to qqq is within a factor 1+ε1+\varepsilon1+ε of the true nearest distance.

Arya, Mount, Netanyahu, Silverman and Wu (J. ACM 45 (1998), 891–923) gave the first structure for this problem that is simultaneously of linear size, built in O(dnlog⁡n)O(dn\log n)O(dnlogn) time, and answers (1+ε)(1+\varepsilon)(1+ε)-approximate queries in O(cd,εlog⁡n)O(c_{d,\varepsilon}\log n)O(cd,ε​logn) time for any fixed ddd, with cd,ε≤d⌈1+6d/ε⌉dc_{d,\varepsilon}\le d\lceil 1+6d/\varepsilon\rceil^dcd,ε​≤d⌈1+6d/ε⌉d. The structure, the balanced box-decomposition tree (BBD-tree), and the priority search on it became the basis of the ANN library of Mount and Arya.

Timeline. Arya and Mount (SODA 1993) studied approximate nearest neighbor queries in fixed dimensions; the conference version of this paper (SODA 1994) gave an optimal algorithm; the journal version (1998), which the paper itself describes as differing from the conference version by a single balanced structure without auxiliary data structures (p. 897), is the one formalized here. Later work, for example by Har-Peled, Indyk and Motwani (2012), addressed the exponential dependence on ddd.

Setting

Points are vectors in Rd\mathbb R^dRd. For an integer m≥1m\ge1m≥1 the LmL_mLm​ distance is dist⁡m(x,y)=(∑i∣xi−yi∣m)1/m\operatorname{dist}_m(x,y)=(\sum_i|x_i-y_i|^m)^{1/m}distm​(x,y)=(∑i​∣xi​−yi​∣m)1/m, and for m=∞m=\inftym=∞ it is max⁡i∣xi−yi∣\max_i|x_i-y_i|maxi​∣xi​−yi​∣. A rectangle is a product ∏i[ℓi,hi]\prod_i[\ell_i,h_i]∏i​[ℓi​,hi​] of closed intervals; its size is the length of its longest side. A box is a rectangle with positive sides whose aspect ratio, longest over shortest side, is at most 333.

A cell consists of an outer box bOb_ObO​ and an optional inner box bIb_IbI​; as a point set it is bOb_ObO​, or the closure of bO∖bIb_O\setminus b_IbO​∖bI​. Its size is the size of bOb_ObO​. The inner box must be sticky for the outer one: in every coordinate, each of the two gaps between the inner and the outer interval is either 000 or at least the width of the inner interval.

A BBD-tree subdivides a root box by two operations. A fair split cuts a cell by a hyperplane xi=tx_i=txi​=t into a low and a high child; a shrink cuts it by a shrinking box bbb into an inner child (outer box bbb) and an outer child (outer box unchanged, inner box bbb). Throughout, every box has aspect ratio at most 333, a parent's inner box lies entirely within one child (within the inner child of a shrink), and inner boxes are sticky. The cells at the leaves are the leaf cells; they cover the root box and have disjoint interiors.

The distance from qqq to a cell ccc is dist⁡m(q,c)=inf⁡x∈cdist⁡m(q,x)\operatorname{dist}_m(q,c)=\inf_{x\in c}\operatorname{dist}_m(q,x)distm​(q,c)=infx∈c​distm​(q,x). Each leaf cell cjc_jcj​ carries an associated data point pjp_jpj​ in its outer box. The search enumerates the leaf cells c0,c1,…c_0,c_1,\dotsc0​,c1​,… in nondecreasing order of distance from qqq, processes each by comparing its point with the closest point ppp seen so far, and terminates at the first cell whose distance from qqq exceeds dist⁡m(q,p)/(1+ε)\operatorname{dist}_m(q,p)/(1+\varepsilon)distm​(q,p)/(1+ε). The goal bounds NNN, the number of cells that did not cause termination, which is the count the paper's proof bounds ("the number of cells visited up until termination", p. 912).

Formalization targets

Goal: Lemma 5 (p. 911)

For every valid BBD-tree, every Minkowski metric 1≤m≤∞1\le m\le\infty1≤m≤∞, every ε>0\varepsilon>0ε>0, every query point and every sorted enumeration of the leaf cells,

N≤⌈1+6dε⌉d.N\le\Big\lceil 1+\frac{6d}{\varepsilon}\Big\rceil^d.N≤⌈1+ε6d​⌉d.

Milestones

The packing constraint (Lemma 4, p. 908): for r,s>0r,s>0r,s>0, the number of leaf cells of size at least sss meeting an open LmL_mLm​ ball of radius rrr is at most

⌈1+6rs⌉d.\Big\lceil 1+\frac{6r}{s}\Big\rceil^d.⌈1+s6r​⌉d.

Its proof has three stated steps, each a milestone: an LmL_mLm​ ball of radius rrr lies in an axis-parallel cube of side 2r2r2r; at most ⌈1+6r/s⌉d\lceil1+6r/s\rceil^d⌈1+6r/s⌉d interior-disjoint boxes of side at least s/3s/3s/3 meet such a ball; and the leaf cells of size at least sss meeting the ball can be replaced by as many interior-disjoint boxes of size at least sss meeting it. The proof of Lemma 5 contributes two more: the LmL_mLm​ diameter of a rectangle is at most ddd (indeed d1/md^{1/m}d1/m) times its longest side, and every visited cell has size at least rε/dr\varepsilon/drε/d, where rrr is the distance to the last cell that did not cause termination.

A companion statement records the correctness of the termination rule: the closest point processed is a (1+ε)(1+\varepsilon)(1+ε)-approximate nearest neighbor.

Significance

Lemma 5 is the explicit content of the query bound of Theorem 1(i): each visited cell costs O(dlog⁡n)O(d\log n)O(dlogn) time to enumerate and process, so the query takes O(d⌈1+6d/ε⌉dlog⁡n)O(d\lceil1+6d/\varepsilon\rceil^d\log n)O(d⌈1+6d/ε⌉dlogn) time, with no dependence on nnn beyond the logarithm. Lemma 4 is the property of the subdivision on which this rests, and it is used again for the kkk-nearest-neighbor variant (Lemma 6) and for approximate range searching with the same tree.

The results are proved on paper and widely cited; none has a machine-checked proof. The mission produces checked versions of the packing constraint and of the cell-count bound for an abstract BBD-tree, defined by its invariants rather than by a particular construction algorithm, so that any construction meeting the invariants inherits the bound. It also exposes two places where the printed argument needs care: the open versus closed ball in Lemma 4, and the step in Lemma 5 that applies Lemma 4 to cells within distance rrr of qqq, which touch the closed ball of radius rrr.

Difficulty

The counting step of Lemma 4 is asserted on the page ("the densest packing of axis-aligned rectangles of side length at least s/3s/3s/3 is realized by a regular grid"), and a formal argument must replace that sentence with a genuine counting argument. The replacement step is the geometric core: the outer box of a leaf cell with an inner box overlaps every leaf cell inside that inner box, so outer boxes cannot be counted directly, and without stickiness many nested inner boxes could crowd against one face of a cell. Applying Lemma 4 inside Lemma 5 is not immediate either: the visited cells lie within distance rrr of qqq, so they meet the closed ball, while Lemma 4 concerns the open ball, and a naive enlargement of the radius changes the ceiling exactly when 6d/ε6d/\varepsilon6d/ε is an integer.

Formalization scope

Points are Fin d → ℝ, the metric index mmm is an element of ℕ∞ with 1≤m1\le m1≤m, and the LmL_mLm​ distance is defined explicitly by the formula above. Rectangles are pairs of corner vectors; boxes have positive sides and aspect ratio at most 333. A cell's point set is the closure of the outer box minus the inner box, as the paper's "cells are considered to be closed" requires; an inner box equal to its outer box is excluded. A BBD-tree is an inductive tree of splits and shrinks with a validity predicate expressing the §2.1 invariants relative to the root cell; the root may be any box rather than the paper's hypercube, and the construction algorithms of §2.2–§2.5 are not formalized.

The enumeration is a list of (leaf cell, associated point) pairs that is a permutation of the leaf cells, sorted by distance from qqq, with each point in its cell's outer box. A cell is processed before its own termination test, and NNN counts the cells processed before the cell whose test fires (all cells if none fires). Lemma 4 and its counting step use the open ball of property (d). Theorem 1's O(⋅)O(\cdot)O(⋅) time and space claims, Lemmas 1–3 on the construction, and the kkk-nearest-neighbor Lemma 6 are out of scope.

This convention follows the proof of Lemma 5, which takes rrr to be the distance to "the last leaf cell that did not cause the algorithm to terminate" and bounds the cells up to that one. If the cell whose test fires is also counted, the printed bound can be exceeded by one: a valid one-dimensional tree with ε=6\varepsilon=6ε=6 needs three processed cells against ⌈1+6d/ε⌉d=2\lceil 1+6d/\varepsilon\rceil^d=2⌈1+6d/ε⌉d=2. The formal goal therefore states the bound for the cells that did not cause termination, which is what the proof establishes; consequently at most ⌈1+6d/ε⌉d+1\lceil 1+6d/\varepsilon\rceil^d+1⌈1+6d/ε⌉d+1 cells are processed in total.

The goal must not be trivialized: the enumeration must contain every leaf cell (an empty enumeration would give N=0N=0N=0), it must be sorted, cells must be closed sets rather than outer boxes minus open inner boxes (which leaves isolated boundary points and makes the goal false), and no size bound or packing fact may be assumed in the goal.

Contributions welcome: proofs of the milestones in any order, general lemmas on LmL_mLm​ distances and interior-disjoint boxes (reusable beyond this mission), and a construction of valid BBD-trees from the paper's midpoint or middle-interval rules.

Selected references

  • S. Arya, D. M. Mount, N. S. Netanyahu, R. Silverman, A. Y. Wu, An optimal algorithm for approximate nearest neighbor searching in fixed dimensions, J. ACM 45(6):891–923, 1998. https://doi.org/10.1145/293347.293348
  • S. Arya, D. M. Mount, Approximate nearest neighbor queries in fixed dimensions, Proc. 4th ACM-SIAM SODA, 271–280, 1993 (reference [Arya and Mount 1993b] of the main paper, https://doi.org/10.1145/293347.293348).
  • S. Arya, D. M. Mount, N. S. Netanyahu, R. Silverman, A. Y. Wu, An optimal algorithm for approximate nearest neighbor searching in fixed dimensions, Proc. 5th ACM-SIAM SODA, 573–582, 1994 (reference [Arya et al. 1994] of the main paper).
  • D. M. Mount, S. Arya, ANN: A library for approximate nearest neighbor searching. https://www.cs.umd.edu/~mount/ANN/
  • S. Har-Peled, P. Indyk, R. Motwani, Approximate nearest neighbor: towards removing the curse of dimensionality, Theory of Computing 8:321–350, 2012. https://doi.org/10.4086/toc.2012.v008a014
8 thms1 active userReviewed
CombinatoricsGraph TheoryLinear Optimization+1·Captain: mikedeng1

The Geometry of Graphs and Some of Its Algorithmic Applications 1: Every Multicommodity Flow Network with k Source-Sink Pairs Has a Cut S with Cap(S)/Dem(S) ≤ O(log k) · maxflowResearch Paper

Motivation

Routing several commodities through one capacitated network at the same time is a basic problem of network optimization, with applications to communication networks, VLSI layout and divide-and-conquer graph algorithms. Its optimum is the value of a linear program, but the natural certificates of an upper bound are combinatorial: every cut of the network limits how much can be routed across it. For a single commodity the max-flow min-cut theorem says that the best cut certificate is exact. With many commodities it is not, and the size of the gap between the best flow and the best cut is the question of this mission.

  • 1988–1999, Leighton and Rao proved that for uniform demands (one unit between every pair of vertices) the gap is O(log⁡n)O(\log n)O(logn) on an nnn-vertex network, and that the bound is attained on expanders (Leighton–Rao, JACM 1999; FOCS 1988).
  • 1990–1995, Klein, Rao, Agrawal and Ravi extended a polylogarithmic bound to arbitrary demands, O(log⁡Clog⁡D)O(\log C \log D)O(logClogD) in the total capacity CCC and total demand DDD (Combinatorica 15, 1995); Plotkin and Tardos improved it to O(log⁡2k)O(\log^2 k)O(log2k) in the number of commodities kkk (Combinatorica 15, 1995).
  • 1995, Linial, London and Rabinovich (Combinatorica 15, 1995), and independently Aumann and Rabani (SIAM J. Comput. 1998), showed that the gap is bounded by the least distortion of embedding a metric derived from the network into ℓ1\ell_1ℓ1​, and obtained the bound O(log⁡k)O(\log k)O(logk) from Bourgain's embedding theorem. This mission formalizes that theorem, Theorem 4.1 of the Linial–London–Rabinovich paper.

Setting

A multicommodity flow network has a finite vertex set VVV, capacities Ci,j=Cj,i≥0C_{i,j} = C_{j,i} \ge 0Ci,j​=Cj,i​≥0 (zero for non-edges and on the diagonal), and kkk commodities: commodity μ\muμ has a source sμs_\musμ​, a sink tμt_\mutμ​ and a demand Dμ≥0D_\mu \ge 0Dμ​≥0.

A feasible concurrent flow of value λ\lambdaλ sends, for every μ\muμ, λDμ\lambda D_\muλDμ​ units of commodity μ\muμ from sμs_\musμ​ to tμt_\mutμ​: arc flows fμ(i,j)≥0f_\mu(i,j) \ge 0fμ​(i,j)≥0 satisfy conservation of matter, with net outflow λDμ\lambda D_\muλDμ​ at sμs_\musμ​, −λDμ-\lambda D_\mu−λDμ​ at tμt_\mutμ​ and 000 elsewhere, and the total flow of all commodities through each undirected edge {i,j}\{i,j\}{i,j}, in both directions, is at most Ci,jC_{i,j}Ci,j​. The maxflow of the network is the largest such λ\lambdaλ.

For S⊆VS \subseteq VS⊆V, Cap(S)=∑i∈S∑j∉SCi,j\mathrm{Cap}(S) = \sum_{i \in S}\sum_{j \notin S} C_{i,j}Cap(S)=∑i∈S​∑j∈/S​Ci,j​ is the capacity of the edges leaving SSS, and Dem(S)\mathrm{Dem}(S)Dem(S) is the total demand of the pairs that SSS separates, i.e. with ∣S∩{sμ,tμ}∣=1|S \cap \{s_\mu,t_\mu\}| = 1∣S∩{sμ​,tμ​}∣=1. Every flow of value λ\lambdaλ has to push λ Dem(S)\lambda\,\mathrm{Dem}(S)λDem(S) units across the cut, so

maxflow≤Cap(S)Dem(S)for every S with Dem(S)>0.\mathrm{maxflow} \le \frac{\mathrm{Cap}(S)}{\mathrm{Dem}(S)} \quad\text{for every } S \text{ with } \mathrm{Dem}(S) > 0.maxflow≤Dem(S)Cap(S)​for every S with Dem(S)>0.

A semi-metric on VVV is a function d≥0d \ge 0d≥0 with d(i,i)=0d(i,i) = 0d(i,i)=0, symmetry and the triangle inequality; distinct points may be at distance 000, as in the paper.

Formalization targets

Goal: Theorem 4.1

There is an absolute constant C0>0C_0 > 0C0​>0 such that every network in which some commodity has Dμ>0D_\mu > 0Dμ​>0 and sμ≠tμs_\mu \ne t_\musμ​=tμ​ has a set S⊆VS \subseteq VS⊆V with Dem(S)>0\mathrm{Dem}(S) > 0Dem(S)>0 and

Cap(S)Dem(S)≤C0log⁡(max⁡(k,2))⋅maxflow.\frac{\mathrm{Cap}(S)}{\mathrm{Dem}(S)} \le C_0 \log(\max(k,2)) \cdot \mathrm{maxflow}.Dem(S)Cap(S)​≤C0​log(max(k,2))⋅maxflow.

The constant is not fixed; only the shape O(log⁡k)O(\log k)O(logk) in the number of commodities is asserted.

Milestones, in the order the proof uses them

  1. Weak duality (§4, p. 226): λ Dem(S)≤Cap(S)\lambda\,\mathrm{Dem}(S) \le \mathrm{Cap}(S)λDem(S)≤Cap(S) for every feasible λ≥0\lambda \ge 0λ≥0 and every SSS.
  2. LP duality display (p. 227): maxflow=min⁡d∑{i,j}Ci,jdi,j∑μDμdsμ,tμ\mathrm{maxflow} = \min_d \dfrac{\sum_{\{i,j\}} C_{i,j} d_{i,j}}{\sum_\mu D_\mu d_{s_\mu,t_\mu}}maxflow=mind​∑μ​Dμ​dsμ​,tμ​​∑{i,j}​Ci,j​di,j​​ over semi-metrics ddd.
  3. Corollary 3.4, Claim 2 (p. 223): every finite semi-metric space with kkk marked pairs has a non-expanding map into some ℓ1m\ell_1^mℓ1m​ that shrinks each marked pair by at most C1log⁡(max⁡(k,2))C_1 \log(\max(k,2))C1​log(max(k,2)).
  4. Coordinate minimum (p. 227): for points of ℓ1m\ell_1^mℓ1m​, the cost-to-demand ratio is at least its value on the best single coordinate.
  5. 0/1 rounding (pp. 227–228): for symmetric real weights aaa and nonnegative symmetric weights bbb, the minimum of ∑aij∣zi−zj∣/∑bij∣zi−zj∣\sum a_{ij}|z_i - z_j| / \sum b_{ij}|z_i - z_j|∑aij​∣zi​−zj​∣/∑bij​∣zi​−zj​∣ over real vectors zzz is attained at a 0/1 vector.

Significance

The theorem bounds the flow–cut gap: the integrality gap of the linear relaxation of the sparsest cut problem is O(log⁡k)O(\log k)O(logk), so solving one linear program and rounding gives an O(log⁡k)O(\log k)O(logk)-approximation to the sparsest cut. Sparsest-cut approximations are the engine of approximation algorithms for minimum bisection, graph partitioning, crossing number and VLSI layout. The dependence on kkk rather than on the number of vertices matters when few pairs carry demand. The bound is tight up to the constant: on constant-degree expanders with all-pairs unit demands the gap is Ω(log⁡n)\Omega(\log n)Ω(logn) (Leighton–Rao).

The result has been proved since 1995 and is textbook material (Williamson–Shmoys, Ch. 15). It has no machine-checked proof. A formalization adds a verified bridge between concurrent flows, LP duality on networks and ℓ1\ell_1ℓ1​ embeddings of finite metrics; each piece is reusable on its own. Corollary 3.4, Claim 2 in particular is a terminal version of Bourgain's theorem, of which no formal proof exists either.

Difficulty

Two steps carry the weight. The first is the duality between concurrent flows and metrics: Mathlib has no linear programming duality theorem in a form that applies directly, and the dual of the arc-flow program has to be identified with a minimum over semi-metrics, which needs a shortest-path argument on top of LP duality. The second is the embedding: Claim 2 of Corollary 3.4 must achieve distortion O(log⁡k)O(\log k)O(logk) on the kkk marked pairs, independent of ∣X∣|X|∣X∣. A direct application of Bourgain's theorem to the whole space gives O(log⁡∣X∣)O(\log |X|)O(log∣X∣), which is not enough when kkk is much smaller than the number of vertices, and the paper's proof is a one-line reference to an earlier argument.

Formalization scope

  • Vertex sets are finite types V with [Fintype V] [DecidableEq V]; capacities are a function C : V → V → ℝ with symmetry, nonnegativity and zero diagonal as fields of a Network structure. Commodities are indexed by Fin k; coincident or repeated pairs are allowed.
  • Flows are arc flows; the capacity bounds the total over all commodities and both directions. maxflow is the supremum of feasible values; Lean's sSup returns 000 on an unbounded set, which only happens without a commodity of positive demand and distinct endpoints, and the goal assumes one.
  • Sums over edges are over unordered pairs: the page's ∑i≠j\sum_{i \ne j}∑i=j​ in the LP-duality and coordinate displays counts each edge twice, while Cap\mathrm{Cap}Cap counts it once; the statements use 12∑i∑j\tfrac12\sum_i\sum_j21​∑i​∑j​ in both places, which removes the factor-2 slip without changing the proof.
  • Explicit constants. The paper's O(log⁡k)O(\log k)O(logk) in Theorem 4.1 is C0log⁡(max⁡(k,2))C_0 \log(\max(k,2))C0​log(max(k,2)) with C0C_0C0​ quantified before the network; the Ω(1/log⁡k)\Omega(1/\log k)Ω(1/logk) of Corollary 3.4 is 1/(C1log⁡(max⁡(k,2)))1/(C_1\log(\max(k,2)))1/(C1​log(max(k,2))) with C1C_1C1​ quantified before the metric space. The max⁡(k,2)\max(k,2)max(k,2) keeps k=1k = 1k=1 in scope, where log⁡k=0\log k = 0logk=0.
  • Out of scope. The deterministic polynomial-time algorithms of Theorem 4.1 and Corollary 3.4, and the target dimension ℓ1O(n2)\ell_1^{O(n^2)}ℓ1O(n2)​ of the latter, are not stated; the statements assert the existence of the cut and of the embedding.
  • The 0/1 rounding step adds b≥0b \ge 0b≥0, which the page omits but its argument needs.
  • A trivializing formalization is ruled out: the constant C0C_0C0​ is quantified before the network, so it cannot depend on the instance, and maxflow is defined from flows, not as the metric minimum.
  • Contributions welcome: an LP duality theorem for finite-dimensional linear programs in the form needed here, a formal Bourgain-type embedding with terminal distortion, and the max-flow min-cut theorem for undirected capacities.

Selected references

  • N. Linial, E. London, Y. Rabinovich, The geometry of graphs and some of its algorithmic applications, Combinatorica 15 (1995) 215–245. https://doi.org/10.1007/BF01200757
  • Y. Aumann, Y. Rabani, An O(log k) approximate min-cut max-flow theorem and approximation algorithm, SIAM J. Comput. 27 (1998) 291–301. https://doi.org/10.1137/S0097539794285983
  • T. Leighton, S. Rao, Multicommodity max-flow min-cut theorems and their use in designing approximation algorithms, J. ACM 46 (1999) 787–832. https://doi.org/10.1145/331524.331526
  • J. Bourgain, On Lipschitz embedding of finite metric spaces in Hilbert space, Israel J. Math. 52 (1985) 46–52. https://doi.org/10.1007/BF02776078
  • D. P. Williamson, D. B. Shmoys, The Design of Approximation Algorithms, Cambridge University Press, 2011, Chapter 15. https://doi.org/10.1017/CBO9780511921735
9 thms1 active userReviewed
AlgebraNumber Theory·Captain: mikedeng1

Factoring Polynomials with Rational Coefficients III: A Reduced Basis of the Lattice of Multiples of h mod p^k Finds the Irreducible Factor h₀ = gcd(b₁, …, b_t)Research Paper

Motivation

Factoring a polynomial with rational coefficients into irreducible factors is one of the basic tasks of computer algebra. Before 1982 the standard method (Berlekamp's algorithm modulo a small prime, Hensel lifting, then recombination of the ppp-adic factors, as in Zassenhaus's approach) could take exponential time, because the number of ways to recombine modular factors grows exponentially with the number of factors. A. K. Lenstra, H. W. Lenstra, Jr. and L. Lovász gave the first deterministic polynomial-time algorithm for factoring primitive polynomials in Z[X]\mathbb Z[X]Z[X] (Math. Ann. 261, 1982). Its key idea is to replace recombination by a search for a short vector in a lattice, and the lattice basis reduction algorithm introduced for that purpose (the LLL algorithm) has since become a standard tool in number theory, cryptanalysis and integer programming.

Section 2 of the paper, Factors and Lattices, is the bridge between the two halves: it shows that an irreducible factor of fff can be read off from a reduced basis of a lattice built from a ppp-adic factor of fff. This mission formalizes that section.

Timeline. Mignotte (1974) bounded the coefficients of a factor of an integer polynomial in terms of the polynomial itself. A. K. Lenstra (Mathematisch Centrum report IW 190/81, 1981, Theorem 2) proved the weaker statement that, under the same conditions, a short lattice vector has a nontrivial gcd with fff. LLL (1982) proved the sharper Propositions (2.7), (2.13) and (2.16) used here, which pin down the irreducible factor h0h_0h0​ itself.

Setting

For g=∑iaiXig=\sum_i a_iX^ig=∑i​ai​Xi with real coefficients, the length of ggg is ∣g∣=(∑iai2)1/2|g|=(\sum_i a_i^2)^{1/2}∣g∣=(∑i​ai2​)1/2. For a positive integer qqq, (g mod q)(g\bmod q)(gmodq) is the polynomial over Z/qZ\mathbb Z/q\mathbb ZZ/qZ obtained by reducing every coefficient modulo qqq.

Throughout, ppp is a prime number, kkk a positive integer, and f∈Z[X]f\in\mathbb Z[X]f∈Z[X] a polynomial of degree n>0n>0n>0. A polynomial h∈Z[X]h\in\mathbb Z[X]h∈Z[X] is fixed with

  • (2.1) hhh has leading coefficient 111;
  • (2.2) (h mod pk)(h\bmod p^k)(hmodpk) divides (f mod pk)(f\bmod p^k)(fmodpk) in (Z/pkZ)[X](\mathbb Z/p^k\mathbb Z)[X](Z/pkZ)[X];
  • (2.3) (h mod p)(h\bmod p)(hmodp) is irreducible in Fp[X]\mathbb F_p[X]Fp​[X];
  • (2.4) (h mod p)2(h\bmod p)^2(hmodp)2 does not divide (f mod p)(f\bmod p)(fmodp) in Fp[X]\mathbb F_p[X]Fp​[X].

Write l=deg⁡hl=\deg hl=degh, so 0<l≤n0<l\le n0<l≤n. Proposition (2.5) shows that fff has an irreducible factor h0∈Z[X]h_0\in\mathbb Z[X]h0​∈Z[X] with (h mod p)∣(h0 mod p)(h\bmod p)\mid(h_0\bmod p)(hmodp)∣(h0​modp), unique up to sign; this is the factor the section recovers.

Fix an integer m≥lm\ge lm≥l. The lattice LLL is the set of polynomials g∈Z[X]g\in\mathbb Z[X]g∈Z[X] of degree at most mmm such that (h mod pk)(h\bmod p^k)(hmodpk) divides (g mod pk)(g\bmod p^k)(gmodpk). Identifying ∑i=0maiXi\sum_{i=0}^m a_iX^i∑i=0m​ai​Xi with (a0,…,am)∈Rm+1(a_0,\dots,a_m)\in\mathbb R^{m+1}(a0​,…,am​)∈Rm+1, LLL is a lattice of rank m+1m+1m+1 with basis {pkXi:0≤i<l}∪{hXj:0≤j≤m−l}\{p^kX^i:0\le i<l\}\cup\{hX^j:0\le j\le m-l\}{pkXi:0≤i<l}∪{hXj:0≤j≤m−l} and determinant pklp^{kl}pkl.

A basis b1,…,bm+1b_1,\dots,b_{m+1}b1​,…,bm+1​ of LLL is reduced if its Gram–Schmidt data bi∗b_i^*bi∗​, μij=(bi,bj∗)/(bj∗,bj∗)\mu_{ij}=(b_i,b_j^*)/(b_j^*,b_j^*)μij​=(bi​,bj∗​)/(bj∗​,bj∗​) satisfy ∣μij∣≤12|\mu_{ij}|\le\frac12∣μij​∣≤21​ for j<ij<ij<i and ∣bi∗+μi i−1bi−1∗∣2≥34∣bi−1∗∣2|b_i^*+\mu_{i\,i-1}b_{i-1}^*|^2\ge\frac34|b_{i-1}^*|^2∣bi∗​+μii−1​bi−1∗​∣2≥43​∣bi−1∗​∣2 for 1<i≤m+11<i\le m+11<i≤m+1.

Formalization targets

Goal: Proposition (2.16)

Assume

(2.14)pkl>2mn/2(2mm)n/2∣f∣m+n,\text{(2.14)}\qquad p^{kl}>2^{mn/2}\binom{2m}{m}^{n/2}|f|^{m+n},(2.14)pkl>2mn/2(m2m​)n/2∣f∣m+n,

that b1,…,bm+1b_1,\dots,b_{m+1}b1​,…,bm+1​ is a reduced basis of LLL, and that some jjj satisfies

(2.17)∣bj∣<(pkl/∣f∣m)1/n.\text{(2.17)}\qquad |b_j|<\big(p^{kl}/|f|^m\big)^{1/n}.(2.17)∣bj​∣<(pkl/∣f∣m)1/n.

If ttt is the largest such jjj, then

deg⁡h0=m+1−t,h0=gcd⁡(b1,…,bt),\deg h_0=m+1-t,\qquad h_0=\gcd(b_1,\dots,b_t),degh0​=m+1−t,h0​=gcd(b1​,…,bt​),

and (2.17) holds for all 1≤j≤t1\le j\le t1≤j≤t.

Milestones

  1. (2.5): existence and uniqueness of h0h_0h0​, and for g∣fg\mid fg∣f the equivalence of (h mod p)∣(g mod p)(h\bmod p)\mid(g\bmod p)(hmodp)∣(gmodp), (h mod pk)∣(g mod pk)(h\bmod p^k)\mid(g\bmod p^k)(hmodpk)∣(gmodpk) and h0∣gh_0\mid gh0​∣g.
  2. (2.11): inside the proof of (2.7), the elements of M={λf+μb}M=\{\lambda f+\mu b\}M={λf+μb} of degree below e+le+le+l lie in pkZ[X]p^k\mathbb Z[X]pkZ[X].
  3. (2.7): if b∈Lb\in Lb∈L and pkl>∣f∣m∣b∣np^{kl}>|f|^m|b|^npkl>∣f∣m∣b∣n then h0∣bh_0\mid bh0​∣b.
  4. Mignotte's bound: a divisor ggg of fff with deg⁡g≤m\deg g\le mdegg≤m has ∣g∣≤(2mm)1/2∣f∣|g|\le\binom{2m}{m}^{1/2}|f|∣g∣≤(m2m​)1/2∣f∣.
  5. (2.13): under (2.14), deg⁡h0≤m\deg h_0\le mdegh0​≤m if and only if ∣b1∣<(pkl/∣f∣m)1/n|b_1|<(p^{kl}/|f|^m)^{1/n}∣b1​∣<(pkl/∣f∣m)1/n.
  6. (2.18): #J≤m+1−deg⁡h1\#J\le m+1-\deg h_1#J≤m+1−degh1​ for linearly independent bjb_jbj​ divisible by h1h_1h1​.
  7. (2.19): if deg⁡h0≤m\deg h_0\le mdegh0​≤m, then {1,…,m+1−deg⁡h0}⊂J\{1,\dots,m+1-\deg h_0\}\subset J{1,…,m+1−degh0​}⊂J.

Companion items: the basis of LLL and d(L)=pkld(L)=p^{kl}d(L)=pkl (2.6), and the remark that for t=1t=1t=1 the vector b1b_1b1​ is itself an irreducible factor of fff.

Significance

Proposition (2.16) is what makes the factoring algorithm of Sect. 3 correct: running the reduction for increasing mmm, the first mmm for which (2.15) holds produces h0h_0h0​ by one gcd computation, and repeating on f/h0f/h_0f/h0​ factors fff completely. Together with the polynomial running time of basis reduction (missions I and II of this series), it yields the polynomial-time factoring theorem (3.6). Proposition (2.7) on its own is a general principle, often reused: a polynomial that is divisible by hhh modulo pkp^kpk and has small norm relative to pklp^{kl}pkl must share the factor h0h_0h0​ with fff.

All results here are proved in the paper and standard in textbooks (e.g. von zur Gathen and Gerhard, Modern Computer Algebra). To our knowledge there is no machine-checked proof of (2.7), (2.13) or (2.16) in Lean or Mathlib. Mathlib has Hensel-type lemmas and the Mahler measure, including a coefficient-wise Mignotte bound and Landau's inequality, but not the ℓ2\ell^2ℓ2 form of Mignotte's bound used here, nor any of the lattice statements. A Lean development of this section would be the algebraic core of a verified LLL factoring theorem.

Difficulty

The obvious argument for (2.7) is to bound the resultant of fff and bbb: it is divisible by pklp^{kl}pkl when they share a factor modulo pkp^kpk, and bounded by ∣f∣m∣b∣n|f|^m|b|^n∣f∣m∣b∣n by Hadamard. That argument gives only gcd⁡(f,b)≠1\gcd(f,b)\ne1gcd(f,b)=1, the weaker version of [8], not that h0h_0h0​ divides bbb. The paper's sharper statement needs a lattice MMM of combinations λf+μb\lambda f+\mu bλf+μb, the projection to its top coefficients, and the congruence argument (2.11) that forces the low-degree elements of MMM into pkZ[X]p^k\mathbb Z[X]pkZ[X]; formalizing it requires determinant and Hadamard bounds for a lattice of rank n+m′−2en+m'-2en+m′−2e inside a space of polynomials.

Mignotte's ℓ2\ell^2ℓ2 bound needs the Mahler measure and the inequality ∣g∣≤(2dd)1/2M(g)|g|\le\binom{2d}{d}^{1/2}M(g)∣g∣≤(d2d​)1/2M(g), which is not the coefficient-wise form available in Mathlib. The step (2.19) needs Proposition (1.12) on reduced bases, which is the goal of mission I. The final part of (2.16) needs the primitivity of the basis vectors, which depends on LLL being exactly the set of multiples of hhh modulo pkp^kpk of degree at most mmm.

Formalization scope

Polynomials are Polynomial ℤ; (g mod q)(g\bmod q)(gmodq) is g.map (Int.castRingHom (ZMod q)); ∣g∣|g|∣g∣ is the square root of the sum of the squares of the coefficients over the support. Degrees are natDegree, except in (2.11), where degree with values in WithBot ℕ keeps deg⁡0=−∞\deg 0=-\inftydeg0=−∞ as on the page. A polynomial of degree at most mmm is identified with its coefficient vector in EuclideanSpace ℝ (Fin (m + 1)). Linear independence of b1,…,bm+1b_1,\dots,b_{m+1}b1​,…,bm+1​ is over R\mathbb RR on coefficient vectors; "basis for LLL" means in LLL, independent, and spanning LLL over Z\mathbb ZZ. Gram–Schmidt vectors are Mathlib's unnormalised InnerProductSpace.gramSchmidt.

Indices are 0-based: the paper's b1b_1b1​ is b 0. The index ttt of (2.16) is kept as the paper's 1-based value, 1≤t≤m+11\le t\le m+11≤t≤m+1, so deg⁡h0=m+1−t\deg h_0=m+1-tdegh0​=m+1−t appears unchanged. The powers 2mn/22^{mn/2}2mn/2, (2mm)n/2\binom{2m}{m}^{n/2}(m2m​)n/2, (2mm)1/2\binom{2m}{m}^{1/2}(m2m​)1/2 and (⋅)1/n(\cdot)^{1/n}(⋅)1/n are real powers with real exponents.

The standing assumptions are hypotheses of every item that involves ppp, kkk or hhh: ppp prime, k≥1k\ge1k≥1, deg⁡f>0\deg f>0degf>0, (2.1)–(2.4), m≥lm\ge lm≥l. Mignotte's bound (which assumes only f≠0f\ne0f=0) and (2.18) (pure linear algebra on polynomials of degree at most mmm) do not need them. The factor h0h_0h0​ is any irreducible h0∈Z[X]h_0\in\mathbb Z[X]h0​∈Z[X] with h0∣fh_0\mid fh0​∣f and (h mod p)∣(h0 mod p)(h\bmod p)\mid(h_0\bmod p)(hmodp)∣(h0​modp). A gcd is stated by its universal property (divides each, and every common divisor divides it), which determines it up to sign. Two milestones are stated slightly more generally than the page: Mignotte's bound for every divisor of degree at most mmm, and (2.18) for every nonzero common divisor h1h_1h1​.

The goal does not assume (2.7), (2.13), Mignotte's bound, (2.18) or (2.19); these are milestones. A trivial formalization in which h0h_0h0​ is an arbitrary divisor of fff, or in which "reduced basis" is asserted of a family that need not be a basis of LLL, is ruled out by the definitions.

Needed infrastructure: Hensel-type arguments over Z/pkZ\mathbb Z/p^k\mathbb ZZ/pkZ, Gauss's lemma, the Mahler measure, Hadamard's inequality, and Proposition (1.12) on reduced bases. The lattice determinant results and the ℓ2\ell^2ℓ2 Mignotte bound are reusable beyond this mission. Proofs of any milestone are welcome, as are proofs of the missing Mathlib infrastructure.

Selected references

  • A. K. Lenstra, H. W. Lenstra, Jr., L. Lovász, Factoring polynomials with rational coefficients, Math. Ann. 261 (1982), 515–534. https://doi.org/10.1007/BF01457454
  • M. Mignotte, An inequality about factors of polynomials, Math. Comp. 28 (1974), 1153–1157 (reference [10] of the paper).
  • D. E. Knuth, The Art of Computer Programming, Vol. 2, Seminumerical Algorithms, Addison-Wesley, 1981, Exercise 4.6.2.20 (reference [7] of the paper).
  • A. K. Lenstra, Lattices and factorization of polynomials, Report IW 190/81, Mathematisch Centrum, Amsterdam, 1981 (reference [8] of the paper; its Theorem 2 is the weaker form of (2.7)).
  • J. von zur Gathen, J. Gerhard, Modern Computer Algebra, 3rd ed., Cambridge University Press, 2013, Ch. 16 (textbook treatment).
9 thms1 active userReviewed
CombinatoricsOperations ResearchProbability·Captain: mikedeng1

Packet Routing and Job-Shop Scheduling in O(Congestion + Dilation) Steps: Edge-Simple Paths with Congestion c and Dilation d Admit an O(c + d)-Step Schedule with Constant-Size QueuesResearch Paper

Motivation

In a store-and-forward network, messages are cut into packets that travel from node to node along wires, one wire per time step, and wait in buffers between moves. Routing such traffic splits into two problems: choosing a path for each packet, and scheduling the packets along their paths, deciding at every step which packets move and which wait. Leighton, Maggs and Rao showed that the second problem always has an essentially optimal solution: once paths are fixed, two simple parameters of the paths determine the routing time up to a constant factor, on every network.

The result separates path selection from timing in the design of routing algorithms for parallel machines, and it reaches beyond networks: a job-shop problem in which every operation takes one unit of time and no job visits a machine twice is the same problem with jobs as packets and machines as edges.

Timeline.

  • 1988: Leighton, Maggs and Rao, extended abstract at FOCS, Universal packet routing algorithms.
  • 1994: the full paper in Combinatorica 14, with the existence theorem of an O(c+d)O(c+d)O(c+d) schedule with constant queues (Theorem 3.4) and a randomized on-line algorithm.
  • 1999: Leighton, Maggs and Richa, Fast algorithms for finding O(congestion + dilation) packet routing schedules, make the construction algorithmic, using the algorithmic Local Lemma of Beck.

Setting

A network is a directed multigraph: a type VVV of nodes, a type EEE of edges, and maps src,tgt:E→V\mathrm{src},\mathrm{tgt}:E\to Vsrc,tgt:E→V. A path is a list of edges e0,…,eℓ−1e_0,\dots,e_{\ell-1}e0​,…,eℓ−1​ with tgt(ek)=src(ek+1)\mathrm{tgt}(e_k)=\mathrm{src}(e_{k+1})tgt(ek​)=src(ek+1​); it is edge-simple if no edge occurs twice. A finite set PPP of packets is given, each with its path.

The dilation ddd is the largest number of edges on a path; the congestion ccc is the largest number of paths through one edge. Since a packet crosses at most one edge per step and an edge carries at most one packet per step, every schedule needs at least max⁡(c,d)\max(c,d)max(c,d) steps.

A schedule assigns to every packet ppp and every index kkk of its path the step τ(p,k)≥1\tau(p,k)\ge1τ(p,k)≥1 at which ppp crosses its kkk-th edge, strictly increasing in kkk. Its length is the last crossing step. A packet waits in its initial queue before its first crossing, in the edge queue at the head of the edge it last crossed between two crossings, and in its final queue after its last crossing. Only edge queues count for queue size: the other two are fixed by the instance. A schedule is valid if at most one packet crosses each edge at each step.

For the proof, the paper measures schedules that are not yet valid through frames: a TTT-frame is a run of TTT consecutive steps, and the relative congestion of a frame is the largest number of packets crossing one edge in it, divided by TTT.

Formalization targets

Goal: Theorem 3.4 (p. 11)

There are absolute constants KKK and QQQ such that every finite set of packets with edge-simple paths of congestion at most ccc and dilation at most ddd, on any network, has a valid schedule with

length≤K (c+d),every edge queue≤Q at every step.\text{length}\le K\,(c+d),\qquad \text{every edge queue}\le Q \text{ at every step}.length≤K(c+d),every edge queue≤Q at every step.

The constants are not fixed: the paper proves existence, and any constants are a valid answer.

Milestones, in the order the proof uses them

  1. Lemma 3.1 (p. 8), the Lovász Local Lemma: events of probability at most ppp with dependence at most b≥1b\ge1b≥1 and 4pb<14pb<14pb<1 all fail together with positive probability.
  2. Lemma 3.2 (p. 8): with congestion and dilation at most ddd, a schedule of length O(d)O(d)O(d) with no waiting in edge queues and at most TTT packets per edge in every frame of size T≥log⁡2dT\ge\log_2 dT≥log2​d.
  3. The recurrences (pp. 12–13): I(1)=log⁡dI^{(1)}=\log dI(1)=logd, I(i+1)=log⁡5I(i)I^{(i+1)}=\log^5 I^{(i)}I(i+1)=log5I(i), r(1)=1r^{(1)}=1r(1)=1, r(i+1)=r(i)(1+κ/log⁡I(i))r^{(i+1)}=r^{(i)}(1+\kappa/\sqrt{\log I^{(i)}})r(i+1)=r(i)(1+κ/logI(i)​) stop at some j=O(log⁡∗d)j=O(\log^* d)j=O(log∗d) with r(j)=O(1)r^{(j)}=O(1)r(j)=O(1).
  4. Lemma 3.5 (p. 14): frame bounds for all sizes from TTT to 2T−12T-12T−1 imply them for all sizes ≥T\ge T≥T.
  5. The final simulation (pp. 12–13): a schedule with relative congestion O(1)O(1)O(1) in frames of constant size, in which every packet waits at most once every k1≥2k_1\ge2k1​≥2 steps, becomes a valid schedule, a constant factor longer, with constant edge queues.

Significance

The theorem shows that congestion and dilation, two quantities read off the paths alone, determine the optimal schedule length up to a constant factor on every network, with buffers of constant size. Path-selection algorithms that minimize c+dc+dc+d therefore yield near-optimal routing, and the same bound holds for unit-time job shops without repeated machines. It is also an often-cited application of the Local Lemma beyond a single round of random choices: the proof applies it O(log⁡∗d)O(\log^* d)O(log∗d) times in succession.

The result has been proved since 1994, and the algorithmic version since 1999. As far as is known, no part of it is machine-checked. The mission produces a formal model of store-and-forward schedules with edge queues and frames, a formal statement of the theorem that excludes the degenerate readings, and formal versions of the steps of its proof.

Difficulty

The naive approach gives each packet a random initial delay and then lets it move without waiting. That gives O(log⁡(Nd))O(\log(Nd))O(log(Nd)) packets per edge per step, and O(c+dlog⁡(Nd))O(c+d\log(Nd))O(c+dlog(Nd)) steps after slowing down. Lemma 3.2 does better only in frames of size log⁡d\log dlogd, not in single steps. Recursing on frames, as in Theorem 3.3, loses a constant factor per level and gives (c+d)2O(log⁡∗(c+d))(c+d)2^{O(\log^* (c+d))}(c+d)2O(log∗(c+d)).

Removing that factor is the central difficulty. Each refinement must keep the relative congestion nearly unchanged, r(i+1)=r(i)(1+O(1)/log⁡I(i))r^{(i+1)}=r^{(i)}(1+O(1)/\sqrt{\log I^{(i)}})r(i+1)=r(i)(1+O(1)/logI(i)​), which requires second-order terms in the tail estimates, delays spread over the block rather than inserted at its start, and careful handling of block boundaries. The constant queue bound needs an invariant: every packet waits at most once every I(i)I^{(i)}I(i) steps. The Local Lemma gives existence only; the construction is non-constructive.

Formalization scope

Conventions committed to in Lean:

  • The network is arbitrary: V E : Type with src tgt : E → V, no finiteness or degree bound. Packets form a Fintype P; paths are List E with matching endpoints (List.IsChain) and List.Nodup.
  • Congestion and dilation are bounds (CongestionLE path c, DilationLE path d), equivalent to exact values because every bound is monotone.
  • A schedule is a Timetable: time p k : ℕ, the step at which packet p crosses its k-th edge, at least 1 and strictly increasing in k. Length at most L means every crossing step is ≤ L. Valid means two different crossings of one edge happen at different steps.
  • The edge-queue size of edge g at the end of step t counts crossings of g at a step ≤ t whose packet crosses its next edge at a step > t. Initial and final queues are not counted.
  • Frames: frameCount τ g t T counts the packets that cross g at a step in [t, t+T). Relative congestion at most r in frames of size ≥ T₀ is frameCount ≤ r·T for all T ≥ 1 with T₀ ≤ T.
  • log is Real.logb 2. Every O(1) and "sufficiently large" is a constant quantified before the instance, and in the goal ∃ K Q comes before the network.
  • Lemma 3.1 is stated on an arbitrary probability space with measurable events. Dependence uses independence from the generated σ-algebra, and the statement adds 1 ≤ b, without which the page's statement is false.

These choices rule out the trivial formalizations: constants chosen after the instance would make K=cdK=cdK=cd suffice; a schedule without edge exclusivity would make the greedy schedule of length ddd a solution; a missing queue bound drops half of the theorem; and a statement without its length bound is solved by sending one packet at a time.

Not stated: Lemmas 3.6–3.10 and the summary of the refinement step (p. 20). They concern the block decomposition and delay-insertion rules of pp. 13–14 and 17–18, which the paper defines only in prose. Contributions are welcome on the Local Lemma (finite or general), the probabilistic estimates of Lemma 3.2, Lemma 3.5, the elementary simulation step, and formal definitions of the block operations from which Lemmas 3.6–3.10 can be stated. The schedule model is reusable for other routing results, such as the on-line algorithm of §2 or the O(c+d)O(c+d)O(c+d) results for leveled networks.

Selected references

  • F. T. Leighton, B. M. Maggs, S. B. Rao, Packet routing and job-shop scheduling in O(congestion + dilation) steps, Combinatorica 14 (1994) 167–186. https://doi.org/10.1007/BF01215349 (this mission cites the authors' manuscript).
  • F. T. Leighton, B. M. Maggs, S. B. Rao, Universal packet routing algorithms, Proc. 29th IEEE FOCS (1988) 256–269.
  • F. T. Leighton, B. M. Maggs, A. W. Richa, Fast algorithms for finding O(congestion + dilation) packet routing schedules, Combinatorica 19 (1999) 375–401. https://doi.org/10.1007/s004930050061
  • P. Erdős, L. Lovász, Problems and results on 3-chromatic hypergraphs and some related questions, in Infinite and Finite Sets, Colloq. Math. Soc. János Bolyai 10 (1975) 609–627.
  • J. Spencer, Ten Lectures on the Probabilistic Method, SIAM (1987), pp. 57–58. https://doi.org/10.1137/1.9780898719918
10 thms1 active userReviewed
Algorithmic Game TheoryCombinatoricsOperations Research+1·Captain: mikedeng1

Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments V: Stackelberg Matroid Pricing Is an Assortment Problem Under a Regular Choice ModelResearch Paper

Motivation

In Stackelberg network pricing a leader sets prices on some resources, and a follower then buys the cheapest structure available to them, paying the leader for the priced resources they use. The Stackelberg Minimum Spanning Tree problem, introduced by Cardinal, Demaine, Fiorini, Joret, Langerman, Newman and Weimann (Algorithmica 2011), is the version in which the follower buys a minimum spanning tree. The best known approximation factors for it are those of uniform pricing, which gives every priced edge the same price (Berbeglia–Joret, p. 21).

Independently, revenue management studies assortment optimisation: a seller chooses which products to offer, and customers choose among the offered products according to a discrete choice model. Berbeglia and Joret (arXiv:1606.01371, Algorithmica 2020) analyse the revenue-ordered heuristic (offer every product whose revenue is at least some threshold) under any regular choice model, and prove tight approximation bounds.

§4.6 of that paper shows that the two problems are the same problem: a Stackelberg Matroid pricing instance is an assortment problem under a regular choice model, and uniform pricing is the revenue-ordered heuristic on that model. The bounds of Cardinal et al. on uniform pricing thus become special cases of the general bounds on revenue-ordered assortments. This mission formalizes that correspondence (Theorem 4.16).

Setting

Choice model. Let C\mathcal CC be a finite set of products. A system of choice probabilities assigns to each offered set S⊆CS\subseteq\mathcal CS⊆C and product xxx a probability P(x,S)\mathcal P(x,S)P(x,S), with no-purchase probability P(0,S)=1−∑x∈SP(x,S)\mathcal P(0,S)=1-\sum_{x\in S}\mathcal P(x,S)P(0,S)=1−∑x∈S​P(x,S). It is regular if (i) all probabilities are nonnegative, (ii) P(x,S)=0\mathcal P(x,S)=0P(x,S)=0 for x∉Sx\notin Sx∈/S, (iii) ∑x∈SP(x,S)≤1\sum_{x\in S}\mathcal P(x,S)\le1∑x∈S​P(x,S)≤1, and (iv) P(x,S)≥P(x,S′)\mathcal P(x,S)\ge\mathcal P(x,S')P(x,S)≥P(x,S′) whenever S⊆S′S\subseteq S'S⊆S′ and x∈S∪{0}x\in S\cup\{0\}x∈S∪{0}. With revenues r:C→R>0r:\mathcal C\to\mathbb R_{>0}r:C→R>0​, rev(S)=∑x∈SP(x,S)r(x)\mathrm{rev}(S)=\sum_{x\in S}\mathcal P(x,S)r(x)rev(S)=∑x∈S​P(x,S)r(x) and OPT=max⁡Srev(S)\mathrm{OPT}=\max_S\mathrm{rev}(S)OPT=maxS​rev(S). The revenue-ordered assortment generated by yyy is {y′∈C:r(y′)≥r(y)}\{y'\in\mathcal C:r(y')\ge r(y)\}{y′∈C:r(y′)≥r(y)}.

Greedy algorithm. Given a family of independent sets, a linear ordering LLL and a set FFF, greedy(F,L)\mathrm{greedy}(F,L)greedy(F,L) scans FFF in the order induced by LLL, starting from ∅\emptyset∅, and adds each element that keeps the current set independent.

Stackelberg Matroid problem. An instance is a matroid M=(E,X)M=(E,\mathcal X)M=(E,X), a bipartition E=R⊔BE=R\sqcup BE=R⊔B into red and blue elements, and red costs c:R→R>0c:R\to\mathbb R_{>0}c:R→R>0​; some base of MMM lies inside RRR. The leader chooses prices p:B→R>0p:B\to\mathbb R_{>0}p:B→R>0​. The customer buys a minimum-weight base by running greedy on R∪BR\cup BR∪B with an ordering L∗L^*L∗ that is non-decreasing in weight (ccc on RRR, ppp on BBB) and puts blue elements first on ties. The leader earns revStack(p,L∗)=∑e∈B∩greedyM(R∪B,L∗)p(e)\mathrm{rev}_{\mathrm{Stack}}(p,L^*)=\sum_{e\in B\cap\mathrm{greedy}_M(R\cup B,L^*)}p(e)revStack​(p,L∗)=∑e∈B∩greedyM​(R∪B,L∗)​p(e).

The assortment instance. Let c1<⋯<ckc_1<\dots<c_kc1​<⋯<ck​ be the distinct red costs. Products are C=B×{c1,…,ck}\mathcal C=B\times\{c_1,\dots,c_k\}C=B×{c1​,…,ck​} with r((e,q))=∣B∣ qr((e,q))=|B|\,qr((e,q))=∣B∣q. The auxiliary matroid M′M'M′ on R∪CR\cup\mathcal CR∪C declares XXX independent when it holds at most one pair (e,q)(e,q)(e,q) per blue eee and (R∩X)∪{e:(e,q)∈X}(R\cap X)\cup\{e:(e,q)\in X\}(R∩X)∪{e:(e,q)∈X} is independent in MMM. With an ordering LLL of R∪CR\cup\mathcal CR∪C that is non-decreasing in cost and puts products before red elements on ties, P((e,q),S)=1/∣B∣\mathcal P((e,q),S)=1/|B|P((e,q),S)=1/∣B∣ if (e,q)∈greedyM′(R∪S,L)(e,q)\in\mathrm{greedy}_{M'}(R\cup S,L)(e,q)∈greedyM′​(R∪S,L) and 000 otherwise.

Formalization targets

Goal: Theorem 4.16 (p. 24)

For the instance above, with B≠∅B\ne\emptysetB=∅ and every admissible LLL:

P is regular,r>0,max⁡S⊆Crev(S)=max⁡p>0, L∗revStack(p,L∗),\mathcal P\ \text{is regular},\quad r>0,\qquad \max_{S\subseteq\mathcal C}\mathrm{rev}(S)=\max_{p>0,\ L^*}\mathrm{rev}_{\mathrm{Stack}}(p,L^*),P is regular,r>0,S⊆Cmax​rev(S)=p>0, L∗max​revStack​(p,L∗),

and uniform pricing corresponds to revenue-ordered assortments: for each cic_ici​ some revenue-ordered assortment earns the revenue of the uniform price cic_ici​, and every revenue-ordered assortment earns the revenue of some uniform price cic_ici​.

Milestones

  1. Lemma 4.14 (p. 23): for F⊆F′F\subseteq F'F⊆F′, ∣greedyM(F′,L)∣≥∣greedyM(F,L)∣|\mathrm{greedy}_M(F',L)|\ge|\mathrm{greedy}_M(F,L)|∣greedyM​(F′,L)∣≥∣greedyM​(F,L)∣ and F∩greedyM(F′,L)⊆greedyM(F,L)F\cap\mathrm{greedy}_M(F',L)\subseteq\mathrm{greedy}_M(F,L)F∩greedyM​(F′,L)⊆greedyM​(F,L).
  2. Property (14) (p. 31): orderings agreeing on a block partition make greedy pick the same number of elements per block.
  3. Lemma 4.15 (p. 23): the Stackelberg revenue does not depend on the compatible ordering.
  4. M′M'M′ is a matroid (p. 32).
  5. Regularity of P\mathcal PP (pp. 32–33).
  6. rev(S)\mathrm{rev}(S)rev(S) equals the Stackelberg revenue of pS(e)=min⁡{q:(e,q)∈S}p_S(e)=\min\{q:(e,q)\in S\}pS​(e)=min{q:(e,q)∈S} (pp. 33–34).
  7. Rounding prices up to the cost levels does not decrease revenue (p. 34).
  8. For prices in {c1,…,ck}∪{+∞}\{c_1,\dots,c_k\}\cup\{+\infty\}{c1​,…,ck​}∪{+∞}, rev(Sp)\mathrm{rev}(S_p)rev(Sp​) equals the Stackelberg revenue of ppp (pp. 34–35).

Significance

Theorem 4.16 transfers every guarantee for revenue-ordered assortments under regular models to uniform pricing in Stackelberg Matroid pricing. Specialising Theorems 3.1, 3.2 and 3.3 of the paper through it gives exactly the three bounds on uniform pricing proved by Cardinal et al. for Stackelberg Minimum Spanning Tree (Theorem 3 of their paper), which those authors showed to be tight (p. 24). It also places uniform pricing inside a general picture: it is a threshold policy for a regular choice model whose purchase probabilities come from a matroid greedy algorithm, and the paper notes that the argument extends to polymatroids.

The result is proved in the paper, with two steps left to the reader (M′M'M′ is a matroid) or justified briefly (rounding prices). No machine-checked proof exists. A formalization also produces a reusable greedy algorithm on finite matroids with its monotonicity properties (Lemma 4.14, (14)), which Mathlib at the pinned revision does not have.

Difficulty

The obvious argument identifies the customer's run of greedy on (M,R∪B)(M,R\cup B)(M,R∪B) with the run of greedy on (M′,R∪S)(M',R\cup S)(M′,R∪S) step by step. That identification fails as stated: the choice probabilities are defined with one fixed ordering LLL of R∪CR\cup\mathcal CR∪C, while the customer's ordering L∗L^*L∗ is any ordering compatible with the prices, and ties among blue elements of equal price, or between a product and a red element of equal cost, may be broken differently. Equality of revenues therefore needs the tie-independence property (14) applied to M′M'M′ as well as to MMM, which in turn needs M′M'M′ to be a matroid. A second gap is axiom (iv) for the no-purchase option: it requires that offering more products never decreases the number of products greedy selects, which is Lemma 4.14 (i)–(ii) for M′M'M′ combined, not a pointwise statement. Finally, the paper's "+∞+\infty+∞" price must be handled with the red base: without a base inside RRR, a blue element priced above all costs can still be bought and the optimum is unbounded.

Formalization scope

  • Elements and orderings. The matroid is a Mathlib Matroid α; RRR, BBB are Finset α with R∪BR\cup BR∪B equal to the ground set; costs and prices are functions α → ℝ, used only on RRR and BBB. A linear ordering is a duplicate-free List covering the set; greedy on FFF scans the whole list and skips elements outside FFF, so FFF is never re-sorted.
  • Greedy is defined for an arbitrary independence predicate on finite sets, so that it applies to M′M'M′ before M′M'M′ is shown to be a matroid.
  • Customer model. Compatibility (15a)–(15b), including blue priority on ties, is part of the definition of an admissible customer ordering. The red base is a field of every instance.
  • Assortment instance. Elements of R∪CR\cup\mathcal CR∪C live in α ⊕ (α × ℝ). The paper's conditions (1)–(2) for M′M'M′ contain two typos (a missing "∈X\in X∈X" and X\mathcal XX for XXX); the intended conditions are formalized. The price +∞+\infty+∞ is the real number 1+∑f∈Rc(f)1+\sum_{f\in R}c(f)1+∑f∈R​c(f), strictly above every red cost.
  • Goal shape. The theorem is stated for the explicit instance of the proof, for every admissible LLL. The optimum of the Stackelberg side is a maximum (IsGreatest) over positive real prices and all compatible customer orderings. Cost levels are quantified as elements of the set of red costs rather than by index.
  • Ruled out. An existential statement ("some regular instance has the same optimum") is met by a single product with revenue OPTStack\mathrm{OPT}_{\mathrm{Stack}}OPTStack​ and is not this theorem; so is a customer model without tie-breaking, a formalization without the red base, or Lemma 4.14 only for F=F′F=F'F=F′.

Contributions welcome: proofs of Lemma 4.14 and (14) for Mathlib matroids (reusable beyond this mission), the matroid property of parallel extensions such as M′M'M′, and the three revenue identities.

Selected references

  • G. Berbeglia and G. Joret, Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments, arXiv:1606.01371v3, 2019 (Algorithmica, 2020). https://arxiv.org/abs/1606.01371
  • J. Cardinal, E. D. Demaine, S. Fiorini, G. Joret, S. Langerman, I. Newman and O. Weimann, The Stackelberg Minimum Spanning Tree Game, Algorithmica 59(2):129–144, 2011. https://doi.org/10.1007/s00453-009-9299-y
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Vol. B, Algorithms and Combinatorics 24, Springer, 2003 (matroids and the greedy algorithm). https://link.springer.com/book/9783540443896
14 thms1 active userReviewed
CombinatoricsLinear OptimizationOperations Research·Captain: mikedeng1

Online Primal-Dual Algorithms for Covering and Packing 3: A Deterministic O(log d log(n/OPT))-Competitive Algorithm for Online Unweighted Set CoverResearch Paper

Motivation

Online set cover is the basic covering problem in which the requests arrive over time. A ground set of elements and a family of sets are known in advance, but which elements must be covered is revealed one element at a time, and each arriving element has to be covered at once by a set chosen irrevocably. The problem models resource placement under unknown demand (facilities, servers, sensors that must serve clients as they appear) and is the prototype for a family of online covering problems.

Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 2009) gave the first deterministic algorithm, with competitive ratio O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn) for nnn elements and mmm sets, and showed that no deterministic algorithm does better than Ω(log⁡mlog⁡n/(log⁡log⁡m+log⁡log⁡n))\Omega(\log m\log n/(\log\log m+\log\log n))Ω(logmlogn/(loglogm+loglogn)) on some instances. Buchbinder and Naor (Math. Oper. Res. 2009) recast the fractional part of that algorithm as an instance of a general online primal-dual scheme for covering and packing linear programs, and turned an offline pessimistic estimator of Srinivasan into an online potential function. The result, in their Section 5.1, is a deterministic algorithm whose ratio O(log⁡dlog⁡(n/OPT))O(\log d\log(n/OPT))O(logdlog(n/OPT)) depends on the maximum element frequency ddd instead of the number of sets mmm, and on the ratio n/OPTn/OPTn/OPT instead of nnn.

Timeline:

  • 2003 (conference), 2009 (journal): Alon et al., deterministic O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn) for unweighted online set cover, with a potential ∑j∉Cn2wj\sum_{j\notin C} n^{2w_j}∑j∈/C​n2wj​.
  • 2005 (conference), 2009 (journal): Buchbinder and Naor, the general online fractional covering/packing scheme, and the derandomized rounding of this mission.

Setting

A set-cover instance consists of a finite ground set XXX of nnn elements and a finite family S\mathcal SS of mmm sets. For an element eee, Se\mathcal S_eSe​ is the collection of sets containing eee, and ddd bounds its size: ∣Se∣≤d|\mathcal S_e|\le d∣Se​∣≤d for every eee (the frequency). In the unweighted problem every set costs 111.

Elements arrive in a list σ\sigmaσ. The algorithm maintains:

  • fractional weights w(s)≥0w(s)\ge 0w(s)≥0 for the sets, produced by the paper's Section 3 scheme with {0,1}\{0,1\}{0,1} coefficients: when an element eee arrives that is not yet fractionally covered (∑s∈Sew(s)<1\sum_{s\in\mathcal S_e}w(s)<1∑s∈Se​​w(s)<1), its dual variable y(e)y(e)y(e) is raised to the least value at which
w(s)=max⁡{w(s), 1d(exp⁡(B2c(s)∑k: s∋eky(ek))−1)}(s∋e)w(s)=\max\Big\{w(s),\ \tfrac1d\Big(\exp\Big(\tfrac{B}{2c(s)}\textstyle\sum_{k:\ s\ni e_k}y(e_k)\Big)-1\Big)\Big\}\qquad(s\ni e)w(s)=max{w(s), d1​(exp(2c(s)B​∑k: s∋ek​​y(ek​))−1)}(s∋e)

gives ∑s∈Sew(s)≥1\sum_{s\in\mathcal S_e}w(s)\ge 1∑s∈Se​​w(s)≥1; here B>0B>0B>0 is a parameter;

  • a cover C⊆S\mathcal C\subseteq\mathcal SC⊆S that only grows; CCC is the set of elements covered by C\mathcal CC.

With f(e)=min⁡{1,exp⁡(−α+α∑s∋ew(s))}f(e)=\min\{1,\exp(-\alpha+\alpha\sum_{s\ni e}w(s))\}f(e)=min{1,exp(−α+α∑s∋e​w(s))}, the potential is Φ=Φ1+Φ2\Phi=\Phi_1+\Phi_2Φ=Φ1​+Φ2​ with

Φ1=1−∏e∈X∖C(1−f(e)),Φ2=exp⁡(∑s∈S((ln⁡2)χC(s)−αw(s))−OPT),\Phi_1=1-\prod_{e\in X\setminus C}\big(1-f(e)\big),\qquad \Phi_2=\exp\Big(\sum_{s\in\mathcal S}\big((\ln 2)\chi_{\mathcal C}(s)-\alpha w(s)\big)-OPT\Big),Φ1​=1−e∈X∖C∏​(1−f(e)),Φ2​=exp(s∈S∑​((ln2)χC​(s)−αw(s))−OPT),

where OPTOPTOPT is the optimum number of sets covering the arrived elements, assumed known, r=eln⁡(e/(e−1))r=e\ln(e/(e-1))r=eln(e/(e−1)) and α=max⁡{1,ln⁡(rn/OPT)}\alpha=\max\{1,\ln(rn/OPT)\}α=max{1,ln(rn/OPT)}. The rounding rule: each time the weight of a set sss is augmented, sss is added to C\mathcal CC if this does not increase Φ\PhiΦ.

Formalization targets

Goal: Lemma 5.2

Every arriving element is covered by C\mathcal CC, and at every time

∣C∣ ≤ (2αln⁡(1+d)+1) OPTln⁡2,α=max⁡{1,ln⁡rnOPT}.|\mathcal C|\ \le\ \frac{\big(2\alpha\ln(1+d)+1\big)\,OPT}{\ln 2},\qquad \alpha=\max\Big\{1,\ln\frac{rn}{OPT}\Big\}.∣C∣ ≤ ln2(2αln(1+d)+1)OPT​,α=max{1,lnOPTrn​}.

This is the paper's OPT⋅O(log⁡dlog⁡(n/OPT))OPT\cdot O(\log d\log(n/OPT))OPT⋅O(logdlog(n/OPT)) with the constant its proof gives.

Milestones

  1. Theorem 3.2 (covering half): for every B>0B>0B>0, the {0,1}\{0,1\}{0,1} scheme with frequency bound ℓ\ellℓ yields a fractional cover of cost at most 2ln⁡(1+ℓ)2\ln(1+\ell)2ln(1+ℓ) times that of any fractional cover.
  2. Lemma 5.1 (i): initially Φ≤1\Phi\le 1Φ≤1; Φ>0\Phi>0Φ>0 in every state.
  3. Lemma 5.1 (ii): after the weight of a set is augmented by δ≥0\delta\ge0δ≥0, taking the set or excluding it leaves Φ\PhiΦ no larger than before.

Significance

The bound improves Alon et al.'s O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn) whenever sets are many but each element lies in few of them (d≪md\ll md≪m), and whenever the optimum is large compared with nnn. It also shows that the fractional part and the rounding part of an online covering algorithm can be designed separately: any online fractional solution with a competitive guarantee can be rounded deterministically by an online potential function. The same method gives the routing result of Section 5.2 of the paper.

As far as is known, none of these results is machine-checked. Related formal work on the platform covers Alon et al.'s algorithm and its O(log⁡mlog⁡n)O(\log m\log n)O(logmlogn) bound (a different potential and a different fractional update), and the general covering scheme of Buchbinder and Naor's monograph; neither states Lemma 5.1 or Lemma 5.2, nor Theorem 3.2 for the {0,1}\{0,1\}{0,1} scheme with ℓ\ellℓ in place of nnn. A complete development here would give a verified derandomized rounding argument, reusable for other online covering problems.

Difficulty

The difficulty is not in the final inequality, which follows from Φ2≤1\Phi_2\le1Φ2​≤1 in one line, but in keeping Φ≤1\Phi\le1Φ≤1 throughout. The decision to take a set must be made with no knowledge of future elements, and the potential has to account for elements that may never arrive: Φ1\Phi_1Φ1​ ranges over the whole ground set. Lemma 5.1 (ii) asks that, for every current state, one of the two decisions does not increase a non-linear function of all uncovered elements at once and this must hold for every state, not only for the states a particular run reaches. On the fractional side, Theorem 3.2 is only asserted, "along the same lines" as Theorem 3.1, so its constant has to be re-derived with ℓ\ellℓ in place of nnn and with the scheme's continuous increase made discrete.

A tempting shortcut is to bound ∣C∣|\mathcal C|∣C∣ by the number of rounds or by ∑sw(s)\sum_s w(s)∑s​w(s) directly; neither gives a logarithmic factor in n/OPTn/OPTn/OPT, which comes only from the choice of α\alphaα in Φ\PhiΦ.

Formalization scope

The instance is the published OnlinePrimalDual.OnlineSetCover.SetCoverInstance (elements E, set indices T, incidence elemSets, positive costs c), with elementWeight and coveredBy. Unit costs are the hypothesis ∀ s, inst.c s = 1 in Lemma 5.2; Theorem 3.2 is stated for general positive costs. Logarithms are natural (Real.log), because they invert Real.exp.

Committed conventions:

  • The fractional scheme is the discrete form of the continuous increase: in each round y(e)y(e)y(e) is the least t≥0t\ge0t≥0 (an sInf) at which the new constraint holds. Arrival lists may repeat elements; an element already covered changes nothing.
  • The rounding treats each set's increase within a round as one augmentation; the augmented sets are processed one at a time in the order of a list ord containing every set, and a set is added when Φ(w+δs1s,C∪{s})≤Φ(w,C)\Phi(w+\delta_s\mathbf 1_s,\mathcal C\cup\{s\})\le\Phi(w,\mathcal C)Φ(w+δs​1s​,C∪{s})≤Φ(w,C). Lemma 5.2 holds for every order.
  • The algorithm is a function, so every run exists.
  • OPTOPTOPT is a natural number ≥1\ge1≥1 bounding the size of some cover of the arrived elements; d≥1d\ge1d≥1 bounds the frequency of every element. At the true optimum and the maximum frequency this is the paper's statement.
  • Explicit constants replacing O(⋅)O(\cdot)O(⋅): Theorem 3.2's O(log⁡ℓ)O(\log\ell)O(logℓ) is 2ln⁡(1+ℓ)2\ln(1+\ell)2ln(1+ℓ); Lemma 5.2's OPT⋅O(log⁡dlog⁡(n/OPT))OPT\cdot O(\log d\log(n/OPT))OPT⋅O(logdlog(n/OPT)) is (2αln⁡(1+d)+1) OPT/ln⁡2(2\alpha\ln(1+d)+1)\,OPT/\ln2(2αln(1+d)+1)OPT/ln2 with α=max⁡{1,ln⁡(rn/OPT)}\alpha=\max\{1,\ln(rn/OPT)\}α=max{1,ln(rn/OPT)}.
  • The proof of Lemma 5.1 (i) on p. 13 prints ddd where rrr is meant ("exp⁡(−dne−α)\exp(-dne^{-\alpha})exp(−dne−α)", "α≥ln⁡(dn/OPT)\alpha\ge\ln(dn/OPT)α≥ln(dn/OPT)"); the statement uses rrr, and rrr is printed "eln⁡(e/e−1)e\ln(e/e-1)eln(e/e−1)" for eln⁡(e/(e−1))e\ln(e/(e-1))eln(e/(e−1)).

Not in scope: the packing half of Theorem 3.2, Theorem 3.1 for general coefficients, and the doubling wrapper of p. 12 that removes the assumption that OPTOPTOPT is known. The guarantee is for the algorithm run with the stated α\alphaα; a formalization in which Φ\PhiΦ's product ranges only over arrived elements, or in which the weights or the chosen family are free variables constrained by hypotheses instead of being produced by the algorithm (OPTOPTOPT is an input of the algorithm, as the page assumes it known), would be a different and weaker statement and is ruled out.

Contributions welcome: proofs of the three milestones and of the goal, and general lemmas about the fractional round (attainment of the least ttt, monotonicity of the weights) that other online covering missions can reuse.

Selected references

  • N. Buchbinder, J. Naor, Online Primal-Dual Algorithms for Covering and Packing, Mathematics of Operations Research 34(2), 2009. https://doi.org/10.1287/moor.1080.0363
  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM Journal on Computing 39(2), 2009. https://doi.org/10.1137/060661946
  • A. Srinivasan, Improved approximation guarantees for packing and covering integer programs, SIAM Journal on Computing 29(2), 1999. https://doi.org/10.1137/S0097539796314240
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal-Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3), 2009. https://doi.org/10.1561/0400000024
10 thms1 active userReviewed
Linear OptimizationOperations Research·Captain: mikedeng1

Online Primal-Dual Algorithms for Covering and Packing 4: Online Rounding of the Fractional Routing Scheme Respects Capacities and Is O(log P(max)·[exp(1 + 2 ln m/u(min)) − 1])-CompetitiveResearch Paper

Motivation

In online routing of virtual circuits, connection requests between pairs of nodes of a capacitated network arrive one at a time. Each request must be accepted and routed on a single path with bandwidth 111, or rejected, immediately and irrevocably, and no edge may carry more than its capacity. The goal is to maximize the number of accepted requests (the throughput). The model goes back to Awerbuch, Azar and Plotkin (FOCS 1993), whose deterministic algorithm has a logarithmic competitive ratio when edge capacities are at least logarithmic in the size of the network, and it underlies the analysis of admission control in circuit-switched and bandwidth-reserved networks.

Buchbinder and Naor (Math. Oper. Res. 2009) recover an algorithm with the same competitive factor from a general recipe: an online primal–dual scheme first produces a feasible fractional routing online, and an online version of Raghavan's pessimistic estimator (J. Comput. Syst. Sci. 1988) then rounds it, also online. This mission formalizes that construction and its guarantee (Section 5.2 of the paper, with the Section 3 scheme it uses).

Timeline:

  • 1987–1988: Raghavan and Thompson introduce randomized rounding for multicommodity flow; Raghavan derandomizes it with pessimistic estimators.
  • 1993: Awerbuch, Azar and Plotkin give the deterministic throughput-competitive online routing algorithm.
  • 2005–2009: Buchbinder and Naor's primal–dual framework (ESA 2005; MOR 2009) derives an algorithm with the same factor systematically.

Setting

Let EEE be a finite set of mmm edges with capacities u(e)>0u(e) > 0u(e)>0, and u(min⁡)=min⁡eu(e)u(\min) = \min_e u(e)u(min)=mine​u(e). Requests r1,r2,…r_1, r_2, \dotsr1​,r2​,… arrive online; request rir_iri​ comes with a finite list P(ri)\mathcal P(r_i)P(ri​) of admissible paths, each a set of edges, all of size at most P(max⁡)P(\max)P(max).

A fractional routing assigns flows f(ri,P)≥0f(r_i, P) \ge 0f(ri​,P)≥0; it is feasible when ∑P∈P(ri)f(ri,P)≤1\sum_{P \in \mathcal P(r_i)} f(r_i, P) \le 1∑P∈P(ri​)​f(ri​,P)≤1 for every request and the load ∑ri∑P∋ef(ri,P)\sum_{r_i}\sum_{P \ni e} f(r_i, P)∑ri​​∑P∋e​f(ri​,P) of every edge is at most u(e)u(e)u(e). Its value is val(f)=∑ri∑Pf(ri,P)\mathrm{val}(f) = \sum_{r_i}\sum_P f(r_i, P)val(f)=∑ri​​∑P​f(ri​,P); OPT\mathrm{OPT}OPT is the largest value of a feasible routing of the arrived requests, an upper bound on the integral optimum.

The fractional scheme. The covering LP paired with the routing LP (the paper's primal, Fig. 3) has variables x(e)x(e)x(e) (cost u(e)u(e)u(e)) and Z(ri)Z(r_i)Z(ri​) (cost 111) with constraints ∑e∈Px(e)+Z(ri)≥1\sum_{e \in P} x(e) + Z(r_i) \ge 1∑e∈P​x(e)+Z(ri​)≥1. When rir_iri​ arrives, its paths are visited in order; for each path whose constraint fails, f(ri,P)f(r_i,P)f(ri​,P) is raised from 000 to the least value restoring it, while x(e)=max⁡(x(e),1ℓ(eB′Fe/(2u(e))−1))x(e) = \max\big(x(e), \tfrac1\ell(e^{B' F_e/(2u(e))}-1)\big)x(e)=max(x(e),ℓ1​(eB′Fe​/(2u(e))−1)) for e∈Pe \in Pe∈P and Z(ri)=max⁡(Z(ri),1ℓ(eB′f(ri)/2−1))Z(r_i) = \max\big(Z(r_i), \tfrac1\ell(e^{B' f(r_i)/2}-1)\big)Z(ri​)=max(Z(ri​),ℓ1​(eB′f(ri​)/2−1)) follow the flow (FeF_eFe​ the load of eee, f(ri)f(r_i)f(ri​) the flow of rir_iri​). The parameters are ℓ=P(max⁡)+1\ell = P(\max)+1ℓ=P(max)+1 and B′=2ln⁡(1+ℓ)B' = 2\ln(1+\ell)B′=2ln(1+ℓ).

The rounding. With the rounding scale B=exp⁡(1+ln⁡(2m)/u(min⁡))−1B = \exp(1 + \ln(2m)/u(\min)) - 1B=exp(1+ln(2m)/u(min))−1, the integral edge usage χ(e)\chi(e)χ(e) and the number sss of served requests, the potential is Φ=Φ1+Φ2\Phi = \Phi_1 + \Phi_2Φ=Φ1​+Φ2​,

Φ1=12exp⁡(val(f)2B−sln⁡2),Φ2=12m∑eexp⁡((1+ln⁡2mu(e))χ(e)−Fe).\Phi_1 = \tfrac12\exp\Big(\frac{\mathrm{val}(f)}{2B} - s\ln 2\Big), \qquad \Phi_2 = \frac1{2m}\sum_{e}\exp\Big(\Big(1+\frac{\ln 2m}{u(e)}\Big)\chi(e) - F_e\Big).Φ1​=21​exp(2Bval(f)​−sln2),Φ2​=2m1​e∑​exp((1+u(e)ln2m​)χ(e)−Fe​).

After the fractional round of rir_iri​, the algorithm serves rir_iri​ on a path P∈P(ri)P \in \mathcal P(r_i)P∈P(ri​) (adding 111 to χ(e)\chi(e)χ(e) for e∈Pe \in Pe∈P) if this gives potential at most the potential Φstart\Phi^{\mathrm{start}}Φstart before the round; otherwise it rejects rir_iri​.

Formalization targets

Goal: Lemma 5.4

For every request sequence, the algorithm never exceeds a capacity, and for every feasible fractional routing fff,

χ(e)≤u(e)  ∀e,∑riχ(ri) ≥ val(f)4Bln⁡2⋅ln⁡(P(max⁡)+2)−1.\chi(e) \le u(e)\ \ \forall e, \qquad \sum_{r_i}\chi(r_i) \ \ge\ \frac{\mathrm{val}(f)}{4B\ln 2\cdot\ln(P(\max)+2)} - 1 .χ(e)≤u(e)  ∀e,ri​∑​χ(ri​) ≥ 4Bln2⋅ln(P(max)+2)val(f)​−1.

Milestone: Theorem 3.2 (packing half, on routing)

The fractional scheme's flows falgf^{\mathrm{alg}}falg are feasible and val(f)≤2ln⁡(P(max⁡)+2) val(falg)\mathrm{val}(f) \le 2\ln(P(\max)+2)\,\mathrm{val}(f^{\mathrm{alg}})val(f)≤2ln(P(max)+2)val(falg) for every feasible fff.

Milestone: Lemma 5.3

Φ≤1\Phi \le 1Φ≤1 initially, Φ>0\Phi > 0Φ>0 always, and whenever the flows of a request are raised by a non-negative amount of total at most 111, serving the request on some path or rejecting it does not increase Φ\PhiΦ.

Significance

The result shows that a deterministic online algorithm for throughput-competitive routing, previously designed by hand, falls out of two generic components: an online fractional packing scheme and an online pessimistic estimator. A side product is that the fractional phase alone produces, online, a near-optimal routing that respects all capacities exactly, independently of their size. When u(min⁡)≥log⁡nu(\min) \ge \log nu(min)≥logn the rounding loses only a constant factor and the algorithm is O(log⁡P(max⁡))O(\log P(\max))O(logP(max))-competitive, as in Awerbuch–Azar–Plotkin.

The results are proved in the paper; none is machine-checked. A formalization supplies a checked instance of the online primal–dual method together with derandomized online rounding, and fixes the constants the paper leaves inside O(⋅)O(\cdot)O(⋅). Related platform content: the monograph's OnlinePrimalDual.Routing.per_copy_guarantee and routing_competitive concern the Buchbinder–Naor (1,O(log⁡n))(1, O(\log n))(1,O(logn))-competitive algorithm with copies of the graph, a different scheme.

Difficulty

The fractional guarantee is argued in the paper continuously (rates of change of the primal and dual values), while the scheme as formalized is discrete: each flow is the least value restoring a constraint, and every primal variable is a maximum whose branch may switch during the increase. The continuous argument does not transfer verbatim, and feasibility depends on the least value restoring the constraint with equality.

The rounding is a derandomization. The existence of a good path or a good rejection is established in the paper as an expectation over a random trial; a deterministic statement about finitely many alternatives is what the mission asks for, with all m+1m+1m+1 exponential terms of Φ\PhiΦ under control at once. A frequent first attempt compares with the potential after the fractional round; the rule compares with Φstart\Phi^{\mathrm{start}}Φstart, before the flow increase, and the guarantee is stated for that comparison.

Formalization scope

  • Edges are a non-empty Fintype E; capacities are real and positive. A request is a List (Finset E) of paths; the request sequence is a list. Simple paths of a graph are a special case; nothing in the argument uses graph structure. P(max⁡)P(\max)P(max) is a parameter with every path of size at most P(max⁡)P(\max)P(max).
  • A routing is a List (List ℝ) of the shape of the request sequence. OPT\mathrm{OPT}OPT is quantified as "every feasible fractional routing".
  • The continuous increase is its discrete equivalent (an attained sInf). Ties among good paths are broken by list order; only paths that received flow in the current round are candidates for serving, so a request whose flow was not increased is rejected.
  • Explicit constants replacing O(⋅)O(\cdot)O(⋅): Theorem 3.2's O(log⁡ℓ)O(\log \ell)O(logℓ) becomes 2ln⁡(1+ℓ)=2ln⁡(P(max⁡)+2)2\ln(1+\ell) = 2\ln(P(\max)+2)2ln(1+ℓ)=2ln(P(max)+2); Lemma 5.4's O(log⁡P(max⁡)⋅[exp⁡(1+2ln⁡m/u(min⁡))−1])O(\log P(\max)\cdot[\exp(1+2\ln m/u(\min))-1])O(logP(max)⋅[exp(1+2lnm/u(min))−1]) becomes 4Bln⁡2⋅ln⁡(P(max⁡)+2)4B\ln 2\cdot\ln(P(\max)+2)4Bln2⋅ln(P(max)+2) with additive −1-1−1, where B=exp⁡(1+ln⁡(2m)/u(min⁡))−1B = \exp(1+\ln(2m)/u(\min))-1B=exp(1+ln(2m)/u(min))−1 is the scale chosen on p. 15. The printed "2ln⁡m2\ln m2lnm" differs from the proof's "ln⁡2m\ln 2mln2m"; the proof's constant is used (it is at least as strong for m≥2m \ge 2m≥2). All logarithms are natural.
  • The algorithm is a fully specified function: a formalization in which requests are never served, or OPT\mathrm{OPT}OPT is a free variable pinned by hypotheses, would trivialize the goal and is ruled out.
  • Not included: the covering half of Theorem 3.2, and the remark on u(min⁡)≥log⁡nu(\min) \ge \log nu(min)≥logn.

Contributions welcome: proofs of the milestones, a reusable lemma "convex combination ≤\le≤ value ⇒\Rightarrow⇒ some outcome ≤\le≤ value" for derandomization, and the discrete-to-continuous bridge for the Section 3 scheme.

Selected references

  • N. Buchbinder, J. Naor, Online Primal-Dual Algorithms for Covering and Packing, Mathematics of Operations Research, 2009. https://doi.org/10.1287/moor.1080.0363
  • B. Awerbuch, Y. Azar, S. Plotkin, Throughput-Competitive On-Line Routing, Proc. 34th FOCS, pp. 32–40, 1993. https://doi.org/10.1109/SFCS.1993.366884
  • P. Raghavan, Probabilistic construction of deterministic algorithms: approximating packing integer programs, J. Comput. Syst. Sci. 37(2), 1988. https://doi.org/10.1016/0022-0000(88)90003-7
  • P. Raghavan, C. D. Thompson, Randomized rounding: a technique for provably good algorithms and algorithmic proofs, Combinatorica 7(4), 1987. https://doi.org/10.1007/BF02579324
7 thms1 active userReviewed
Linear OptimizationOperations Research·Captain: mikedeng1

Online Primal-Dual Algorithms for Covering and Packing 1: The Online Fractional Packing Scheme Is B-Competitive and Violates Each Packing Constraint by at Most 2 log(1 + n·a_i(max)/a_i(min))/BResearch Paper

Motivation

Many resource-allocation problems arrive one request at a time and must be answered immediately: a bandwidth request is admitted or refused when it appears, an advertiser's budget is charged when a query arrives, a job is accepted before later jobs are seen. Their linear-programming relaxations are packing problems: maximize a total profit subject to capacity constraints, where the variables are revealed online and each must be set irrevocably when it is revealed. A standard yardstick for such an online algorithm is its competitive ratio, the worst-case ratio between the offline optimum and the algorithm's value.

Buchbinder and Naor (Math. Oper. Res. 2009) gave a single online primal-dual scheme for the general online fractional packing problem, together with a matching scheme for covering. The scheme raises the newly revealed packing variable while increasing the dual covering variables along an exponential curve, and its analysis is a short primal-dual argument. Earlier online algorithms for throughput-competitive routing and for set cover (Alon et al. 2009) can be read as instances of it, and the same template later became the basis of a monograph on the primal-dual approach to online algorithms (Buchbinder, Naor 2009).

This mission formalizes the paper's headline result, Theorem 3.1, for the scheme exactly as the paper defines it.

Setting

Fix a finite set III of n≥1n\ge1n≥1 packing constraints (equivalently, primal covering variables), with known capacities c(i)>0c(i)>0c(i)>0. Packing variables y(1),…,y(m)y(1),\dots,y(m)y(1),…,y(m) arrive one per round; in round jjj the variable y(j)y(j)y(j) is revealed together with its non-negative column a(i,j)a(i,j)a(i,j), i∈Ii\in Ii∈I. The offline problems form the primal-dual pair of Figure 1 of the paper:

(P) min⁡∑ic(i)x(i)  s.t. ∑ia(i,j)x(i)≥1 ∀j, x≥0;(D) max⁡∑jy(j)  s.t. ∑ja(i,j)y(j)≤c(i) ∀i, y≥0.\text{(P)}\ \min\sum_i c(i)x(i)\ \text{ s.t. } \sum_i a(i,j)x(i)\ge1\ \forall j,\ x\ge0;\qquad \text{(D)}\ \max\sum_j y(j)\ \text{ s.t. } \sum_j a(i,j)y(j)\le c(i)\ \forall i,\ y\ge0.(P) mini∑​c(i)x(i)  s.t. i∑​a(i,j)x(i)≥1 ∀j, x≥0;(D) maxj∑​y(j)  s.t. j∑​a(i,j)y(j)≤c(i) ∀i, y≥0.

The profit of every y(j)y(j)y(j) is normalized to 111. Every column is assumed to have a positive entry; otherwise the packing problem is unbounded. An online algorithm may set y(j)y(j)y(j) only in round jjj and never changes it later.

The scheme with parameter B>0B>0B>0 keeps a primal vector xxx (initially 000) and the dual vector yyy. In round jjj it computes the prefix maximum ai(max⁡)=max⁡k≤ja(i,k)a_i(\max)=\max_{k\le j}a(i,k)ai​(max)=maxk≤j​a(i,k). If the new covering constraint ∑ia(i,j)x(i)≥1\sum_i a(i,j)x(i)\ge1∑i​a(i,j)x(i)≥1 already holds, it sets y(j)=0y(j)=0y(j)=0. Otherwise it sets y(j)y(j)y(j) to the least t≥0t\ge0t≥0 at which the constraint holds after every x(i)x(i)x(i) is replaced by

max⁡{x(i), 1n ai(max⁡)[exp⁡(B2c(i)∑k=1ja(i,k)y(k))−1]},y(j)=t.\max\Big\{x(i),\ \frac{1}{n\,a_i(\max)}\Big[\exp\Big(\frac{B}{2c(i)}\sum_{k=1}^{j}a(i,k)y(k)\Big)-1\Big]\Big\},\qquad y(j)=t.max{x(i), nai​(max)1​[exp(2c(i)B​k=1∑j​a(i,k)y(k))−1]},y(j)=t.

After rrr rounds, X(r)=∑ic(i)x(i)X(r)=\sum_i c(i)x(i)X(r)=∑i​c(i)x(i) is the primal value and Y(r)=∑k≤ry(k)Y(r)=\sum_{k\le r}y(k)Y(r)=∑k≤r​y(k) the dual value. For the analysis, ai(max⁡)a_i(\max)ai​(max) and ai(min⁡)a_i(\min)ai​(min) also denote the largest and the smallest non-zero coefficient of row iii over all mmm columns.

Formalization targets

Goal: Theorem 3.1

For every B>0B>0B>0, the scheme's dual solution is non-negative; after every round rrr, every non-negative y′y'y′ that satisfies the packing constraints restricted to the first rrr columns has ∑k≤ry′(k)≤B Y(r)\sum_{k\le r}y'(k)\le B\,Y(r)∑k≤r​y′(k)≤BY(r) (the scheme is BBB-competitive); and after all mmm rounds, for every iii,

∑k=1ma(i,k) y(k) ≤ c(i)⋅2log⁡(1+n ai(max⁡)/ai(min⁡))B.\sum_{k=1}^{m}a(i,k)\,y(k)\ \le\ c(i)\cdot\frac{2\log\big(1+n\,a_i(\max)/a_i(\min)\big)}{B}.k=1∑m​a(i,k)y(k) ≤ c(i)⋅B2log(1+nai​(max)/ai​(min))​.

The paper states the second part as c(i)⋅O((log⁡n+log⁡(ai(max⁡)/ai(min⁡)))/B)c(i)\cdot O\big((\log n+\log(a_i(\max)/a_i(\min)))/B\big)c(i)⋅O((logn+log(ai​(max)/ai​(min)))/B); the bound above is the one its proof establishes.

Milestones: the three claims of the proof

  1. Claim (i): X(r)≤B⋅Y(r)X(r)\le B\cdot Y(r)X(r)≤B⋅Y(r) after every round rrr.
  2. Claim (ii): after every round, x≥0x\ge0x≥0 and xxx satisfies every covering constraint revealed so far; no x(i)x(i)x(i) ever decreases.
  3. Claim (iii): the violation bound of the goal.

Significance

Theorem 3.1 says that a solution within factor BBB of the optimum can be maintained online at the price of overloading each packing constraint by a factor of order (log⁡n+log⁡(amax⁡/amin⁡))/B(\log n+\log(a_{\max}/a_{\min}))/B(logn+log(amax​/amin​))/B. Scaling the output down by the overload gives a feasible online packing solution with competitive ratio O(log⁡n+log⁡(amax⁡/amin⁡))O(\log n+\log(a_{\max}/a_{\min}))O(logn+log(amax​/amin​)), and Lemma 3.1 of the paper shows that no online algorithm does better up to constant factors. The same trade-off underlies the paper's online rounding results for routing (§5.2) and, through the covering counterpart, for set cover (§5.1).

The result is proved in the paper. As far as the platform's record shows, it is not formalized: the published OnlinePrimalDual.GeneralPacking.theorem14_1 (a restatement of the monograph's version) takes the inequality X≤BYX\le BYX≤BY and primal feasibility as hypotheses on arbitrary vectors x,yx,yx,y and derives competitiveness by weak duality; it does not mention the scheme and has no violation bound. The published OnlinePrimalDual.GeneralPacking.lemma14_2 is the matching lower bound (Lemma 3.1) and is not part of this mission. A formalization here would give the first machine-checked guarantee for the scheme itself and a reusable analysis pattern (a potential bound integrated along a monotone path) for the other schemes of the paper.

Difficulty

The paper's argument is a derivative comparison along a continuous process: while y(j)y(j)y(j) rises, ∂X/∂y(j)≤B\partial X/\partial y(j)\le B∂X/∂y(j)≤B. In the discrete formulation each round jumps directly to the least admissible y(j)y(j)y(j), and each x(i)x(i)x(i) is a maximum of its old value and an exponential, so it is continuous but not differentiable where the maximum switches; the comparison must be turned into an integral inequality over [0,y(j)][0,y(j)][0,y(j)] for such functions. The prefix maximum ai(max⁡)a_i(\max)ai​(max) changes between rounds, and the claim that this never lowers or raises the primal value needs an invariant (x(i)x(i)x(i) is always at least the current increment value). The violation bound rests on a second invariant, x(i)≤1/ai(min⁡)x(i)\le1/a_i(\min)x(i)≤1/ai​(min), which holds because y(j)y(j)y(j) is the least admissible value; any formalization that loses minimality (for example by taking an arbitrary admissible ttt) loses claim (iii).

Formalization scope

  • The instance is the published OnlinePrimalDual.GeneralPacking.GeneralInstance I (Fin m) (costs c>0c>0c>0, coefficients a≥0a\ge0a≥0); n=∣I∣n=|I|n=∣I∣ with [Nonempty I]; columns are Fin m, arrive in index order, and are 0-based in Lean, so "the first rrr columns" is (k : ℕ) < r. m≥1m\ge1m≥1 is [NeZero m].
  • ai(max⁡)a_i(\max)ai​(max), ai(min⁡)a_i(\min)ai​(min) over all columns are the published aMax and aMin. For a row with no non-zero coefficient aMin is 000 and both sides of the violation bound are 000.
  • The scheme is a function, stateAfter inst B r. The continuous loop of the paper is replaced by its discrete implementation, which the paper itself prescribes (p. 4): y(j)y(j)y(j) is the least t≥0t\ge0t≥0 restoring the new covering constraint, written as sInf. Every theorem assumes that every column has a positive entry (the paper's standing assumption, p. 4); this makes the infimum attained. If the prefix maximum is 000, Lean's 1/0=01/0=01/0=0 gives increment 000, which agrees with the paper's bracket being 000.
  • Explicit constant. The paper's c(i)⋅O((log⁡n+log⁡(ai(max⁡)/ai(min⁡)))/B)c(i)\cdot O((\log n+\log(a_i(\max)/a_i(\min)))/B)c(i)⋅O((logn+log(ai​(max)/ai​(min)))/B) is instantiated as c(i)⋅2log⁡(1+n ai(max⁡)/ai(min⁡))/Bc(i)\cdot 2\log(1+n\,a_i(\max)/a_i(\min))/Bc(i)⋅2log(1+nai​(max)/ai​(min))/B, from claim (iii) of the proof. Logarithms are natural (Real.log), since they invert Real.exp.
  • BBB-competitiveness is stated against every non-negative feasible packing solution of every prefix of the input, not only at the end.
  • A formalization in which the inequality X≤BYX\le BYX≤BY, primal feasibility, or the bound x(i)≤1/ai(min⁡)x(i)\le1/a_i(\min)x(i)≤1/ai​(min) is assumed rather than derived from the scheme is ruled out: every statement here is about the vectors the scheme computes from the instance.
  • Needed infrastructure: monotonicity and continuity of the per-round primal path, attainment of the infimum, an integral (or mean-value) form of the derivative comparison for maxima of exponentials, and weak duality for finite LPs. The weak-duality step and the per-round integration lemma are reusable for missions 2–4 of this series. Proofs of the milestones, and of helper lemmas such as the invariant x(i)≤1/ai(min⁡)x(i)\le1/a_i(\min)x(i)≤1/ai​(min), are welcome.

Selected references

  • N. Buchbinder, J. Naor, Online Primal-Dual Algorithms for Covering and Packing, Mathematics of Operations Research, 2009. https://doi.org/10.1287/moor.1080.0363
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal-Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3), 2009. https://doi.org/10.1561/0400000024
  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM Journal on Computing 39(2), 2009. https://doi.org/10.1137/060661946
8 thms1 active userReviewed
Complexity Theory·Captain: hao jia

Weighted Falsifiability of Unambiguous DNFsOpen Problem

Motivation

A disjunctive normal form (DNF) is a disjunction of terms, each term a conjunction of Boolean literals. An unambiguous DNF has pairwise disjoint terms: no Boolean assignment satisfies two different terms. This restriction makes several tasks easy. In particular, the cited open-problem entry records polynomial-time algorithms for weighted satisfiability on unambiguous DNFs and for unweighted falsifiability. The unresolved boundary is weighted falsifiability: can one find a high-weight assignment outside the union of the terms, without enumerating all assignments?

This question is relevant to the complexity of negating compact representations of Boolean functions. Amarilli's entry observes that, since unambiguous DNFs are d-DNNFs, a polynomial-time negation procedure for d-DNNFs would yield a polynomial-time solution to weighted falsifiability on unambiguous DNFs by applying weighted satisfiability to the negated representation. Conversely, if weighted falsifiability for unambiguous DNFs—or even for d-DNNFs—is NP-hard, then, unless P=NP\mathrm{P}=\mathrm{NP}P=NP, d-DNNFs cannot be negated in polynomial time. These are implications stated by the source, not results established by this mission.

Historical note

The question appears on Albertine Amarilli's open-problem list. The entry cites a Theoretical Computer Science Stack Exchange question by Mikaël Monet and credits him with helping prepare the entry. It records two partial tractability results: weighted satisfiability with binary weights, and weighted falsifiability when the variable weights are unary. The entry gives no date for when the problem was posed or last seen open, so this description does not assign one. The linked discussion is useful context, not a novelty or resolution certificate.

Setting

Let X={x0,…,xn−1}X=\{x_0,\ldots,x_{n-1}\}X={x0​,…,xn−1​} be exactly the variables occurring in the DNF. The formal input declares this finite universe by its size nnn; validity requires every declared variable to occur in at least one literal. An input DNF is a finite list of terms, and each term is a finite list of signed variable indices. An assignment is a function ν:X→{0,1}\nu:X\to\{0,1\}ν:X→{0,1}. A positive literal xix_ixi​ is true when ν(xi)=1\nu(x_i)=1ν(xi​)=1; a negative literal ¬xi\neg x_i¬xi​ is true when ν(xi)=0\nu(x_i)=0ν(xi​)=0. A term is true when all its literals are true, and the DNF is true when at least one term is true. Thus the empty DNF is false and an empty term is true.

The input also contains one positive integer weight cic_ici​ for each variable and a positive threshold ttt. The weight of an assignment is

w(ν)=∑i=0n−1ciν(xi).w(\nu)=\sum_{i=0}^{n-1} c_i\nu(x_i).w(ν)=i=0∑n−1​ci​ν(xi​).

The DNF is valid for this problem when every literal index is below nnn and every pair of distinct terms is mutually unsatisfiable. The decision question is whether there exists an assignment that falsifies the DNF and has weight at least ttt.

Formalization targets

Partial result — weighted satisfiability

For valid unambiguous DNF inputs with positive binary-encoded weights and threshold, the decision problem asking whether a satisfying assignment has weight at least ttt has a deterministic polynomial-time algorithm. This is the weighted-satisfiability baseline recorded in the source entry. It is a separate result from the goal below.

Partial result — unary-weight falsifiability

For the same valid DNF model, when each variable weight is encoded in unary, weighted falsifiability has a deterministic polynomial-time algorithm. The threshold remains binary-encoded in this formalization. The source entry records this unary-weight restriction as tractable.

Goal — binary-weight falsifiability

For arbitrary positive binary-encoded variable weights and a positive binary-encoded threshold, determine whether one fixed deterministic Turing machine and one polynomial time bound decide weighted falsifiability for every valid input. The machine must be correct on all valid instances; its running-time bound is uniform and measured in the length of the explicit input code. No witness output is required.

The two partial results are reference points, not assumptions from which the goal is claimed to follow. The goal is the open binary-weight case; it must not be replaced by the satisfiability problem or by the unary-weight restriction.

Dependency graph

Input, semantics, validity, and serialization definitions
├── binary-weight weighted satisfiability (source baseline)
├── unary-weight weighted falsifiability (source baseline)
└── binary-weight weighted falsifiability (open goal)

Each branch shares the same finite DNF model and correctness predicates. The arrows indicate required definitions and scope, not a claim that either partial theorem implies the open goal.

Significance

A positive result would give a uniform algorithm for finding whether a disjoint union of Boolean subcubes omits any sufficiently heavy point, even when weights are represented compactly in binary. A negative complexity result would identify a sharp obstruction to efficient complement-related operations on these representations. The exact-weight version (asking for weight exactly ttt) is a different problem and is outside this mission's scope; the goal here is specifically weight at least ttt.

Formalizing the question fixes the universe of variables, signed-literal semantics, unambiguity condition, threshold direction, input encoding, and computational model. It also makes the unary and satisfiability baselines comparable to the binary-weight goal without treating a finite search or a candidate implementation as a complexity proof. No solution is supplied or presumed here.

Difficulty

The direct search over all 2n2^n2n assignments is exponential in nnn. Counting satisfying assignments is enough to settle ordinary falsifiability, but a weighted threshold partitions assignments by exponentially many possible total weights when the weights are binary. The unary dynamic program therefore does not by itself give a polynomial bound in the binary input length. Conversely, solving weighted satisfiability on the DNF does not answer whether a heavy assignment lies outside it. The task is to settle that gap without silently replacing binary magnitude by unary size.

Formalization scope

The Lean model uses Input, an explicit variable count, a list of signed-index terms, a weight list, and a threshold. validInput requires exactly one positive weight per variable, positive weights and threshold, in-range literal indices, that every declared variable occurs in the formula, and pairwise unsatisfiable distinct terms. The finite assignment type is Fin n → Bool; unused variables remain part of the input. The decision predicate is existential and exact.

The binary code includes the variable count, every list count and delimiter, all signed indices, all weights, and the threshold. Natural-number payloads use canonical binary digits with an explicit unary length prefix. The unary-weight code changes only the variable-weight payloads to unary; formula data and threshold remain binary. The complexity statements use Mathlib's bundled deterministic Turing.TM2ComputableInPolyTime model, with a single machine and polynomial bound in the chosen code length. This formalization does not claim refinement to JSON, CPython, or any runtime implementation. Human review should check the encoding/decoder round-trip and the source correspondence before launch.

The reusable definitions are the finite DNF semantics, weighted assignment score, validity predicate, binary/unary encoders, and exact decision predicates. Formalizing the two cited partial results is part of the mission's milestone path; neither is evidence that the binary-weight goal is solved.

Selected references

  • Albertine Amarilli, “Weighted falsifiability for unambiguous DNFs,” List of open questions in theoretical computer science, https://a3nm.net/work/research/questions/#weighted-falsifiability-for-unambiguous-dnfs.
  • Mikaël Monet, “Is this problem on unambiguous DNFs hard?”, Theoretical Computer Science Stack Exchange, https://cstheory.stackexchange.com/questions/53733/is-this-problem-on-unambiguous-dnfs-hard.
4 thms1 active userReviewed
Captain: Goku

QMA Strong Error Reduction with No Witness-Length IncreaseResearch Paper

Motivation

A QMA verifier receives a quantum witness and checks it with a circuit generated efficiently from the input. An acceptance probability separated by an inverse-polynomial gap is enough to define the class, but applications often need the probability of a wrong answer to be exponentially small. Repeating the verifier on many supplied witness registers achieves this error reduction while allowing the witness to grow. Marriott and Watrous proved the stronger statement that the same error reduction can be obtained without increasing the number of witness qubits Quantum Arthur–Merlin Games, Section 3.

The existing Lean development verifies the copy-based theorem, including soundness for witnesses entangled across the copies, and constructs a uniform circuit family with polynomial resources. This mission asks for the separate witness-preserving theorem. The paper already proves that mathematical statement; the open work here is its formalization in the stated QMA circuit model.

Setting

At each input length nnn, a verifier has m(n)m(n)m(n) witness qubits, a finite work register, a designated output wire, and a quantum circuit. A uniformly generated family has a polynomial-time classical procedure that emits the complete circuit description, including the witness and work-register sizes. On yes-instances, some normalized witness makes the verifier accept with probability at least a(n)a(n)a(n). On no-instances, every normalized witness is accepted with probability at most b(n)b(n)b(n). The thresholds satisfy 0≤b(n)≤a(n)≤10\le b(n)\le a(n)\le10≤b(n)≤a(n)≤1 and a(n)−b(n)≥1/q(n)a(n)-b(n)\ge1/q(n)a(n)−b(n)≥1/q(n) for a polynomial qqq.

The existing formalization represents witnesses as complex amplitude functions on bit strings, requires normalization explicitly, and uses layered circuits over its specified finite gate set. It also represents efficiently available real thresholds by polynomial-time procedures that output dyadic approximations. These are part of the formal statement's interface and must be made visible to users of the mission.

Target

For every polynomial error exponent rrr and every source verifier satisfying the conditions above, construct a uniformly generated, well-formed, polynomial-resource verifier for the same language, with completeness at least 1−2−r(n)1-2^{-r(n)}1−2−r(n) and soundness at most 2−r(n)2^{-r(n)}2−r(n), while keeping the witness count exactly m(n)m(n)m(n) at every input length:

mnew(n)=mold(n).m_{\mathrm{new}}(n)=m_{\mathrm{old}}(n).mnew​(n)=mold​(n).

This is the witness-preserving strong error-reduction result of Marriott and Watrous (Theorem 4). The existing copy-based result corresponds to the weaker QMA class inclusion in Theorem 3 and will be linked as a proved background result. The mission goal must state the witness-count equation explicitly so that a copy-based amplifier cannot satisfy it.

Significance

Witness-preserving amplification lets a QMA protocol demand much stronger reliability without asking the prover for a longer message. That matters whenever witness size is itself a resource being compared or bounded. The copy-based theorem shows that the QMA class is robust under error reduction, but does not establish this fixed-message guarantee.

Formalizing the stronger result would add a reusable account of a verifier that reuses one witness, proves soundness for every normalized input state, and compiles its behavior into an ordinary uniform circuit family. Those components can support later formalizations that reason about repeated quantum verification under a fixed witness budget.

Difficulty

The completed copy-based proof uses three independent verifier blocks in each amplification round and bounds arbitrary entangled witnesses across those blocks. Its circuit resource analysis therefore allows the witness count to grow. A witness-preserving argument cannot use that construction. It must analyze repeated verification on one register and establish exponentially small error without assuming the input witness has a special spectral form. The formal circuit model currently exposes final-output measurements; any additional measurement behavior used in the analysis must be justified in that model and shown implementable by a finite, uniformly generated circuit.

The central audit point is the exact witness-length equation. A theorem that merely returns another polynomial-size witness, or that changes the source verifier's witness definition, is a useful class-level result but does not prove this mission's target.

Formalization scope

The goal is parameterized by input-length-dependent completeness and soundness thresholds with an inverse-polynomial gap, and by a polynomial target exponent. Every witness quantifier is over normalized states. The output verifier must satisfy the same well-formedness and polynomial-resource conditions as the completed copy-based development. The platform statement uses its existing ShiClassQMAU.UniformQMA circuit-family encoding, which includes the witness and ancilla counts separately. A final proof should be kernel checked with only Lean's standard logical axioms and should not assume an amplification transducer or an unproved measurement lemma.

The paper quantifies over the class poly of unary-time constructible functions. This proposal represents the gap denominator and target exponent as literal Polynomial ℕ values, matching the checked copy-based development. It therefore formalizes a polynomial-parameter instance of Theorem 4 rather than the paper's full function-class generality. The threshold functions are supplied by polynomial-time dyadic approximators in place of the paper's informal efficient-computation convention. These interface choices are explicit in the Lean goal and should not be read as a proof of the broader formulation.

The local copy-based proof is complete and audited, but it has not yet been transplanted to Prove2Me. Its publication is preparatory work for this mission, not evidence that the witness-preserving goal is already solved. The proposal should reference the published copy-based endpoint and include only a few substantial milestones, so each item is meaningful to audit.

Selected references

  • C. Marriott and J. Watrous, Quantum Arthur–Merlin Games, Computational Complexity 14 (2005), Section 3, Theorems 3 and 4. Paper.
  • A. Kitaev, A. Shen, and M. Vyalyi, Classical and Quantum Computation, Graduate Studies in Mathematics 47, American Mathematical Society (2002), Section 14.2, cited by Marriott and Watrous for the copy-based amplification proof.
3 thms1 active userReviewed
Machine LearningOperations ResearchProbability·Captain: mikedeng1

Competitive Caching with Machine Learned Advice: The Competitive Ratio of Predictive MarkerResearch Paper

Motivation

Caching (online paging) is one of the oldest problems in online algorithms: a fast memory of kkk slots serves a sequence of requests, and every request for an element not in the fast memory is a cache miss that forces the element to be loaded, possibly evicting another one. With the whole request sequence known in advance, evicting the element whose next request is furthest in the future is optimal (Bélády, 1966). Without that knowledge, no deterministic algorithm is better than kkk-competitive, and the best randomized algorithms are Θ(log⁡k)\Theta(\log k)Θ(logk)-competitive (Fiat, Karp, Luby, McGeoch, Sleator and Young, 1991).

Lykouris and Vassilvitskii asked what happens in between: an online algorithm receives, with every request, a machine-learned prediction of the element's next arrival time. A good predictor should make the algorithm nearly as good as Bélády's rule (consistency), and a bad predictor should never make it worse than a classical algorithm (robustness). Their paper (arXiv:1802.05399v4; J. ACM 2021) is one of the founding papers of learning-augmented algorithms, and its algorithm, Predictive Marker, is the reference point for the later literature on caching with predictions.

Timeline.

  • 1966: Bélády's furthest-in-future rule is optimal offline.
  • 1985: Sleator and Tarjan show that deterministic online paging is at best kkk-competitive.
  • 1991: Fiat et al. introduce the Marker algorithm, 2Hk2H_k2Hk​-competitive, and the clean-element lower bound on the optimum.
  • 2018: Lykouris and Vassilvitskii (arXiv:1802.05399) introduce Predictive Marker, with ratio 2min⁡(1+2Sℓ(ϵ),2Hk)2\min(1+2S_\ell(\epsilon), 2H_k)2min(1+2Sℓ​(ϵ),2Hk​) for an ϵ\epsilonϵ-accurate predictor.
  • 2020: Rohatgi (arXiv:1910.12172, SODA 2020) and Wei (arXiv:2005.13716, APPROX/RANDOM 2020) improve the dependence on the error.

Setting

A request sequence σ=(z1,…,zn)\sigma = (z_1, \dots, z_n)σ=(z1​,…,zn​) lists elements of a set ZZZ. A cache of size k≥1k \ge 1k≥1 starts empty. A request for a cached element is a hit; otherwise it is a miss, the element is loaded, and if the cache is full some element is evicted first. The offline optimum Opt(σ)\mathrm{Opt}(\sigma)Opt(σ) is the least number of misses over all eviction schedules chosen with knowledge of σ\sigmaσ.

With each request ziz_izi​ the algorithm receives a real prediction hih_ihi​. The true label yiy_iyi​ is the position of the next request of ziz_izi​, or n+1n+1n+1 if there is none. For a loss function ℓ≥0\ell \ge 0ℓ≥0, the error of the predictions is ηℓ(h,σ)=∑iℓ(yi,hi)\eta_\ell(h,\sigma) = \sum_i \ell(y_i, h_i)ηℓ​(h,σ)=∑i​ℓ(yi​,hi​), and the predictions are ϵ\epsilonϵ-accurate when ηℓ(h,σ)≤ϵ⋅Opt(σ)\eta_\ell(h,\sigma) \le \epsilon \cdot \mathrm{Opt}(\sigma)ηℓ​(h,σ)≤ϵ⋅Opt(σ).

The spread of ℓ\ellℓ measures how cheaply a predictor can get the order of arrivals completely wrong: Sℓ(m)S_\ell(m)Sℓ​(m) is the least length T≥1T \ge 1T≥1 such that every strictly increasing integer sequence a1<⋯<aTa_1 < \dots < a_Ta1​<⋯<aT​ and every non-increasing real sequence b1≥⋯≥bTb_1 \ge \dots \ge b_Tb1​≥⋯≥bT​ have total loss ∑iℓ(ai,bi)≥m\sum_i \ell(a_i, b_i) \ge m∑i​ℓ(ai​,bi​)≥m.

Predictive Marker (Algorithm 1) works in the phases of the Marker algorithm. Requested elements are marked. A phase ends when the cache is full, every cached element is marked, and a miss occurs; then all marks are removed. An element requested in a phase but not in the previous one is clean, and Q(σ)Q(\sigma)Q(σ) is the total number of clean elements. Each clean miss starts a chain. An element evicted in the current phase that is requested again (a stale miss) extends the chain in which it was evicted. Evictions are among unmarked elements. As long as the chain's length n(r,c)n(r,c)n(r,c) is at most Hk=1+12+⋯+1kH_k = 1 + \tfrac12 + \dots + \tfrac1kHk​=1+21​+⋯+k1​, the evicted element is one with the largest prediction. After that it is chosen uniformly at random. The expected number of misses of Predictive Marker is costPM(σ)\mathrm{cost}_{PM}(\sigma)costPM​(σ).

Formalization targets

Goal: Theorem 3.3

If SSS is concave on [0,∞)[0,\infty)[0,∞) and majorizes the spread, then for every ϵ≥0\epsilon \ge 0ϵ≥0, every tie-breaking rule, and every sequence with ϵ\epsilonϵ-accurate predictions,

E[costPM(σ)]≤2⋅min⁡(1+2S(ϵ), 2Hk)⋅Opt(σ).\mathbb E\bigl[\mathrm{cost}_{PM}(\sigma)\bigr] \le 2\cdot\min\bigl(1 + 2S(\epsilon),\ 2H_k\bigr)\cdot \mathrm{Opt}(\sigma).E[costPM​(σ)]≤2⋅min(1+2S(ϵ), 2Hk​)⋅Opt(σ).

Milestones

  • Claim 1 (Fiat et al.): Q(σ)≤2 Opt(σ)Q(\sigma) \le 2\,\mathrm{Opt}(\sigma)Q(σ)≤2Opt(σ).
  • Proof of Theorem 3.3, last sentence: Opt(σ)≤Q(σ)\mathrm{Opt}(\sigma) \le Q(\sigma)Opt(σ)≤Q(σ).
  • Lemma 3.3: a chain that evicts by the predictions only has length n(r,c)≤1+S(ηr,c)n(r,c) \le 1 + S(\eta_{r,c})n(r,c)≤1+S(ηr,c​), where ηr,c\eta_{r,c}ηr,c​ is the error of the predictions on the elements evicted into it.
  • Lemma 3.4: E[n(r,c)]≤E[min⁡(1+2S(ηr,c),2Hk)]\mathbb E[n(r,c)] \le \mathbb E[\min(1 + 2S(\eta_{r,c}), 2H_k)]E[n(r,c)]≤E[min(1+2S(ηr,c​),2Hk​)].

Significance

The result. Theorem 3.3 gives both guarantees at once. For an exact predictor (ϵ=0\epsilon = 0ϵ=0) the ratio is a constant, 2(1+2S(0))2(1 + 2S(0))2(1+2S(0)), independent of kkk; for an arbitrary predictor it is 4Hk4H_k4Hk​, within a constant factor of the optimal randomized ratio. In between, the ratio degrades with the error at the rate of the spread: for the absolute loss the spread grows like m\sqrt mm​, so the ratio grows like ϵ\sqrt\epsilonϵ​. The spread and the chain decomposition are the tools later papers build on to trade consistency against robustness.

Formalizing it. The theorem is proved on paper; no machine-checked proof of it, of the Marker analysis, or of the clean-element bound of Fiat et al. is known. A formalization supplies a precise model of a randomized online algorithm with predictions. It also settles the details the paper leaves implicit: the eviction missing from the clean branch of Algorithm 1 as printed, the cap 2Hk2H_k2Hk​ printed as 2log⁡k2\log k2logk in Lemma 3.4, and the behaviour of the spread at 000.

Difficulty

The obvious argument charges every miss to a chain and bounds each chain separately. That works for chains that follow the predictions, but a chain that switches to random evictions interacts with every other chain of the phase, because all of them evict from the same pool of unmarked elements. A bound on its expected length must hold whatever the other chains evict, including evictions that depend on earlier coin flips. A second difficulty is summing. The chain errors ηr,c\eta_{r,c}ηr,c​ and the chain lengths are both random, while the hypothesis controls only the total error ηℓ(h,σ)\eta_\ell(h,\sigma)ηℓ​(h,σ) against Opt(σ)\mathrm{Opt}(\sigma)Opt(σ), not the number of chains Q(σ)Q(\sigma)Q(σ) in which the error is spread.

Formalization scope

Elements form a type with decidable equality. A request sequence is a list; predictions are one real per request, and every real sequence is allowed. Labels are 1-based next-arrival positions, with n+1n+1n+1 for elements never requested again. The paper prints the label with equal features; the element is meant. Opt\mathrm{Opt}Opt is computed as the minimum over all demand-paging schedules from the empty cache, which loses no generality. HkH_kHk​ is harmonic k as a real number, never log⁡k\log klogk.

Predictive Marker is a PMF over final states. The random eviction of line 21 is uniform over the unmarked cached elements, and ties in the arg max are a parameter quantified universally. The eviction of lines 23–24 is also performed after a clean miss; as printed, it sits only in the stale branch. The expected cost lies in [0,∞][0,\infty][0,∞].

The spread takes real arguments and lengths T≥1T \ge 1T≥1. SSS must be concave on [0,∞)[0,\infty)[0,∞), finite, and at least the spread. It must also be continuous at 000, which the paper does not say: without it the chain lemma fails for losses whose minimal reversed-order loss stays 000 over several lengths. ϵ\epsilonϵ-accuracy is the pointwise condition on the given pair (σ,h)(\sigma, h)(σ,h). The competitive ratio is written as a product, so Opt(σ)=0\mathrm{Opt}(\sigma) = 0Opt(σ)=0 needs no special case. Lemma 3.3 is stated pointwise for chains without random evictions, as its proof shows. Lemma 3.4 has 2Hk2H_k2Hk​ in place of the printed 2log⁡k2\log k2logk, with the minimum inside the expectation because ηr,c\eta_{r,c}ηr,c​ is random.

The statement must not be trivialized. Opt\mathrm{Opt}Opt is the true offline optimum, not Bélády's rule applied to the predictions. The expectation is taken over Predictive Marker's own run, never compared with itself. The spread hypothesis is satisfiable; for example, the constant loss 111 has spread max⁡(1,⌈m⌉)≤m+1\max(1,\lceil m\rceil) \le m + 1max(1,⌈m⌉)≤m+1.

Out of scope: Lemma 3.2 (the special-marking algorithm SM, which enters only through Lemma 3.4's proof); Lemma 3.1 and Corollaries 1–2, whose printed constants are false for small mmm or disagree with Theorem 3.3; the lower bounds of §3.1 and §3.4; the extensions of §4; the experiments of §5; running time and learnability.

Welcome contributions: the Marker phase structure and its equivalence with the combinatorial phases, the clean-element bounds Q/2≤Opt≤QQ/2 \le \mathrm{Opt} \le QQ/2≤Opt≤Q (reusable for any marking algorithm), and a bound on the expected number of misses caused by elements evicted uniformly at random within a phase.

Selected references

  • T. Lykouris, S. Vassilvitskii, Competitive Caching with Machine Learned Advice, arXiv:1802.05399v4, 2020; J. ACM 68(4), 2021. https://arxiv.org/abs/1802.05399v4
  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive paging algorithms, J. Algorithms 12(4), 1991. https://doi.org/10.1016/0196-6774(91)90041-V
  • L. A. Bélády, A study of replacement algorithms for a virtual-storage computer, IBM Systems Journal 5(2), 1966. https://doi.org/10.1147/sj.52.0078
  • D. D. Sleator, R. E. Tarjan, Amortized efficiency of list update and paging rules, Comm. ACM 28(2), 1985. https://doi.org/10.1145/2786.2793
  • D. Rohatgi, Near-optimal bounds for online caching with machine learned advice, SODA 2020. https://arxiv.org/abs/1910.12172
  • A. Wei, Better and simpler learning-augmented online caching, APPROX/RANDOM 2020. https://arxiv.org/abs/2005.13716
10 thms1 active userReviewed
Operations ResearchOptimizationProbability·Captain: mikedeng1

An Optimal On-Line Algorithm for Metrical Task System 2: The Randomized Competitive Ratio of the Uniform Task System Lies Between H(n) and 2H(n)Research Paper

Motivation

Metrical task systems, introduced by Borodin, Linial and Saks (J. ACM 39(4), 1992), are a common abstraction of on-line problems in which a server occupies one of finitely many states, pays a cost for each task depending on its current state, and may pay a transition cost to change state first. Paging, list update and the kkk-server problem all fit into this framework. The paper's first main result is that every deterministic on-line algorithm on an nnn-state metrical task system has competitive ratio at least 2n−12n-12n−1, and that 2n−12n-12n−1 is attained. The lower bound comes from an adversary that always charges the state the algorithm currently occupies. That adversary needs to know the algorithm's state, which suggests that randomization can help.

Section 7 of the paper makes this precise for the simplest system, the uniform task system, in which all transitions cost 111. There the randomized competitive ratio against an oblivious adversary is between H(n)H(n)H(n) and 2H(n)2H(n)2H(n), where H(n)=1+12+⋯+1nH(n)=1+\tfrac12+\cdots+\tfrac1nH(n)=1+21​+⋯+n1​ is between ln⁡n\ln nlnn and 1+ln⁡n1+\ln n1+lnn. This was the first logarithmic bound for a task system.

Timeline:

  • 1985: Sleator and Tarjan introduce competitive analysis for list update and paging (CACM 28(2)).
  • 1987/1992: Borodin, Linial and Saks define metrical task systems, prove the deterministic ratio 2n−12n-12n−1, and prove H(n)≤wˉ≤2H(n)H(n)\le\bar w\le 2H(n)H(n)≤wˉ≤2H(n) for the uniform system (conference version STOC 1987; journal version cited above).
  • 1991: Fiat, Karp, Luby, McGeoch, Sleator and Young prove the analogous 2Hk2H_k2Hk​ upper bound for randomized paging (J. Algorithms 12(4)).

Setting

A task system (S,d)(S,d)(S,d) is a finite set SSS of nnn states with a transition-cost matrix ddd: d(i,i)=0d(i,i)=0d(i,i)=0, d(i,j)>0d(i,j)>0d(i,j)>0 for i≠ji\ne ji=j, and d(i,k)≤d(i,j)+d(j,k)d(i,k)\le d(i,j)+d(j,k)d(i,k)≤d(i,j)+d(j,k). In the uniform task system, d(i,j)=1d(i,j)=1d(i,j)=1 for all i≠ji\neq ji=j. A task is a vector T∈R≥0ST\in\mathbb R_{\ge0}^ST∈R≥0S​ of processing costs. Given an initial state s0s_0s0​ and tasks T=T1⋯Tm\mathbf T=T^1\cdots T^mT=T1⋯Tm, a schedule is σ:{0,…,m}→S\sigma:\{0,\dots,m\}\to Sσ:{0,…,m}→S with σ(0)=s0\sigma(0)=s_0σ(0)=s0​, of cost

c(T;σ)=∑i=1md(σ(i−1),σ(i))+∑i=1mTi(σ(i)).c(\mathbf T;\sigma)=\sum_{i=1}^m d(\sigma(i-1),\sigma(i))+\sum_{i=1}^m T^i(\sigma(i)).c(T;σ)=i=1∑m​d(σ(i−1),σ(i))+i=1∑m​Ti(σ(i)).

The off-line optimum c0(T)c_0(\mathbf T)c0​(T) is the least cost over all schedules.

A deterministic on-line algorithm chooses σ(i)\sigma(i)σ(i) from s0s_0s0​ and T1,…,TiT^1,\dots,T^iT1,…,Ti. A randomized on-line algorithm RRR chooses σ(i)\sigma(i)σ(i) at random, with a distribution that depends on s0s_0s0​, on T1,…,TiT^1,\dots,T^iT1,…,Ti and on the states σ(0),…,σ(i−1)\sigma(0),\dots,\sigma(i-1)σ(0),…,σ(i−1) already visited. The task sequence is fixed before any random choice is made (an oblivious adversary). With pr(σ∣T)\mathrm{pr}(\sigma\mid\mathbf T)pr(σ∣T) the probability that RRR follows σ\sigmaσ, the expected cost is cˉR(T)=∑σc(T;σ) pr(σ∣T)\bar c_R(\mathbf T)=\sum_\sigma c(\mathbf T;\sigma)\,\mathrm{pr}(\sigma\mid\mathbf T)cˉR​(T)=∑σ​c(T;σ)pr(σ∣T). For w>0w>0w>0, RRR is expected www-competitive if there is a constant KKK with

cˉR(T)≤w c0(T)+K\bar c_R(\mathbf T)\le w\,c_0(\mathbf T)+KcˉR​(T)≤wc0​(T)+K

for every finite task sequence and every initial state. The randomized competitive ratio wˉ(S,d)\bar w(S,d)wˉ(S,d) is the infimum of all such www over all RRR.

Formalization targets

Goal: Theorem 7.1

For the uniform task system on n≥1n\ge1n≥1 states,

H(n)  ≤  wˉ(S,d)  ≤  2H(n).H(n)\;\le\;\bar w(S,d)\;\le\;2H(n).H(n)≤wˉ(S,d)≤2H(n).

Milestones

  1. Upper bound (p. 759). Some randomized on-line algorithm is expected 2H(n)2H(n)2H(n)-competitive on the uniform task system.
  2. Lemma 7.2 (p. 759). Let DDD be a distribution on infinite task sequences over a finite task alphabet, with E(c0(Tj))→∞E(c_0(\mathbf T^j))\to\inftyE(c0​(Tj))→∞, and let mj=inf⁡AE(cA(Tj))m_j=\inf_A E(c_A(\mathbf T^j))mj​=infA​E(cA​(Tj)) over deterministic on-line algorithms. Then every achievable www satisfies
lim sup⁡j→∞mjE(c0(Tj))≤w.\limsup_{j\to\infty}\frac{m_j}{E(c_0(\mathbf T^j))}\le w .j→∞limsup​E(c0​(Tj))mj​​≤w.
  1. mj≥j/nm_j\ge j/nmj​≥j/n (p. 760) when the tasks are independent uniformly random unit elementary tasks UsU_sUs​ (cost 111 in sss, 000 elsewhere).
  2. Coupon collector (p. 760). For i.i.d. uniform states on SSS, the expected number of draws until every state has appeared is nH(n)nH(n)nH(n).
  3. Off-line cost (p. 760). Under the same distribution, E(c0(Tj))≤j/(nH(n))+CE(c_0(\mathbf T^j))\le j/(nH(n))+CE(c0​(Tj))≤j/(nH(n))+C for a constant CCC independent of jjj.

Significance

The theorem shows that randomization reduces the competitive ratio of the uniform task system from 2n−12n-12n−1 to Θ(log⁡n)\Theta(\log n)Θ(logn). That is an exponential improvement, and it identifies the adversary's knowledge of the algorithm's state as the source of the deterministic lower bound. Lemma 7.2 is a form of Yao's principle adapted to the additive-constant definition of competitiveness. It is the standard tool for randomized lower bounds in on-line computation, and the same argument shape reappears for paging and kkk-server lower bounds.

On the formalization side, the result is proved but, as far as is known, has not been machine-checked. A complete development yields a reusable model of randomized on-line algorithms with oblivious adversaries, a Yao-type lemma usable for other on-line problems, and a coupon-collector expectation in the product-measure setting. The upper half additionally needs the continuous-time reduction of the paper's Lemma 3.1 in randomized form, or a direct discrete-time algorithm.

Difficulty

For the upper bound, the natural algorithm is continuous-time. It proceeds in phases, and inside a phase it stays in a state until that state has accumulated cost 111. A discrete task can saturate several states at once and straddle a phase boundary. So a discrete algorithm must either simulate the continuous one or be analyzed directly, and the expected transition count per phase must be controlled with the first phase starting in a deterministic state.

For the lower bound, the first obstacle is that the natural statement "wˉ≥lim sup⁡mj/E(c0)\bar w\ge\limsup m_j/E(c_0)wˉ≥limsupmj​/E(c0​)" silently assumes that a randomized algorithm's expected cost, averaged over random inputs, is at least that of the best deterministic algorithm. With the behavioural (kernel) definition used here, this requires converting a kernel into a mixture of deterministic algorithms, which is Kuhn's theorem on each finite horizon. The second obstacle is that the paper's claim E(c0(Tj))≤j/(nH(n))+O(1)E(c_0(\mathbf T^j))\le j/(nH(n))+O(1)E(c0​(Tj))≤j/(nH(n))+O(1) is supported only by the elementary renewal theorem, which gives a limit of ratios; the additive bound needs a sharper renewal estimate. Mathlib has no renewal theory. The hypothesis E(c0(Tj))→∞E(c_0(\mathbf T^j))\to\inftyE(c0​(Tj))→∞ of Lemma 7.2 must also be established for the uniform distribution; the paper does not prove it separately.

Formalization scope

  • States form a finite nonempty type S, and nnn = Fintype.card S; no n≥2n\ge2n≥2 assumption is made (at n=1n=1n=1 the goal reads 1≤wˉ≤21\le\bar w\le21≤wˉ≤2, and wˉ=1\bar w=1wˉ=1). H(n)H(n)H(n) is Mathlib's harmonic n, cast to R\mathbb RR. The uniform system has unit transition cost.
  • Tasks are finite and nonnegative. The paper also allows +∞+\infty+∞ entries; these are excluded. Task sequences are Fin m → S → ℝ and schedules are Fin (m+1) → S with σ 0 = s₀. c0c_0c0​ is a finite minimum.
  • A randomized algorithm is a kernel S → List (S → ℝ) → List S → PMF S. This is the paper's scheduler–taskmaster description (p. 758), equivalent to a distribution over deterministic algorithms on every finite task sequence. pr(σ∣T)\mathrm{pr}(\sigma\mid\mathbf T)pr(σ∣T) is the product of kernel probabilities, and cˉR\bar c_RcˉR​ is a finite sum. That pr(⋅∣T)\mathrm{pr}(\cdot\mid\mathbf T)pr(⋅∣T) sums to 111 has been checked locally.
  • wˉ(S,d)\bar w(S,d)wˉ(S,d) is the real sInf of {w:∃R, R expected w-competitive}\{w : \exists R,\ R \text{ expected } w\text{-competitive}\}{w:∃R, R expected w-competitive}. On the empty set this would be 000, so the upper bound is stated as the existence of an expected 2H(n)2H(n)2H(n)-competitive algorithm, and Lemma 7.2 is stated for every achievable www. The goal's lower half forces the set to be nonempty. Statements of the form "wˉ≤c\bar w\le cwˉ≤c" alone are therefore not acceptable substitutes for milestones 1 and 2.
  • Lemma 7.2 is restricted to task sequences over a finite alphabet, with the product σ\sigmaσ-algebra and measurable singletons. This makes every E(cA(Tj))E(c_A(\mathbf T^j))E(cA​(Tj)) a genuine integral for every deterministic AAA, and it covers the paper's application. The lim sup⁡\limsuplimsup of Lemma 7.2 is taken in EReal.
  • The coupon-collector time takes values in [0,∞][0,\infty][0,∞] and its expectation is a lower Lebesgue integral. Milestone 5 renders the paper's O(1)O(1)O(1) as an explicit constant CCC chosen before jjj.

Contributions welcome: proofs of any milestone; a discrete-time randomized phase algorithm; a general Kuhn-type conversion from kernels to mixtures of deterministic algorithms; renewal-theoretic lemmas.

Selected references

  • A. Borodin, N. Linial, M. Saks, An Optimal On-Line Algorithm for Metrical Task System, J. ACM 39(4):745–763, 1992. https://doi.org/10.1145/146585.146588
  • D. D. Sleator, R. E. Tarjan, Amortized Efficiency of List Update and Paging Rules, Commun. ACM 28(2):202–208, 1985. https://doi.org/10.1145/2786.2793
  • A. Fiat, R. M. Karp, M. Luby, L. A. McGeoch, D. D. Sleator, N. E. Young, Competitive Paging Algorithms, J. Algorithms 12(4):685–699, 1991. https://doi.org/10.1016/0196-6774(91)90041-V
  • A. C.-C. Yao, Probabilistic Computations: Toward a Unified Measure of Complexity, FOCS 1977, 222–227. https://doi.org/10.1109/SFCS.1977.24
  • S. M. Ross, Applied Probability Models with Optimization Applications, Holden-Day, 1970 (the elementary renewal theorem cited as [20] in the paper).
9 thms1 active userReviewed
PreviousPage 9 of 10Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me