Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Theoretical Computer Science

464 missions · 237 completed

The mathematical foundations of computation: which problems can be solved, by what algorithms, and at what cost in time, space, or communication. Distinguished by its emphasis on rigor and unconditional lower bounds, it spans computational complexity, algorithm design, automata and computability, cryptography, and the analysis of Boolean functions.

Missions

Open227Completed237All464
Algorithmic Game Theory·Captain: marwahaha

Randomized quasipolynomial-time mean-payoff gamesOpen Problem

Motivation

Mean-payoff games ask which starting positions allow a player to guarantee a nonnegative long-run average reward. Binary-encoded weights make the bit cost of solving the complete winning set a central part of the question. The source manuscript presents the surrounding research claim.

Setting

A game is a finite nonempty directed multigraph with integer edge weights, an owner for each vertex and an outgoing edge everywhere. Winning means that a history-dependent maximizer strategy guarantees liminf average payoff at least zero against every opponent strategy.

Formalization target

Construct one randomized three-tape machine and C>0 such that every encoded game of length L has a time bound

T≤2C(log⁡2(L+2))2,T\le2^{C(\log_2(L+2))^2},T≤2C(log2​(L+2))2,

all T-bit random tapes halt by T, and at least 7/8 of them output the exact winning-set indicator, with all other output cells blank.

The selected formal target is OAI.randomized_quasipolynomial_mean_payoff.

Significance and status

The target makes the input encoding, computation model, success fraction and complete output explicit. It is an existence theorem for a uniform machine, not a separate solver for each game. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

The running time must hold on every random tape, while correctness holds on the specified fraction. Signed weights and the full binary input length cannot be replaced by unary magnitude bounds.

Formalization scope

The published definitions specify games, strategies, plays, liminf payoffs, serialization and tape transitions. The independent finite Truffet elimination counterexample is retained as contextual reference; it is not a prerequisite or an asserted proof of the randomized algorithm. The manuscript’s certification/always-correct consequence is not an additional attached goal.

Selected references

  • OpenAI, Randomized quasipolynomial-time mean-payoff games, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
4 thms2 active usersReviewed
Analysis·Captain: marwahaha

Tree Constructions for the l1 Distortion of Binary Edit DistanceOpen Problem

Motivation

Embedding edit distance into ℓ₁ would permit algorithms and geometric tools for that normed space. Distortion lower bounds quantify the loss any such representation must incur. The source manuscript presents the surrounding research claim.

Setting

Edit distance is the least number of unit insertions, deletions and substitutions, with unrestricted intermediate word lengths. For a finite equal-length binary set W, c₁(W) is the infimum over all injective maps into the full real sequence space ℓ₁ of the product of the two worst distance ratios.

Formalization target

Find an absolute c>0 and d₀ such that for every d≥d₀ there are 1≤n≤d and at least two binary words of length n with

c1(W)≥exp⁡ ⁣(clog⁡d log⁡log⁡d).c_1(W)\ge\exp\!\left(c\sqrt{\log d\,\log\log d}\right).c1​(W)≥exp(clogdloglogd​).

The selected formal target is OAI.TreeEdit.binary_lower_bound.

Significance and status

The witness exists for every sufficiently large length cap. The target bounds distortion against every injective ℓ₁ embedding, not only a particular algorithm. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

A bad map is not a lower bound for the infimum over all maps. The finite family must force distortion uniformly while preserving its common binary word length.

Formalization scope

The chosen target uses Word Bool n and Finset witnesses. A companion binary_torus formulation is retained as a reference to the same lower-bound endpoint. Its independent source group repeats edit-distance declarations and is not combined into one import. No companion upper embedding theorem is attached.

Selected references

  • OpenAI, Tree Constructions for the l1 Distortion of Binary Edit Distance, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
27 thms2 active usersReviewed
Formal VerificationMathematical Logic·Captain: mikedeng1

Compositional Shape Analysis by Means of Bi-Abduction 1: The Best Abductive Solution for Points-To Symbolic Heaps Is a Computable Disjunction of Symbolic HeapsResearch Paper

Motivation

Automatic verification of programs that manipulate pointers needs procedure specifications: preconditions saying which part of the heap a procedure touches and postconditions saying what it leaves behind. Writing them by hand does not scale to millions of lines of code. Calcagno, Distefano, O'Hearn and Yang (J. ACM 58(6), 2011) infer them compositionally with bi-abduction: when symbolic execution reaches a call whose precondition is not implied by the current state, it asks for the missing memory MMM that would make it hold. This abduction question in separation logic,

Δ∗M⊨H,\Delta * M \models H,Δ∗M⊨H,

is the engine behind the Abductor tool and, later, Facebook Infer.

The question has many solutions (M=falseM = \mathsf{false}M=false is always one), so its quality matters. The paper defines an order ≾\precsim≾ on solutions that prefers less memory and then logical strength, shows that a best solution always exists as a semantic object, and then asks whether it can be written down and computed in the language that the analysis actually manipulates: symbolic heaps. For the fragment whose only spatial predicate is points-to, it answers yes. That answer, Theorem 3.25, is the goal of this mission.

Setting

Values are natural numbers; 000 is nil and the nonzero naturals are the locations. A heap hhh is a finite partial map from locations to values; a stack sss assigns a value to every variable; a state is a pair (s,h)(s,h)(s,h). Write h=h0⊎h1h = h_0 \uplus h_1h=h0​⊎h1​ when h0,h1h_0,h_1h0​,h1​ have disjoint domains and hhh is their union. A predicate is an arbitrary set of states. On predicates:

  • s,h⊨F∗Gs,h \models F * Gs,h⊨F∗G iff h=h0⊎h1h = h_0 \uplus h_1h=h0​⊎h1​ with s,h0⊨Fs,h_0 \models Fs,h0​⊨F and s,h1⊨Gs,h_1 \models Gs,h1​⊨G;
  • s,h⊨F− ⁣ ⁣∗Gs,h \models F \mathbin{-\!\!*} Gs,h⊨F−∗G iff for every h′h'h′ disjoint from hhh with s,h′⊨Fs,h' \models Fs,h′⊨F, we have s,h⊎h′⊨Gs,h \uplus h' \models Gs,h⊎h′⊨G;
  • emp\mathsf{emp}emp holds in the empty heap, true\mathsf{true}true everywhere, and ¬\neg¬, ∨\vee∨, ∧\wedge∧, ∃X\exists X∃X, ∀X\forall X∀X are the Boolean and quantifier operations; F⊨GF \models GF⊨G is inclusion.

Symbolic heaps of the Points-to Instantiation. Expressions EEE are variables or natural-number constants. A pure formula Π\PiΠ is a conjunction of E=E′E = E'E=E′ and E≠E′E \neq E'E=E′. A spatial formula Σ\SigmaΣ is a ∗*∗-conjunction of points-to facts E↦E′E \mapsto E'E↦E′, possibly with ∗ true*\,\mathsf{true}∗true; here s,h⊨E↦E′s,h \models E \mapsto E's,h⊨E↦E′ iff [ ⁣[E] ⁣]s≠0[\![E]\!]s \neq 0[[E]]s=0 and hhh is the one-cell heap [ [ ⁣[E] ⁣]s↦[ ⁣[E′] ⁣]s ][\,[\![E]\!]s \mapsto [\![E']\!]s\,][[[E]]s↦[[E′]]s]. A symbolic heap is H=∃X⃗. Π∧ΣH = \exists \vec X.\, \Pi \wedge \SigmaH=∃X.Π∧Σ, and a disjunction D=H1∨⋯∨HnD = H_1 \vee \dots \vee H_nD=H1​∨⋯∨Hn​. In the abduction question (5), Δ∗D⊨H\Delta * D \models HΔ∗D⊨H, the left-hand side Δ=Π∧L1↦R1∗⋯∗Ln↦Rn\Delta = \Pi \wedge L_1 \mapsto R_1 * \dots * L_n \mapsto R_nΔ=Π∧L1​↦R1​∗⋯∗Ln​↦Rn​ is quantifier-free.

Orders. M≤M′M \le M'M≤M′ iff M′⊨M∗trueM' \models M * \mathsf{true}M′⊨M∗true (spatially smaller), and

M≾M′  ⟺  (M≤M′∧M′≰M)∨(M≤M′∧M′≤M∧M⊨M′).M \precsim M' \iff (M \le M' \wedge M' \not\le M) \vee (M \le M' \wedge M' \le M \wedge M \models M').M≾M′⟺(M≤M′∧M′≤M)∨(M≤M′∧M′≤M∧M⊨M′).

min⁡(F)\min(F)min(F) keeps the states of FFF no proper subheap of which (with the same stack) is in FFF. Elsewhere(F)=¬(F− ⁣ ⁣∗false)\mathrm{Elsewhere}(F) = \neg(F \mathbin{-\!\!*} \mathsf{false})Elsewhere(F)=¬(F−∗false) says that some separate heap satisfies FFF, and the compatible preorder is D≤cD′  ⟺  (D∧Elsewhere(Δ))≤(D′∧Elsewhere(Δ))D \le_c D' \iff (D \wedge \mathrm{Elsewhere}(\Delta)) \le (D' \wedge \mathrm{Elsewhere}(\Delta))D≤c​D′⟺(D∧Elsewhere(Δ))≤(D′∧Elsewhere(Δ)). Subtraction is F−G=F∧¬((¬emp)∗G)F - G = F \wedge \neg((\neg\mathsf{emp}) * G)F−G=F∧¬((¬emp)∗G).

Formalization targets

Goal: Theorem 3.25

There is a single algorithm fff such that for every quantifier-free Δ\DeltaΔ and symbolic heap HHH of the Points-to Instantiation, the disjunction D=f(Δ,H)D = f(\Delta, H)D=f(Δ,H) satisfies

Δ∗D⊨HandD≾M  for every predicate M with Δ∗M⊨H.\Delta * D \models H \quad\text{and}\quad D \precsim M \ \text{ for every predicate } M \text{ with } \Delta * M \models H.Δ∗D⊨HandD≾M  for every predicate M with Δ∗M⊨H.

Both halves are part of the goal: the best solution is expressible as a disjunction of symbolic heaps, and it is computable.

Milestones, in the order the paper's argument uses them

  1. Lemma 3.16. If DDD is a minimal solution w.r.t. ≤c\le_c≤c​, then min⁡(D∨¬Elsewhere(Δ))\min(D \vee \neg\mathrm{Elsewhere}(\Delta))min(D∨¬Elsewhere(Δ)) is the minimal solution w.r.t. ≾\precsim≾.
  2. Figure 2 derives solutions (§3.4.2). If Δ∗[D]▹H\Delta * [D] \triangleright HΔ∗[D]▹H is derivable, then Δ∗D⊨H\Delta * D \models HΔ∗D⊨H.
  3. Lemma 3.18. For all Δ,H\Delta, HΔ,H some DDD with Δ∗[D]▹H\Delta * [D] \triangleright HΔ∗[D]▹H is derivable, and the proof search terminates.
  4. Lemma 3.19. If Δ∗[D]▹H\Delta * [D] \triangleright HΔ∗[D]▹H is derivable and Δ∗F⊨H\Delta * F \models HΔ∗F⊨H, then D≤cFD \le_c FD≤c​F.
  5. Lemma 3.20. Incompat(Δ)\mathrm{Incompat}(\Delta)Incompat(Δ) and ¬Elsewhere(Δ)\neg\mathrm{Elsewhere}(\Delta)¬Elsewhere(Δ) are semantically equivalent.
  6. Lemma 3.23. Six algebraic properties of subtraction, including min⁡(F1∨⋯∨Fn)=G1∨⋯∨Gn\min(F_1 \vee \dots \vee F_n) = G_1 \vee \dots \vee G_nmin(F1​∨⋯∨Fn​)=G1​∨⋯∨Gn​ with Gi=((Fi−F1)⋯−Fn)G_i = ((F_i - F_1)\cdots - F_n)Gi​=((Fi​−F1​)⋯−Fn​).
  7. Quantifier removal for pure formulae (§3.4.4). ∃X.Π\exists X.\Pi∃X.Π is equivalent to a computable pure formula without XXX.
  8. Subtraction with quantifiers (§3.4.4). (∃X⃗.Δ)−(∃Y⃗.Δ′)(\exists\vec X.\Delta) - (\exists\vec Y.\Delta')(∃X.Δ)−(∃Y.Δ′) is a computable disjunction of symbolic heaps.

Significance

The result. Semantically the best solution is min⁡(Δ− ⁣ ⁣∗H)\min(\Delta \mathbin{-\!\!*} H)min(Δ−∗H) (Theorem 3.13 of the paper), a formula that nests − ⁣ ⁣∗-\!\!*−∗ and negation around ∗*∗, which no automatic separation-logic prover handles and which says nothing directly about the shape of the missing memory. Theorem 3.25 shows that in the points-to fragment this object collapses to a finite disjunction of symbolic heaps, the format in which an analysis draws "pictures of memory", and that it can be computed. It gives an optimal abduction procedure against which the paper's heuristic procedure can be measured.

Formalizing it. The theorem is proved in the paper, but several steps are given as sketches ("the proof of each of these properties is straightforward", "a straightforward exercise"), Lemma 3.18 has only a proof sketch, and the quantifier-free subtraction display on p. 33 is incomplete as printed (it inspects only the points-to facts and not the pure part of the subtracted heap). A machine-checked development would supply the missing arguments, fix the subtraction step, and give a verified reference implementation of optimal abduction for points-to symbolic heaps. No part of it is known to have been formalized.

Difficulty

The obvious route is to compute min⁡(Δ− ⁣ ⁣∗H)\min(\Delta \mathbin{-\!\!*} H)min(Δ−∗H) directly, but − ⁣ ⁣∗-\!\!*−∗ quantifies over all heaps, and symbolic heaps have no syntax for it. The paper splits the problem into three phases (a ≤c\le_c≤c​-minimal solution from a proof system, the incompatible solutions, and min⁡\minmin), and each phase carries its own difficulty. The proof system's minimality (Lemma 3.19) must hold against arbitrary semantic predicates, not only symbolic heaps, and it fails as soon as Δ\DeltaΔ may denote more than one heap for a given stack (the paper notes that adding list segments breaks it). Computing min⁡\minmin needs subtraction of symbolic heaps with quantifiers, which in turn needs quantifier elimination for Boolean combinations of equalities over an infinite domain, and the paper's quantifier-free subtraction step has to be repaired. Showing that the final disjunction is ≾\precsim≾-least, not merely a solution, needs all three phases.

Formalization scope

All statements live in the namespace BiAbduction.Systematic. Values are ℕ with nil 0, locations are the nonzero naturals, variables are ℕ (program and logical variables form one sort), and heaps are maps ℕ → Option ℕ with 0 unallocated and finite domain. Finiteness of heaps is essential, since min⁡\minmin relies on well-foundedness of the subheap order. Predicates are arbitrary Set (Stack × Heap). The syntax is built from ℕ, Bool, Sum, Prod and List by abbreviations, so "computed by an algorithm" is Mathlib's Computable₂ with the standard Primcodable encodings. The left-hand side Δ\DeltaΔ has no true conjunct, as in the paper's proofs; the right-hand side may have one. Figure 2 is an inductive relation in which psto may match any right-hand points-to fact. The soundness and ≤c\le_c≤c​-minimality statements assume the paper's bound-variable convention (no variable bound in HHH occurs in Δ\DeltaΔ); the goal does not need it.

The goal cannot be met by a degenerate reading. The competitors MMM range over all predicates, not only over disjunctions, and computability refers to fixed standard encodings. The points-to semantics excludes nil addresses, and heaps are finite.

A complete development needs the separation-logic algebra of predicates (associativity and commutativity of ∗*∗, the adjunction between ∗*∗ and − ⁣ ⁣∗-\!\!*−∗), properties of min⁡\minmin under finite heaps, the soundness and minimality of the proof system, quantifier elimination for equality logic, and a computability argument for list-manipulating procedures. The semantic layer and the quantifier-elimination result are reusable beyond this mission. Contributions to any milestone, and to the supporting lemmas of §3.3 (Lemmas 3.10–3.11, Theorem 3.13), are welcome.

Theorem numbers and page references are those of the accepted manuscript of the J. ACM article (72 pages), not of the typeset journal version.

Selected references

  • C. Calcagno, D. Distefano, P. W. O'Hearn, H. Yang, Compositional Shape Analysis by means of Bi-Abduction, Journal of the ACM 58(6), Article 26, 2011. https://doi.org/10.1145/2049697.2049700
  • C. Calcagno, D. Distefano, P. W. O'Hearn, H. Yang, Compositional Shape Analysis by means of Bi-Abduction, POPL 2009. https://doi.org/10.1145/1480881.1480917
  • J. Berdine, C. Calcagno, P. W. O'Hearn, Symbolic Execution with Separation Logic, APLAS 2005. https://doi.org/10.1007/11575467_5
  • J. C. Reynolds, Separation Logic: A Logic for Shared Mutable Data Structures, LICS 2002. https://doi.org/10.1109/LICS.2002.1029817
  • D. Pym, P. W. O'Hearn, H. Yang, Possible Worlds and Resources: The Semantics of BI, Theoretical Computer Science 315(1), 2004. https://doi.org/10.1016/j.tcs.2003.11.020
13 thms2 active usersReviewed
Formal Verification·Captain: mikedeng1

Compositional Shape Analysis by Means of Bi-Abduction 2: With Precise Preconditions and Best Anti-Frames, the Canonical Precondition of an Action Sequence Is Its FootprintResearch Paper

Motivation

Automatic program analyses for heap-manipulating code have to infer, for each procedure, a precondition describing the memory the procedure needs. Calcagno, Distefano, O'Hearn and Yang (J. ACM 2011) do this with bi-abduction: at a call site the analysis asks for an anti-frame MMM, the missing memory, and a frame, the memory left untouched, so that the current state together with MMM meets the callee's precondition. Their tool, Abductor, and its successor Infer, derive specifications compositionally, procedure by procedure, without a whole program.

A natural question is what the inferred preconditions mean. The paper's informal answer is that the analysis aims at footprints: descriptions of the cells a program actually uses. §4.2.4 makes this precise for straight-line sequences of actions: if each precondition is precise and the prover always returns the best anti-frame, the inferred precondition is exactly the footprint. That result rests on the semantic theory of best abductive solutions developed in §3.3: with respect to a natural order, the abduction question F∗M⊨GF * M \models GF∗M⊨G has a unique best solution, min⁡(F− ⁣ ⁣∗G)\min(F \mathbin{-\!\!*} G)min(F−∗G).

Setting

A heap is a finite partial map from locations to values; a stack maps variables to values; a state is a stack–heap pair (s,h)(s,h)(s,h). A predicate is an arbitrary set of states. Write h=h0⊎h1h = h_0 \uplus h_1h=h0​⊎h1​ when h0,h1h_0, h_1h0​,h1​ have disjoint domains and hhh is their union, and h′⊆hh' \subseteq hh′⊆h for a subheap. The separating conjunction F∗GF * GF∗G holds of (s,h)(s,h)(s,h) when h=h0⊎h1h = h_0 \uplus h_1h=h0​⊎h1​ with (s,h0)∈F(s,h_0) \in F(s,h0​)∈F and (s,h1)∈G(s,h_1) \in G(s,h1​)∈G; true\mathsf{true}true is the set of all states; the separating implication F− ⁣ ⁣∗GF \mathbin{-\!\!*} GF−∗G holds of (s,h)(s,h)(s,h) when every disjoint h′h'h′ with (s,h′)∈F(s,h') \in F(s,h′)∈F gives (s,h⊎h′)∈G(s, h \uplus h') \in G(s,h⊎h′)∈G. Entailment F⊨GF \models GF⊨G is inclusion.

A solution of the abduction question F∗M⊨GF * M \models GF∗M⊨G is any predicate MMM with F∗M⊨GF * M \models GF∗M⊨G. Solutions are compared by the spatial preorder and the betterness order

M≤M′  ⟺  M′⊨M∗true,M≾M′  ⟺  (M≤M′∧M′≰M)∨(M≤M′∧M′≤M∧M⊨M′).M \le M' \iff M' \models M * \mathsf{true}, \qquad M \precsim M' \iff (M \le M' \wedge M' \not\le M) \vee (M \le M' \wedge M' \le M \wedge M \models M').M≤M′⟺M′⊨M∗true,M≾M′⟺(M≤M′∧M′≤M)∨(M≤M′∧M′≤M∧M⊨M′).

The minimal states of FFF are min⁡(F)\min(F)min(F): the states (s,h)∈F(s,h) \in F(s,h)∈F such that no proper subheap h′⊊hh' \subsetneq hh′⊊h has (s,h′)∈F(s,h') \in F(s,h′)∈F.

An action α\alphaα is given by its specification {Pα} α {Qα}\{P_\alpha\}\,\alpha\,\{Q_\alpha\}{Pα​}α{Qα​}, a pair of predicates. A predicate PPP is precise if every (s,h)(s,h)(s,h) has at most one subheap hf⊆hh_f \subseteq hhf​⊆h with (s,hf)∈P(s,h_f) \in P(s,hf​)∈P. For a nonempty sequence of actions, the safe states and the footprint are

safe(α)=Pα∗true,safe(α;C)=Pα∗(Qα− ⁣ ⁣∗safe(C)),foot(C)=min⁡(safe(C)).\mathrm{safe}(\alpha) = P_\alpha * \mathsf{true},\quad \mathrm{safe}(\alpha;C) = P_\alpha * \big(Q_\alpha \mathbin{-\!\!*} \mathrm{safe}(C)\big),\quad \mathrm{foot}(C) = \min(\mathrm{safe}(C)).safe(α)=Pα​∗true,safe(α;C)=Pα​∗(Qα​−∗safe(C)),foot(C)=min(safe(C)).

The canonical precondition PCP_CPC​ of a sequence, as computed by an ideal bi-abductive prover, is PαP_\alphaPα​ for a single action and Pα∗MP_\alpha * MPα​∗M for α;C\alpha; Cα;C, where MMM is the best solution of Qα∗M⊨PC∗trueQ_\alpha * M \models P_C * \mathsf{true}Qα​∗M⊨PC​∗true.

Formalization targets

Goal: Theorem 4.11 (Deriving Footprint)

If every precondition PβP_\betaPβ​ of the sequence is precise and every anti-frame is a ≾\precsim≾-best solution, then

foot(C)=PC.\mathrm{foot}(C) = P_C .foot(C)=PC​.

Milestones

  1. Lemma 3.10. ≤\le≤ is a preorder; M≤min⁡(M)M \le \min(M)M≤min(M) and min⁡(M)≤M\min(M) \le Mmin(M)≤M; and M,M′M, M'M,M′ are ≤\le≤-equivalent iff min⁡(M)=min⁡(M′)\min(M) = \min(M')min(M)=min(M′).
  2. Lemma 3.11. ≾\precsim≾ is a partial order, and M′≤MM' \le MM′≤M implies min⁡(M′)≾M\min(M') \precsim Mmin(M′)≾M.
  3. Lemma 3.12. F− ⁣ ⁣∗GF \mathbin{-\!\!*} GF−∗G is a ≤\le≤-least solution of F∗M⊨GF * M \models GF∗M⊨G; equivalently F∗M⊨G  ⟺  M⊨F− ⁣ ⁣∗GF * M \models G \iff M \models F \mathbin{-\!\!*} GF∗M⊨G⟺M⊨F−∗G.
  4. Theorem 3.13. The ≾\precsim≾-least solution exists, is unique, and equals min⁡(F− ⁣ ⁣∗G)\min(F \mathbin{-\!\!*} G)min(F−∗G).
  5. Proof of Theorem 4.11, safe states. safe(C)=foot(C)∗true\mathrm{safe}(C) = \mathrm{foot}(C) * \mathsf{true}safe(C)=foot(C)∗true for every sequence.
  6. Proof of Theorem 4.11, precision. If PPP is precise, min⁡(P∗X)=min⁡(P)∗min⁡(X)\min(P * X) = \min(P) * \min(X)min(P∗X)=min(P)∗min(X) for every XXX, and min⁡(P)=P\min(P) = Pmin(P)=P.

Significance

Theorem 3.13 gives the abduction question a canonical semantic answer, and it is the yardstick for every algorithm in the paper: the heuristic procedure of §3.2 is shown not to reach it, and the systematic procedure of §3.4 is proved to compute it on a restricted fragment. Theorem 4.11 connects this semantic optimum to program analysis: on straight-line paths, bi-abduction with an ideal prover infers neither more nor less memory than the program touches. It is the paper's theoretical justification for aiming the analysis at footprints.

Neither result has a machine-checked proof that this mission knows of; the platform has no separation-logic layer at all. The mission produces a self-contained semantic layer for separation logic over a concrete heap model (finite heaps, ∗*∗, − ⁣ ⁣∗\mathbin{-\!\!*}−∗, min⁡\minmin, the orders ≤\le≤ and ≾\precsim≾, precise predicates) that the companion mission on the systematic abduction algorithm, and later work on frame inference or footprint analysis, can share. The paper proves both results; the work here is to formalize those proofs.

Difficulty

Most steps are short once the definitions are fixed, and the paper states several of them as "immediate". Two points are not. First, min⁡(M)≤M\min(M) \le Mmin(M)≤M and the "if" direction of Lemma 3.10(3) need every state of MMM to lie above a minimal one; this holds because heaps are finite, so the subheap order is well founded, and fails for infinite heaps. Second, the inductive step of Theorem 4.11 passes through safe(C)=PC∗true\mathrm{safe}(C) = P_C * \mathsf{true}safe(C)=PC​∗true and through distributing min⁡\minmin over a precise ∗*∗-factor. Precision of PαP_\alphaPα​ is what forces the split of a minimal heap of Pα∗XP_\alpha * XPα​∗X to be unique; without it, the two sides of the displayed chain on p. 50 differ. The induction must carry precision for every action of the tail.

Formalization scope

Lean represents values and variables as natural numbers, with 000 as nil and the nonzero naturals as locations; a heap is a cell map ℕ → Option ℕ with cell 0 = none and finite domain; disjoint union is a relation. Predicates are Set (Stack × Heap), entailment is ⊆, and true\mathsf{true}true is Set.univ. Program and logical variables are not distinguished, and actions carry no parameters, as in §4.2.4; the stack is the same on both sides of every connective. "The minimal solution w.r.t. ≾\precsim≾" is the ≾\precsim≾-least solution, competing against every predicate, not only symbolic heaps. A sequence of actions is a head action plus a tail list, so the empty sequence never occurs. Theorem numbers and pages are those of the accepted manuscript of the J. ACM article (pp. 1–72, footer "Journal of the ACM, Vol. V, No. N, May 2011"), not of the typeset Article 26.

The paper does not define "the canonical spec" in §4.2.4. The formalization reads it from the proof of Theorem 4.11, as an inductive relation whose anti-frames are arbitrary ≾\precsim≾-least solutions. Defining the anti-frame as min⁡(Qα− ⁣ ⁣∗(PC∗true))\min(Q_\alpha \mathbin{-\!\!*} (P_C * \mathsf{true}))min(Qα​−∗(PC​∗true)) would build Theorem 3.13 into the definition, and dropping precision, allowing infinite heaps or restricting the competitors in the definition of a best solution would change the theorem; all of these are ruled out.

Needed infrastructure: the heap model with union and subheap lemmas, well-foundedness of strict subheap inclusion on finite heaps, the adjunction between ∗*∗ and − ⁣ ⁣∗\mathbin{-\!\!*}−∗, and upward closure of safe(C)\mathrm{safe}(C)safe(C). Reusable pieces, such as the heap model, the adjunction and the properties of min⁡\minmin, are welcome as separate lemmas.

Selected references

  • C. Calcagno, D. Distefano, P. W. O'Hearn, H. Yang, Compositional Shape Analysis by means of Bi-Abduction, Journal of the ACM 58(6), 2011. https://doi.org/10.1145/2049697.2049700
  • C. Calcagno, D. Distefano, P. W. O'Hearn, H. Yang, Compositional Shape Analysis by means of Bi-Abduction, POPL 2009. https://doi.org/10.1145/1480881.1480917
  • C. Calcagno, P. W. O'Hearn, H. Yang, Local Action and Abstract Separation Logic, LICS 2007. https://doi.org/10.1109/LICS.2007.30
  • D. Pym, P. W. O'Hearn, H. Yang, Possible Worlds and Resources: The Semantics of BI, Theoretical Computer Science 315(1), 2004. https://doi.org/10.1016/j.tcs.2003.11.020
  • J. C. Reynolds, Separation Logic: A Logic for Shared Mutable Data Structures, LICS 2002. https://doi.org/10.1109/LICS.2002.1029817
9 thms2 active usersReviewed
Harmonic AnalysisProbability·Captain: mikedeng1

On Lattices, Learning with Errors, Random Linear Codes, and Cryptography 1: A Discrete Gaussian on L + u Plus Continuous Gaussian Noise ν_s Is Within Statistical Distance 4ε of ν_t, t = √(r² + s²)Research Paper

Motivation

The learning with errors (LWE) problem underlies most of post-quantum public-key cryptography. Its hardness rests on Regev's reduction from worst-case lattice problems to LWE (Regev, J. ACM 2009). The reduction is iterative: it repeatedly turns samples of a discrete Gaussian on a lattice into samples of a narrower one. Its classical step, Lemma 3.11, needs the following fact. Adding continuous Gaussian noise to a discrete Gaussian sample gives, up to a small statistical distance, a continuous Gaussian. That fact is Claim 3.9 of the paper. Through Corollary 3.10 it turns a lattice point plus noise into an LWE-type sample with a periodic Gaussian error.

The tool behind it is the smoothing parameter of Micciancio and Regev (SIAM J. Comput. 2007). Above this width a discrete Gaussian on a lattice behaves like a continuous one. Claims of this type have since become standard in lattice-based cryptography: discrete Gaussian sampling, trapdoors, and the convolution theorems of Peikert (CRYPTO 2010).

This mission formalizes Claim 3.9 from the published J. ACM article (Article 34, 2009). The paper's main theorem, Theorem 3.1, is a quantum reduction about efficient algorithms. It is outside this series of missions.

Setting

Work in Rn\mathbb{R}^nRn with the Euclidean norm and Lebesgue measure. For s>0s > 0s>0 the Gaussian function is ρs(x)=exp⁡(−π∥x/s∥2)\rho_s(x) = \exp(-\pi\|x/s\|^2)ρs​(x)=exp(−π∥x/s∥2), its shift is ρs,c(x)=ρs(x−c)\rho_{s,c}(x) = \rho_s(x - c)ρs,c​(x)=ρs​(x−c), and νs=ρs/sn\nu_s = \rho_s/s^nνs​=ρs​/sn is a probability density (Eqs. (4)–(5)). For a countable set AAA, ρs(A)=∑x∈Aρs(x)\rho_s(A) = \sum_{x \in A}\rho_s(x)ρs​(A)=∑x∈A​ρs​(x).

A lattice L⊂RnL \subset \mathbb{R}^nL⊂Rn is the set of integer combinations of nnn linearly independent vectors. Its dual is L∗={y:⟨x,y⟩∈Z ∀x∈L}L^* = \{y : \langle x, y\rangle \in \mathbb{Z}\ \forall x \in L\}L∗={y:⟨x,y⟩∈Z ∀x∈L}, and det⁡(L∗)=1/det⁡(L)\det(L^*) = 1/\det(L)det(L∗)=1/det(L), where det⁡(L)\det(L)det(L) is the volume of a fundamental parallelepiped. For u∈Rnu \in \mathbb{R}^nu∈Rn and r>0r > 0r>0, the discrete Gaussian DL+u,rD_{L+u,r}DL+u,r​ is the distribution on the coset L+uL + uL+u with mass ρr(y)/ρr(L+u)\rho_r(y)/\rho_r(L+u)ρr​(y)/ρr​(L+u) at yyy (Eq. (6)).

For ϵ>0\epsilon > 0ϵ>0 the smoothing parameter ηϵ(L)\eta_\epsilon(L)ηϵ​(L) is the smallest sss with ρ1/s(L∗∖{0})≤ϵ\rho_{1/s}(L^*\setminus\{0\}) \le \epsilonρ1/s​(L∗∖{0})≤ϵ (Definition 2.10).

The statistical distance of two densities is Δ(φ1,φ2)=∫Rn∣φ1−φ2∣\Delta(\varphi_1,\varphi_2) = \int_{\mathbb{R}^n}|\varphi_1 - \varphi_2|Δ(φ1​,φ2​)=∫Rn​∣φ1​−φ2​∣, with no factor 12\tfrac1221​, so it ranges in [0,2][0,2][0,2].

Let r,s>0r, s > 0r,s>0 and t=r2+s2t = \sqrt{r^2+s^2}t=r2+s2​. The distribution YYY is obtained by sampling y∼DL+u,ry \sim D_{L+u,r}y∼DL+u,r​ and adding independent noise with density νs\nu_sνs​. Its density is

Y(x)=∑y∈L+uDL+u,r(y) νs(x−y).Y(x) = \sum_{y \in L+u} D_{L+u,r}(y)\,\nu_s(x - y).Y(x)=y∈L+u∑​DL+u,r​(y)νs​(x−y).

Formalization targets

Goal: Claim 3.9 (p. 34:25)

If rs/t≥ηϵ(L)rs/t \ge \eta_\epsilon(L)rs/t≥ηϵ​(L) for some 0<ϵ<120 < \epsilon < \tfrac120<ϵ<21​, then

Δ(Y,νt)≤4ϵ.\Delta(Y, \nu_t) \le 4\epsilon .Δ(Y,νt​)≤4ϵ.

Milestones, in attack order

  1. Lemma 2.14 (Poisson summation), already proved on the platform and used here as a reference: f(L)=det⁡(L∗)f^(L∗)f(L) = \det(L^*)\hat f(L^*)f(L)=det(L∗)f^​(L∗).
  2. The remark after Definition 2.10 (p. 34:19). The map s↦ρ1/s(L∗∖{0})s \mapsto \rho_{1/s}(L^*\setminus\{0\})s↦ρ1/s​(L∗∖{0}) is continuous and strictly decreasing on (0,∞)(0,\infty)(0,∞), with limits ∞\infty∞ at 000 and 000 at ∞\infty∞, and ηϵ(L)\eta_\epsilon(L)ηϵ​(L) is its inverse.
  3. The Fourier transform of a shifted Gaussian (p. 34:25), ρσ,c^(w)=e−2πi⟨c,w⟩σnρ1/σ(w)\widehat{\rho_{\sigma,c}}(w) = e^{-2\pi i\langle c,w\rangle}\sigma^n\rho_{1/\sigma}(w)ρσ,c​​(w)=e−2πi⟨c,w⟩σnρ1/σ​(w).
  4. Claim 3.8 (p. 34:24). If r≥ηϵ(L)r \ge \eta_\epsilon(L)r≥ηϵ​(L), then ρr(L+c)∈rndet⁡(L∗)(1±ϵ)\rho_r(L+c) \in r^n\det(L^*)(1\pm\epsilon)ρr​(L+c)∈rndet(L∗)(1±ϵ).
  5. Eq. (11) (p. 34:25), Y(x)=s−nρt(x) ρrs/t,(r/t)2x−u(L)/ρr,−u(L)Y(x) = s^{-n}\rho_t(x)\,\rho_{rs/t,(r/t)^2x-u}(L)/\rho_{r,-u}(L)Y(x)=s−nρt​(x)ρrs/t,(r/t)2x−u​(L)/ρr,−u​(L).
  6. The pointwise bound (p. 34:26), ∣Y(x)−ρt(x)/tn∣≤ρt(x)/tn⋅4ϵ|Y(x) - \rho_t(x)/t^n| \le \rho_t(x)/t^n\cdot 4\epsilon∣Y(x)−ρt​(x)/tn∣≤ρt​(x)/tn⋅4ϵ.

A supporting item states the bridge used in both proofs: if s≥ηϵ(L)s \ge \eta_\epsilon(L)s≥ηϵ​(L), then ρ1/s(L∗∖{0})≤ϵ\rho_{1/s}(L^*\setminus\{0\}) \le \epsilonρ1/s​(L∗∖{0})≤ϵ.

Significance

Claim 3.9 is what makes Regev's iterative step classical. A discrete Gaussian sample, blurred by continuous noise, cannot be told apart from a continuous Gaussian of the combined width, except with probability 2ϵ2\epsilon2ϵ. Corollary 3.10 projects this onto a direction zzz and reduces it modulo 1 to obtain LWE samples with periodic Gaussian error Ψβ\Psi_\betaΨβ​. Without it, the reduction from lattice problems to LWE has no way to produce its error distribution. Claim 3.8, a milestone here, says that above the smoothing parameter the discrete Gaussian measure is almost invariant under shifts. It is the basic estimate of the theory.

The results are proved in the paper; none of them is formalized. Lean's Mathlib has lattices, their covolume, dual submodules and the Gaussian Fourier transform. The platform has the Poisson summation formula for lattices. This mission adds the smoothing parameter, discrete Gaussians on cosets, and the first machine-checked convolution theorem for discrete and continuous Gaussians. Later work, such as Corollary 3.10 or Peikert's general convolution theorem, can build on it.

Difficulty

Neither density is a finite object. YYY is an infinite sum over a coset of a lattice, normalized by another infinite sum. A direct term-by-term comparison of Y(x)Y(x)Y(x) with νt(x)\nu_t(x)νt​(x) fails: the sum defining Y(x)Y(x)Y(x) is a Gaussian sum over a shifted lattice, and its value genuinely varies with the position of (r/t)2x−u(r/t)^2x - u(r/t)2x−u relative to LLL; for narrow Gaussians the variation is of order one. The claim is that this oscillation is uniformly small, with a relative error that depends only on ϵ\epsilonϵ, not on nnn, xxx or uuu. Two ratios of lattice sums must be bounded at once, uniformly in xxx. The constant 4ϵ4\epsilon4ϵ uses ϵ<12\epsilon < \tfrac12ϵ<21​ in an essential way, because (1+ϵ)/(1−ϵ)(1+\epsilon)/(1-\epsilon)(1+ϵ)/(1−ϵ) must stay below 1+4ϵ1+4\epsilon1+4ϵ.

The smoothing parameter is defined as a least element. That the least element exists, i.e. that the infimum is attained, is itself a statement about continuity and strict monotonicity of an infinite sum in its width.

Formalization scope

  • Rn\mathbb{R}^nRn is EuclideanSpace ℝ (Fin n).
  • A lattice is a Submodule ℤ with [DiscreteTopology L] [IsZLattice ℝ L].
  • L∗L^*L∗ is LinearMap.BilinForm.dualSubmodule (innerₗ _) L.
  • det⁡(L∗)\det(L^*)det(L∗) is written det⁡(L)−1\det(L)^{-1}det(L)−1 with det⁡(L)\det(L)det(L) = ZLattice.covolume L.
  • Lattice sums are real tsums. They are genuinely summable, so no summability hypothesis is added.
  • ηϵ(L)\eta_\epsilon(L)ηϵ​(L) is the real infimum of {s>0:ρ1/s(L∗∖{0})≤ϵ}\{s > 0 : \rho_{1/s}(L^*\setminus\{0\}) \le \epsilon\}{s>0:ρ1/s​(L∗∖{0})≤ϵ}. Its attainment is milestone 2, not part of the definition.
  • YYY is defined by its density, the formula on the first line of the proof.
  • Δ\DeltaΔ is a lower Lebesgue integral with values in [0,∞][0,\infty][0,∞] and no 12\tfrac1221​. A Bochner integral of a non-integrable difference would be 000 and make the bound free; this form rules that trivialization out.

Added hypotheses, each disclosed in the item.

  • ϵ>0\epsilon > 0ϵ>0 in Claim 3.9 and the pointwise bound (Claim 3.8 prints it). Definition 2.10 defines ηϵ\eta_\epsilonηϵ​ only for ϵ>0\epsilon > 0ϵ>0, and for ϵ≤0\epsilon \le 0ϵ≤0 the defining set is empty, so the hypothesis ηϵ(L)≤rs/t\eta_\epsilon(L) \le rs/tηϵ​(L)≤rs/t would be vacuous.
  • r>0r > 0r>0 in Claim 3.8, where ρr\rho_rρr​ requires it, and likewise s>0s > 0s>0 in the supporting item "s≥ηϵ(L)⇒ρ1/s(L∗∖{0})≤ϵs \ge \eta_\epsilon(L) \Rightarrow \rho_{1/s}(L^*\setminus\{0\}) \le \epsilons≥ηϵ​(L)⇒ρ1/s​(L∗∖{0})≤ϵ".
  • n≥1n \ge 1n≥1 in the smoothing remark, which fails for n=0n = 0n=0, where L∗∖{0}L^*\setminus\{0\}L∗∖{0} is empty.

Other conventions.

  • Lemma 2.14 is printed "for any function", with technical conditions omitted (p. 34:20). The referenced platform theorem is the version for Schwartz functions in translated form; every Gaussian used here is Schwartz.
  • Eq. (11) is formalized as the equality of its first and fifth lines, the real-valued completing-the-square identity. The Fourier-side lines are not stated.
  • The Fourier transform is Mathlib's 𝓕, ∫h(x)e−2πi⟨x,w⟩dx\int h(x)e^{-2\pi i\langle x,w\rangle}dx∫h(x)e−2πi⟨x,w⟩dx, as on p. 34:20.

Reusable beyond this mission: the Gaussian, coset-sum and smoothing-parameter definitions, Claim 3.8, and the shifted Fourier transform. Proofs of any milestone are welcome, and so are proofs of the summability and Schwartz facts for Gaussians on lattices that every milestone needs.

Selected references

  • O. Regev, On Lattices, Learning with Errors, Random Linear Codes, and Cryptography, Journal of the ACM 56(6), Article 34, 2009. https://doi.org/10.1145/1568318.1568324
  • D. Micciancio and O. Regev, Worst-Case to Average-Case Reductions Based on Gaussian Measures, SIAM Journal on Computing 37(1), 2007. https://doi.org/10.1137/S0097539705447360
  • C. Peikert, An Efficient and Parallel Gaussian Sampler for Lattices, CRYPTO 2010, LNCS 6223. https://doi.org/10.1007/978-3-642-14623-7_5
9 thms2 active usersReviewed
AnalysisProbability·Captain: mikedeng1

On Lattices, Learning with Errors, Random Linear Codes, and Cryptography 3: The Periodic Gaussians Ψ_α and Ψ_β Are Within Statistical Distance 9(β/α − 1) When 0 < α < β ≤ 2αResearch Paper

Motivation

The Learning with Errors (LWE) problem, introduced by Regev in On Lattices, Learning with Errors, Random Linear Codes, and Cryptography (J. ACM 56(6), 2009, Article 34; doi:10.1145/1568318.1568324), asks to recover a secret vector s∈Zpns \in \mathbb{Z}_p^ns∈Zpn​ from noisy inner products ⟨a,s⟩/p+e mod 1\langle a, s\rangle/p + e \bmod 1⟨a,s⟩/p+emod1. The noise eee is drawn from a periodic normal distribution Ψβ\Psi_\betaΨβ​ on the circle T=R/Z\mathbb{T} = \mathbb{R}/\mathbb{Z}T=R/Z: a centred normal variable reduced modulo 111. LWE has since become the main hardness assumption of lattice-based cryptography, including the post-quantum standards built on it.

Regev's reductions repeatedly need to compare Ψα\Psi_\alphaΨα​ and Ψβ\Psi_\betaΨβ​ for nearby parameters, for instance when the noise parameter is known only up to a small relative error. Claim 2.2 of the paper (p. 34:16) quantifies this: the two periodic normal distributions are close in statistical distance, linearly in the relative change β/α−1\beta/\alpha - 1β/α−1. This mission formalizes Claim 2.2 and the steps of its proof. The source is the published J. ACM article; the paper's main theorem, a quantum reduction from worst-case lattice problems to LWE, is outside this series.

Setting

Identify T=R/Z\mathbb{T} = \mathbb{R}/\mathbb{Z}T=R/Z with the segment [0,1)[0,1)[0,1) with addition modulo 111. For β>0\beta > 0β>0 the normal density with mean 000 and standard deviation β/2π\beta/\sqrt{2\pi}β/2π​ is

νβ(x)=1βexp⁡(−π(xβ)2),x∈R,\nu_\beta(x) = \frac{1}{\beta}\exp\Bigl(-\pi\Bigl(\frac{x}{\beta}\Bigr)^2\Bigr), \qquad x \in \mathbb{R},νβ​(x)=β1​exp(−π(βx​)2),x∈R,

(Eq. (5) in dimension one), and the periodic normal density (Eq. (7)) is its periodization

Ψβ(r)=∑k=−∞∞1βexp⁡(−π(r−kβ)2),r∈[0,1),\Psi_\beta(r) = \sum_{k=-\infty}^{\infty} \frac{1}{\beta}\exp\Bigl(-\pi\Bigl(\frac{r-k}{\beta}\Bigr)^2\Bigr), \qquad r \in [0,1),Ψβ​(r)=k=−∞∑∞​β1​exp(−π(βr−k​)2),r∈[0,1),

the density of a νβ\nu_\betaνβ​-distributed variable reduced modulo 111.

The statistical distance of two densities φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ (p. 34:14) is

Δ(φ1,φ2)=∫∣φ1−φ2∣,\Delta(\varphi_1, \varphi_2) = \int |\varphi_1 - \varphi_2|,Δ(φ1​,φ2​)=∫∣φ1​−φ2​∣,

the integral taken over R\mathbb{R}R for densities on the line and over [0,1)[0,1)[0,1) for densities on T\mathbb{T}T. The paper uses this normalization without a factor 12\tfrac1221​, so that Δ\DeltaΔ ranges in [0,2][0,2][0,2] on probability densities. In Lean these objects are RegevLWE.PeriodicGauss.nu, Psi, statDist and statDistT.

Formalization targets

Goal: Claim 2.2

For any 0<α<β≤2α0 < \alpha < \beta \le 2\alpha0<α<β≤2α,

Δ(Ψα,Ψβ)≤9(βα−1).\Delta(\Psi_\alpha, \Psi_\beta) \le 9\Bigl(\frac{\beta}{\alpha} - 1\Bigr).Δ(Ψα​,Ψβ​)≤9(αβ​−1).

The hypotheses and the constant 999 are exactly as printed.

Milestones

  1. The bound on the line (proof of Claim 2.2, first sentence). For 0<α<β≤2α0 < \alpha < \beta \le 2\alpha0<α<β≤2α,
Δ(να,νβ)≤9(βα−1).\Delta(\nu_\alpha, \nu_\beta) \le 9\Bigl(\frac{\beta}{\alpha} - 1\Bigr).Δ(να​,νβ​)≤9(αβ​−1).
  1. Reduction modulo 1 does not increase Δ\DeltaΔ (p. 34:15, used on p. 34:16): for integrable φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ on R\mathbb{R}R, the periodizations φ~i(r)=∑kφi(r−k)\tilde\varphi_i(r) = \sum_k \varphi_i(r-k)φ~​i​(r)=∑k​φi​(r−k) satisfy Δ(φ~1,φ~2)≤Δ(φ1,φ2)\Delta(\tilde\varphi_1, \tilde\varphi_2) \le \Delta(\varphi_1, \varphi_2)Δ(φ~​1​,φ~​2​)≤Δ(φ1​,φ2​).
  2. The three displayed steps of the proof after normalizing to α=1\alpha = 1α=1, β=1+ϵ\beta = 1 + \epsilonβ=1+ϵ, 0<ϵ≤10 < \epsilon \le 10<ϵ≤1: the first display (a triangle-inequality split and an exact evaluation), the pointwise bound
∣e−π(1−1/(1+ϵ)2)x2−1∣≤π(1−1/(1+ϵ)2)x2≤2πϵx2,\bigl|e^{-\pi(1-1/(1+\epsilon)^2)x^2} - 1\bigr| \le \pi\bigl(1 - 1/(1+\epsilon)^2\bigr)x^2 \le 2\pi\epsilon x^2,​e−π(1−1/(1+ϵ)2)x2−1​≤π(1−1/(1+ϵ)2)x2≤2πϵx2,

and the final evaluation

ϵ+2πϵ∫Rx2e−πx2/(1+ϵ)2 dx=ϵ+ϵ(1+ϵ)3≤9ϵ.\epsilon + 2\pi\epsilon\int_{\mathbb{R}} x^2 e^{-\pi x^2/(1+\epsilon)^2}\,dx = \epsilon + \epsilon(1+\epsilon)^3 \le 9\epsilon.ϵ+2πϵ∫R​x2e−πx2/(1+ϵ)2dx=ϵ+ϵ(1+ϵ)3≤9ϵ.

Significance

Claim 2.2 is a stability statement for the LWE error distribution. It lets an algorithm that works for one noise parameter be applied to a nearby one at a controlled cost in statistical distance, which is how Regev's reductions tolerate an approximately known parameter. It also states a quantitative fact about wrapped normal distributions, which appear outside cryptography, for example in directional statistics.

The result is proved in the paper; no machine-checked proof is known to this mission. Formalizing it produces a reusable one-dimensional toolkit: the L1L^1L1 distance between two centred normal densities, the second moment of a Gaussian in Regev's normalization, and the contraction of L1L^1L1 distance under periodization. Each of these is a building block for formalizing the rest of the paper's analysis of Gaussian noise.

Difficulty

The arithmetic is elementary; the work is in the analysis. The statement on T\mathbb{T}T involves infinite series inside an integral, and the passage from the line to the circle requires exchanging a sum over Z\mathbb{Z}Z with an integral and controlling the series almost everywhere. A direct attack on Ψα−Ψβ\Psi_\alpha - \Psi_\betaΨα​−Ψβ​ termwise on [0,1)[0,1)[0,1) does not by itself produce a bound in terms of β/α−1\beta/\alpha - 1β/α−1; the comparison has to be made on the line first. On the line, the scaling to α=1\alpha = 1α=1 is a change of variables in a Lebesgue integral, and the evaluation of ∫x2e−πx2/σ2dx=σ3/(2π)\int x^2 e^{-\pi x^2/\sigma^2}dx = \sigma^3/(2\pi)∫x2e−πx2/σ2dx=σ3/(2π) requires Gaussian moment identities in the paper's normalization rather than Mathlib's.

Formalization scope

  • Reals and densities. Everything is one-dimensional over R\mathbb{R}R; distributions are represented by their densities, not by measures. T\mathbb{T}T is the interval Set.Ico 0 1 with Lebesgue measure; Ψβ\Psi_\betaΨβ​ is a real tsum over k∈Zk \in \mathbb{Z}k∈Z, which converges absolutely for β≠0\beta \ne 0β=0.
  • Statistical distance. Δ\DeltaΔ is a lower Lebesgue integral ∫⁻ ENNReal.ofReal |φ₁ - φ₂| valued in [0,∞][0,\infty][0,∞], with no factor 12\tfrac1221​, as on p. 34:14. Bounds are compared through ENNReal.ofReal. A Bochner integral would be 000 on a non-integrable difference and would make any upper bound trivially true; the extended-valued integral rules this out.
  • Added hypotheses. None on the goal or on the line bound. The modulo-1 milestone assumes φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ integrable (the paper states the data-processing fact for random variables, whose densities are integrable); only the "modulo 1" instance used in the proof is stated, not the general inequality for arbitrary randomized functions. The pointwise bound is stated for every ϵ≥0\epsilon \ge 0ϵ≥0, a harmless generalization of the proof's range 0<ϵ≤10 < \epsilon \le 10<ϵ≤1. The first display is stated as its three component facts (inequality, evaluation =ϵ= \epsilon=ϵ, and the rewriting of the integrand), which together give the printed chain.
  • No trivialization. The goal is Claim 2.2 on T\mathbb{T}T, not the bound on the line, and neither side can collapse to a junk value: the left side is an extended nonnegative integral and the right side is positive under the hypotheses.
  • Welcome contributions. Gaussian moment lemmas in the normalization e−πx2/s2e^{-\pi x^2/s^2}e−πx2/s2, the periodization contraction for general integrable functions, and a measure-level statement identifying Ψβ\Psi_\betaΨβ​ with the pushforward of νβ\nu_\betaνβ​ under reduction modulo 111.

Selected references

  • O. Regev, On Lattices, Learning with Errors, Random Linear Codes, and Cryptography, Journal of the ACM 56(6), Article 34, 2009. https://doi.org/10.1145/1568318.1568324
  • D. Micciancio and S. Goldwasser, Complexity of Lattice Problems: A Cryptographic Perspective, Kluwer, 2002 (cited on p. 34:15 for the data-processing property of statistical distance). https://doi.org/10.1007/978-1-4615-0897-7
7 thms2 active usersReviewed
Number TheoryProbability·Captain: mikedeng1

On Lattices, Learning with Errors, Random Linear Codes, and Cryptography 5: If Every χ^⋆k Is Below ⌊p/2⌋/2 with Probability > 1 − δ, the Cryptosystem Decrypts Correctly with Probability ≥ 1 − δResearch Paper

Motivation

Learning with errors (LWE) asks to recover a secret vector s∈Zpns \in \mathbb Z_p^ns∈Zpn​ from noisy inner products (ai,⟨ai,s⟩+ei)(a_i, \langle a_i, s\rangle + e_i)(ai​,⟨ai​,s⟩+ei​), where the aia_iai​ are uniform and the errors eie_iei​ are drawn from a narrow distribution χ\chiχ on Zp\mathbb Z_pZp​. Regev introduced the problem and showed that solving it is at least as hard as solving worst-case lattice problems by a quantum algorithm (Regev 2009). The same paper uses LWE to build a public-key cryptosystem, the ancestor of most lattice-based encryption schemes in use today, including the schemes standardized by NIST in 2024 (ML-KEM, derived from Kyber).

A cryptosystem has two halves: security (an eavesdropper learns nothing about the plaintext) and correctness (the legitimate receiver recovers the plaintext). This mission is the correctness half of Regev's scheme: Lemma 5.1 of the paper, which converts a tail bound on the noise into a bound on the probability that decryption fails. The source is the published article, Journal of the ACM 56(6), Article 34 (2009). The paper's main theorem, a quantum reduction from lattice problems to LWE, is outside this series.

Setting

Fix an integer p≥2p \ge 2p≥2 and let Zp={0,1,…,p−1}\mathbb Z_p = \{0, 1, \dots, p-1\}Zp​={0,1,…,p−1} with addition modulo ppp. Fix integers n,m≥0n, m \ge 0n,m≥0 and a probability distribution χ\chiχ on Zp\mathbb Z_pZp​. All additions are in Zp\mathbb Z_pZp​, and ⟨a,s⟩=∑jajsj\langle a, s\rangle = \sum_j a_j s_j⟨a,s⟩=∑j​aj​sj​ for a,s∈Zpna, s \in \mathbb Z_p^na,s∈Zpn​.

  • Distance from zero. For a∈Zpa \in \mathbb Z_pa∈Zp​, ∣a∣|a|∣a∣ (absZ) is the integer aaa if a∈{0,…,⌊p/2⌋}a \in \{0, \dots, \lfloor p/2\rfloor\}a∈{0,…,⌊p/2⌋} and p−ap - ap−a otherwise.
  • Convolution powers. χ⋆k\chi^{\star k}χ⋆k (convPow χ k) is the law of the sum of kkk independent samples from χ\chiχ; χ⋆0\chi^{\star 0}χ⋆0 is the point mass at 000.
  • Private key. s∈Zpns \in \mathbb Z_p^ns∈Zpn​, chosen uniformly.
  • Public key. a1,…,am∈Zpna_1, \dots, a_m \in \mathbb Z_p^na1​,…,am​∈Zpn​ independent and uniform, e1,…,em∈Zpe_1, \dots, e_m \in \mathbb Z_pe1​,…,em​∈Zp​ independent with law χ\chiχ, and (ai,bi)i=1m(a_i, b_i)_{i=1}^m(ai​,bi​)i=1m​ with bi=⟨ai,s⟩+eib_i = \langle a_i, s\rangle + e_ibi​=⟨ai​,s⟩+ei​ (publicKey).
  • Encryption. A subset S⊆[m]S \subseteq [m]S⊆[m] is chosen uniformly among all 2m2^m2m subsets. The bit 000 is encrypted as (∑i∈Sai,∑i∈Sbi)\bigl(\sum_{i\in S} a_i, \sum_{i\in S} b_i\bigr)(∑i∈S​ai​,∑i∈S​bi​) and the bit 111 as (∑i∈Sai,⌊p/2⌋+∑i∈Sbi)\bigl(\sum_{i\in S} a_i, \lfloor p/2\rfloor + \sum_{i\in S} b_i\bigr)(∑i∈S​ai​,⌊p/2⌋+∑i∈S​bi​) (encrypt).
  • Decryption. A pair (a,b)(a, b)(a,b) decrypts to 000 if b−⟨a,s⟩b - \langle a, s\rangleb−⟨a,s⟩ is closer to 000 than to ⌊p/2⌋\lfloor p/2\rfloor⌊p/2⌋ modulo ppp, i.e. ∣b−⟨a,s⟩∣<∣b−⟨a,s⟩−⌊p/2⌋∣|b - \langle a, s\rangle| < |b - \langle a, s\rangle - \lfloor p/2\rfloor|∣b−⟨a,s⟩∣<∣b−⟨a,s⟩−⌊p/2⌋∣, and to 111 otherwise (decrypt, decodeResidue).

The outcome distribution outcome n m χ c of a bit ccc is the law of the decrypted bit when all of sss, a1,…,ama_1,\dots,a_ma1​,…,am​, e1,…,eme_1,\dots,e_me1​,…,em​ and SSS are drawn as above.

Formalization targets

Goal: Lemma 5.1 (Correctness), p. 34:35

Let δ>0\delta > 0δ>0 and assume that for every k∈{0,1,…,m}k \in \{0, 1, \dots, m\}k∈{0,1,…,m},

Pr⁡e∼χ⋆k[ ∣e∣<⌊p2⌋/2 ]>1−δ.\Pr_{e \sim \chi^{\star k}}\Bigl[\,|e| < \Bigl\lfloor \frac p2\Bigr\rfloor\Big/2\,\Bigr] > 1 - \delta .e∼χ⋆kPr​[∣e∣<⌊2p​⌋/2]>1−δ.

Then for each bit c∈{0,1}c \in \{0,1\}c∈{0,1},

Pr⁡[decryption of an encryption of c equals c]≥1−δ,\Pr[\text{decryption of an encryption of } c \text{ equals } c] \ge 1 - \delta ,Pr[decryption of an encryption of c equals c]≥1−δ,

the probability being over all the randomness of the protocol. The lemma has no hard-coded parameters: ppp, mmm, nnn, χ\chiχ and δ\deltaδ are arbitrary, and the paper's concrete choice (ppp prime in [n2,2n2][n^2, 2n^2][n2,2n2], χ=Ψˉα(n)\chi = \bar\Psi_{\alpha(n)}χ=Ψˉα(n)​) is supplied separately by Claim 5.2.

Milestones (proof of Lemma 5.1, p. 34:36)

  1. Residue identity. For an encryption (a,b)(a, b)(a,b) of 000, b−⟨a,s⟩=∑i∈Seib - \langle a, s\rangle = \sum_{i\in S} e_ib−⟨a,s⟩=∑i∈S​ei​; for an encryption of 111, b−⟨a,s⟩=⌊p/2⌋+∑i∈Seib - \langle a, s\rangle = \lfloor p/2\rfloor + \sum_{i\in S} e_ib−⟨a,s⟩=⌊p/2⌋+∑i∈S​ei​.
  2. Residue law. For a fixed SSS, ∑i∈Sei∼χ⋆∣S∣\sum_{i\in S} e_i \sim \chi^{\star |S|}∑i∈S​ei​∼χ⋆∣S∣.
  3. Rounding. If ∣x∣<⌊p/2⌋/2|x| < \lfloor p/2\rfloor/2∣x∣<⌊p/2⌋/2 then xxx is closer to 000 than to ⌊p/2⌋\lfloor p/2\rfloor⌊p/2⌋, so the residue xxx decrypts to 000 and the residue ⌊p/2⌋+x\lfloor p/2\rfloor + x⌊p/2⌋+x decrypts to 111.

Significance

The result. Lemma 5.1 is the interface between the noise distribution and the scheme: any bound on the tails of the convolution powers χ⋆k\chi^{\star k}χ⋆k, k≤mk \le mk≤m, gives a bound on the decryption error, independently of the security analysis. With Claim 5.2 it shows that the paper's parameters decrypt correctly except with negligible probability. The same template (residue equals accumulated noise; small noise rounds correctly) underlies the correctness proofs of essentially every later LWE-based encryption scheme.

Formalizing it. The result is proved in the paper and is elementary; it is not open. As far as is known, no machine-checked statement of Regev's scheme as a probability experiment exists on Prove2Me; related platform items concern a different scheme (a dual-Regev variant with deterministic noise bounds over an even modulus). The mission's contribution is a faithful, reusable definition of the cryptosystem as a probability experiment over all of its randomness, together with a proof of its correctness lemma. The definitions (the distance ∣⋅∣|\cdot|∣⋅∣ on Zp\mathbb Z_pZp​, convolution powers of a distribution on Zp\mathbb Z_pZp​, i.i.d. product distributions) are reusable by later missions on the security proof (Claim 5.3, Lemma 5.4) or on other LWE schemes.

Difficulty

The arithmetic is short; the work lies in the probability bookkeeping. The hypothesis controls the law of the noise for each fixed subset size, while the conclusion is about a single experiment in which SSS is random and independent of the errors, and the keys sss and aia_iai​ are random too. The step that needs care is identifying the law of ∑i∈Sei\sum_{i\in S} e_i∑i∈S​ei​ for a fixed SSS with χ⋆∣S∣\chi^{\star|S|}χ⋆∣S∣ from a product distribution, and then averaging over SSS; the uniform choices of sss and aia_iai​ must be shown not to affect the residue. A second point is the rounding step: ∣⋅∣|\cdot|∣⋅∣ is a cyclic distance on Zp\mathbb Z_pZp​, and the strict inequality ∣x∣<⌊p/2⌋/2|x| < \lfloor p/2\rfloor/2∣x∣<⌊p/2⌋/2 is sharp (at ∣x∣=⌊p/2⌋/2|x| = \lfloor p/2\rfloor/2∣x∣=⌊p/2⌋/2 the residue is equidistant and decrypts to 111), so odd and even ppp and ties must be handled exactly as printed.

Formalization scope

  • p:Np : \mathbb Np:N with [NeZero p] and the hypothesis 2≤p2 \le p2≤p (the paper defines Zp\mathbb Z_pZp​ for p≥2p \ge 2p≥2, p. 34:14). Primality, part of the paper's parameter choice, is not assumed: Lemma 5.1 does not use it.
  • Zp\mathbb Z_pZp​ is ZMod p, vectors are Fin n → ZMod p, ⟨a,s⟩\langle a, s\rangle⟨a,s⟩ is a ⬝ᵥ s, bits are Fin 2, and subsets of [m][m][m] are Finset (Fin m).
  • Distributions are PMFs. χ⋆k\chi^{\star k}χ⋆k is defined recursively by binds; the i.i.d. errors use the product PMF with mass ∏iχ(ei)\prod_i \chi(e_i)∏i​χ(ei​); uniform choices are PMF.uniformOfFintype. The experiment outcome n m χ c draws sss, then aaa, then eee, then SSS, all independently.
  • ∣a∣|a|∣a∣ is computed from the representative a.val; ⌊p/2⌋\lfloor p/2\rfloor⌊p/2⌋ is natural-number division p / 2; ⌊p/2⌋/2\lfloor p/2\rfloor/2⌊p/2⌋/2 is compared in R\mathbb RR, since it can be a half-integer.
  • Decryption ties (∣x∣=∣x−⌊p/2⌋∣|x| = |x - \lfloor p/2\rfloor|∣x∣=∣x−⌊p/2⌋∣) decrypt to 111, as printed ("Otherwise, the decryption is 1").
  • Probabilities in the goal are real numbers (toReal of PMF masses, exact because they are at most 111). The form ENNReal.ofReal (1 − δ) < Pr was rejected: for δ≥1\delta \ge 1δ≥1 it would add the hypothesis Pr⁡>0\Pr > 0Pr>0, which the page does not make.
  • The goal is not a statement about a fixed key, a fixed subset SSS or a fixed error vector: the probability is over all of sss, aia_iai​, eie_iei​ and SSS, and the hypothesis quantifies over every k∈{0,…,m}k \in \{0, \dots, m\}k∈{0,…,m}. A formalization conditioning on any of these would be a different (weaker) theorem. For k=0k = 0k=0 the hypothesis reads 1>1−δ1 > 1 - \delta1>1−δ, true for δ>0\delta > 0δ>0, so it imposes no hidden restriction.
  • No printed slip was found in Lemma 5.1 or its proof.

Contributions welcome: proofs of the three milestones and the goal; general lemmas on convolution powers and product distributions of PMFs on finite groups.

Selected references

  • O. Regev, On Lattices, Learning with Errors, Random Linear Codes, and Cryptography, Journal of the ACM 56(6), Article 34, 2009. https://doi.org/10.1145/1568318.1568324
  • O. Regev, The Learning with Errors Problem, IEEE Conference on Computational Complexity (invited survey), 2010. https://doi.org/10.1109/CCC.2010.26
  • NIST, Module-Lattice-Based Key-Encapsulation Mechanism Standard, FIPS 203, 2024. https://doi.org/10.6028/NIST.FIPS.203
5 thms2 active usersReviewed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

Fast Approximation Algorithms for Fractional Packing and Covering Problems 3: An ε-Relaxed Decision Procedure for the General Problem Ax ≤ b, x ∈ P Using O(ρ²ε⁻² log(mρ/ε)) Oracle CallsResearch Paper

Motivation

Many linear programs that arise in combinatorial optimization have a few "complicating" constraints Ax≤bAx \le bAx≤b on top of a set PPP over which linear optimization is easy: multicommodity flow, where PPP is a product of single-commodity flow polytopes; scheduling and the Held–Karp bound, where PPP is a polytope of assignments or trees. Plotkin, Shmoys and Tardos showed that for such problems an approximate solution can be found with a number of calls to the linear optimizer over PPP that depends on the required accuracy and on a structural quantity, the width, but only logarithmically on the number of constraints. Their packing and covering algorithms (§§2–3 of the paper) assume nonnegative data. Section 4 removes that assumption and treats an arbitrary system of linear inequalities over a convex set. This framework, later known as the multiplicative-weights method for linear programs, is among the standard tools of approximation algorithms (Arora, Hazan and Kale's 2012 survey gives the modern account).

Timeline. Shahrokhi and Matula (1990) gave an exponential-potential algorithm for the maximum concurrent flow problem. Plotkin, Shmoys and Tardos (FOCS 1991; Cornell ORIE Technical Report 999, 1992; Mathematics of Operations Research 1995) generalized it to fractional packing, covering and the general problem of this mission. Grigoriadis and Khachiyan (1994–1996) obtained related bounds for block-angular and convex resource-sharing problems. Garg and Könemann (1998) and Arora, Hazan and Kale (2012) gave width-free or simplified variants.

Setting

An instance of the GENERAL problem consists of an arbitrary real m×nm\times nm×n matrix AAA with rows a1,…,ama_1,\dots,a_ma1​,…,am​, an arbitrary vector b∈Rmb\in\mathbb R^mb∈Rm, a convex set P⊆RnP\subseteq\mathbb R^nP⊆Rn, and a positive vector d∈Rmd\in\mathbb R^md∈Rm that sets the scale of the allowed error. The question is whether some x∈Px\in Px∈P satisfies Ax≤bAx\le bAx≤b. Such a point is an exact solution; a point x∈Px\in Px∈P with Ax≤b+εdAx\le b+\varepsilon dAx≤b+εd is an ε\varepsilonε-approximate solution.

For x∈Px\in Px∈P write

λ(x)=max⁡1≤i≤maix−bidi,\lambda(x)=\max_{1\le i\le m}\frac{a_ix-b_i}{d_i},λ(x)=1≤i≤mmax​di​ai​x−bi​​,

the least λ\lambdaλ with Ax≤b+λdAx\le b+\lambda dAx≤b+λd; it may be negative. The width is ρ=max⁡imax⁡x∈P∣aix−bi∣/di\rho=\max_i\max_{x\in P}|a_ix-b_i|/d_iρ=maxi​maxx∈P​∣ai​x−bi​∣/di​. Access to PPP is through subroutine (10): given y≥0y\ge 0y≥0 in Rm\mathbb R^mRm, return x~∈P\tilde x\in Px~∈P minimizing ytAxy^tAxytAx over PPP. For a dual vector y≥0y\ge0y≥0 let CG(y)=min⁡{yt(Ax−b):x∈P}C_{\mathcal G}(y)=\min\{y^t(Ax-b):x\in P\}CG​(y)=min{yt(Ax−b):x∈P}. The relaxed optimality conditions for a point xxx with λ=λ(x)\lambda=\lambda(x)λ=λ(x) and a dual vector yyy are

(G1)  λ ytd≤4 yt(Ax−b),(G2)  yt(Ax−b)−CG(y)≤λ5 ytd.(\mathcal G1)\ \ \lambda\,y^td\le 4\,y^t(Ax-b),\qquad(\mathcal G2)\ \ y^t(Ax-b)-C_{\mathcal G}(y)\le\tfrac{\lambda}{5}\,y^td.(G1)  λytd≤4yt(Ax−b),(G2)  yt(Ax−b)−CG​(y)≤5λ​ytd.

The dual solution corresponding to xxx with parameter α\alphaα is yi=di−1eα(aix−bi)/diy_i=d_i^{-1}e^{\alpha(a_ix-b_i)/d_i}yi​=di−1​eα(ai​x−bi​)/di​, and its potential is Φ=ytd\Phi=y^tdΦ=ytd. Procedure IMPROVE-GENERAL (Figure 4) starts from x0∈Px_0\in Px0​∈P with λ0=λ(x0)\lambda_0=\lambda(x_0)λ0​=λ(x0​), fixes α\alphaα and a step size σ\sigmaσ, and, while λ(x)≥λ0/2\lambda(x)\ge\lambda_0/2λ(x)≥λ0​/2 and (G2)(\mathcal G2)(G2) fails, replaces xxx by (1−σ)x+σx~(1-\sigma)x+\sigma\tilde x(1−σ)x+σx~, where x~\tilde xx~ is the oracle's answer for the current dual solution. The driver calls IMPROVE-GENERAL repeatedly, stopping with an ε\varepsilonε-approximate solution or with a report that none exists.

Formalization targets

Goal: Theorem 4.5

For every ε∈(0,1)\varepsilon\in(0,1)ε∈(0,1), every start x0∈Px_0\in Px0​∈P and every exact minimizing oracle, the driver stops; an output point is an ε\varepsilonε-approximate solution; an infeasibility report is correct (∄x∈P\nexists x\in P∄x∈P with Ax≤bAx\le bAx≤b); and the number of oracle calls is at most

N=2(⌊log⁡2(ρ/ε)⌋+1)+11520 ρ2ε2ln⁡12 m max⁡(ρ,ε)ε=O ⁣(ρ2ε−2log⁡mρε).N=2\big(\lfloor\log_2(\rho/\varepsilon)\rfloor+1\big)+11520\,\frac{\rho^2}{\varepsilon^2}\ln\frac{12\,m\,\max(\rho,\varepsilon)}{\varepsilon}=O\!\Big(\rho^2\varepsilon^{-2}\log\frac{m\rho}{\varepsilon}\Big).N=2(⌊log2​(ρ/ε)⌋+1)+11520ε2ρ2​lnε12mmax(ρ,ε)​=O(ρ2ε−2logεmρ​).

Milestones

  1. Lemma 4.1. If x∈Px\in Px∈P, y≥0y\ge0y≥0, y≠0y\ne0y=0 satisfy (G1)(\mathcal G1)(G1) and (G2)(\mathcal G2)(G2) with λ(x)>0\lambda(x)>0λ(x)>0, no exact solution exists.
  2. Lemma 4.2. If α≥2λ−1ln⁡(6mρλ−1)\alpha\ge2\lambda^{-1}\ln(6m\rho\lambda^{-1})α≥2λ−1ln(6mρλ−1), then xxx and its dual solution satisfy (G1)(\mathcal G1)(G1).
  3. Lemma 4.3. If (G2)(\mathcal G2)(G2) fails and 0≤σ≤λ/(24αρ2)0\le\sigma\le\lambda/(24\alpha\rho^2)0≤σ≤λ/(24αρ2), the step to (1−σ)x+σx~(1-\sigma)x+\sigma\tilde x(1−σ)x+σx~ lowers the potential: Φ−Φ^≥ασλΦ/30\Phi-\hat\Phi\ge\alpha\sigma\lambda\Phi/30Φ−Φ^≥ασλΦ/30.
  4. Theorem 4.4. IMPROVE-GENERAL started with λ0>0\lambda_0>0λ0​>0 stops after at most 2+8640ρ2λ0−2ln⁡(12mρλ0−1)2+8640\rho^2\lambda_0^{-2}\ln(12m\rho\lambda_0^{-1})2+8640ρ2λ0−2​ln(12mρλ0−1​) oracle calls.

Significance

The result gives an ε\varepsilonε-relaxed decision procedure for any system of linear inequalities over a convex set with a linear-optimization oracle, with no sign conditions on the data. Its oracle-call count is independent of nnn and logarithmic in mmm, which is what makes it useful when mmm is large and PPP has a fast combinatorial optimizer. The simultaneous packing-and-covering problem is the special case where every row is either nonnegative or nonpositive; the paper's width-reduction techniques (§5) and applications (§6) build on this procedure and on its packing and covering counterparts.

The paper's statements use O(⋅)O(\cdot)O(⋅) and Ω(⋅)\Omega(\cdot)Ω(⋅); this mission states the explicit constants that the paper's own proofs give. The result is proved in the literature; no machine-checked proof of it is known on Prove2Me or in Mathlib. It also records a gap in Figure 4 (below) and states the theorem for the smallest correction that makes the paper's proof go through. Formalizing the analysis yields reusable potential-function arguments (second-order bounds on ex+δe^{x+\delta}ex+δ, geometric decrease of a potential between two levels) of the kind used throughout multiplicative-weights analyses.

Difficulty

The correctness half is short; the complexity half carries the weight. Lemma 4.3 needs a second-order bound on the exponential that is valid only when the step changes each exponent by at most 1/21/21/2, so the step size must be tied to λ\lambdaλ and ρ\rhoρ. Theorem 4.4 then has to control the potential between a ceiling meαλ0me^{\alpha\lambda_0}meαλ0​ and a floor eαλ0/2e^{\alpha\lambda_0/2}eαλ0​/2 while λ\lambdaλ moves, and Theorem 4.5 has to sum the per-call bounds over a sequence of calls whose λ0\lambda_0λ0​ halves each time, so that the last call dominates.

The first reading of Figure 4 fails here: Figure 4 fixes α=4λ0−1ln⁡(6mρλ0−1)\alpha=4\lambda_0^{-1}\ln(6m\rho\lambda_0^{-1})α=4λ0−1​ln(6mρλ0−1​) and σ=λ0/(24αρ2)\sigma=\lambda_0/(24\alpha\rho^2)σ=λ0​/(24αρ2) from λ0\lambda_0λ0​, but the loop runs for every λ≥λ0/2\lambda\ge\lambda_0/2λ≥λ0​/2. For λ<λ0\lambda<\lambda_0λ<λ0​ the hypothesis σ≤λ/(24αρ2)\sigma\le\lambda/(24\alpha\rho^2)σ≤λ/(24αρ2) of Lemma 4.3 fails, and the decrease bound from its proof becomes negative for λ<5λ0/6\lambda<5\lambda_0/6λ<5λ0​/6. At λ=λ0/2\lambda=\lambda_0/2λ=λ0​/2, the hypothesis of Lemma 4.2 requires α≥4λ0−1ln⁡(12mρλ0−1)\alpha\ge4\lambda_0^{-1}\ln(12m\rho\lambda_0^{-1})α≥4λ0−1​ln(12mρλ0−1​), which the printed α\alphaα does not meet, so (G1)(\mathcal G1)(G1) and the infeasibility certificate are not guaranteed. With the printed parameters, the iteration bound is not established by the paper's argument.

Formalization scope

  • Representation. Constraints are indexed by Fin m with m≥1m\ge1m≥1 ([NeZero m]), coordinates by Fin n; AAA is a real matrix and bbb, ddd real vectors with d>0d>0d>0; PPP is a convex set. No sign hypothesis is put on AAA, bbb or PPP.
  • Width. ρ>0\rho>0ρ>0 is an upper bound on the width (∣aix−bi∣≤ρdi|a_ix-b_i|\le\rho d_i∣ai​x−bi​∣≤ρdi​ on PPP), not a supremum; the algorithm uses ρ\rhoρ in its parameters, and the theorems hold for every such bound, the exact width included.
  • Oracle. Subroutine (10) is an arbitrary function from dual vectors to points; theorems assume that for every y≥0y\ge0y≥0 it returns a point of PPP minimizing ytAxy^tAxytAx over PPP, and quantify over every such oracle.
  • Corrected parameters. IMPROVE-GENERAL uses α=4λ0−1ln⁡(12mρλ0−1)\alpha=4\lambda_0^{-1}\ln(12m\rho\lambda_0^{-1})α=4λ0−1​ln(12mρλ0−1​) and σ=λ0/(48αρ2)\sigma=\lambda_0/(48\alpha\rho^2)σ=λ0​/(48αρ2), i.e. Figure 4's formulas with λ0/2\lambda_0/2λ0​/2 for λ0\lambda_0λ0​. Lemmas 4.1–4.3 are stated as printed; they do not mention Figure 4.
  • Runs and cost. Procedure and driver are defined with a fuel bound; the theorems assert that the loop test fails before the fuel is exhausted. One oracle call is charged per evaluation of the loop test that reaches (G2)(\mathcal G2)(G2); the loop body reuses its answer. The driver checks λ(x)≤ε\lambda(x)\le\varepsilonλ(x)≤ε before every call, so no call is made with λ0≤ε\lambda_0\le\varepsilonλ0​≤ε, and it reports infeasibility only when a call stopped on its (G2)(\mathcal G2)(G2) test with λ>ε\lambda>\varepsilonλ>ε.
  • Explicit constants replacing O(⋅)O(\cdot)O(⋅) and Ω(⋅)\Omega(\cdot)Ω(⋅). Lemma 4.3: Ω(ασλΦ)\Omega(\alpha\sigma\lambda\Phi)Ω(ασλΦ) becomes ασλΦ/30\alpha\sigma\lambda\Phi/30ασλΦ/30. Theorem 4.4: O(ρ2λ0−2log⁡(mρλ0−1))O(\rho^2\lambda_0^{-2}\log(m\rho\lambda_0^{-1}))O(ρ2λ0−2​log(mρλ0−1​)) becomes 2+8640ρ2λ0−2ln⁡(12mρλ0−1)2+8640\rho^2\lambda_0^{-2}\ln(12m\rho\lambda_0^{-1})2+8640ρ2λ0−2​ln(12mρλ0−1​) oracle calls. Theorem 4.5: O(ρ2ε−2log⁡(mρε−1))O(\rho^2\varepsilon^{-2}\log(m\rho\varepsilon^{-1}))O(ρ2ε−2log(mρε−1)) becomes NNN above; max⁡(ρ,ε)\max(\rho,\varepsilon)max(ρ,ε) equals ρ\rhoρ whenever a call is made. The "time to compute AxAxAx" clause of Theorem 4.5 is not formalized.
  • Ruled out. A formalization that assumes termination, takes the oracle's optimality only at the points visited, lets the constant depend on the instance, or allows a call with λ0≤0\lambda_0\le0λ0​≤0 (where ln⁡\lnln and division return junk values) is not the paper's theorem.
  • Needed. Finite sums and maxima over Fin m, second-order bounds on Real.exp and monotonicity of Real.log, convex combinations, induction over fuelled recursions. The potential-decrease lemmas are reusable for the packing and covering missions of the same paper. Proofs of any milestone are welcome independently.

Selected references

  • S. A. Plotkin, D. B. Shmoys, É. Tardos, Fast Approximation Algorithms for Fractional Packing and Covering Problems, Cornell University School of ORIE, Technical Report No. 999, 1992 (§4, pp. 23–27). Journal version: Mathematics of Operations Research 20(2):257–301, 1995. https://doi.org/10.1287/moor.20.2.257
  • F. Shahrokhi, D. W. Matula, The maximum concurrent flow problem, Journal of the ACM 37(2):318–334, 1990. https://doi.org/10.1145/77600.77620
  • M. D. Grigoriadis, L. G. Khachiyan, Fast approximation schemes for convex programs with many blocks and coupling constraints, SIAM Journal on Optimization 4(1):86–107, 1994. https://doi.org/10.1137/0804004
  • N. Garg, J. Könemann, Faster and simpler algorithms for multicommodity flow and other fractional packing problems, SIAM Journal on Computing 37(2):630–652, 2007. https://doi.org/10.1137/S0097539704446232
  • S. Arora, E. Hazan, S. Kale, The multiplicative weights update method: a meta-algorithm and applications, Theory of Computing 8:121–164, 2012. https://doi.org/10.4086/toc.2012.v008a006
9 thms2 active usersReviewed
AlgebraInformation Theory·Captain: mikedeng1

Fuzzy Extractors: How to Generate Strong Keys from Biometrics and Other Noisy Data 3: Shingling plus PinSketch Gives an Average-Case Secure Sketch for Edit DistanceResearch Paper

Why noisy secrets need sketches

Biometric readings, physical unclonable functions and typed passphrases share two defects as cryptographic keys: they are not uniformly distributed, and they are never reproduced exactly. Dodis, Ostrovsky, Reyzin and Smith (SIAM J. Comput. 38(1), 2008; preprint arXiv:cs/0602007v4) introduced the secure sketch to handle the second defect without destroying what entropy the secret has. A secure sketch publishes a string sss from which any reading close to the original recovers the original exactly, while the original keeps a guaranteed amount of min-entropy given sss. Many sources of noise are not substitutions but insertions and deletions: keystroke sequences, sequenced DNA, and any reading whose alignment drifts. For these the relevant distance is the edit distance, and §7 of the paper gives a secure sketch for it.

This mission formalizes that construction: Theorem 7.5 (p. 27), together with the results it is assembled from, PinSketch for set difference (Theorem 6.3, p. 23, with the BCH decoding argument of Appendix E) and the shingling embedding (Lemma 7.3, p. 25), glued by Lemma 4.7 (p. 15).

Setting

All logarithms are base 2. A random variable is identified with its distribution. The min-entropy of WWW is H∞(W)=−log⁡max⁡wPr⁡[W=w]\mathbf H_\infty(W) = -\log \max_w \Pr[W = w]H∞​(W)=−logmaxw​Pr[W=w], and the average min-entropy of WWW given III is H~∞(W∣I)=−log⁡∑imax⁡wPr⁡[W=w∧I=i]\tilde{\mathbf H}_\infty(W \mid I) = -\log \sum_i \max_w \Pr[W = w \wedge I = i]H~∞​(W∣I)=−log∑i​maxw​Pr[W=w∧I=i].

Let M\mathcal MM be a set with an integer-valued distance dis\mathrm{dis}dis. An average-case (M,m,m~,t)(\mathcal M, m, \tilde m, t)(M,m,m~,t)-secure sketch is a pair of randomized procedures (SS,Rec)(\mathsf{SS}, \mathsf{Rec})(SS,Rec) such that Rec(w′,SS(w))=w\mathsf{Rec}(w', \mathsf{SS}(w)) = wRec(w′,SS(w))=w whenever dis(w,w′)≤t\mathrm{dis}(w, w') \le tdis(w,w′)≤t, and H~∞(W∣SS(W),I)≥m~\tilde{\mathbf H}_\infty(W \mid \mathsf{SS}(W), I) \ge \tilde mH~∞​(W∣SS(W),I)≥m~ for every pair (W,I)(W, I)(W,I) with H~∞(W∣I)≥m\tilde{\mathbf H}_\infty(W \mid I) \ge mH~∞​(W∣I)≥m. The difference m−m~m - \tilde mm−m~ is the entropy loss.

Three spaces occur.

  1. EditF(n)\mathrm{Edit}_{\mathcal F}(n)EditF​(n): strings of length nnn over a finite alphabet F\mathcal FF of FFF letters, with distance the smallest number of character insertions and deletions turning one string into the other.
  2. SDif(U)\mathrm{SDif}(\mathcal U)SDif(U): all subsets of a finite universe U\mathcal UU, with distance ∣w△w′∣|w \triangle w'|∣w△w′∣.
  3. For PinSketch, U=GF(2μ)∗\mathcal U = GF(2^\mu)^*U=GF(2μ)∗, of size n=2μ−1n = 2^\mu - 1n=2μ−1. A subset www has syndrome entries si(w)=∑x∈wxis_i(w) = \sum_{x \in w} x^isi​(w)=∑x∈w​xi, computed in the field. PinSketch publishes (s1,s3,…,s2t−1)(s_1, s_3, \dots, s_{2t-1})(s1​,s3​,…,s2t−1​).

A ccc-shingle of a string is a length-ccc consecutive substring, and the ccc-shingling SHc(w)⊆Fc\mathrm{SH}_c(w) \subseteq \mathcal F^cSHc​(w)⊆Fc is the set of all of them. A map f:M1→M2f : \mathcal M_1 \to \mathcal M_2f:M1​→M2​ is a (t1,t2,λ)(t_1, t_2, \lambda)(t1​,t2​,λ)-biometric embedding with recovery information ggg if it maps distance ≤t1\le t_1≤t1​ to distance ≤t2\le t_2≤t2​, ggg takes at most 2λ2^\lambda2λ values, and www is determined by (f(w),g(w))(f(w), g(w))(f(w),g(w)).

Formalization targets

Goal: Theorem 7.5

For every finite alphabet F\mathcal FF with FFF letters, all n,c,t∈Nn, c, t \in \mathbb Nn,c,t∈N with 1≤c≤n1 \le c \le n1≤c≤n and every real mmm, there is an average-case secure sketch

(EditF(n), m, m−⌈nc⌉log⁡2(n−c+1)−(2c−1) t ⌈log⁡(Fc+1)⌉, t).\Big(\mathrm{Edit}_{\mathcal F}(n),\ m,\ m - \big\lceil \tfrac nc \big\rceil \log_2(n - c + 1) - (2c - 1)\,t\,\lceil \log(F^c + 1) \rceil,\ t\Big).(EditF​(n), m, m−⌈cn​⌉log2​(n−c+1)−(2c−1)t⌈log(Fc+1)⌉, t).

Milestones

  1. Set difference. Theorem 6.3: PinSketch is an average-case (SDif(U),m,m−tlog⁡(n+1),t)(\mathrm{SDif}(\mathcal U), m, m - t\log(n+1), t)(SDif(U),m,m−tlog(n+1),t) secure sketch. On the way:
    • the Appendix E identity s2i=si2s_{2i} = s_i^2s2i​=si2​;
    • the key equation S(z)σ(z)≡ω(z) mod zδS(z)\sigma(z) \equiv \omega(z) \bmod z^\deltaS(z)σ(z)≡ω(z)modzδ;
    • the uniqueness of ω/σ\omega/\sigmaω/σ among low-degree solutions;
    • Lemma 6.2: a word of weight ≤(δ−1)/2\le (\delta - 1)/2≤(δ−1)/2 is determined by its first δ−1\delta - 1δ−1 syndromes;
    • step 4 of Construction 6: decoding returns w△w′w \triangle w'w△w′.
  2. Edit distance into set difference. Lemma 7.3: SHc\mathrm{SH}_cSHc​ is an average-case (t1,(2c−1)t1,m1,m1−⌈n/c⌉log⁡2(n−c+1))(t_1, (2c-1)t_1, m_1, m_1 - \lceil n/c \rceil \log_2(n - c + 1))(t1​,(2c−1)t1​,m1​,m1​−⌈n/c⌉log2​(n−c+1)) biometric embedding. Its strengthening: SHc\mathrm{SH}_cSHc​ has recovery information gcg_cgc​ with λ=⌈n/c⌉log⁡2(n−c+1)\lambda = \lceil n/c \rceil \log_2(n - c + 1)λ=⌈n/c⌉log2​(n−c+1).
  3. Composition. Lemma 4.7: an embedding with recovery information turns an average-case sketch on M2\mathcal M_2M2​ for entropy m1−λm_1 - \lambdam1​−λ into one on M1\mathcal M_1M1​ for entropy m1m_1m1​, with the same residual entropy.

Significance

Theorem 7.5 gives a secure sketch for the edit metric whose entropy loss is, for a good choice of ccc, about 2.38 (tlog⁡F)1/3(nlog⁡n)2/32.38\,(t \log F)^{1/3}(n \log n)^{2/3}2.38(tlogF)1/3(nlogn)2/3 (p. 26). This is sublinear in nnn for ttt up to nearly linear, and for large ttt it improves on the low-distortion embedding approach of §7.1. Combined with a strong extractor it yields fuzzy extractors for edit distance (Theorem 7.4). PinSketch is itself the standard set-difference sketch, and Lemma 4.7 is a general transfer principle between metrics.

All results here are proved in the paper. None has a machine-checked proof that we know of. A complete development would also formalize a fragment of BCH decoding over GF(2μ)GF(2^\mu)GF(2μ), the syndrome-uniqueness theorem for binary BCH codes, and a combinatorial lemma on how insertions and deletions act on shingle sets. Each is reusable outside this mission.

Difficulty

There are two hard steps.

The first is Lemma 6.2. That a low-weight word is determined by δ−1\delta - 1δ−1 power sums is a statement about Vandermonde systems in characteristic 2, where the even power sums carry no new information. Newton's identities, the usual characteristic-zero route from power sums to elementary symmetric functions, fail there because they divide by integers that vanish in characteristic 2. The paper argues through the error-locator and error-evaluator polynomials instead.

The second is the distance clause of Lemma 7.3. An edit path between two strings of length nnn passes through strings of other lengths, so a per-step bound on the shingle sets must hold for strings of every length, including lengths below ccc.

The entropy statements involve average min-entropy over arbitrary auxiliary variables, and each needs the chain-rule bound of Lemma 2.2(b) in average-case form.

Formalization scope

  • Laws and kernels. Random variables are PMFs, and randomized procedures are kernels M → PMF S. The auxiliary variable of every average-case statement ranges over every ι : Type, not only finite types. Average min-entropy uses the joint form above. "Min-entropy mmm" means ≥m\ge m≥m, and mmm is real.
  • The field. The paper's GF(2m)GF(2^m)GF(2m) is any finite field K of characteristic 2, and its degree is renamed μ\muμ because mmm denotes min-entropy. Appendix E's large field F\mathcal FF is this K, distinct from §7's alphabet F\mathcal FF. Only binary words are formalized, as subsets (Finset Kˣ); the qqq-ary generality of Lemma E.1 is not.
  • The key equation. ω(z)\omega(z)ω(z) is written without division, congruence mod zδz^\deltazδ is divisibility by XδX^\deltaXδ, and the ratio identity is cross-multiplied.
  • Edit distance. It reuses the published weighted edit distance MasekPaterson.Shared.editDist with cost 1 per insertion or deletion and 2 per replacement, which equals the insertion/deletion count.
  • Shingling and gcg_cgc​. Shingling is defined for strings of all lengths. gcg_cgc​ is the concrete function of the proof, with 0-based indices.
  • Explicit hypotheses.
    • The Appendix E uniqueness statement takes the BCH designed distance to satisfy 1≤δ1 \le \delta1≤δ; at δ=0\delta=0δ=0 its congruence is vacuous and the conclusion can fail.
    • 1≤c≤n1 \le c \le n1≤c≤n, which the paper leaves implicit, is assumed in Lemma 7.3 and Theorem 7.5.
    • ϵ\epsilonϵ is dropped from Theorem 7.5, where it does not occur in the conclusion.
    • ⌈log⁡(Fc+1)⌉\lceil \log(F^c + 1) \rceil⌈log(Fc+1)⌉ is Nat.clog 2 (F ^ c + 1).
  • Misprints, read as corrected.
    • In Definition 7, f(w2)f(w_2)f(w2​) is read as f(w1′)f(w_1')f(w1′​).
    • In Lemma 4.7, Rec(w′,s)\mathsf{Rec}(w', s)Rec(w′,s) is read as Rec(f(w′),s)\mathsf{Rec}(f(w'), s)Rec(f(w′),s).
    • In Appendix E, w′(z)w'(z)w′(z) is read as ω′(z)\omega'(z)ω′(z).
  • Efficiency. Every claim of efficiency or running time (Lemma 6.2, Theorem 6.3, Theorem 7.5) is dropped: Mathlib has no complexity substrate, and no vacuous substitute is used.
  • Excluded trivializations. The distance is the insertion/deletion distance, not the Hamming distance on length-nnn strings (a different and easier problem). It is not a degenerate cost that is identically 0: insertion and deletion each cost 1.
  • Not posed here. Lemma 2.2(b) and Lemma 3.1 are posed in the companion mission on Hamming fuzzy extractors. Proofs that need them may restate them.

Contributions are welcome on any milestone. The BCH part (Appendix E, Lemma 6.2) and the shingling part (Lemma 7.3) are independent.

Selected references

  • Y. Dodis, R. Ostrovsky, L. Reyzin, A. Smith, Fuzzy Extractors: How to Generate Strong Keys from Biometrics and Other Noisy Data, SIAM J. Comput. 38(1):97–139, 2008. https://doi.org/10.1137/060651380 ; arXiv:cs/0602007v4, https://arxiv.org/abs/cs/0602007
  • J. H. van Lint, Introduction to Coding Theory, 2nd ed., Springer, 1992 (BCH codes and their decoding; the reference [vL92] of Appendix E).
  • A. Z. Broder, On the resemblance and containment of documents, Compression and Complexity of Sequences, IEEE, 1997 (shingling). https://doi.org/10.1109/SEQUEN.1997.666900
  • W. J. Masek, M. S. Paterson, A faster algorithm computing string edit distances, J. Comput. System Sci. 20(1):18–31, 1980 (the weighted edit distance reused here). https://doi.org/10.1016/0022-0000(80)90002-1
13 thms2 active usersReviewed
CombinatoricsInformation Theory·Captain: mikedeng1

Fuzzy Extractors: How to Generate Strong Keys from Biometrics and Other Noisy Data 4: A Secure Sketch Correcting t Errors Has Residual Min-Entropy at Most L(M, t, m)Research Paper

Motivation

Biometric readings, typed passphrases and physical measurements are secrets that are never reproduced exactly: a second reading w′w'w′ of the same fingerprint differs from the enrolled reading www in a few positions. Dodis, Ostrovsky, Reyzin and Smith (arXiv:cs/0602007, SIAM J. Comput. 38(1), 2008) introduced the secure sketch, public helper data that lets anyone holding a nearby w′w'w′ recover www while leaking as little as possible about www, and the fuzzy extractor, which in addition turns www into a nearly uniform key. Their constructions for the Hamming, set-difference and edit metrics are the standard reference for this primitive in cryptography.

A construction is judged by its entropy loss: how much min-entropy of the secret the published sketch destroys. To call a construction optimal one needs a lower bound on that loss which holds for every sketch, whatever its algorithm. Appendix C of the paper supplies such a bound from coding theory. It shows that, for uniformly distributed inputs, the code-offset sketch for the Hamming metric and the set-difference sketches lose no more entropy than any sketch must. This mission formalizes that bound, Lemma C.1.

Setting

A metric space is a finite set M\mathcal MM with an integer-valued distance dis\mathrm{dis}dis; the paper also requires dis(x,y)=0\mathrm{dis}(x,y)=0dis(x,y)=0 exactly when x=yx=yx=y, symmetry, and the triangle inequality (§2.1, p. 7). Random variables are identified with their laws; logarithms are base 2.

The min-entropy of a random variable AAA is H∞(A)=−log⁡max⁡aPr⁡[A=a]\mathbf H_\infty(A) = -\log \max_a \Pr[A=a]H∞​(A)=−logmaxa​Pr[A=a]. For a pair (A,B)(A,B)(A,B) the average min-entropy is

H~∞(A∣B)=−log⁡Eb←B[max⁡aPr⁡[A=a∣B=b]],\tilde{\mathbf H}_\infty(A\mid B) = -\log \mathbb E_{b\leftarrow B}\Big[\max_a \Pr[A=a\mid B=b]\Big],H~∞​(A∣B)=−logEb←B​[amax​Pr[A=a∣B=b]],

the negative logarithm of the probability that an adversary who sees BBB guesses AAA.

An (M,m,m~,t)(\mathcal M,m,\tilde m,t)(M,m,m~,t)-secure sketch (Definition 3, p. 11) is a pair of randomized procedures: SS\mathsf{SS}SS maps w∈Mw\in\mathcal Mw∈M to a string sss, and Rec\mathsf{Rec}Rec maps (w′,s)(w',s)(w′,s) back to M\mathcal MM. Correctness: if dis(w,w′)≤t\mathrm{dis}(w,w')\le tdis(w,w′)≤t then Rec(w′,SS(w))=w\mathsf{Rec}(w',\mathsf{SS}(w))=wRec(w′,SS(w))=w. Security: for every distribution WWW on M\mathcal MM with H∞(W)≥m\mathbf H_\infty(W)\ge mH∞​(W)≥m, one has H~∞(W∣SS(W))≥m~\tilde{\mathbf H}_\infty(W\mid \mathsf{SS}(W))\ge\tilde mH~∞​(W∣SS(W))≥m~.

An (M,K,t)(\mathcal M,K,t)(M,K,t)-code (§2.2, p. 8) is a set C⊆MC\subseteq\mathcal MC⊆M of KKK points such that every ball {c:dis(w,c)≤t}\{c : \mathrm{dis}(w,c)\le t\}{c:dis(w,c)≤t} around a point w∈Mw\in\mathcal Mw∈M contains at most one codeword. For S⊆MS\subseteq\mathcal MS⊆M, K(M,t,S)K(\mathcal M,t,S)K(M,t,S) is the largest KKK for which an (M,K,t)(\mathcal M,K,t)(M,K,t)-code lies inside SSS, and K(M,t)=K(M,t,M)K(\mathcal M,t)=K(\mathcal M,t,\mathcal M)K(M,t)=K(M,t,M). Finally (Appendix C, p. 40)

L(M,t,m)=log⁡(min⁡∣S∣=2mK(M,t,S)),L(\mathcal M,t,m) = \log\Big(\min_{|S|=2^m} K(\mathcal M,t,S)\Big),L(M,t,m)=log(∣S∣=2mmin​K(M,t,S)),

the worst case, over all sets SSS of 2m2^m2m points, of the largest ttt-error-correcting code inside SSS.

In the Lean development these are minEntropy, avgMinEntropy, IsSecureSketch, IsCode, K dis t S and L dis t N hN, in the namespace FuzzyExtractors.LowerBound.

Formalization targets

Goal: Lemma C.1

If (SS,Rec)(\mathsf{SS},\mathsf{Rec})(SS,Rec) is an (M,m,m′,t)(\mathcal M,m,m',t)(M,m,m′,t)-secure sketch and 2m=N2^m=N2m=N is a natural number with N≤∣M∣N\le|\mathcal M|N≤∣M∣, then

m′≤L(M,t,m).m' \le L(\mathcal M,t,m).m′≤L(M,t,m).

The bound fixes no particular metric and no particular sketch; it is stated for every finite integer-valued metric and every sketch, with an arbitrary type of sketch values.

Milestones

The proof in Appendix C has three steps, each a milestone. For WWW uniform on a set SSS of 2m2^m2m points:

  1. some sketch value vvv has Pr⁡[SS(W)=v]>0\Pr[\mathsf{SS}(W)=v]>0Pr[SS(W)=v]>0 and H∞(W∣SS(W)=v)≥m′\mathbf H_\infty(W\mid\mathsf{SS}(W)=v)\ge m'H∞​(W∣SS(W)=v)≥m′;
  2. the set TTT of points of SSS that can produce vvv has ∣T∣≥2m′|T|\ge 2^{m'}∣T∣≥2m′;
  3. under the correctness property alone, TTT is an (M,∣T∣,t)(\mathcal M,|T|,t)(M,∣T∣,t)-code.

A fourth milestone is the lemma's second sentence: when m=log⁡∣M∣m=\log|\mathcal M|m=log∣M∣,

m′≤log⁡K(M,t).m' \le \log K(\mathcal M,t).m′≤logK(M,t).

Significance

The result. Lemma C.1 converts any secure sketch into a code: the residual entropy m′m'm′ of the sketch can be no larger than the logarithm of the best ttt-error-correcting code inside a worst-case set of 2m2^m2m points. For uniform inputs it says m′≤log⁡K(M,t)m'\le\log K(\mathcal M,t)m′≤logK(M,t), so the entropy loss is at least log⁡∣M∣−log⁡K(M,t)\log|\mathcal M|-\log K(\mathcal M,t)log∣M∣−logK(M,t). The code-offset construction built from an optimal code attains that loss, which is how the paper certifies its Hamming and set-difference constructions as optimal for uniform passwords. The companion Lemma C.2 gives the analogous bound for fuzzy extractors, up to a −log⁡(1−ε)-\log(1-\varepsilon)−log(1−ε) term. Lower bounds of this shape are what separate an efficient construction from a provably best one.

Formalizing it. The lemma has a complete, short proof in the paper; it has no machine-checked proof that we know of. The mission produces a checked version of the bound for arbitrary finite integer metrics and arbitrary randomized sketches, together with reusable definitions of min-entropy and average min-entropy on probability mass functions, of secure sketches, and of ttt-error-correcting codes in a general finite metric space.

Difficulty

The combinatorial core, that the preimage set of one sketch value is a code, is immediate from correctness. The work lies in the probabilistic bookkeeping. One must pass from an average bound on guessing probability to a single good sketch value, which requires handling sketch values of probability zero and an infinite (possibly uncountable) space of sketch outputs. One must then pass from "Pr⁡[W=w∣v]≤2−m′\Pr[W=w\mid v]\le 2^{-m'}Pr[W=w∣v]≤2−m′ for all www" to "at least 2m′2^{m'}2m′ points carry positive probability", and compute the min-entropy of a uniform distribution exactly. Finally the bound must be transferred to the minimum over all sets of size 2m2^m2m, a finite but large family. A first idea, to reason only about deterministic sketches, does not suffice: Definition 3 allows randomized SS\mathsf{SS}SS and Rec\mathsf{Rec}Rec, and the statement quantifies over them.

Formalization scope

Laws are Mathlib PMFs; randomized procedures are maps into PMF. The sketch value type V is arbitrary, standing in for {0,1}∗\{0,1\}^*{0,1}∗. Average min-entropy is written in the equivalent joint form −log⁡∑bmax⁡aPr⁡[A=a∧B=b]-\log\sum_b\max_a\Pr[A=a\wedge B=b]−log∑b​maxa​Pr[A=a∧B=b], which avoids conditioning on null events. "Min-entropy mmm" is read as H∞(W)≥m\mathbf H_\infty(W)\ge mH∞​(W)≥m, and m,m′m, m'm,m′ are real numbers. Rec\mathsf{Rec}Rec is randomized and correctness asks that it return www with probability one for every possible sketch value of www.

The explicit choices:

  • L(M,t,m)L(\mathcal M,t,m)L(M,t,m) is defined only when 2m2^m2m is a natural number N≤∣M∣N\le|\mathcal M|N≤∣M∣ (otherwise the minimum ranges over no sets); the goal takes such an NNN with (N:R)=2m(N:\mathbb R)=2^m(N:R)=2m. The printed K(n,t,S)K(n,t,S)K(n,t,S) inside the minimum is read as K(M,t,S)K(\mathcal M,t,S)K(M,t,S), and the printed L(M,t,n)L(\mathcal M,t,n)L(M,t,n) as L(M,t,log⁡∣M∣)L(\mathcal M,t,\log|\mathcal M|)L(M,t,log∣M∣).
  • The code-bound statements explicitly assume all metric axioms from §2.1: zero distance exactly for equal points, symmetry, and the triangle inequality. Symmetry is used because the ball condition of a code measures dis(w′,c)\mathrm{dis}(w',c)dis(w′,c), while correctness is stated for dis(c,w′)\mathrm{dis}(c,w')dis(c,w′). The second-sentence milestone also assumes M\mathcal MM nonempty, which the paper leaves implicit.
  • The hypothesis is the worst-case secure sketch of Definition 3, not the average-case one of Definition 4, which would weaken the lemma.
  • Definition 3's efficiency requirement is dropped; no complexity theory is formalized, and no placeholder predicate replaces it.

Two trivializing formalizations are ruled out: K(M,t,S)K(\mathcal M,t,S)K(M,t,S) is the largest size of a code in SSS, not a count of codes; and a code is defined by the ball condition, not by "distinct codewords are at distance greater than ttt", which is weaker in the absence of the triangle inequality.

Needed infrastructure: the min-entropy of a uniform PMF on a finset, the averaging argument over a tsum of ENNReal values, and monotonicity of Finset.inf'. The min-entropy and code definitions are reusable by every other mission of this paper. Contributions are welcome on any milestone, in any order.

Selected references

  • Y. Dodis, R. Ostrovsky, L. Reyzin, A. Smith, Fuzzy Extractors: How to Generate Strong Keys from Biometrics and Other Noisy Data, SIAM J. Comput. 38(1):97–139, 2008. arXiv:cs/0602007v4. https://arxiv.org/abs/cs/0602007 — DOI https://doi.org/10.1137/060651380
  • A. Juels, M. Wattenberg, A Fuzzy Commitment Scheme, ACM CCS 1999. https://doi.org/10.1145/319709.319714
  • R. Renner, S. Wolf, Simple and Tight Bounds for Information Reconciliation and Privacy Amplification, ASIACRYPT 2005. https://doi.org/10.1007/11593447_11
7 thms2 active usersReviewed
Complexity TheoryProbabilityQuantum Information·Captain: mikedeng1

Strengths and Weaknesses of Quantum Computing II: Relative to a Random Permutation, a Quantum Algorithm Needs Ω(2^{n/3}) Queries to Decide the First Bit of A⁻¹(1ⁿ)Research Paper

Motivation

An oracle lets an algorithm ask for the value of a function without giving it a description of that function. An oracle lower bound isolates how many questions are needed, even when computation between questions is unrestricted. Bennett, Bernstein, Brassard and Vazirani used this viewpoint to compare classical and quantum access to randomly chosen functions and permutations. Their Theorem 3.6 states an almost-sure separation: relative to a random permutation oracle, a quantum machine using time o(2n/3)o(2^{n/3})o(2n/3) cannot capture all of (NP∩coNP)A(\mathrm{NP}\cap\mathrm{coNP})^A(NP∩coNP)A BBBV, Theorem 3.6. The same paper notes that its exponent 1/31/31/3 may reflect the available argument rather than the true boundary BBBV, p. 12.

The finite statement behind that separation is a quantum query lower bound for a uniformly random permutation. It asks about one bit of the inverse image of a fixed string, rather than inversion of the whole permutation. This gives a sharply defined target with the paper's explicit query and error constants.

Setting

Let Σn={0,1}n\Sigma^n=\{0,1\}^nΣn={0,1}n, and let AAA be a permutation oracle of Σn\Sigma^nΣn. Its inverse image of the all-one string 1n1^n1n exists and is unique. Define the language LA\mathcal L_ALA​ by putting yyy in LA\mathcal L_ALA​ when the first bit of A−1(y)A^{-1}(y)A−1(y) is 111. The paper observes that access to AAA puts this language in both NPA\mathrm{NP}^ANPA and coNPA\mathrm{coNP}^AcoNPA: either possible bit of the inverse image can be witnessed by an input to the permutation BBBV, p. 10. This mission tests membership only at y=1ny=1^ny=1n.

A TTT-query quantum algorithm starts in a unit vector of a finite complex Hilbert space. A basis configuration records an optional length-nnn query string, an answer register, and finite workspace. On a querying configuration (x,z,w)(x,z,w)(x,z,w), an oracle operation replaces the answer register by z⊕A(x)z\oplus A(x)z⊕A(x); it leaves a nonquerying configuration unchanged. Each oracle operation is followed by an algorithm-chosen unitary. The final acceptance probability is the sum of the squared amplitudes of accepting basis configurations. A run decides a yes-or-no question if its acceptance probability is at least 2/32/32/3 on a yes instance and at most 1/31/31/3 on a no instance. These thresholds match the paper's bounded-error convention BBBV, §2 and §3.1.

For a state ϕ\phiϕ, the query magnitude qy(ϕ)q_y(\phi)qy​(ϕ) is the total squared amplitude of basis configurations querying string yyy. Thus 0≤qy(ϕ)≤10\le q_y(\phi)\le10≤qy​(ϕ)≤1 for a unit state, and the magnitudes over all strings sum to at most 111. This is Definition 3.2 of the paper BBBV, p. 7.

Formalization targets

The goal is the finite claim in the proof of Theorem 3.6. For every n≥1n\ge1n≥1, every finite-workspace algorithm MMM with TTT queries, and a uniform permutation AAA of Σn\Sigma^nΣn,

T≤2n/3100⟹Pr⁡A ⁣[M fails to decide whether the first bit of A−1(1n) is 1]≥18.T\le\frac{2^{n/3}}{100} \quad\Longrightarrow\quad \Pr_A\!\left[M\text{ fails to decide whether the first bit of }A^{-1}(1^n)\text{ is }1\right]\ge\frac18.T≤1002n/3​⟹APr​[M fails to decide whether the first bit of A−1(1n) is 1]≥81​.

The milestones follow the statements used in the paper: Theorem 3.1 relates Euclidean distance between final states to their observed distributions; Theorem 3.3 bounds the effect of changing answers at queried strings; and the proof of Theorem 3.6 establishes the uniform transposition chain, the 1/21/21/2 membership split, the expected query-magnitude estimate, and the 1/501/501/50 expected final-state distance BBBV, pp. 7–11. The source text of each milestone is recorded with its page in the mission's milestone list.

Significance

The result identifies a concrete task that cannot be decided reliably with too few quantum oracle calls for a positive fraction of length-nnn permutation oracles. The inverse image exists by definition, so the obstruction is the number of queries needed to learn its first bit. This is the quantitative part of the paper's relative separation for NP∩coNP\mathrm{NP}\cap\mathrm{coNP}NP∩coNP; the passage to an almost-sure statement over countably many machines is described in the paper but lies beyond this mission's formal goal BBBV, pp. 10–12.

The theorem is proved on paper and is not claimed here as an open mathematical problem. Formalizing it produces reusable finite-dimensional machinery for quantum queries: an XOR oracle as a unitary basis permutation, query magnitude, a time-dependent hybrid oracle, and counting-based probability over finite permutation spaces. The milestone statements remain open Lean proof obligations in this proposal.

Difficulty

A direct comparison of an algorithm's run under two nearby permutation oracles requires knowing that the algorithm seldom queries the locations where those oracles differ. The distinguished preimage A−1(1n)A^{-1}(1^n)A−1(1n) cannot simply be declared rarely queried: learning about it is exactly the task under study. The paper therefore studies a chain of random transpositions and a run whose oracle changes by step. The subtle point is that a string used in a later transposition is still uniform when the earlier query state is formed BBBV, pp. 10–11. The expected query-magnitude milestone states that point explicitly.

Formalization scope

The Lean carrier of strings is Fin(n)→Z/2Z\mathrm{Fin}(n)\to\mathbb Z/2\mathbb ZFin(n)→Z/2Z. Algorithms use finite configuration types and EuclideanSpace ℂ; the query register is optional, and none represents configurations that make no length-nnn query. An oracle answers with the full length-nnn value by XOR in the answer register. The paper describes a Boolean oracle, but one full-value query can be simulated with nnn Boolean queries and one Boolean query with two full-value queries. The latter direction transfers this lower bound to the paper's oracle at a changed constant. Answers at lengths other than nnn are fixed and absorbed into the inter-query unitaries, as in the paper's finite-length argument. The full oracle quantum Turing machine, complexity classes as Lean objects, and the almost-sure conclusion are outside the model.

Probabilities and expectations are finite counting fractions. The chain samples a uniform π0\pi_0π0​ and independent uniform x1,…,xT+1x_1,\ldots,x_{T+1}x1​,…,xT+1​, with x0=π0−1(1n)x_0=\pi_0^{-1}(1^n)x0​=π0−1​(1n); this has the same joint law as the paper's conditional sampling order. The recurrence πi+1=πi∘(xi xi+1)\pi_{i+1}=\pi_i\circ(x_i\ x_{i+1})πi+1​=πi​∘(xi​ xi+1​) uses the paper's composition direction. The first-bit test requires n≥1n\ge1n≥1, and any comparison to πT−1\pi_{T-1}πT−1​ requires T≥1T\ge1T≥1. The goal quantifies over every finite workspace and algorithm before sampling the permutation. A uniform function in place of a permutation, or a predetermined inverse image, would change the task and is excluded.

The paper's Theorem 3.3 prints a final-state bound ε\varepsilonε that fails for a one-query XOR example; the milestone states the valid 2ε2\varepsilon2ε bound. Its baseline oracle may vary by step because the proof of Theorem 3.6 uses the hybrid run. The explicit constants T≤2n/3/100T\le 2^{n/3}/100T≤2n/3/100, failure probability 1/81/81/8, and expected distance 1/501/501/50 remain as printed. General finite-dimensional unitary and probability lemmas, together with a proof of the time-dependent hybrid bound, are welcome contributions. The finite query model and transposition-chain definitions are reusable in other oracle lower bounds.

Selected references

  • C. H. Bennett, E. Bernstein, G. Brassard, and U. Vazirani, Strengths and weaknesses of quantum computing, SIAM Journal on Computing 26(5), 1997; arXiv:quant-ph/9701001v1.
10 thms2 active usersReviewed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

Fast Approximation Algorithms for Fractional Packing and Covering Problems 2: An ε-Relaxed Decision Procedure for Fractional Covering Using O(m + ρ log² m + ε⁻²ρ log(m/ε)) Oracle CallsResearch Paper

Motivation

Many linear programs that arise in combinatorial optimization ask only whether a convex set contains a point satisfying a family of nonnegative linear constraints. In the fractional covering problem the constraints have the form Ax≥bAx\ge bAx≥b with A≥0A\ge 0A≥0: the fractional relaxation of set cover, the Held–Karp lower bound for the travelling salesman problem, and the cutting-stock relaxation all have this shape. General-purpose LP methods solve such problems exactly but slowly. Plotkin, Shmoys and Tardos showed that when a fast subroutine can optimize a linear function over the convex set, a Lagrangean-relaxation scheme with an exponential potential finds an approximate solution with a number of subroutine calls that depends on a width parameter and on the accuracy, not on the dimension of the set (Plotkin, Shmoys, Tardos, Cornell ORIE TR 999, 1992; journal version Math. Oper. Res. 20(2), 1995).

The covering half of that paper (§3) is the object of this mission. It is the template for later covering and mixed packing–covering solvers, including those of Garg and Könemann (SIAM J. Comput. 2007) and Young (FOCS 2001).

Setting

Fix integers m≥1m\ge1m≥1, nnn. Let AAA be a real m×nm\times nm×n matrix with nonnegative entries and rows a1,…,ama_1,\dots,a_ma1​,…,am​, write aix=∑jAijxja_ix=\sum_j A_{ij}x_jai​x=∑j​Aij​xj​, let b∈Rmb\in\mathbb R^mb∈Rm with b>0b>0b>0, and let P⊆RnP\subseteq\mathbb R^nP⊆Rn be a nonempty convex set contained in the nonnegative orthant.

  • COVERING asks whether there is x∈Px\in Px∈P with Ax≥bAx\ge bAx≥b; such an xxx is an exact solution. For ε>0\varepsilon>0ε>0, an ε\varepsilonε-approximate solution is x∈Px\in Px∈P with Ax≥(1−ε)bAx\ge(1-\varepsilon)bAx≥(1−ε)b.
  • For x∈Rnx\in\mathbb R^nx∈Rn, λ(x)=min⁡iaix/bi\lambda(x)=\min_i a_ix/b_iλ(x)=mini​ai​x/bi​ is the largest λ\lambdaλ with Ax≥λbAx\ge\lambda bAx≥λb, and λ∗=max⁡{λ(x):x∈P}\lambda^*=\max\{\lambda(x):x\in P\}λ∗=max{λ(x):x∈P}. A point x∈Px\in Px∈P is ε\varepsilonε-optimal when λ(x)≥(1−ε)λ∗\lambda(x)\ge(1-\varepsilon)\lambda^*λ(x)≥(1−ε)λ∗.
  • The width is max⁡imax⁡x∈Paix/bi\max_i\max_{x\in P}a_ix/b_imaxi​maxx∈P​ai​x/bi​; a number ρ>0\rho>0ρ>0 with aix≤ρ bia_ix\le\rho\,b_iai​x≤ρbi​ for all x∈Px\in Px∈P and all iii is a width bound.
  • Subroutine (7) receives y∈Rmy\in\mathbb R^my∈Rm, y≥0y\ge0y≥0, and returns x~∈P\tilde x\in Px~∈P maximizing ytAxy^tAxytAx over PPP; CC(y)C_{\mathcal C}(y)CC​(y) is that maximum.
  • For α>0\alpha>0α>0, the dual solution corresponding to xxx is yi=1bie−αaix/biy_i=\frac1{b_i}e^{-\alpha a_ix/b_i}yi​=bi​1​e−αai​x/bi​, and the potential is Φ=ytb=∑ie−αaix/bi\Phi=y^tb=\sum_ie^{-\alpha a_ix/b_i}Φ=ytb=∑i​e−αai​x/bi​.
  • The relaxed optimality conditions are (C1)(\mathcal C1)(C1): (1+ε)λ ytb≥ytAx(1+\varepsilon)\lambda\,y^tb\ge y^tAx(1+ε)λytb≥ytAx, and (C2)(\mathcal C2)(C2): CC(y)−ytAx≤ε (CC(y)+ytb)C_{\mathcal C}(y)-y^tAx\le\varepsilon\,(C_{\mathcal C}(y)+y^tb)CC​(y)−ytAx≤ε(CC​(y)+ytb).
  • IMPROVE-COVER(x,ε)(x,\varepsilon)(x,ε) (Figure 3) sets λ0=λ(x)\lambda_0=\lambda(x)λ0​=λ(x), α=4λ0−1ε−1ln⁡(4mε−1)\alpha=4\lambda_0^{-1}\varepsilon^{-1}\ln(4m\varepsilon^{-1})α=4λ0−1​ε−1ln(4mε−1) and σ=ε/(4αρ)\sigma=\varepsilon/(4\alpha\rho)σ=ε/(4αρ); while λ(x)≤2λ0\lambda(x)\le2\lambda_0λ(x)≤2λ0​ and C2\mathcal C2C2 fails, it moves xxx to (1−σ)x+σx~(1-\sigma)x+\sigma\tilde x(1−σ)x+σx~, x~\tilde xx~ the subroutine's answer for the current dual solution.
  • The covering algorithm obtains a start with Ax≥1mbAx\ge\frac1mbAx≥m1​b from mmm subroutine calls, calls IMPROVE-COVER with ε=1/6\varepsilon=1/6ε=1/6 until C2\mathcal C2C2 holds or an exact solution appears, then halves ε\varepsilonε phase by phase.

The Lean names match: rowVal, lam, WidthBound, IsMaxOracle, C1, C2, dualY, potential, improveCover, initCover, coverAlgorithm, in the namespace FracPackCover.Covering.

Formalization targets

Goal: Theorem 3.7 (p. 21)

For every instance as above, every width bound ρ\rhoρ, every exact maximization oracle and every 0<ε0<10<\varepsilon_0<10<ε0​<1, the covering algorithm stops after at most

N=m+(⌈log⁡2m⌉+1)(2+4320 ρln⁡(24m))+2⌈log⁡2ε0−1⌉+9408 ρ ε0−2ln⁡24mε0N=m+\big(\lceil\log_2m\rceil+1\big)\big(2+4320\,\rho\ln(24m)\big)+2\lceil\log_2\varepsilon_0^{-1}\rceil+9408\,\rho\,\varepsilon_0^{-2}\ln\frac{24m}{\varepsilon_0}N=m+(⌈log2​m⌉+1)(2+4320ρln(24m))+2⌈log2​ε0−1​⌉+9408ρε0−2​lnε0​24m​

calls to subroutine (7), and either returns x∈Px\in Px∈P with Ax≥(1−ε0)bAx\ge(1-\varepsilon_0)bAx≥(1−ε0​)b, or reports that no x∈Px\in Px∈P has Ax≥bAx\ge bAx≥b, correctly. This is the paper's O(m+ρlog⁡2m+ε−2ρlog⁡(mε−1))O(m+\rho\log^2m+\varepsilon^{-2}\rho\log(m\varepsilon^{-1}))O(m+ρlog2m+ε−2ρlog(mε−1)) with the constants of its proof.

Milestones

In the order the proof uses them:

  • Lemma 3.1: C1\mathcal C1C1 and C2\mathcal C2C2 imply that no exact solution exists if λ≤1−3ε\lambda\le1-3\varepsilonλ≤1−3ε, and that xxx is 3ε3\varepsilon3ε-optimal if λ≥1−3ε\lambda\ge1-3\varepsilonλ≥1−3ε.
  • Lemma 3.2: if α≥2λ−1ε−1ln⁡(4mε−1)\alpha\ge2\lambda^{-1}\varepsilon^{-1}\ln(4m\varepsilon^{-1})α≥2λ−1ε−1ln(4mε−1), the dual solution corresponding to xxx satisfies C1\mathcal C1C1.
  • Lemma 3.3: while C2\mathcal C2C2 fails, a step of size σ≤ε/(4αρ)\sigma\le\varepsilon/(4\alpha\rho)σ≤ε/(4αρ) lowers the potential: Φ−Φ^≥εασΦ\Phi-\hat\Phi\ge\varepsilon\alpha\sigma\PhiΦ−Φ^≥εασΦ.
  • Lemma 3.4: during IMPROVE-COVER, λ≥34λ0\lambda\ge\frac34\lambda_0λ≥43​λ0​.
  • Theorem 3.5: one call of IMPROVE-COVER makes at most 2+20ρε−3ln⁡(4m/ε)2+20\rho\varepsilon^{-3}\ln(4m/\varepsilon)2+20ρε−3ln(4m/ε) oracle calls, and at most 2+196ρε−2ln⁡(4m/ε)2+196\rho\varepsilon^{-2}\ln(4m/\varepsilon)2+196ρε−2ln(4m/ε) from a 6ε6\varepsilon6ε-optimal start with ε≤1/12\varepsilon\le1/12ε≤1/12.
  • Lemma 3.6: mmm oracle calls give x∈Px\in Px∈P with Ax≥1mbAx\ge\frac1mbAx≥m1​b, or prove that no exact solution exists.

Significance

Theorem 3.7 says that approximate fractional covering is no harder, in subroutine calls, than about ρε−2log⁡(m/ε)\rho\varepsilon^{-2}\log(m/\varepsilon)ρε−2log(m/ε) linear optimizations over PPP, plus lower-order terms in mmm. In §6 of the paper this yields fast approximation algorithms for covering-type relaxations such as the Held–Karp bound and the bin-packing and cutting-stock relaxations, where PPP is a product of simple sets and the subroutine is a minimum-spanning-tree or knapsack computation. The result also certifies infeasibility: when the algorithm reports that no exact solution exists, the dual vector at hand proves it.

The result has been proved since 1991 and has been reproved in several later frameworks. As far as is known, it has not been machine-checked. A formal development contributes the explicit constants and a precise statement of the driver, which the paper gives only in prose. It also provides a reusable Lean account of exponential-potential methods with an optimization oracle.

Difficulty

The obvious argument tracks the potential Φ\PhiΦ and stops when it is small. This does not work directly, because α\alphaα is tied to λ0\lambda_0λ0​, and the guarantee C1\mathcal C1C1 depends on λ\lambdaλ staying close to λ0\lambda_0λ0​ throughout. Lemma 3.4 controls that, and it is a statement about the reachable states of a while loop, not about an arbitrary point. Two further points are delicate. Unlike packing, condition C2\mathcal C2C2 is not scaled by λ\lambdaλ, so C1\mathcal C1C1 and C2\mathcal C2C2 give ε\varepsilonε-optimality only when λ\lambdaλ is near 111; the first phase must first raise λ\lambdaλ from 1/m1/m1/m by repeated doubling. And the cost of ε\varepsilonε-scaling is bounded only because each phase starts from a 6ε6\varepsilon6ε-optimal point, which requires carrying Lemma 3.1 across phase boundaries. The bookkeeping that turns per-call bounds into a single explicit NNN, over a fuel-bounded run, is substantial.

Formalization scope

Rows are Fin m with [NeZero m], coordinates Fin n; AAA is a Matrix (Fin m) (Fin n) ℝ; PPP is a Set (Fin n → ℝ), convex, nonempty and in the nonnegative orthant. λ(x)\lambda(x)λ(x) is a Finset.inf' over the rows. Conventions committed to:

  • Width. ρ\rhoρ is any upper bound with ρ>0\rho>0ρ>0, not a supremum; the theorems hold for every such bound, the exact width included.
  • Oracle. Subroutine (7) is a function that, for every y≥0y\ge0y≥0, returns a maximizer of ytAxy^tAxytAx over PPP; every theorem quantifies over all such functions. Box (7) of the report prints "min", but every use maximizes; the maximizer reading is adopted.
  • Optimality without λ∗\lambda^*λ∗. "xxx is cεc\varepsiloncε-optimal" is stated as (1−cε)λ(x′)≤λ(x)(1-c\varepsilon)\lambda(x')\le\lambda(x)(1−cε)λ(x′)≤λ(x) for every x′∈Px'\in Px′∈P.
  • Runs. IMPROVE-COVER and the driver are fuel-bounded functions returning some (result, oracle calls) when they stop within the fuel. Each while-test that reaches the C2\mathcal C2C2 check costs one oracle call; the loop body reuses that answer. The goal asserts that the run with fuel ⌈N⌉\lceil N\rceil⌈N⌉ stops; it does not assume termination.
  • Driver. The prose of pp. 20–21 is written down as initCover, firstPhase and scalingPhases with εk=162−k\varepsilon_k=\frac16 2^{-k}εk​=61​2−k.
  • Constants replacing O(⋅)O(\cdot)O(⋅). Theorem 3.5: 2+20ρε−3ln⁡(4m/ε)2+20\rho\varepsilon^{-3}\ln(4m/\varepsilon)2+20ρε−3ln(4m/ε) and 2+196ρε−2ln⁡(4m/ε)2+196\rho\varepsilon^{-2}\ln(4m/\varepsilon)2+196ρε−2ln(4m/ε) oracle calls. Theorem 3.7: the NNN above.
  • Implicit hypotheses made explicit. y≠0y\ne0y=0 and ε<13\varepsilon<\frac13ε<31​ in Lemma 3.1; λ>0\lambda>0λ>0 in Lemmas 3.2–3.4 and Theorem 3.5; σ≥0\sigma\ge0σ≥0 in Lemma 3.3.
  • Misprint. Theorem 3.5's second sentence names IMPROVE-PACKING; it is stated for IMPROVE-COVER.

A trivializing formalization is ruled out: the goal requires the run to return an outcome within the stated number of oracle calls, for every exact oracle and every width bound, and each outcome must be correct.

A complete development needs elementary real analysis (the second-order bound ex+δ≤ex+δex+ε2∣δ∣exe^{x+\delta}\le e^x+\delta e^x+\frac\varepsilon2|\delta|e^xex+δ≤ex+δex+2ε​∣δ∣ex for ∣δ∣≤ε/4|\delta|\le\varepsilon/4∣δ∣≤ε/4), geometric-decay counting arguments, and induction over fuel-bounded loops. The potential-decrease and termination lemmas are reusable for the packing and general missions of the same paper. Proofs of any milestone, and alternative arguments with better constants, are welcome.

Selected references

  • S. A. Plotkin, D. B. Shmoys, É. Tardos, Fast Approximation Algorithms for Fractional Packing and Covering Problems, Cornell University School of ORIE Technical Report No. 999, February 1992. https://core.ac.uk/download/79020349.pdf
  • S. A. Plotkin, D. B. Shmoys, É. Tardos, Fast Approximation Algorithms for Fractional Packing and Covering Problems, Mathematics of Operations Research 20(2), 257–301, 1995. https://doi.org/10.1287/moor.20.2.257
  • N. Garg, J. Könemann, Faster and Simpler Algorithms for Multicommodity Flow and Other Fractional Packing Problems, SIAM Journal on Computing 37(2), 630–652, 2007. https://doi.org/10.1137/S0097539704446232
  • N. E. Young, Sequential and Parallel Algorithms for Mixed Packing and Covering, Proc. 42nd IEEE FOCS, 538–546, 2001. https://arxiv.org/abs/cs/0110040
10 thms2 active usersReviewed
Graph TheoryLinear Optimization·Captain: mikedeng1

Multicommodity Max-Flow Min-Cut Theorems and Their Use in Designing Approximation Algorithms III: Every Directed Uniform Multicommodity Flow Problem Has Ω(𝒮/log n) ≤ f ≤ 𝒮Research Paper

Motivation

Many graph problems in routing, VLSI layout and scheduling ask for a cut that separates a lot of demand while cutting little capacity. For a single commodity, the max-flow min-cut theorem of Ford and Fulkerson says that the largest flow equals the smallest cut. For several commodities sharing one network this equality fails, and the question becomes how far apart the two quantities can be. Leighton and Rao (J. ACM 46 (1999), extending their FOCS 1988 paper) proved that for uniform demands the gap is at most logarithmic in the number of nodes, and turned the proof into approximation algorithms for a range of NP-hard cut problems.

Their §2.4 extends the result to directed networks, where every edge carries flow in one direction only. The directed version is the one behind their approximation algorithms for directed problems, most prominently the minimum feedback arc set problem (§3 of the paper), where the cut structure of a digraph, not of its underlying undirected graph, is what matters.

Timeline. Ford and Fulkerson (1956): max-flow = min-cut for one commodity. Hu (1963): equality for two commodities in undirected graphs. Shahrokhi and Matula (1990, circulated 1986): the uniform concurrent flow problem and its LP dual. Leighton and Rao (FOCS 1988; J. ACM 1999): Ω(S/log⁡n)≤f≤S\Omega(\mathcal S/\log n)\le f\le\mathcal SΩ(S/logn)≤f≤S for uniform and product demands, undirected and directed, tight up to the constant for undirected uniform problems. Klein, Rao, Agrawal and Ravi (1990s) and Linial, London and Rabinovich (1995) extended the undirected theorem to general demands with an O(log⁡k)O(\log k)O(logk) gap. For directed graphs with general demands the gap is polynomial in nnn (Chuzhoy and Khanna 2009), so the uniform-demand directed theorem is the setting where a logarithmic gap holds.

Setting

A directed network is a finite vertex set VVV with n=∣V∣n=|V|n=∣V∣ nodes and a capacity C(u,v)≥0C(u,v)\ge0C(u,v)≥0 for each ordered pair, with C(u,u)=0C(u,u)=0C(u,u)=0; there is an edge directed from uuu to vvv when C(u,v)>0C(u,v)>0C(u,v)>0. For U⊆VU\subseteq VU⊆V write Uˉ=V∖U\bar U=V\setminus UUˉ=V∖U and let C(U,Uˉ)=∑u∈U, v∈UˉC(u,v)C(U,\bar U)=\sum_{u\in U,\,v\in\bar U}C(u,v)C(U,Uˉ)=∑u∈U,v∈Uˉ​C(u,v) be the capacity of the edges directed from UUU to Uˉ\bar UUˉ.

The directed uniform multicommodity flow problem (directed UMFP) has one commodity for every ordered pair (u,v)(u,v)(u,v) with u≠vu\ne vu=v, each with demand 111. A concurrent flow of value λ\lambdaλ routes λ\lambdaλ units of every commodity simultaneously, each edge carrying flow only in its own direction, with total flow on the edge u→vu\to vu→v at most C(u,v)C(u,v)C(u,v). The max-flow fff is the largest such λ\lambdaλ.

The ratio cost of a cut is C(U,Uˉ)/(∣U∣ ∣Uˉ∣)C(U,\bar U)/(|U|\,|\bar U|)C(U,Uˉ)/(∣U∣∣Uˉ∣), and the min-cut is

S=min⁡∅≠U⊊VC(U,Uˉ)∣U∣ ∣Uˉ∣.\mathcal S=\min_{\emptyset\ne U\subsetneq V}\frac{C(U,\bar U)}{|U|\,|\bar U|}.S=∅=U⊊Vmin​∣U∣∣Uˉ∣C(U,Uˉ)​.

A distance function assigns a length d(u,v)≥0d(u,v)\ge0d(u,v)≥0 to each directed edge; d(u,v)d(u,v)d(u,v) then also denotes the length of a shortest directed path from uuu to vvv, its total weight is W=∑u,vC(u,v) d(u,v)W=\sum_{u,v}C(u,v)\,d(u,v)W=∑u,v​C(u,v)d(u,v), and the distance constraint is ∑(u,v)∈V2d(u,v)≥1\sum_{(u,v)\in V^2}d(u,v)\ge1∑(u,v)∈V2​d(u,v)≥1. The sets NinΔ(v,G)\mathcal N^\Delta_{\mathrm{in}}(v,G)NinΔ​(v,G) and NoutΔ(v,G)\mathcal N^\Delta_{\mathrm{out}}(v,G)NoutΔ​(v,G) are the nodes from which vvv can be reached, respectively which can be reached from vvv, by a directed path of length at most Δ\DeltaΔ. Logarithms are to base 222.

In Lean these are DiNetwork, diCutCap, diRatio, diMinCut, diDemand, IsDiConcurrentFlow, diMaxFlow, diDist, diTotalWeight, SatisfiesDiConstraint, inBall and outBall, in the namespace LeightonRao.Directed.

Formalization targets

Goal: Theorem 12 (p. 804)

There is an absolute constant c>0c>0c>0 such that every directed UMFP on n≥2n\ge2n≥2 nodes satisfies

c Slog⁡n≤f≤S.c\,\frac{\mathcal S}{\log n}\le f\le\mathcal S.clognS​≤f≤S.

The constant is left unfixed, as in the paper's Ω(⋅)\Omega(\cdot)Ω(⋅); any improvement of the constant leaves the goal intact.

Milestones

  1. Weak duality (p. 804): every concurrent flow of value λ\lambdaλ has λ∣U∣∣Uˉ∣≤C(U,Uˉ)\lambda|U||\bar U|\le C(U,\bar U)λ∣U∣∣Uˉ∣≤C(U,Uˉ) for every proper cut.
  2. LP duality (§2.2, p. 796, used for directed graphs in §2.4): every feasible distance function has W≥fW\ge fW≥f, and an optimal one has W=fW=fW=f.
  3. Lemma 13 (p. 804): for every Δ>0\Delta>0Δ>0, an ordered partition V1,…,VrV_1,\dots,V_rV1​,…,Vr​ whose backward edges (from ViV_iVi​ to VjV_jVj​, j<ij<ij<i) have capacity at most 8Wlog⁡n/Δ8W\log n/\Delta8Wlogn/Δ, each part containing a node whose in- and out-balls of radius Δ\DeltaΔ are at least as large as the part.
  4. Corollary 14 (p. 806): with Δ=1/4n2\Delta=1/4n^2Δ=1/4n2, either a node whose in- and out-balls both have at least 2n/32n/32n/3 nodes, or a directed cut of ratio cost at most 8Wlog⁡n/(Δ(n/6)(5n/6))8W\log n/(\Delta(n/6)(5n/6))8Wlogn/(Δ(n/6)(5n/6)).
  5. Lemma 15 (p. 806): a set TTT with ∣T∣≥2n/3|T|\ge2n/3∣T∣≥2n/3 and ∑u∉Td(T,u)≥1/4n\sum_{u\notin T}d(T,u)\ge1/4n∑u∈/T​d(T,u)≥1/4n or ∑u∉Td(u,T)≥1/4n\sum_{u\notin T}d(u,T)\ge1/4n∑u∈/T​d(u,T)≥1/4n gives a directed cut of ratio cost at most 12W12W12W.
  6. Lemma 16 (p. 807): a distance function satisfying the distance constraint gives a directed cut of ratio cost at most 11525Wlog⁡n\tfrac{1152}{5}W\log n51152​Wlogn.

Significance

The result. Theorem 12 says that the directed sparsest cut and the directed uniform concurrent flow agree within an O(log⁡n)O(\log n)O(logn) factor. Since the flow is an LP, this gives an O(log⁡n)O(\log n)O(logn)-approximation for the directed uniform sparsest cut, and through divide and conquer, polylogarithmic approximations for directed problems such as minimum feedback arc set and minimum directed cut linear arrangement (§3 of the paper). It is also the case in which a logarithmic flow–cut gap survives for digraphs: with arbitrary demands, the directed gap is polynomial.

Formalizing it. The theorem has been proved since 1988, but no part of it is formalized: Mathlib has no multicommodity flows, no directed path metrics over real lengths, and no region-growing arguments. This mission produces the directed concurrent-flow model, its LP duality, and the directed region-growing decomposition of Lemma 13, each reusable beyond this paper (directed multicut, feedback arc set, low-diameter decompositions of digraphs).

Difficulty

The obvious route copies the undirected proof: grow a ball around a node until the capacity on its boundary is small compared with the capacity inside, cut it off, and repeat. In a digraph this fails at two places. A ball of small out-radius can have large in-radius, so a piece cut off by out-distances is not small in the sense needed later; and cutting off a piece only controls the edges leaving it in one direction, so edges pointing back into earlier pieces are not paid for. Lemma 13 has to bound the capacity of all backward edges of an ordered partition while keeping each part inside both an in-ball and an out-ball around one of its own nodes. The final averaging step also changes: the undirected argument sums d(T,u)+d(T,v)d(T,u)+d(T,v)d(T,u)+d(T,v) over symmetric pairs, which has no directed counterpart, so the distance constraint over ordered pairs has to be split between distances into one set and out of another.

Formalization scope

Vertices form a Fintype with decidable equality, and every goal-level statement assumes n≥2n\ge2n≥2. Commodities are ordered pairs with demand 111; a flow is in arc form, fst(i,j)≥0f_{st}(i,j)\ge0fst​(i,j)≥0 with conservation, and the capacity constraint is per directed edge. The max-flow is the supremum (sSup) of the achievable values λ≥0\lambda\ge0λ≥0; the min-cut is an infimum over nonempty proper subsets, since the ratio is 0/00/00/0 otherwise. Shortest-path distances are infima over directed walks (lists of vertices along edges of positive capacity); for nonnegative lengths these equal shortest-path lengths. An unreachable pair would get Lean's junk value 000, so every statement using d(u,v)d(u,v)d(u,v) assumes strong connectivity (C(U,Uˉ)>0C(U,\bar U)>0C(U,Uˉ)>0 for every proper UUU), the directed analogue of the paper's standing assumption on p. 789; the balls are defined through the existence of a walk and need no such assumption. WWW counts each directed edge once, and the distance constraint sums over ordered pairs. "We can find" is read as existence; running times are not formalized. The Ω\OmegaΩ of Theorem 12 is one absolute constant chosen before the network; the explicit constants 888, 1152/51152/51152/5 and 121212 of the milestones are the ones computed in the paper's proofs.

Two printed slips are corrected and disclosed: Lemma 13 (1) prints 1≤j<i<r1\le j<i<r1≤j<i<r where the proof uses i≤ri\le ri≤r, and the proof's last line prints ∣NoutΔ(v,G)∣≤∣Vi∣|\mathcal N^\Delta_{\mathrm{out}}(v,G)|\le|V_i|∣NoutΔ​(v,G)∣≤∣Vi​∣ where the statement has ≥\ge≥.

The statement cannot be trivialized by a degenerate cut or flow: cuts range over nonempty proper subsets, the flow's capacity constraint is directional, and the goal's constant is quantified before the network, so a constant depending on nnn does not count.

Needed infrastructure: LP duality for the concurrent flow LP (or a direct proof of the max-flow/distance duality), shortest directed paths with real lengths, and the region-growing bookkeeping. Contributions to any milestone are welcome, as are alternative proofs of Lemma 13 by continuous region growing.

Selected references

  • T. Leighton and S. Rao, Multicommodity max-flow min-cut theorems and their use in designing approximation algorithms, J. ACM 46(6):787–832, 1999. https://doi.org/10.1145/331524.331526
  • F. Shahrokhi and D. W. Matula, The maximum concurrent flow problem, J. ACM 37(2):318–334, 1990. https://doi.org/10.1145/77600.77620
  • N. Linial, E. London and Yu. Rabinovich, The geometry of graphs and some of its algorithmic applications, Combinatorica 15(2):215–245, 1995. https://doi.org/10.1007/BF01200757
  • J. Chuzhoy and S. Khanna, Polynomial flow-cut gaps and hardness of directed cut problems, J. ACM 56(2):6, 2009. https://doi.org/10.1145/1502793.1502795
8 thms2 active usersReviewed
Graph TheoryLinear Optimization·Captain: mikedeng1

Multicommodity Max-Flow Min-Cut Theorems and Their Use in Designing Approximation Algorithms II: Every Product Multicommodity Flow Problem with k Commodities Has Ω(𝒮/log k) ≤ f ≤ 𝒮Research Paper

Why multicommodity max-flow and min-cut

For a single commodity, the Ford–Fulkerson theorem says that the maximum flow between two nodes equals the minimum capacity of a cut separating them. Many routing and partitioning problems involve many source–sink pairs at once, and for those the equality fails: the largest fraction of every demand that can be routed simultaneously can be strictly smaller than the sparsest cut. Leighton and Rao (J. ACM 1999, building on their FOCS 1988 paper) proved that the gap is at most logarithmic for broad classes of demand patterns, and turned the proof into the first O(log⁡n)O(\log n)O(logn)-approximation algorithms for sparsest cut, balanced separators, minimum feedback arc set, crossing number and VLSI layout problems.

This mission formalizes Section 2.3 of the paper: the extension of the uniform max-flow min-cut theorem to product multicommodity flow problems (PMFPs), where the demand between two nodes is the product of their node weights.

Timeline.

  • 1956: Ford and Fulkerson, single-commodity max-flow = min-cut.
  • 1963: Hu, equality for two commodities.
  • 1988: Leighton and Rao (FOCS), Θ(log⁡n)\Theta(\log n)Θ(logn) gap for uniform demands; the product-demand extension, pointed out to them by Shmoys, Tardos and Sinclair, appears in the journal version (1999), Theorem 7.
  • 1993–1995: Klein–Agrawal–Ravi–Rao, Garg–Vazirani–Yannakakis, Linial–London–Rabinovich and Aumann–Rabani extend the O(log⁡k)O(\log k)O(logk) gap to arbitrary demands with kkk commodities.

Setting

A network is a finite vertex set VVV with a symmetric capacity C(u,v)≥0C(u,v)\ge0C(u,v)≥0 on each pair, zero on the diagonal; {u,v}\{u,v\}{u,v} is an edge when C(u,v)>0C(u,v)>0C(u,v)>0. For U⊆VU\subseteq VU⊆V, the cut capacity is C(U,Uˉ)=∑u∈U, v∉UC(u,v)C(U,\bar U)=\sum_{u\in U,\,v\notin U}C(u,v)C(U,Uˉ)=∑u∈U,v∈/U​C(u,v). The network is assumed connected: C(U,Uˉ)>0C(U,\bar U)>0C(U,Uˉ)>0 for every nonempty proper UUU.

A PMFP is given by a node weighting π:V→R≥0\pi:V\to\mathbb R_{\ge0}π:V→R≥0​. Write P\mathcal PP for the set of nodes with π(u)≠0\pi(u)\ne0π(u)=0, p=∣P∣p=|\mathcal P|p=∣P∣, and π(U)=∑u∈Uπ(u)\pi(U)=\sum_{u\in U}\pi(u)π(U)=∑u∈U​π(u). As in the paper, the weights are normalized so that π(V)=p\pi(V)=pπ(V)=p. Every pair {u,v}\{u,v\}{u,v} is a commodity with demand π(u)π(v)\pi(u)\pi(v)π(u)π(v); there are k=(p2)k=\binom p2k=(2p​) commodities with nonzero demand. The uniform problem is π≡1\pi\equiv1π≡1.

The max-flow fff is the largest λ\lambdaλ such that λπ(u)π(v)\lambda\pi(u)\pi(v)λπ(u)π(v) units of every commodity can be routed simultaneously, with the total flow on each edge (both directions) at most its capacity. The min-cut is

S=min⁡U: π(U)>0, π(Uˉ)>0C(U,Uˉ)π(U) π(Uˉ),\mathcal S=\min_{U:\ \pi(U)>0,\ \pi(\bar U)>0}\frac{C(U,\bar U)}{\pi(U)\,\pi(\bar U)},S=U: π(U)>0, π(Uˉ)>0min​π(U)π(Uˉ)C(U,Uˉ)​,

the quotient being the weighted ratio cost of the cut ⟨U,Uˉ⟩\langle U,\bar U\rangle⟨U,Uˉ⟩.

The dual objects are distance functions: lengths d(e)≥0d(e)\ge0d(e)≥0 on the edges, with total weight W=∑eC(e)d(e)W=\sum_eC(e)d(e)W=∑e​C(e)d(e); d(u,v)d(u,v)d(u,v) is the shortest-path distance and d(T,u)=min⁡t∈Td(t,u)d(T,u)=\min_{t\in T}d(t,u)d(T,u)=mint∈T​d(t,u). The weighted distance constraint is ∑{u,v}∈P2π(u)π(v)d(u,v)≥1\sum_{\{u,v\}\in\mathcal P^2}\pi(u)\pi(v)d(u,v)\ge1∑{u,v}∈P2​π(u)π(v)d(u,v)≥1.

Formalization targets

Goal: Theorem 7 (pp. 801–802)

There is an absolute constant c>0c>0c>0 such that every normalized PMFP with p≥2p\ge2p≥2 on a connected network satisfies

c Slog⁡2max⁡(k,2)≤f≤S.\frac{c\,\mathcal S}{\log_2\max(k,2)}\le f\le\mathcal S .log2​max(k,2)cS​≤f≤S.

The goal leaves the constant unfixed, which is the paper's Ω(⋅)\Omega(\cdot)Ω(⋅).

Milestones, in the order the proof uses them

  1. Weak duality (§1.2, pp. 789–790): f π(U)π(Uˉ)≤C(U,Uˉ)f\,\pi(U)\pi(\bar U)\le C(U,\bar U)fπ(U)π(Uˉ)≤C(U,Uˉ) for every cut with positive weight on both sides.
  2. LP duality for the PMFP (p. 802 with p. 796): distance functions satisfying the weighted constraint have W≥fW\ge fW≥f, and one attains W=fW=fW=f.
  3. Lemma 8 (p. 802): a partition whose components meeting P\mathcal PP have radius at most Δ\DeltaΔ and whose cross capacity is at most 4Wlog⁡p/Δ4W\log p/\Delta4Wlogp/Δ.
  4. Corollary 9 (p. 802): either a set TTT of radius 1/2p21/2p^21/2p2 with π(T)≥2p/3\pi(T)\ge2p/3π(T)≥2p/3, or a cut of weighted ratio cost O(Wlog⁡p)O(W\log p)O(Wlogp).
  5. Lemma 10 (p. 802): a heavy set TTT far on average from the remaining weight yields a cut of weighted ratio cost O(W)O(W)O(W).
  6. Lemma 11 (p. 803): a distance function satisfying the weighted constraint yields a cut of weighted ratio cost O(Wlog⁡p)O(W\log p)O(Wlogp).

Stronger companions

  • S≤36log⁡2max⁡(k,2)⋅f\mathcal S\le36\log_2\max(k,2)\cdot fS≤36log2​max(k,2)⋅f, the constant of the paper's proof.
  • Theorem 7 without the normalization π(V)=p\pi(V)=pπ(V)=p, which the paper assumes "without loss of generality".

Significance

Theorem 7 bounds the multicommodity flow–cut gap by O(log⁡k)O(\log k)O(logk) for every product demand pattern, so an optimal dual distance function certifies a cut within O(log⁡k)O(\log k)O(logk) of the sparsest weighted cut. The paper itself applies it to reversible Markov chains (§3.27, p. 827). There the node weights are the stationary probabilities, and Theorem 7 shows that the inverse conductance and the resistance of a chain agree up to a Θ(log⁡p)\Theta(\log p)Θ(logp) factor, where ppp is the number of states with positive stationary probability.

Theorem 7 was proved in 1988–1999 and is subsumed, up to the constant, by the general O(log⁡k)O(\log k)O(logk) bound for arbitrary demands (Linial–London–Rabinovich 1995; Aumann–Rabani 1998). It has no machine-checked proof, and neither has any of its milestones. A complete development would also be the first formal treatment on Prove2Me of concurrent multicommodity flow, its LP dual, and region-growing (low-diameter) decompositions, which recur across approximation algorithms and metric embeddings.

Difficulty

The upper bound f≤Sf\le\mathcal Sf≤S is a counting argument. The lower bound is the work. Rounding an optimal dual distance function to a cut fails directly: thresholding distances from a single node gives no control on the ratio when the weight is spread out. The paper's argument needs a decomposition of the graph into components of small radius that cuts little capacity, with a loss of only log⁡p\log plogp, not log⁡n\log nlogn: the regions must be grown from weighted nodes only, while the many zero-weight nodes still sit inside the graph and its capacities. It must then separately handle the case where one component carries two thirds of the weight. Formally, the LP duality step alone requires a strong-duality statement for a linear program with one constraint per path, exponentially many, which Mathlib does not provide in this form.

Formalization scope

All objects live in the namespace LeightonRao.Product in a single definitions file.

  • Network and graph. A network is a symmetric nonnegative capacity function on a finite type with zero diagonal. The graph has an edge where the capacity is positive.
  • Commodities. One commodity per ordered pair u≠vu\ne vu=v, with demand 12π(u)π(v)\tfrac12\pi(u)\pi(v)21​π(u)π(v) each way (the paper's footnote 7). The total demand of a pair is then π(u)π(v)\pi(u)\pi(v)π(u)π(v), and the demand separated by UUU is π(U)π(Uˉ)\pi(U)\pi(\bar U)π(U)π(Uˉ).
  • Max-flow. Flows are arc flows per commodity. The max-flow is the supremum of the feasible values λ≥0\lambda\ge0λ≥0.
  • Min-cut. The min-cut ranges only over cuts with π(U)>0\pi(U)>0π(U)>0 and π(Uˉ)>0\pi(\bar U)>0π(Uˉ)>0. On the other cuts the paper's quotient is undefined; reading it with Lean's division by zero would make S=0\mathcal S=0S=0 and the goal trivial.
  • Distances, radius, cross capacity. Graph distances are infima of walk lengths. The radius of a component is measured by walks inside the component. Cross capacity is the capacity between different parts of a Finpartition.
  • Logarithms. log⁡\loglog is log⁡2\log_2log2​ (the paper's footnote 3). For p=2p=2p=2 there is one commodity and log⁡k=0\log k=0logk=0, so the goal uses log⁡2max⁡(k,2)\log_2\max(k,2)log2​max(k,2).
  • Constants. The O(⋅)O(\cdot)O(⋅) constants of the milestones are the ones computed in the paper's proofs: 363636 in Corollary 9 and Lemma 11, 666 in Lemma 10.
  • Hypotheses added to the page, each disclosed in its statement:
    • Δ>0\Delta>0Δ>0 in Lemma 8, where the page says Δ≥0\Delta\ge0Δ≥0 but divides by Δ\DeltaΔ;
    • p≥2p\ge2p≥2 in Lemma 8, which is false for p=1p=1p=1;
    • the weighted ratio cost in Lemma 10, as its proof and its use in Lemma 11 require.
  • Not formalized. The polynomial-time content of "we can find" is not formalized; each such claim is an existence statement.

Contributions are welcome at every level:

  • proofs of the milestones;
  • a general strong-duality lemma for concurrent flow, reusable for the uniform, directed and short-path missions of this series;
  • a reusable region-growing decomposition lemma.

Selected references

  • T. Leighton and S. Rao, Multicommodity max-flow min-cut theorems and their use in designing approximation algorithms, J. ACM 46(6):787–832, 1999. https://doi.org/10.1145/331524.331526
  • T. Leighton and S. Rao, An approximate max-flow min-cut theorem for uniform multicommodity flow problems with applications to approximation algorithms, FOCS 1988, 422–431. https://doi.org/10.1109/SFCS.1988.21958
  • N. Garg, V. V. Vazirani and M. Yannakakis, Approximate max-flow min-(multi)cut theorems and their applications, SIAM J. Comput. 25(2):235–251, 1996. https://doi.org/10.1137/S0097539793243016
  • N. Linial, E. London and Y. Rabinovich, The geometry of graphs and some of its algorithmic applications, Combinatorica 15(2):215–245, 1995. https://doi.org/10.1007/BF01200757
  • Y. Aumann and Y. Rabani, An O(log k) approximate min-cut max-flow theorem and approximation algorithm, SIAM J. Comput. 27(1):291–301, 1998. https://doi.org/10.1137/S0097539794285983
  • F. Shahrokhi and D. W. Matula, The maximum concurrent flow problem, J. ACM 37(2):318–334, 1990. https://doi.org/10.1145/77600.77620
8 thms2 active usersReviewed
Complexity TheoryInformation TheoryProbability·Captain: mikedeng1

A Pseudorandom Generator from Any One-Way Function: One-Way Functions Exist If and Only If Pseudorandom Generators ExistResearch Paper

Motivation

Cryptographic protocols use random looking strings that can be reproduced from a shorter private seed. A pseudorandom generator provides those strings if no efficient observer can tell them from uniformly sampled bits. A one-way function provides a different kind of asymmetry: anyone can evaluate it efficiently, but no efficient algorithm can usually recover a preimage of a random output. Håstad, Impagliazzo, Levin, and Luby proved that these two existence questions are equivalent. Their result identifies average-case inversion hardness as sufficient for computational pseudorandomness, without assuming a particular candidate function or algebraic problem (Håstad et al., 1999).

The equivalence is known mathematically; this mission asks for a machine-checked account of its qualitative security claim. The original article develops stronger quantitative time–success comparisons. Those comparisons are relevant to concrete cryptography, but the existence equivalence can be stated through asymptotically negligible success probabilities. This distinction is fixed throughout the formalization.

Setting

At security parameter nnn, a function ensemble FFF receives a string from the Boolean cube {0,1}tn\{0,1\}^{t_n}{0,1}tn​ and returns one in {0,1}ℓn\{0,1\}^{\ell_n}{0,1}ℓn​. The lengths are polynomial-time parameters, and one uniform machine evaluates the family when given 1n1^n1n, separators, an optional unary integer advice value, and the input. The optional advice is polynomially bounded and may depend on nnn without being computable. The goal itself uses no advice.

An adversary is a polynomial-time bit-string machine with polynomially many independent random coins. For inversion it sees Fn(X)F_n(X)Fn​(X) for a uniform input XXX and may return any string x′x'x′ of the correct input length with Fn(x′)=Fn(X)F_n(x')=F_n(X)Fn​(x′)=Fn​(X). It need not recover the original XXX. The ensemble is one-way if that success probability is negligible for every such adversary. For distinguishing, the adversary accepts only by outputting the one-bit string [1][1][1]. Two laws are computationally indistinguishable if every adversary has negligible difference between its acceptance probabilities.

A generator GGG is pseudorandom when tn<ℓnt_n<\ell_ntn​<ℓn​ for positive nnn and its output law on a uniform tnt_ntn​-bit seed is computationally indistinguishable from the uniform law on ℓn\ell_nℓn​ bits. Strict stretch is essential: the identity map would otherwise satisfy the indistinguishability clause. All probabilities are finite counting fractions over Boolean cubes, so neither arbitrary measures nor a default value for an empty event space enters the definitions.

The intermediate results use Shannon entropy and order-two Rényi entropy, both in bits, and statistical distance, half the L1L^1L1 difference of finite laws. A universal hash family is pairwise independent in the exact sense of Definition 4.6: for distinct inputs x,x′x,x'x,x′ and any two prescribed outputs a,a′a,a'a,a′, the chance over the uniform key that both outputs occur is exactly the reciprocal of the square of the output-space size. The public hash key is retained in the extracted output (Håstad et al., 1999, §§2–4).

Formalization targets

Main equivalence

The goal is Theorem 6.3, on printed page 1387:

(∃F  OWF(F))⟺(∃G  PRG(G)).(\exists F\;\mathrm{OWF}(F))\quad\Longleftrightarrow\quad (\exists G\;\mathrm{PRG}(G)).(∃FOWF(F))⟺(∃GPRG(G)).

Existence is the stable target: it does not fix a particular generator or an output-stretch constant. The reverse direction is the one the article attributes to Levin; the forward direction passes through the article's false-entropy and pseudoentropy constructions.

Intermediate targets

Lemma 4.8 bounds the statistical distance of a universal hash output with its public key by 2−(e+1)2^{-(e+1)}2−(e+1) when the source has Rényi entropy at least mmm and the hash output has m−2em-2em−2e bits. Theorem 4.14 converts a pseudoentropy generator into a PRG using the integer lengths and repetition count in Construction 4.13. Lemma 6.4 compares the Shannon entropies of the two Section 6 output laws:

H(E)≥H(D)+10n2,H(\mathcal E)\ge H(\mathcal D)+10n^2,H(E)≥H(D)+10n2,

with kn≥125n3k_n\ge125n^3kn​≥125n3. Theorem 6.2 gives the resulting mildly nonuniform false-entropy generator from a one-way function. The cited Levin direction is a separate existential milestone. These statements are the mission's milestone list, in their attack order (Håstad et al., 1999, pp. 1378–1387).

Significance

The result supplies a general route from any suitable average-case hard inversion task to a source of computational pseudorandom bits. It means an existence theorem for one primitive also settles the existence question for the other; it does not claim that an arbitrary one-bit-stretch generator is itself one-way. The paper's intermediate entropy notions record how much unpredictability remains or appears when outputs have nonuniform statistical laws.

A completed formalization would make the definitions of adversary, negligible advantage, universal hashing, entropy, and the finite output laws independently reusable. The known paper proof is not yet represented by the theorem stubs in this proposal. Formalizing the cited reverse implication, the entropy comparisons, and the links between the paper's intermediate generator notions remains solver work. No claim is made that the quantitative reduction bounds have been machine checked.

Difficulty

The one-way hypothesis only limits efficient inversion of an output; it does not directly say that the output is close to uniform. In particular, the output may carry statistical structure even when finding a preimage is hard. A direct attempt to hash the output without accounting for its varying preimage sizes does not produce the claimed pseudorandom law. The Section 6 construction therefore involves a random index, a hash prefix, independent parity masks, and a second public hash key. Their exact sample spaces matter for both the entropy gap and computational indistinguishability (Håstad et al., 1999, §§4, 6).

Formalization scope

Bit strings are Levin2003.Bits, fixed-length cubes are Levin2003.cube, and polynomial time is Mathlib's TM2 notion through the published Levin2003_owf_model. That module's own OneWay predicate requires length preservation, which Definition 3.2 of this paper does not; this mission defines its own ensemble and one-way predicate. Uniform adversaries receive no advice in the goal. Their coin budgets are polynomially bounded, and their inputs expose the security parameter in unary. Those choices rule out the vacuous encoding with unrestricted adversaries or an invisible security parameter.

The §6 laws use a finite product seed. The printed (6.8) samples index blocks as bit strings of length ⌈log⁡n⌉\lceil\log n\rceil⌈logn⌉, but (6.3) defines f′f'f′ only for indices 0,…,n−10,\ldots,n-10,…,n−1 and (6.5) averages uniformly over that range. The formalization uses Fin n indices. Thus Theorem 6.2 is stated for the repaired finite seed law, with a polynomial-time evaluator on its binary encoding. This exposes a gap between that seed space and Definition 3.9's uniform bit seed; bridging it is part of a complete proof. The prefix of a hash output is padded for the binary law, while the index remains present so the padding loses no information. The real-valued mnm_nmn​ in (6.6) is rounded down to a bit length, and its integer value is the advice for Theorem 6.2. Construction 4.13 retains its printed floor and ceiling. Its pseudoentropy surplus sns_nsn​ may be real-valued, as in the paper; polynomial-time computability of sns_nsn​ is rendered as sn=pn/qns_n=p_n/q_nsn​=pn​/qn​ with natural numbers whose binary expansions are polynomial-time computable from 1n1^n1n.

Lemma 6.4 explicitly bounds approximate degeneracy by n−1n-1n−1, which its printed proof uses without stating. For a one-way function that bound is needed only eventually. Accordingly computational-entropy lower bounds are formulated for all sufficiently large positive nnn; the paper's Definition 3.7 says all nnn. Lemma 6.5's oracle-machine statement and its printed probability constant are left for a separate treatment. The model covers qualitative negligible success, not time–success ratios, expected-time bookkeeping, or labels such as weak-preserving. Contributions that close those quantitative gaps are welcome, as are proofs of the selected milestones and reusable finite-entropy lemmas.

Selected references

  • J. Håstad, R. Impagliazzo, L. A. Levin, and M. Luby, A Pseudorandom Generator from Any One-Way Function, SIAM Journal on Computing 28(4):1364–1396, 1999. DOI: 10.1137/S0097539793244708.
9 thms2 active usersReviewed
CombinatoricsOperations Research·Captain: mikedeng1

Flowshop and Jobshop Schedules: Complexity and Approximation 2: The 3-Partition Flow Shop on Three Machines Has a Preemptive Schedule of Finish Time 2tB Iff a 3-Partition ExistsResearch Paper

Motivation

A flow shop is the simplest multi-stage production model: every job passes through the same machines in the same order, and the question is how to sequence the work so that everything is finished as early as possible. Gonzalez and Sahni's 1978 paper in Operations Research settled the computational complexity of the preemptive version of this problem, in which a task may be interrupted and resumed later on the same machine. For two machines the optimal finish time is computed by Johnson's rule, and preemption does not help. The paper shows that with three machines the preemptive problem is already NP-complete, and its second result, Theorem 2, strengthens this to NP-completeness in the strong sense: the problem stays hard even when the task times are written in unary.

Strong NP-completeness matters because it rules out a pseudo-polynomial algorithm, one whose running time is polynomial in the sum of the task lengths. The preemptive three-machine flow shop (F3∣pmtn∣Cmax⁡F3\mid pmtn\mid C_{\max}F3∣pmtn∣Cmax​ in later notation) is a standard entry in complexity classifications of scheduling problems, and Theorem 2 is the reference for its status. The paper notes that Garey and Johnson obtained a proof independently.

Timeline. Johnson (1954) solved the two-machine flow shop. Garey, Johnson and Sethi (1976) proved the non-preemptive three-machine flow shop NP-complete in the strong sense. Gonzalez and Sahni (1978) treated the preemptive case: Theorem 1 (ordinary NP-completeness via Partition) and Theorem 2 (strong NP-completeness via 3-Partition), the subject of this mission.

Setting

A flow shop has m≥1m\ge 1m≥1 processors P1,…,PmP_1,\dots,P_mP1​,…,Pm​ and a finite set of jobs. Task jjj of job iii runs on PjP_jPj​ and takes time tj,i≥0t_{j,i}\ge 0tj,i​≥0; zero times are allowed. For each job, task j≥2j\ge 2j≥2 can begin only after task j−1j-1j−1 has been completed, and schedules start at time 000.

A preemptive schedule is given, as in the paper's footnote on p. 40, by finitely many pieces (s,f)(s,f)(s,f) per task: the task is processed on its processor during [s,f)[s,f)[s,f). Pieces have 0≤s<f0\le s<f0≤s<f, pieces on the same processor do not overlap, the pieces of a task have total length tj,it_{j,i}tj,i​, and a piece of task j′j'j′ starts only after every piece of every earlier task j<j′j<j'j<j′ of the same job has ended. A task has no preemption when it is processed in at most one piece; a non-preemptive schedule has no preemption anywhere. The completion time of job iii is fi(S)f_i(S)fi​(S), the end of its last piece, and the finish time is FT(S)=max⁡ifi(S)FT(S)=\max_i f_i(S)FT(S)=maxi​fi​(S).

3-Partition. An instance C=(a1,…,as,B)C=(a_1,\dots,a_s,B)C=(a1​,…,as​,B), s=3ts=3ts=3t, consists of a positive integer BBB and nonnegative integers aia_iai​ with ∑iai=tB\sum_i a_i=tB∑i​ai​=tB and B/4<ai<B/2B/4<a_i<B/2B/4<ai​<B/2. It has a 3-partition if {1,…,s}\{1,\dots,s\}{1,…,s} splits into ttt disjoint sets L1,…,LtL_1,\dots,L_tL1​,…,Lt​, each of three elements with ∑j∈Lkaj=B\sum_{j\in L_k}a_j=B∑j∈Lk​​aj​=B.

The instance FS. From CCC the proof of Lemma 4 builds a three-processor flow shop with s+t+2s+t+2s+t+2 jobs:

  • jobs 1,…,s1,\dots,s1,…,s: times (ai, 0, ai)(a_i,\,0,\,a_i)(ai​,0,ai​) on (P1,P2,P3)(P_1,P_2,P_3)(P1​,P2​,P3​);
  • job s+1s+1s+1: (0, 2B, B)(0,\,2B,\,B)(0,2B,B);
  • jobs s+i+1s+i+1s+i+1, 1≤i≤t−21\le i\le t-21≤i≤t−2: (B, 2B, B)(B,\,2B,\,B)(B,2B,B);
  • job s+ts+ts+t: (B, 2B, 0)(B,\,2B,\,0)(B,2B,0);
  • job s+t+1s+t+1s+t+1: (0, 0, B)(0,\,0,\,B)(0,0,B);
  • job s+t+2s+t+2s+t+2: (B, 0, 0)(B,\,0,\,0)(B,0,0).

Each processor carries total work exactly 2tB2tB2tB, and the threshold is τ=2tB\tau=2tBτ=2tB.

Formalization targets

Goal: Theorem 2, as Lemma 4's equivalence

For every 3-Partition instance CCC with t≥2t\ge 2t≥2,

∃ S preemptive schedule of FS: FT(S)≤2tB⟺C has a 3-partition,\exists\,S \text{ preemptive schedule of } FS:\ FT(S)\le 2tB \quad\Longleftrightarrow\quad C \text{ has a 3-partition},∃S preemptive schedule of FS: FT(S)≤2tB⟺C has a 3-partition,

and every task time of FSFSFS satisfies tj,i≤2Bt_{j,i}\le 2Btj,i​≤2B. The second clause records that the instance's numbers are bounded by those of CCC, the reduction's contribution to "the problem size being measured as the sum of the length of the tasks".

Milestones

  1. Lemma 3 (p. 40). For a flow shop with m≥1m\ge 1m≥1 processors, every preemptive schedule SSS can be replaced by a schedule S′S'S′ with no preemptions on P1P_1P1​ and on PmP_mPm​ and FT(S′)=FT(S)FT(S')=FT(S)FT(S′)=FT(S).
  2. Lemma 4(a) (p. 41). If CCC has a 3-partition, FSFSFS has a non-preemptive schedule with FT≤2tBFT\le 2tBFT≤2tB.
  3. First step of Lemma 4(b) (pp. 41–42). In every preemptive schedule of FSFSFS with FT≤2tBFT\le 2tBFT≤2tB, the jobs among 1,…,s1,\dots,s1,…,s whose P1P_1P1​ task is completed by time 2B2B2B have ∑t1,i=B\sum t_{1,i}=B∑t1,i​=B.
  4. Lemma 4(b) (pp. 41–42). If CCC has no 3-partition, every preemptive schedule of FSFSFS has FT>2tBFT>2tBFT>2tB.

Significance

The result. Theorem 2 places the preemptive three-machine flow shop among the strongly NP-hard scheduling problems, so no algorithm polynomial in the number of jobs and the total processing time exists unless P = NP. It also shows that allowing preemption, which makes several single-stage problems (such as P∣pmtn∣Cmax⁡P\mid pmtn\mid C_{\max}P∣pmtn∣Cmax​) easy, does not help for three-stage flow shops. Lemma 3, that preemptions on the first and last machines can be removed without changing the finish time, holds for any number of machines and is a reusable structural fact about flow-shop schedules.

Formalizing it. The result is proved on paper, and its proof of the "only if" direction is an informal busy-processor argument repeated window by window. As far as is known, no part of it has a machine-checked proof. A formal development has to make the interval accounting rigorous: why each processor is busy throughout [0,2tB][0,2tB][0,2tB], why exactly BBB units of element jobs end on P1P_1P1​ by 2B2B2B, and how the argument restarts on [2B,2tB][2B,2tB][2B,2tB]. Lemma 3 needs an exchange argument on piece representations. Both are new for the platform.

Difficulty

The direction "3-partition ⇒\Rightarrow⇒ schedule" is a direct construction. The hard direction is the converse. Preemption lets any task be split across many intervals, so the usual non-preemptive arguments, which reason about the order in which whole tasks run, do not apply directly. The paper's argument that the window [0,2B][0,2B][0,2B] must contain exactly three element jobs of total BBB on P1P_1P1​ depends on every processor being continuously busy, and turning "otherwise there is idle time" into a precise statement requires a careful account of which jobs are available to each processor at each moment. The induction on windows is then not a literal restriction of the schedule to a smaller instance, because pieces may cross the boundary at 2B2B2B.

Formalization scope

  • Times are real numbers; the 3-Partition data are natural numbers cast to R\mathbb RR. Processors are Fin m with P1=P_1=P1​= 0; in FSFSFS, P1,P2,P3P_1,P_2,P_3P1​,P2​,P3​ are 0, 1, 2.
  • The 3-Partition instance is the published ResourceScheduling.Chain.ThreePartition (0-based indices, t parts, b =B=B=B, Valid, HasSolution), whose definition is the paper's p. 37 problem.
  • Preemptive schedules are finite sets of pieces per task; precedence is required between every pair of tasks j<j′j<j'j<j′ of a job, so a zero task occupies no time and does not break the job's order. Finish time is a maximum over jobs with baseline 000, never an unattained supremum.
  • "No preemptions on PjP_jPj​" means at most one piece per task on PjP_jPj​.
  • Not formalized: "NP-complete", the reduction symbol ∝\propto∝, "the problem size being measured as the sum of the length of the tasks", and Lemma 2 (membership in NP). The goal states the equivalence Lemma 4 proves for the constructed instance, plus the bound tj,i≤2Bt_{j,i}\le 2Btj,i​≤2B on its task times.
  • Added hypothesis: t≥2t\ge 2t≥2. For t<2t<2t<2 the paper's job indices s+1s+1s+1 and s+ts+ts+t coincide with conflicting times, so the construction is undefined there.
  • The first step of Lemma 4(b) is read as: the sum of t1,it_{1,i}t1,i​ over element jobs whose P1P_1P1​ task has completed by time 2B2B2B equals BBB.
  • A trivializing formalization is ruled out: the schedules quantified over are all preemptive schedules of the specific instance FS(C)FS(C)FS(C), the threshold 2tB2tB2tB is explicit, and the validity conditions B/4<ai<B/2B/4<a_i<B/2B/4<ai​<B/2 are kept, so the schedule side cannot match the weaker "partition into ttt groups of sum BBB".

Contributions welcome: the interval-accounting lemmas (busy processors, work available before a time), Lemma 3's exchange argument, and the schedule of Figure 2.

Selected references

  • T. Gonzalez, S. Sahni, Flowshop and Jobshop Schedules: Complexity and Approximation, Operations Research 26(1):36–52, 1978. https://doi.org/10.1287/opre.26.1.36
  • M. R. Garey, D. S. Johnson, R. Sethi, The Complexity of Flowshop and Jobshop Scheduling, Mathematics of Operations Research 1(2):117–129, 1976. https://doi.org/10.1287/moor.1.2.117
  • S. M. Johnson, Optimal two- and three-stage production schedules with setup times included, Naval Research Logistics Quarterly 1(1):61–68, 1954. https://doi.org/10.1002/nav.3800010110
  • M. R. Garey, D. S. Johnson, "Strong" NP-Completeness Results: Motivation, Examples, and Implications, Journal of the ACM 25(3):499–508, 1978. https://doi.org/10.1145/322077.322090
8 thms2 active usersReviewed
CombinatoricsOperations ResearchProbability·Captain: mikedeng1

An Optimal Algorithm for On-line Bipartite Matching 2: No Randomized On-line Algorithm Guarantees an Expected Matching Larger Than n(1 − 1/e) + o(n)Research Paper

Motivation

An online matching algorithm must commit to each assignment when a request arrives, before it sees later requests. This limitation arises whenever waiting for the full instance is impossible: an available resource can be assigned to a current request or saved for an unknown future request. The quality of the assignment is measured by how many requests can be matched. The central question is how much the lack of future information costs, even when an algorithm uses randomness. Karp, U. Vazirani, and V. Vazirani studied this question for bipartite graphs and proved an asymptotic ceiling of 1−1/e1-1/e1−1/e for the expected fraction matched by any randomized online rule on graphs with a perfect matching (Karp, Vazirani, and Vazirani, 1990).

The paper also analyzes RANKING and gives a matching asymptotic guarantee from below. This mission concerns the separate upper-bound result: the existence of hard instances for every algorithm. The upper bound matters independently of any particular proposed rule. It says that improving an algorithm's decisions cannot remove the worst-case loss due to decisions made before all columns are revealed. Its quantifiers make the adversarial model precise: the graph is selected with knowledge of the algorithm, before that algorithm's random choices are made.

Setting

There are nnn boys, represented by rows, and nnn girls, represented by columns. A bipartite graph G⊆[n]×[n]G\subseteq[n]\times[n]G⊆[n]×[n] records which boy and girl pairs may be matched. The graph is assumed to contain a perfect matching: some bijection between the two sides uses only edges of GGG. This assumption supplies an offline benchmark of nnn matches. Without it, a graph with no edges would make every upper bound on matching size empty of content.

Girls arrive one at a time. On arrival, the algorithm learns the edges incident to that girl, chooses an as-yet-unmatched adjacent boy, or declines to match her. A choice cannot later be changed. The paper labels columns so that they arrive in the order n,n−1,…,1n,n-1,\ldots,1n,n−1,…,1. A deterministic algorithm can base its action on the neighborhoods revealed so far. A randomized algorithm can additionally use internal random choices. Its performance p(A)p(A)p(A) is the minimum, over a graph with a perfect matching and a preselected arrival order, of its expected number of matches; the expectation is over its own randomness (Karp, Vazirani, and Vazirani, 1990, p. 352).

The paper's hard family begins with the complete upper-triangular graph TnT_nTn​, where row iii is adjacent to column jjj exactly when i≤ji\le ji≤j. Its columns arrive from largest to smallest. Relabeling the rows by a permutation π\piπ gives an instance TπT_\piTπ​ that still contains a perfect matching. The algorithm RANDOM takes an eligible boy uniformly whenever at least one is available. Write VTn(n,∅)V_{T_n}(n,\varnothing)VTn​​(n,∅) for RANDOM's expected number of matches on TnT_nTn​, beginning with no matched rows (Karp, Vazirani, and Vazirani, 1990, p. 357).

Formalization targets

Main theorem

For every ε>0\varepsilon>0ε>0, there is one threshold NNN such that, for every n≥Nn\ge Nn≥N and every randomized online algorithm AAA on nnn rows and columns, a graph GGG with a perfect matching satisfies

EA[∣M(G)∣]≤(1−e−1+ε)n.\mathbb E_A[|M(G)|]\le (1-e^{-1}+\varepsilon)n.EA​[∣M(G)∣]≤(1−e−1+ε)n.

The threshold is uniform over algorithms. The graph may depend on AAA. This is the quantified upper-bound reading of Theorem 2's p(A)≤n(1−1/e)+o(n)p(A)\le n(1-1/e)+o(n)p(A)≤n(1−1/e)+o(n) (Karp, Vazirani, and Vazirani, 1990, Theorem 2).

Milestone statements

Lemma 13 identifies the average size produced by any deterministic greedy algorithm on a uniformly permuted TnT_nTn​ with RANDOM's expected size on TnT_nTn​. Lemma 14 bounds the worst-case performance of every randomized algorithm, including non-greedy algorithms, by that value. Lemma 16 identifies the value itself by the two-sided limit

lim⁡n→∞VTn(n,∅)n=1−e−1.\lim_{n\to\infty}\frac{V_{T_n}(n,\varnothing)}{n}=1-e^{-1}.n→∞lim​nVTn​​(n,∅)​=1−e−1.

Together these statements give the finite-instance comparison and the asymptotic value named in the goal (Karp, Vazirani, and Vazirani, 1990, Lemmas 13, 14, 16).

Significance

Theorem 2 limits what any randomized online matching rule can guarantee under the paper's oblivious-adversary performance measure. Since the hard graph always admits a perfect matching, the gap from nnn is caused by the order of information and the required irrevocable decisions. The statement applies to the entire algorithm class, rather than comparing two selected procedures. It therefore provides the ceiling against which the paper's lower guarantee for RANKING is measured.

Formalizing the result requires a reusable description of finite online algorithms, their visible histories, and expected matching size. It also requires a definition of uniform random choice from currently eligible rows with an explicit empty-choice case. The 1990 result is proved in the paper; the statements in this mission are targets for machine-checked proofs, not claims of an existing formal proof. The model can support later statements about other matching rules and hard-input distributions without changing the meaning of an online decision.

Difficulty

For a fixed graph, an algorithm can be designed around the graph's particular perfect matching, so one hard graph cannot simply be announced in advance for all deterministic algorithms. The theorem instead has to bound each randomized algorithm against a graph selected for that algorithm. Even then, checking the triangular graph against one rule does not establish a universal bound: different rules can respond differently to the same revealed neighborhoods. The crucial mathematical obstacle is a comparison across all such rules while preserving the restriction that future columns remain unseen. A further asymptotic step is needed to determine RANDOM's value on the triangular family, including both sides of the o(n)o(n)o(n) claim in Lemma 16.

Formalization scope

Both sides are Fin n. An edge set is a subset of row-column pairs. The published perfect-matching predicate is reused: it asks for a bijection whose every selected pair is an edge. The paper's one-based column order n,…,1n,\ldots,1n,…,1 is represented by zero-based order n−1,…,0n-1,\ldots,0n−1,…,0; arrival number zero is the largest column. A deterministic rule receives only the neighborhoods of columns that have arrived, including the current column. A randomized rule is a probability mass function on the finite set of deterministic rules, allowing arbitrary correlations among its choices. The expected size is a finite sum over that mass function.

RANDOM is represented by the conditional-expectation recursion for uniform choice among eligible rows. If none is eligible, the column remains unmatched and there is no division by zero. For n=0n=0n=0, the matching and RANDOM value are zero; the main theorem is eventual in nnn and Lemma 16's value at zero does not affect the limit. Lemma 16 uses a two-sided limit. The paper's o(n)o(n)o(n) in Theorem 2 is stated as ∀ε>0,∃N,∀n≥N\forall\varepsilon>0,\exists N,\forall n\ge N∀ε>0,∃N,∀n≥N with NNN before the algorithm, so the error is uniform across algorithms. A hard graph must contain a perfect matching; dropping this condition would let the empty graph satisfy the inequality trivially.

Useful contributions include finite probabilistic averaging, the greedy comparison, analysis of the recursive RANDOM value, and a proof joining Lemmas 14 and 16 into the uniform goal. The history and matching-run definitions are reusable for other finite online bipartite matching statements. The two numbered claims inside the paper's proof of Lemma 13 and its later remarks are outside the mission's curated milestone list.

Selected references

  • Richard M. Karp, Umesh V. Vazirani, and Vijay V. Vazirani, An Optimal Algorithm for On-line Bipartite Matching, Proceedings of the 22nd Annual ACM Symposium on Theory of Computing, pp. 352–358, 1990. DOI: 10.1145/100216.100262.
9 thms2 active usersReviewed
CombinatoricsOperations ResearchProbability·Captain: mikedeng1

Online Stochastic Matching: Beating 1-1/e 1: When OPT = Ω(n), the Two Suggested Matchings Algorithm Achieves ALG/OPT ≥ (1 − 2/e²)/(4/3 − 2/(3e)) − ε ≈ 0.670 with Probability 1 − e^(−Ω(n))Research Paper

Motivation

Online bipartite matching models a platform that must commit each arriving request to a resource immediately. The motivating application of Feldman, Mehta, Mirrokni and Muthukrishnan is display advertising: an ad server knows from past traffic how many impressions of each type (web page, audience segment) to expect, sells them to advertisers in advance, and must assign each impression to an interested advertiser the moment a user loads the page. The goal is to fill as many contracted impressions as possible.

When arrivals are chosen by an adversary, the best ratio an online algorithm can guarantee is 1−1/e≈0.6321 - 1/e \approx 0.6321−1/e≈0.632, achieved by the RANKING algorithm of Karp, Vazirani and Vazirani (STOC 1990). The ad server, however, is not facing an adversary: it has a forecast. The i.i.d. model captures this: the graph and the distribution of impression types are known in advance, and the impressions are independent draws. The paper asks whether this knowledge allows an online algorithm to beat 1−1/e1 - 1/e1−1/e, and answers yes.

Timeline.

  • 1990: Karp, Vazirani and Vazirani give RANKING, with ratio 1−1/e1 - 1/e1−1/e for adversarial arrivals, and show this is optimal in that model.
  • 2005: Mehta, Saberi, Vazirani and Vazirani obtain 1−1/e1 - 1/e1−1/e for the budgeted AdWords generalization.
  • 2009: Feldman, Mehta, Mirrokni and Muthukrishnan (arXiv:0905.4100, FOCS 2009) show that in the i.i.d. model the two suggested matchings algorithm achieves about 0.6700.6700.670 with high probability when OPT is linear in nnn, the first ratio above 1−1/e1 - 1/e1−1/e for this model, and that no online algorithm reaches 26/2726/2726/27 in expectation.

Setting

An instance is a bipartite graph G=(A,I,E)G = (A, I, E)G=(A,I,E) with a finite set AAA of advertisers, a finite set III of impression types, and edges E⊆A×IE \subseteq A \times IE⊆A×I recording which advertisers want which types. The mission treats the case analysed throughout §4.2 of the paper, in which one impression of each type is expected (ei=1e_i = 1ei​=1). So n=∣I∣n = |I|n=∣I∣ impressions arrive one at a time, with types ω(0),…,ω(n−1)\omega(0), \dots, \omega(n-1)ω(0),…,ω(n−1) drawn independently and uniformly from III. On arrival an impression must be assigned at once and irrevocably to a still unassigned advertiser adjacent to its type, or discarded. ALG(ω)\mathrm{ALG}(\omega)ALG(ω) is the number of impressions an algorithm assigns. OPT(ω)\mathrm{OPT}(\omega)OPT(ω) is the size of a maximum matching of the realization graph, which has one node per arrival ttt, joined to every advertiser aaa with (a,ω(t))∈E(a, \omega(t)) \in E(a,ω(t))∈E.

The two suggested matchings (TSM) algorithm works offline first. Its boosted flow graph GfG_fGf​ has a source arc of capacity 222 into every advertiser, a unit-capacity arc along every edge of EEE, and an arc of capacity 222 from every type to a sink. The algorithm takes the edge set EfE_fEf​ of an integral maximum flow. Every vertex then has at most two edges of EfE_fEf​, so EfE_fEf​ splits into vertex-disjoint paths and cycles. The algorithm colours each component blue and red:

  • on cycles, the colours alternate;
  • on odd paths, the colours alternate, with more blue than red;
  • on even paths between advertisers, the colours alternate;
  • on even paths between types, the first two edges are blue, then the colours alternate, ending in blue.

Online, the first arrival of type iii tries the advertiser along iii's blue edge, the second tries the one along its red edge, and later arrivals are discarded. A tried advertiser that is already taken is not reassigned. The advertisers fall into four classes by their coloured edges: ABRA_{BR}ABR​ (one blue, one red), ABBA_{BB}ABB​ (two blue), ABA_BAB​ (one blue only) and ARA_RAR​ (one red only).

Formalization targets

Goal: Theorem 5, first sentence, ei=1e_i = 1ei​=1

Let

α=1−2/e24/3−2/(3e)≈0.67029.\alpha = \frac{1 - 2/e^2}{4/3 - 2/(3e)} \approx 0.67029 .α=4/3−2/(3e)1−2/e2​≈0.67029.

The goal has three parts. First, every maximum flow edge set admits a colouring that follows the rules. Second, for every ε>0\varepsilon > 0ε>0 and c>0c > 0c>0 there are δ>0\delta > 0δ>0 and NNN such that, for every instance with n≥Nn \ge Nn≥N, every maximum flow edge set and every rule-following colouring,

Pr⁡ω[ OPT≥c n  ⟹  ALG≥(α−ε) OPT ]  ≥  1−e−δn.\Pr_\omega\big[\ \mathrm{OPT} \ge c\,n \implies \mathrm{ALG} \ge (\alpha - \varepsilon)\,\mathrm{OPT}\ \big] \;\ge\; 1 - e^{-\delta n}.ωPr​[ OPT≥cn⟹ALG≥(α−ε)OPT ]≥1−e−δn.

Third, α>1−1/e\alpha > 1 - 1/eα>1−1/e.

Milestones

  1. Facts 1 and 2: concentration for two balls-in-bins statistics.
  2. The note of §4.2.1: each type has no coloured edge, one blue edge, or one blue and one red edge.
  3. Equation (1): ∣Ef∣=2∣ABR∣+2∣ABB∣+∣AB∣+∣AR∣|E_f| = 2|A_{BR}| + 2|A_{BB}| + |A_B| + |A_R|∣Ef​∣=2∣ABR​∣+2∣ABB​∣+∣AB​∣+∣AR​∣.
  4. Equation (2): with high probability, ALG≥(1−1/e2)∣ABB∣+(1−2/e2)∣ABR∣+(1−3/(2e))(∣AB∣+∣AR∣)−4εn\mathrm{ALG} \ge (1 - 1/e^2)|A_{BB}| + (1 - 2/e^2)|A_{BR}| + (1 - 3/(2e))(|A_B| + |A_R|) - 4\varepsilon nALG≥(1−1/e2)∣ABB​∣+(1−2/e2)∣ABR​∣+(1−3/(2e))(∣AB​∣+∣AR​∣)−4εn.
  5. Equation (3): ∣Ef∣=2(∣AT∣+∣IS∣)+∣Eδ∣|E_f| = 2(|A_T| + |I_S|) + |E_\delta|∣Ef​∣=2(∣AT​∣+∣IS​∣)+∣Eδ​∣ for the surgered residual cut (S,T)(S,T)(S,T) of GfG_fGf​.
  6. Equation (4): with high probability, OPT≤∣ABR∣+∣ABB∣+12(∣AB∣+∣AR∣)+(12−1e)∣Eδ∣+εn\mathrm{OPT} \le |A_{BR}| + |A_{BB}| + \tfrac12(|A_B| + |A_R|) + (\tfrac12 - \tfrac1e)|E_\delta| + \varepsilon nOPT≤∣ABR​∣+∣ABB​∣+21​(∣AB​∣+∣AR​∣)+(21​−e1​)∣Eδ​∣+εn.
  7. Lemma 1: ∣Eδ∣≤23∣ABR∣+43∣ABB∣+∣AB∣+13∣AR∣|E_\delta| \le \tfrac23|A_{BR}| + \tfrac43|A_{BB}| + |A_B| + \tfrac13|A_R|∣Eδ​∣≤32​∣ABR​∣+34​∣ABB​∣+∣AB​∣+31​∣AR​∣.

Significance

The theorem separates the i.i.d. model from the adversarial one: knowing the distribution is worth a constant factor above 1−1/e1 - 1/e1−1/e. The suggested matching algorithm of the same paper (Theorem 4) shows that following a single offline matching gets exactly 1−1/e1 - 1/e1−1/e, so the second, red matching is what crosses the barrier. The paper's question started a line of work on the i.i.d. and random-order models, with later improvements to the constant by other authors under further assumptions.

The result has a written proof but, as far as the platform record shows, no machine-checked one. The mission formalizes the paper's own argument: the flow-and-colouring construction, the balls-in-bins concentration facts, the cut-based bound on OPT and the combinatorial Lemma 1. It also fixes two slips in the printed statements (see Formalization scope). The pieces are reusable beyond this paper. The occupancy concentration (Fact 1) and the satisfied-sequences bound (Fact 2) recur in analyses of online algorithms with stochastic input. The degree-capped flow encoding and its path/cycle decomposition are standard tools for 2-matchings.

Difficulty

The upper bound on OPT is the delicate part. A cut of the flow graph bounds the maximum matching of the realization graph only after a second surgery that depends on the random arrivals. Its size must then be compared with the colour classes, which are defined by a different structure (the components of EfE_fEf​). Lemma 1 bridges the two, and it depends on the exact colouring rules: a colouring that only satisfies local degree conditions can put red edges at both ends of an even advertiser path, which breaks the inequality ∣AB∣≥∣AR∣|A_B| \ge |A_R|∣AB​∣≥∣AR​∣ behind (2). On the probabilistic side, the advertisers of ABRA_{BR}ABR​ share impression types with each other, so the success events are dependent, and Fact 2 needs a bounded-differences argument in which one ball affects up to ddd sequences.

Formalization scope

All declarations live in the namespace OnlineStochMatching.TSM. Advertisers and types are finite types A I : Type, and EEE is a Finset (A × I). Probabilities are counting ratios #{ω:Fin n→I∣P ω}/∣I∣n\#\{\omega : \mathrm{Fin}\ n \to I \mid P\,\omega\}/|I|^n#{ω:Fin n→I∣Pω}/∣I∣n, so there are no measurability side conditions. OPT is a maximum over the finite, nonempty set of partial injective assignments. An integral flow of GfG_fGf​ is its set of saturated middle edges, i.e. a subset of EEE with at most two edges per vertex; EfE_fEf​ is such a set of maximum cardinality. A colouring is given by a listing of the components of EfE_fEf​ as vertex sequences. Every theorem quantifies over every maximum EfE_fEf​ and every colouring the rules allow, since the paper fixes neither.

The paper's asymptotic phrases are replaced by explicit quantifiers that come from its own proofs:

  • "with probability 1−e−Ω(n)1 - e^{-\Omega(n)}1−e−Ω(n)" and "with high probability" (Theorem 5, (2), (4)) become: ∃ δ>0, ∃ N\exists\, \delta > 0,\ \exists\, N∃δ>0, ∃N, chosen before the instance, with probability at least 1−e−δn1 - e^{-\delta n}1−e−δn for all n≥Nn \ge Nn≥N;
  • "as long as OPT =Ω(n)= \Omega(n)=Ω(n)" becomes the event OPT≥c n\mathrm{OPT} \ge c\,nOPT≥cn for an arbitrary c>0c > 0c>0 fixed before δ\deltaδ and NNN;
  • the O(1)O(1)O(1) term in the bound on ∣Aδ∗∣|A^*_\delta|∣Aδ∗​∣ (p. 8) is absorbed into εn\varepsilon nεn for n≥Nn \ge Nn≥N.

Corrections to the printed statements:

  • Theorem 5 prints ALG/OPT−ϵ≥α\mathrm{ALG}/\mathrm{OPT} - \epsilon \ge \alphaALG/OPT−ϵ≥α; the proof concludes ALG/OPT+ϵ≥α\mathrm{ALG}/\mathrm{OPT} + \epsilon \ge \alphaALG/OPT+ϵ≥α, so the goal states ALG≥(α−ε)OPT\mathrm{ALG} \ge (\alpha - \varepsilon)\mathrm{OPT}ALG≥(α−ε)OPT;
  • Fact 1 prints the failure probability 2e−ϵn/22e^{-\epsilon n/2}2e−ϵn/2; its proof gives 2e−ϵ2n/22e^{-\epsilon^2 n/2}2e−ϵ2n/2, which is used;
  • Fact 2 states two hypotheses its proof uses: the bins of a sequence are distinct, and c2<nc^2 < nc2<n.

The ratio is multiplied out, so no division by OPT occurs. A colouring condition that is unsatisfiable, or a flow set that is not maximum, would make the goal vacuous or false; part (a) of the goal rules out the first, and every statement requires maximality. Not included: the reduction to general integer eie_iei​ (§4.2.4), the tightness sentence of Theorem 5 (§4.2.5), and footnote 7's variant of the algorithm.

Useful infrastructure: bounded-differences (McDiarmid/Azuma) inequalities for functions of i.i.d. uniform variables, which exist on the platform as separate theorems; path/cycle decomposition of graphs of maximum degree two; and max-flow min-cut for unit-capacity bipartite networks. Contributions are welcome on Facts 1 and 2 independently of the combinatorics, and on Lemma 1 and equations (1) and (3), which are deterministic.

Selected references

  • J. Feldman, A. Mehta, V. Mirrokni, S. Muthukrishnan, Online Stochastic Matching: Beating 1-1/e, FOCS 2009; arXiv:0905.4100v1. https://arxiv.org/abs/0905.4100
  • R. M. Karp, U. V. Vazirani, V. V. Vazirani, An optimal algorithm for on-line bipartite matching, STOC 1990. https://doi.org/10.1145/100216.100262
  • A. Mehta, A. Saberi, U. Vazirani, V. Vazirani, AdWords and generalized online matching, FOCS 2005; J. ACM 54(5), 2007. https://doi.org/10.1145/1284320.1284321
13 thms2 active usersReviewed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

Approximation Algorithms for Precedence-Constrained Scheduling Problems on Parallel Machines That Run at Different Speeds: A min{K + 2√K + 1, 1.89 log m + O(√log m)}-Approximation for Q|prec|CmaxResearch Paper

Scheduling precedence-constrained jobs on machines of different speeds

Graham (1966) showed that list scheduling finds a schedule within a factor 222 of optimal for precedence-constrained jobs on identical parallel machines, the first performance guarantee for an approximation algorithm. When the machines run at different speeds (uniformly related machines), the same analysis breaks down, and for two decades the problem Q∣prec∣Cmax⁡Q|prec|C_{\max}Q∣prec∣Cmax​ resisted a guarantee independent of the speeds better than O(m)O(\sqrt m)O(m​).

Timeline:

  • 1974, Liu and Liu: list scheduling on machines of different speeds, with a guarantee that depends on the speeds and can be arbitrarily large even for a fixed number of machines.
  • 1980, Jaffe: list scheduling on the machines whose speed is within a factor m\sqrt mm​ of the fastest gives an O(m)O(\sqrt m)O(m​)-approximation.
  • 1978, Lenstra and Rinnooy Kan: with precedence constraints, no ρ\rhoρ-approximation with ρ<4/3\rho < 4/3ρ<4/3 exists unless P = NP. This bound already holds for identical machines.
  • 1997–1999, Chudak and Shmoys: an LP-guided variant of list scheduling achieves O(log⁡m)O(\log m)O(logm), and K+2K+1K + 2\sqrt K + 1K+2K​+1 when there are only KKK distinct speeds (J. Algorithms 30 (1999) 323–343; conference version SODA 1997).

The mission formalizes the makespan half of that paper, up to its Theorem 3.7.

Setting

An instance has nnn jobs and m≥1m \ge 1m≥1 machines. Job jjj requires pj>0p_j > 0pj​>0 units of processing, and machine iii runs at speed si>0s_i > 0si​>0, so job jjj takes pj/sip_j/s_ipj​/si​ time units on machine iii. A strict partial order ≺\prec≺ on the jobs gives precedence constraints: j≺kj \prec kj≺k means that job kkk may not start until job jjj has completed.

A schedule runs each job jjj without interruption on one machine μ(j)\mu(j)μ(j), from a start time Sj≥0S_j \ge 0Sj​≥0 to its completion time Cj=Sj+pj/sμ(j)C_j = S_j + p_j/s_{\mu(j)}Cj​=Sj​+pj​/sμ(j)​. A machine processes at most one job at a time, and j≺kj \prec kj≺k forces Cj≤SkC_j \le S_kCj​≤Sk​. Its length is Cmax⁡=max⁡jCjC_{\max} = \max_j C_jCmax​=maxj​Cj​. Cmax⁡∗C^*_{\max}Cmax∗​ is the length of an optimal schedule.

Let sˉ1>sˉ2>⋯>sˉK\bar s_1 > \bar s_2 > \cdots > \bar s_Ksˉ1​>sˉ2​>⋯>sˉK​ be the distinct speeds and mkm_kmk​ the number of machines of speed sˉk\bar s_ksˉk​. An assignment k(j)k(j)k(j) names the speed class at which job jjj is to run. Its loads are Dk=1mk∑j:k(j)=kpj/sˉkD_k = \frac{1}{m_k}\sum_{j:k(j)=k} p_j/\bar s_kDk​=mk​1​∑j:k(j)=k​pj​/sˉk​, and its chain bound CCC is the largest value of ∑j∈Cpj/sˉk(j)\sum_{j\in\mathcal C} p_j/\bar s_{k(j)}∑j∈C​pj​/sˉk(j)​ over chains C\mathcal CC of ≺\prec≺. Speed-based list scheduling is Graham's rule restricted by the assignment: whenever a machine of speed sˉk\bar s_ksˉk​ is idle, it starts the first available job jjj on the list with k(j)=kk(j) = kk(j)=k.

The linear program LP has variables xkj≥0x_{kj} \ge 0xkj​≥0, CjC_jCj​ and DDD. It minimizes DDD subject to the following constraints:

  • ∑kxkj=1\sum_k x_{kj} = 1∑k​xkj​=1;
  • 1mksˉk∑jpjxkj≤D\frac{1}{m_k\bar s_k}\sum_j p_j x_{kj} \le Dmk​sˉk​1​∑j​pj​xkj​≤D;
  • ∑k(pj/sˉk)xkj≤Cj\sum_k (p_j/\bar s_k)x_{kj} \le C_j∑k​(pj​/sˉk​)xkj​≤Cj​, and ∑k(pj/sˉk)xkj≤Cj−Cj′\sum_k (p_j/\bar s_k)x_{kj} \le C_j - C_{j'}∑k​(pj​/sˉk​)xkj​≤Cj​−Cj′​ whenever j′≺jj' \prec jj′≺j;
  • Cj≤DC_j \le DCj​≤D.

From a solution, with pˉj=∑k(pj/sˉk)xkj\bar p_j = \sum_k (p_j/\bar s_k)x_{kj}pˉ​j​=∑k​(pj​/sˉk​)xkj​, the assignment algorithm gives each job jjj the speed class k∉Bj={k:pj/sˉk>γpˉj}k \notin B_j = \{k : p_j/\bar s_k > \gamma\bar p_j\}k∈/Bj​={k:pj​/sˉk​>γpˉ​j​} of largest capacity sˉkmk\bar s_k m_ksˉk​mk​.

Formalization targets

Goal: Theorem 3.7 (p. 10)

There is an absolute constant ccc such that for every instance with m≥2m \ge 2m≥2 machines and KKK distinct speeds, the better of the two schedules below has length at most

min⁡{K+2K+1, 1.89log⁡2m+clog⁡2m}⋅Cmax⁡∗.\min\bigl\{K + 2\sqrt K + 1,\ 1.89\log_2 m + c\sqrt{\log_2 m}\bigr\}\cdot C^*_{\max}.min{K+2K​+1, 1.89log2​m+clog2​m​}⋅Cmax∗​.
  • (A) An optimal LP solution, the assignment algorithm with γ=K+1\gamma = \sqrt K + 1γ=K​+1, and speed-based list scheduling.
  • (B) The same algorithm run on speeds rounded down to powers of eee, with machines slower than sˉ1/(mlog⁡2m)\bar s_1/(m\log_2 m)sˉ1​/(mlog2​m) dropped, and read back on the original machines.

Milestones, in proof order

  • Existence of speed-based list schedules (p. 4).
  • Theorem 2.1: Cmax⁡≤C+∑kDkC_{\max} \le C + \sum_k D_kCmax​≤C+∑k​Dk​.
  • The LP lower bound Dˉ≤Cmax⁡∗\bar D \le C^*_{\max}Dˉ≤Cmax∗​ (p. 6).
  • Lemmas 3.1–3.4: chain bounds 2Dˉ2\bar D2Dˉ and (K+1)Dˉ(\sqrt K + 1)\bar D(K​+1)Dˉ, and load bounds 2KDˉ2K\bar D2KDˉ and (K+K)Dˉ(K + \sqrt K)\bar D(K+K​)Dˉ.
  • Theorem 3.5 and Corollary 3.6: the factor K+2K+1K + 2\sqrt K + 1K+2K​+1 against Cmax⁡∗C^*_{\max}Cmax∗​ and against Dˉ\bar DDˉ.
  • Rounded schedules serve the original instance (p. 9).
  • The speed rounding: at most ⌊log⁡β(αm)⌋+1\lfloor\log_\beta(\alpha m)\rfloor + 1⌊logβ​(αm)⌋+1 speeds, and the LP value grows by a factor of at most β(1+1/α)\beta(1 + 1/\alpha)β(1+1/α) (p. 10).
  • The "In fact" form of the guarantee, relative to any feasible LP solution (p. 10).

Significance

The result gives the first O(log⁡m)O(\log m)O(logm) guarantee for Q∣prec∣Cmax⁡Q|prec|C_{\max}Q∣prec∣Cmax​, independent of the speeds, and a guarantee depending only on the number of distinct speeds. Through the batching technique of Shmoys, Wein and Williamson it extends to release dates (Corollary 3.8). Since LP also relaxes the preemptive problem, it gives an O(log⁡m)O(\log m)O(logm) bound on the ratio between the nonpreemptive and preemptive optima (Corollaries 3.9, 3.10). The "In fact" form, relative to an arbitrary feasible LP solution, drives the paper's ∑wjCj\sum w_jC_j∑wj​Cj​ algorithm in §4.

The result is proved in the literature but, as far as is known, not formalized. A formal proof requires machine-checking the following:

  • the continuous-time list-scheduling argument for different speeds;
  • the filtering argument of Lin and Vitter;
  • the reduction to logarithmically many speeds, including the off-by-one count of rounded speeds that the page leaves implicit.

Later work gave a combinatorial O(log⁡m)O(\log m)O(logm)-approximation (Chekuri and Bender, 2001) and an O(log⁡m/log⁡log⁡m)O(\log m/\log\log m)O(logm/loglogm)-approximation (Li, 2017). These are not part of this mission.

Difficulty

Graham's argument has two lower bounds:

  1. the total processing along a chain;
  2. the time during which every machine is busy.

With different speeds, the first bound fails: a chain may have been run on slow machines, and its length then says nothing about Cmax⁡∗C^*_{\max}Cmax∗​. Forcing every job onto a fast machine repairs chains but can leave most machines idle, so the second bound fails. The paper only guarantees that all machines of one speed are busy at each moment of an idle period. Making this pay off requires an assignment that controls chain lengths and per-class loads simultaneously. That assignment is the delicate part: Theorem 2.1 is the bookkeeping, while Lemmas 3.2 and 3.4 rely on the LP. Two of the formal steps are routine on paper but fiddly in Lean: time-interval accounting over a continuous-time schedule, and the counting of rounded speed classes.

Formalization scope

  • Representation. Jobs are Fin n and machines Fin m with m≥1m \ge 1m≥1. pj>0p_j > 0pj​>0 and si>0s_i > 0si​>0. ≺\prec≺ is a strict partial order, and a chain is a finite set of pairwise comparable jobs. Cmax⁡C_{\max}Cmax​ is the maximum completion time, or 000 with no jobs.
  • Speed classes. The classes are computed from the speeds, so mk≥1m_k \ge 1mk​≥1 and sˉk>0\bar s_k > 0sˉk​>0 by construction. The Lean index 000 is the paper's fastest class sˉ1\bar s_1sˉ1​.
  • The algorithm as predicates. Speed-based list scheduling is the predicate the proof of Theorem 2.1 uses: jobs run at their assigned speed, and no machine of a job's speed idles while that job is available and unstarted. Every list order and every order of idle machines satisfies it. The assignment algorithm is a predicate allowing every maximizer, since the page does not break ties. Theorems 3.5 and 3.7 quantify over all optimal LP solutions, all such assignments and all such schedules. Existence is supplied by the milestones.
  • Comparator. The bound is stated against every feasible schedule of the same instance, never against the LP value or a best schedule of the rounded instance. A statement asserting only that some good schedule exists would be trivially true (the optimum witnesses it); the goal bounds the schedule the algorithm returns.
  • Constants and logarithms. log⁡m\log mlogm is log⁡2m\log_2 mlog2​m, as the paper specifies. m≥2m \ge 2m≥2 is assumed in Theorem 3.7 and in the "In fact" remark, which are asymptotic in mmm. The O(log⁡m)O(\sqrt{\log m})O(logm​) term is one absolute constant ccc, quantified before the instance, and 1.891.891.89 is the page's number.
  • Generalizations and corrections. Lemmas 3.1–3.4 are stated for every feasible LP solution, since their proofs use only feasibility. The speed rounding is relative to sˉ1\bar s_1sˉ1​, with no normalization. The count of rounded speeds is ⌊log⁡β(αm)⌋+1\lfloor\log_\beta(\alpha m)\rfloor + 1⌊logβ​(αm)⌋+1; the page writes log⁡β(αm)\log_\beta(\alpha m)logβ​(αm).
  • Not formalized. Polynomial running time is not formalized.
  • Out of scope. Corollaries 3.8–3.10, Theorem 3.11 and §4 are excluded.

Proofs of any milestone are welcome. Reusable beyond this mission are the following: the model of nonpreemptive schedules on uniformly related machines with precedence, the speed-based list-scheduling predicate with Theorem 2.1, and the LP.

Selected references

  • F. A. Chudak and D. B. Shmoys, Approximation algorithms for precedence-constrained scheduling problems on parallel machines that run at different speeds, J. Algorithms 30 (1999) 323–343 (authors' manuscript used here). https://doi.org/10.1006/jagm.1998.0987
  • R. L. Graham, Bounds for certain multiprocessing anomalies, Bell System Technical Journal 45 (1966) 1563–1581. https://doi.org/10.1002/j.1538-7305.1966.tb01709.x
  • J. M. Jaffe, Efficient scheduling of tasks without full use of processor resources, Theoretical Computer Science 12 (1980) 1–17. https://doi.org/10.1016/0304-3975(80)90002-4
  • J.-H. Lin and J. S. Vitter, ε-approximations with minimum packing constraint violation, STOC 1992, 771–782. https://doi.org/10.1145/129712.129787
  • D. B. Shmoys, J. Wein and D. P. Williamson, Scheduling parallel machines on-line, SIAM J. Computing 24 (1995) 1313–1331. https://doi.org/10.1137/S0097539793248317
  • C. Chekuri and M. A. Bender, An efficient approximation algorithm for minimizing makespan on uniformly related machines, J. Algorithms 41 (2001) 212–224. https://doi.org/10.1006/jagm.2001.1184
  • S. Li, Scheduling to minimize total weighted completion time via time-indexed linear programming relaxations, SIAM J. Computing 46 (2017) 409–440. https://doi.org/10.1137/15M1053163
16 thms2 active usersReviewed
CombinatoricsMachine Learning·Captain: mikedeng1

A Characterization of Multiclass Learnability 1: Classes of Finite DS Dimension Have n → r Sample Compression Schemes with r Polylogarithmic in nResearch Paper

Motivation

In multiclass classification a learner sees examples (x,y)(x, y)(x,y) with xxx in a domain X\mathcal XX and a label yyy in a set Y\mathcal YY, and must predict labels of new points. When Y\mathcal YY is finite, the Natarajan dimension characterizes PAC learnability, extending the role of the VC dimension in binary classification (Natarajan 1989; Ben-David, Cesa-Bianchi, Haussler, Long 1995). Label sets in practice are often unbounded: structured prediction, ranking, and language modelling all predict from very large or infinite label spaces. For infinite Y\mathcal YY the Natarajan dimension fails to characterize learnability, and the question of which combinatorial parameter does was left open by Daniely and Shalev-Shwartz.

Timeline:

  • 1989–1995. Natarajan, then Ben-David et al. and Haussler–Long: for finite Y\mathcal YY, learnability is equivalent to finite Natarajan dimension, with sample complexity depending on log⁡∣Y∣\log|\mathcal Y|log∣Y∣.
  • 2011–2015. Daniely, Sabato, Ben-David and Shalev-Shwartz show that ERM can fail for multiclass problems with many labels. Daniely and Shalev-Shwartz (COLT 2014) introduce the DS dimension, prove that finite DS dimension is necessary for learnability, and ask whether it is sufficient.
  • 2022. Brukhim, Carmon, Dinur, Moran, Yehudayoff prove sufficiency, so the DS dimension characterizes multiclass PAC learnability, and show that the Natarajan dimension does not.

Setting

A concept class is a set H⊆YX\mathcal H\subseteq\mathcal Y^{\mathcal X}H⊆YX of functions. For a sequence S=(x1,…,xn)S=(x_1,\dots,x_n)S=(x1​,…,xn​) the projection H∣S⊆Yn\mathcal H|_S\subseteq\mathcal Y^nH∣S​⊆Yn is the set of label words (h(x1),…,h(xn))(h(x_1),\dots,h(x_n))(h(x1​),…,h(xn​)), h∈Hh\in\mathcal Hh∈H. A finite non-empty set B⊆YdB\subseteq\mathcal Y^dB⊆Yd is a pseudo-cube if every h∈Bh\in Bh∈B has, in every coordinate iii, a neighbour g∈Bg\in Bg∈B that differs from hhh exactly in coordinate iii. The sequence SSS is DS-shattered if H∣S\mathcal H|_SH∣S​ contains an nnn-dimensional pseudo-cube, and the DS dimension dDS(H)d_{DS}(\mathcal H)dDS​(H) is the maximum length of a DS-shattered sequence. The Natarajan dimension dN(H)≤dDS(H)d_N(\mathcal H)\le d_{DS}(\mathcal H)dN​(H)≤dDS​(H) is the same with Boolean cubes ∏i{f(i),g(i)}\prod_i\{f(i),g(i)\}∏i​{f(i),g(i)}, f(i)≠g(i)f(i)\ne g(i)f(i)=g(i), in place of pseudo-cubes.

A sample S∈(X×Y)nS\in(\mathcal X\times\mathcal Y)^nS∈(X×Y)n is H\mathcal HH-realizable if some h∈Hh\in\mathcal Hh∈H is consistent with it. An n→rn\to rn→r sample compression scheme for H\mathcal HH (Littlestone and Warmuth 1986) is a single reconstruction function ρ:(X×Y)r→YX\rho:(\mathcal X\times\mathcal Y)^r\to\mathcal Y^{\mathcal X}ρ:(X×Y)r→YX such that every realizable sample of size nnn contains rrr of its examples S′S'S′ with ρ(S′)\rho(S')ρ(S′) consistent with the whole sample. Logarithms are base 222 throughout.

Formalization targets

Goal: Theorem 36 (p. 22)

For H\mathcal HH with dDS(H)=dDS<∞d_{DS}(\mathcal H)=d_{DS}<\inftydDS​(H)=dDS​<∞ and dN(H)=dNd_N(\mathcal H)=d_NdN​(H)=dN​, and all integers n,t>0n,t>0n,t>0, there is an n→rn\to rn→r sample compression scheme, r≤nr\le nr≤n, with

r≤(dDS+t+1t+1(dDS+t)+103dNlog⁡((dDS+t+1t+1)log⁡(2n)))log⁡(2n).r\le\left(\frac{d_{DS}+t+1}{t+1}(d_{DS}+t)+10^3d_N\log\left(\binom{d_{DS}+t+1}{t+1}\log(2n)\right)\right)\log(2n).r≤(t+1dDS​+t+1​(dDS​+t)+103dN​log((t+1dDS​+t+1​)log(2n)))log(2n).

Milestones

The scheme combines two components, each with its own chain of results:

  • List learning from the DS dimension. Lemma 13 (orientations of out-degree ≤d\le d≤d on Yd+1\mathcal Y^{d+1}Yd+1), Claim 16 (the one-inclusion algorithm is right on some leave-one-out example), Fact 14 (leave-one-out symmetrization), Proposition 32 (a list PAC learner with list size (d+tt)\binom{d+t}{t}(td+t​) and success probability t+1d+t+1\frac{t+1}{d+t+1}d+t+1t+1​), Lemma 39 (an n→r1n\to r_1n→r1​ list compression scheme with r1≤dDS+t+1t+1(dDS+t)log⁡(2n)r_1\le\frac{d_{DS}+t+1}{t+1}(d_{DS}+t)\log(2n)r1​≤t+1dDS​+t+1​(dDS​+t)log(2n) and menu size ≤(dDS+t+1t+1)log⁡(2n)\le\binom{d_{DS}+t+1}{t+1}\log(2n)≤(t+1dDS​+t+1​)log(2n)).
  • Learning from a menu via shifting. Claim 22, Corollary 23, Claim 26, Proposition 27 (avd⁡≤4dE\operatorname{avd}\le4d_Eavd≤4dE​), Corollary 28, Lemma 29 (dE≤5dNlog⁡pd_E\le5d_N\log pdE​≤5dN​logp), Lemma 17 (orientations of out-degree ≤20dNlog⁡p\le20d_N\log p≤20dN​logp on [p]n[p]^n[p]n), Proposition 34 (error ≤20dNlog⁡(p)/n\le20d_N\log(p)/n≤20dN​log(p)/n given a ppp-menu), Lemma 40 (an n→r2n\to r_2n→r2​ compression scheme given a ppp-menu with r2≤103dNlog⁡(p)log⁡(2n)r_2\le10^3d_N\log(p)\log(2n)r2​≤103dN​log(p)log(2n)).

Significance

Theorem 36 is the algorithmic heart of the characterization: by the standard "compression implies generalization" argument it gives PAC learnability of every class of finite DS dimension, with sample complexity O~(dDS3/2/ϵ)\tilde O(d_{DS}^{3/2}/\epsilon)O~(dDS3/2​/ϵ) in the realizable case (t=⌈dDS1/2⌉t=\lceil d_{DS}^{1/2}\rceilt=⌈dDS1/2​⌉), and with the agnostic case following by known reductions. It also exhibits sample compression schemes of size polylogarithmic in nnn for multiclass classes with infinitely many labels, in contrast to the constant-size schemes known for finite VC classes.

The result is proved in the paper; none of it is formalized. The formalization would produce a machine-checked theory of one-inclusion graphs and their orientations, multiclass shifting, the exponential dimension, list learning, and sample compression schemes for arbitrary label sets. These objects recur throughout learning theory (one-inclusion graphs in optimal PAC learning, shifting in VC theory), so the infrastructure is reusable beyond this mission.

Difficulty

The natural first idea, running empirical risk minimization or bounding the Natarajan dimension, fails: classes with Natarajan dimension 111 and infinitely many labels can be unlearnable, and ERM can fail even for learnable classes. The DS dimension gives only a weak guarantee: by Claim 16, among d+1d+1d+1 leave-one-out runs, one is correct. Turning this into a learner requires a list learner whose menus are still of unbounded total size, and then learning with a menu of size ppp, where the obstacle is controlling one-inclusion graph orientations over [p]n[p]^n[p]n by the Natarajan dimension. Multiclass shifting does not preserve the average degree (Example 20), so the binary argument breaks down, and a new potential (avd⁡′\operatorname{avd}'avd′) and a new dimension (dEd_EdE​) are needed. Lemma 13 for infinite classes needs a compactness argument.

Formalization scope

Lean conventions:

  • A class is H : Set (X → Y) with arbitrary types X, Y; sequences and samples are functions on Fin n ([n][n][n] is 0-based).
  • The DS, Natarajan and exponential dimensions are suprema in ℕ∞, so unbounded families give ⊤; hypotheses are written dsDim H = dDS with dDS : ℕ. A pseudo-cube is required to be finite.
  • Logarithms are Real.logb 2. Menu sizes use Set.encard.
  • A compression scheme is a reconstruction function fixed before the sample (∃ ρ, ∀ S, ∃ S'); a subsample may repeat and reorder examples. Theorem 36 states r≤nr\le nr≤n explicitly.
  • Orientations of the one-inclusion graph of V⊆YmV\subseteq\mathcal Y^mV⊆Ym are maps sending a direction iii and a vertex vvv to the head of the edge of direction iii through vvv; the out-degree of vvv counts directions whose head is not vvv.
  • Classes over [p][p][p] use labels Fin p; the shifting condition 1≤g(i)≤∣ef∣1\le g(i)\le|e_f|1≤g(i)≤∣ef​∣ becomes g(i)<∣ef∣g(i)<|e_f|g(i)<∣ef​∣.
  • The one-inclusion algorithm (Algorithms 1 and 3) is parametrized by a permutation-equivariant choice of minimal orientations, the reading under which the paper's leave-one-out proofs are valid; statements about the algorithm hold for every such choice. Its default output on non-realizable input requires a non-empty label set, assumed in Claim 16 and Propositions 32 and 34. Lemma 40 assumes a non-empty label set because it is false for X≠∅=Y\mathcal X\ne\emptyset=\mathcal YX=∅=Y.
  • Distributions are discrete (PMF), and i.i.d. probabilities are sums over Zm\mathcal Z^mZm. The measure-theoretic generality of the paper is not attempted.

A trivial formalization is ruled out by these choices. Placing the reconstruction function after the sample would let it output the consistent hypothesis. A dimension in ℕ defined by sSup would be 000 for infinite dimension. Pseudo-cubes without finiteness would change the dimension (Example 8).

Contributions welcome: proofs of any milestone, in particular the shifting results of §3 (self-contained combinatorics on finite classes), Fact 14 (pure discrete probability), and Lemma 13; general-purpose lemmas about one-inclusion graphs, orientations and sample compression schemes are reusable by other learning-theory missions.

Selected references

  • N. Brukhim, D. Carmon, I. Dinur, S. Moran, A. Yehudayoff, A Characterization of Multiclass Learnability, FOCS 2022; arXiv:2203.01550v1 (2022). https://arxiv.org/abs/2203.01550
  • A. Daniely, S. Shalev-Shwartz, Optimal Learners for Multiclass Problems, COLT 2014. https://arxiv.org/abs/1405.2690
  • N. Littlestone, M. Warmuth, Relating Data Compression and Learnability, unpublished technical report, University of California, Santa Cruz, 1986 (no stable link).
  • D. Haussler, N. Littlestone, M. Warmuth, Predicting {0,1}-Functions on Randomly Drawn Points, Information and Computation 115(2), 1994. https://doi.org/10.1006/inco.1994.1097
  • D. Haussler, P. M. Long, A Generalization of Sauer's Lemma, Journal of Combinatorial Theory, Series A 71(2), 1995. https://doi.org/10.1016/0097-3165(95)90006-3
  • S. Ben-David, N. Cesa-Bianchi, D. Haussler, P. M. Long, Characterizations of Learnability for Classes of {0,…,n}-Valued Functions, JCSS 50(1), 1995. https://doi.org/10.1006/jcss.1995.1008
  • B. K. Natarajan, On Learning Sets and Functions, Machine Learning 4, 1989. https://doi.org/10.1007/BF00114804
20 thms2 active usersReviewed
CombinatoricsGraph TheoryLinear algebra·Captain: mikedeng1

Explicit Expanders of Every Degree and Size 3: Deleting Far-Apart Tree-Like Vertices of a Near-Ramanujan Graph and Matching Their Neighbours Keeps λ ≤ 2√(d−1) + εResearch Paper

Motivation

Sparse graphs with small nontrivial eigenvalues, expanders, are basic objects in combinatorics and theoretical computer science. They are used in error-correcting codes, derandomization, sorting networks, and the analysis of random walks. The Alon–Boppana bound says that a ddd-regular graph on nnn vertices has a nontrivial eigenvalue of absolute value at least 2d−1−o(1)2\sqrt{d-1}-o(1)2d−1​−o(1) (Alon 1986; Nilli 1991). Graphs that reach 2d−12\sqrt{d-1}2d−1​ are Ramanujan graphs.

The classical explicit Ramanujan graphs of Lubotzky, Phillips and Sarnak (1988) and Margulis exist only for degrees d=p+1d = p+1d=p+1 with ppp prime, and only for very sparse sequences of vertex counts. Constructions with λ≤2d−1+ε\lambda\le 2\sqrt{d-1}+\varepsilonλ≤2d−1​+ε for every degree came from Mohanty, O'Donnell and Paredes (STOC 2020, arXiv:1909.06988), but their graphs also do not have every number of vertices. Alon (arXiv:2003.11673, Combinatorica 41, 2021) asked for near-Ramanujan graphs of every degree and every large size. Theorem 1.3 of that paper answers this up to ε\varepsilonε: for every ddd, every ε>0\varepsilon>0ε>0 and every large nnn with ndndnd even there is an explicit (n,d,λ)(n,d,\lambda)(n,d,λ)-graph with λ≤2d−1+ε\lambda\le 2\sqrt{d-1}+\varepsilonλ≤2d−1​+ε.

Setting

A (n,d,λ)(n,d,\lambda)(n,d,λ)-graph is a ddd-regular simple graph on nnn vertices in which every nontrivial eigenvalue of the adjacency matrix AAA has absolute value at most λ\lambdaλ. The trivial eigenvalue is ddd, with the constant eigenvector 1\mathbf 11. Equivalently, every eigenvalue μ\muμ of AAA with an eigenvector f≠0f\ne0f=0, ∑vf(v)=0\sum_v f(v)=0∑v​f(v)=0, satisfies ∣μ∣≤λ|\mu|\le\lambda∣μ∣≤λ.

Distances dist⁡(v,w)\operatorname{dist}(v,w)dist(v,w) are graph distances, and they are ∞\infty∞ between components. The kkk-neighbourhood of a vertex vvv is B(v,k)={w:dist⁡(v,w)≤k}B(v,k)=\{w:\operatorname{dist}(v,w)\le k\}B(v,k)={w:dist(v,w)≤k}. The kkk-neighbourhood of an edge uvuvuv is B(u,k)∪B(v,k)B(u,k)\cup B(v,k)B(u,k)∪B(v,k), and NiN_iNi​ is the set of vertices at distance exactly iii from {u,v}\{u,v\}{u,v}. A set contains no cycle if the subgraph induced on it is a forest. A ball contains at most one cycle if its induced subgraph has at most as many edges as vertices.

The construction starts from a ddd-regular graph HHH on a vertex set VVV and a set U⊆VU\subseteq VU⊆V. Write N(U)N(U)N(U) for the set of neighbours of UUU, and let mmm be a perfect matching on N(U)N(U)N(U). Then H′H'H′ is the subgraph induced on V∖UV\setminus UV∖U, MMM is the graph of matching edges {x,m(x)}\{x,m(x)\}{x,m(x)}, and G=H′∪MG=H'\cup MG=H′∪M.

Formalization targets

Goal: Theorem 1.3, relative to the input graph

Let d≥3d\ge3d≥3, ε>0\varepsilon>0ε>0, r=⌈2/ε⌉r=\lceil 2/\varepsilon\rceilr=⌈2/ε⌉. Suppose HHH is an (N,d,2d−1+ε/2)(N,d,2\sqrt{d-1}+\varepsilon/2)(N,d,2d−1​+ε/2)-graph in which the (2r+4)(2r+4)(2r+4)-neighbourhood of every vertex contains at most one cycle, and r≤log⁡d−1Nr\le\log_{d-1}Nr≤logd−1​N. Then for every uuu with ududud even and u≤N/(2d2r+3)u\le N/(2d^{2r+3})u≤N/(2d2r+3),

∃ G on N−u vertices:G is an (N−u, d, 2d−1+ε)-graph.\exists\, G \text{ on } N-u \text{ vertices}:\quad G \text{ is an } \bigl(N-u,\ d,\ 2\sqrt{d-1}+\varepsilon\bigr)\text{-graph}.∃G on N−u vertices:G is an (N−u, d, 2d−1​+ε)-graph.

The hypotheses on HHH are what Theorem 3.3 (Mohanty–O'Donnell–Paredes) supplies, and that theorem is not formalized.

Milestones

  • Lemma 3.1 (p. 10). A ddd-regular graph whose (2r+4)(2r+4)(2r+4)-balls contain at most one cycle has a set UUU with ∣U∣≥n/(2d2r+3)|U|\ge n/(2d^{2r+3})∣U∣≥n/(2d2r+3), cycle-free (r+1)(r+1)(r+1)-balls, and pairwise distances ≥2r+3\ge 2r+3≥2r+3.
  • Lemma 3.2 (p. 11). If the rrr-neighbourhood of an edge uvuvuv contains no cycle and Af=μfA f=\mu fAf=μf with μ≥2d−1\mu\ge2\sqrt{d-1}μ≥2d−1​, then
∑w∈Nif2(w) ≥ ∑w∈Ni−1f2(w),1≤i≤r.\sum_{w\in N_i}f^2(w)\ \ge\ \sum_{w\in N_{i-1}}f^2(w),\qquad 1\le i\le r .w∈Ni​∑​f2(w) ≥ w∈Ni−1​∑​f2(w),1≤i≤r.
  • The variational characterization of nontrivial eigenvalues (§2.4, p. 8).
  • In G=H′∪MG=H'\cup MG=H′∪M: GGG is ddd-regular on ∣V∣−∣U∣|V|-|U|∣V∣−∣U∣ vertices and AG=AH′+AMA_G=A_{H'}+A_MAG​=AH′​+AM​. Matching edges have cycle-free (r−1)(r-1)(r−1)-neighbourhoods and pairwise disjoint rrr-neighbourhoods.
  • Inequalities (9), (10), (11) (p. 13), and the spectral step: for every admissible UUU and mmm, GGG is an (N−∣U∣,d,2d−1+ε)(N-|U|,d,2\sqrt{d-1}+\varepsilon)(N−∣U∣,d,2d−1​+ε)-graph.

Significance

Theorem 1.3 shows that the size restrictions of algebraic Ramanujan constructions cost nothing spectrally: up to an arbitrarily small ε\varepsilonε, the Alon–Boppana bound is attained by explicit graphs on every admissible vertex count. The deletion method is local. It turns any near-Ramanujan graph whose short cycles are sparse into graphs of all nearby sizes, so it applies to future constructions as well. Lemma 3.2 is a self-contained delocalization statement in the tradition of Kahale 1995: eigenvectors of eigenvalues at least 2d−12\sqrt{d-1}2d−1​ in absolute value cannot concentrate near tree-like edges.

The result is proved on paper. To our knowledge none of it is formalized; Mathlib has adjacency matrices, extended graph distance and acyclicity, but no theory of expanders. A complete development would give machine-checked versions of a delocalization lemma, of the greedy selection of far-apart vertices away from short cycles, and of the variational eigenvalue bound for induced subgraphs. It would also check two points the paper passes over. The proof of Theorem 1.3 treats only positive eigenvalues λ≥2d−1\lambda\ge2\sqrt{d-1}λ≥2d−1​. And its claim that the rrr-neighbourhood of a matching edge is cycle-free fails when two deleted vertices are at distance exactly 2r+32r+32r+3. This mission states the corrected forms (see Formalization scope).

Difficulty

The spectral bound for GGG does not follow from interlacing alone. Deleting vertices is harmless, since by (9) the quadratic form of H′H'H′ is controlled by HHH. But the added matching contributes up to ∑x∈N(U)f(x)2\sum_{x\in N(U)}f(x)^2∑x∈N(U)​f(x)2 to ftAGff^tA_GfftAG​f, which can be as large as ∥f∥2\|f\|^2∥f∥2 for an eigenvector concentrated on N(U)N(U)N(U). The obvious estimate therefore gives only λ≤2d−1+1+ε/2\lambda\le 2\sqrt{d-1}+1+\varepsilon/2λ≤2d−1​+1+ε/2. Closing the gap requires showing that an eigenvector of a large eigenvalue spreads its mass over the rrr layers around each matching edge (Lemma 3.2). That in turn needs those neighbourhoods to be trees in GGG and pairwise disjoint, which is where Lemma 3.1's choice of UUU is used. The combinatorial part, tracking distances and cycles in GGG when GGG mixes edges of HHH with matching edges, is the main formalization burden.

Formalization scope

  • Representation. Vertex sets are finite types. Graphs are Mathlib SimpleGraphs with real adjacency matrices adjMatrix ℝ. The (n, d, λ) predicate requires IsRegularOfDegree d, symmetry, row sums ddd, and ∣μ∣≤λ|\mu|\le\lambda∣μ∣≤λ for every eigenpair (μ,f)(\mu,f)(μ,f) with f≠0f\ne0f=0, ∑f=0\sum f=0∑f=0. Distances use the extended SimpleGraph.edist, never dist (which is 000 across components). Cycle conditions are on induced subgraphs, and "at most one cycle" on a ball is ∣E∣≤∣V∣|E|\le|V|∣E∣≤∣V∣. Deleted vertices are a Finset U; the new graph lives on the subtype {v // v ∉ U}. The matching is a fixed-point-free involution of N(U)N(U)N(U).
  • Explicit quantities replacing the paper's asymptotics. The paper writes "sufficiently large nnn" and u=o(n)u=o(n)u=o(n). The goal instead takes any u≤N/(2d2r+3)u\le N/(2d^{2r+3})u≤N/(2d2r+3) (the size Lemma 3.1 guarantees) with ududud even, plus Lemma 3.1's side condition r≤log⁡d−1Nr\le\log_{d-1}Nr≤logd−1​N. The equality r=⌈2/ε⌉r=\lceil2/\varepsilon\rceilr=⌈2/ε⌉ is used as ⌈2/ε⌉+∈N\lceil2/\varepsilon\rceil_+\in\mathbb N⌈2/ε⌉+​∈N. The paper's "every degree ddd" becomes d≥3d\ge3d≥3, the range of its proof.
  • Corrections. (11) and Lemma 3.2's companion are stated for ∣μ∣≥2d−1|\mu|\ge2\sqrt{d-1}∣μ∣≥2d−1​, both signs. The matching-edge note is stated for the (r−1)(r-1)(r−1)-neighbourhood, which still yields the factor 1/r1/r1/r in (11). Lemma 3.2 itself is stated as printed.
  • Out of scope. Theorem 3.3 ([18]) is a cited input: its graph is the hypothesis HHH. All claims of explicitness and polynomial running time are out of scope, as is §4's remark on applying the method to LPS graphs directly.
  • No trivialization. The input hypotheses are exactly Theorem 3.3's conclusions plus Lemma 3.1's side condition, and they are met by high-girth Ramanujan graphs. No hypothesis mentions the spectrum or Rayleigh quotients of the constructed graph, and the goal's graph must be ddd-regular on exactly N−uN-uN−u vertices.
  • Reusable infrastructure. Welcome contributions include the variational characterization for symmetric matrices with constant row sums, a forest edge-count lemma for balls, BFS-layer structure of cycle-free balls in regular graphs, and the edge-disjoint decomposition AG=AH′+AMA_{G}=A_{H'}+A_MAG​=AH′​+AM​. Each is useful beyond this mission.

Selected references

  • N. Alon, Explicit expanders of every degree and size, arXiv:2003.11673v1, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/2003.11673
  • S. Mohanty, R. O'Donnell, P. Paredes, Explicit near-Ramanujan graphs of every degree, STOC 2020. https://arxiv.org/abs/1909.06988
  • A. Lubotzky, R. Phillips, P. Sarnak, Ramanujan graphs, Combinatorica 8 (1988). https://doi.org/10.1007/BF02126799
  • N. Alon, Eigenvalues and expanders, Combinatorica 6 (1986). https://doi.org/10.1007/BF02579166
  • A. Nilli, On the second eigenvalue of a graph, Discrete Mathematics 91 (1991). https://doi.org/10.1016/0012-365X(91)90112-F
  • N. Kahale, Eigenvalues and expansion of regular graphs, J. ACM 42 (1995). https://doi.org/10.1145/210118.210136
13 thms2 active usersReviewed
Operations ResearchProbabilityStochastic Systems·Captain: mikedeng1

Approximation Algorithms for Stochastic Inventory Control Models 2: The Triple-Balancing Policy Costs at Most Three Times the Optimum for Stochastic Lot-SizingResearch Paper

Motivation

Periodic-review inventory control with a fixed ordering cost is one of the oldest problems in operations research. A firm reviews its stock at the beginning of each of TTT periods, decides whether to place an order, pays a fixed cost KKK for every order it places, and pays holding costs on leftover stock and penalties on unmet (backlogged) demand. When demand is random and correlated across periods, and the firm's forecast evolves as information arrives, the optimal policy solves a dynamic program over the whole information state. That program is intractable in general, and in practice firms use heuristics with no performance guarantee.

Levi, Pál, Roundy and Shmoys (Math. Oper. Res. 32(2), 2007) gave policies with worst-case guarantees for these models, using a "marginal cost accounting" scheme that charges each unit's holding cost to the period in which it was ordered. For the model with fixed ordering costs, the stochastic lot-sizing problem, they assume that the demand of each period is known at the beginning of that period (make-to-order systems, or settings where the short-term forecast is accurate), while demand further ahead stays random and arbitrarily correlated. Under this assumption they define the triple-balancing policy and prove it costs at most three times the optimum in expectation.

Timeline:

  • Scarf (1960) proved that (s,S)(s,S)(s,S) policies are optimal for independent demands with fixed costs; with correlated demand the optimal policy is a state-dependent (st(ft),St(ft))(s_t(f_t), S_t(f_t))(st​(ft​),St​(ft​)) rule that is hard to compute.
  • Levi, Pál, Roundy and Shmoys (2007) gave the dual-balancing 2-approximation for the model without fixed costs (§4) and the triple-balancing 3-approximation for the stochastic lot-sizing problem (§6, Theorem 6.1), both for arbitrarily correlated demand.

Setting

There are periods t=1,…,Tt=1,\dots,Tt=1,…,T on a probability space (Ω,F,μ)(\Omega,\mathcal F,\mu)(Ω,F,μ) with a filtration (Ft)(\mathcal F_t)(Ft​): Ft\mathcal F_tFt​ is the information available at the beginning of period ttt. The data are a fixed ordering cost K≥0K\ge0K≥0, per-unit holding costs ht≥0h_t\ge0ht​≥0, per-unit backlogging penalties pt≥0p_t\ge0pt​≥0, an initial inventory level x1∈Rx_1\in\mathbb Rx1​∈R, and nonnegative demands DtD_tDt​. The per-unit ordering cost is zero, the lead time is zero and there is no discounting. The defining assumption is that DtD_tDt​ is Ft\mathcal F_tFt​-measurable: the demand of a period is known when the period begins. For every period sss there is a conditional joint distribution IsI_sIs​ of the demands given Fs\mathcal F_sFs​, under which every conditional mean E[Dt∣fs]E[D_t\mid f_s]E[Dt​∣fs​] is finite.

A feasible policy is an order process Q=(Qt)Q=(Q_t)Q=(Qt​) with Qt≥0Q_t\ge0Qt​≥0 and QtQ_tQt​ determined by Ft\mathcal F_tFt​. Its inventory levels are xt=x1+∑j<t(Qj−Dj)x_t=x_1+\sum_{j<t}(Q_j-D_j)xt​=x1​+∑j<t​(Qj​−Dj​) before ordering and yt=xt+Qty_t=x_t+Q_tyt​=xt​+Qt​ after ordering, and its cost is

C(Q)=∑t=1T(K 1(Qt>0)+ht(yt−Dt)++pt(Dt−yt)+).\mathcal C(Q)=\sum_{t=1}^T\Bigl(K\,\mathbb 1(Q_t>0)+h_t(y_t-D_t)^++p_t(D_t-y_t)^+\Bigr).C(Q)=t=1∑T​(K1(Qt​>0)+ht​(yt​−Dt​)++pt​(Dt​−yt​)+).

The triple-balancing policy TB uses two rules. Let s∗s^*s∗ be the last period before sss in which TB ordered (s∗=0s^*=0s∗=0 if none). Rule 1: TB orders in period sss if and only if, without an order in sss, the accumulated backlogging cost over (s∗,s](s^*,s](s∗,s] would exceed KKK. Rule 2: when it orders in s<Ts<Ts<T, it orders

qsB=max⁡{q≥0: E[HsB(q)∣fs]≤K},HsB(q)=∑j=sThj(q−(D[s,j]−xs)+)+,q_s^B=\max\{q\ge0:\ E[H_s^B(q)\mid f_s]\le K\},\qquad H_s^B(q)=\sum_{j=s}^T h_j\bigl(q-(D_{[s,j]}-x_s)^+\bigr)^+,qsB​=max{q≥0: E[HsB​(q)∣fs​]≤K},HsB​(q)=j=s∑T​hj​(q−(D[s,j]​−xs​)+)+,

the largest quantity whose expected marginal holding cost over [s,T][s,T][s,T] is at most KKK. When it orders in period TTT, it orders exactly enough to clear the backorders and meet DTD_TDT​. Let NNN be the number of orders TB places.

Formalization targets

Goal: Theorem 6.1

For every instance, the triple-balancing policy TB and every feasible policy PPP satisfy

E[C(TB)]≤3 E[C(P)].E[\mathcal C(TB)]\le 3\,E[\mathcal C(P)].E[C(TB)]≤3E[C(P)].

The constant 3 is the paper's. The statement leaves the demand law, the information structure and the cost data unrestricted beyond the standing assumptions above.

Milestones

  1. §6.1, Rule 2 observation. In a period where TB orders, Ds≤ysTBD_s\le y_s^{TB}Ds​≤ysTB​: no backorders remain at the end of the period.
  2. Lemma 6.1. K⋅E[N]≤E[C(P)]K\cdot E[N]\le E[\mathcal C(P)]K⋅E[N]≤E[C(P)] for every feasible PPP.
  3. Lemma 6.2. E[C(TB)]≤E[C(P)]+2K⋅E[N]E[\mathcal C(TB)]\le E[\mathcal C(P)]+2K\cdot E[N]E[C(TB)]≤E[C(P)]+2K⋅E[N] for every feasible PPP.

Two non-milestone theorems show that the setting is not empty. A conditional demand law exists whenever demands are integrable, and a triple-balancing policy exists when hT>0h_T>0hT​>0.

Significance

The theorem gives a policy that can be computed online and comes with a worst-case expected-cost guarantee that does not depend on the demand distribution, the horizon or the cost data. In this setting the optimal policy is not computable in general, and the previously used heuristics have no such bound. The two lemmas separate a lower bound on every policy, in terms of TB's own number of orders, from an upper bound on TB's cost. The authors' subsequent work extends the balancing template to capacitated and multi-echelon models (§7 of the paper).

The result is proved in the paper. As far as we know, no machine-checked version exists of this theorem, of the balancing argument, or of a stochastic inventory model with correlated demand and evolving information. A formalization would check the argument, which is terse in places: the printed proof of Lemma 6.2 indexes its final sum loosely and must handle the event N=0N=0N=0. It would also produce reusable infrastructure for policies adapted to a filtration, for regular conditional distributions of future demand, and for cost accounting over random intervals between orders.

Difficulty

The costs of TB and of an arbitrary policy cannot be compared period by period, because the two policies order at different, random times that depend on the evolving information. Any comparison has to be made over intervals whose endpoints are stopping times determined by TB, conditioned on the information at their start. At such a time the other policy may hold more or less stock than TB, and the bound must hold in both cases. Bounding each policy's cost on its own does not work: the guarantee rests on a coupling between when TB orders and what every other policy must pay over the same random stretch of time. The formal side adds a second difficulty. Rule 2 is defined through a conditional expectation viewed as a function of the order quantity, so it needs a regular conditional distribution and a measurable selection of the maximizer.

Formalization scope

  • Periods are natural numbers 1,…,T1,\dots,T1,…,T, demands and orders are real-valued, and data at indices outside 1,…,T1,\dots,T1,…,T are unused.
  • Information is a MeasureTheory.Filtration ℕ. A policy is feasible when it is nonnegative and adapted, and "DtD_tDt​ known at the start of period ttt" means DtD_tDt​ is Ft\mathcal F_tFt​-measurable.
  • The conditional distributions IsI_sIs​ are model data: Markov kernels to demand paths that are Fs\mathcal F_sFs​-measurable regular conditional distributions of the demand path. At every outcome they make DsD_sDs​ deterministic, demands nonnegative and the conditional means E[Dt∣fs]E[D_t\mid f_s]E[Dt​∣fs​] finite.
  • Expected costs, E[N]E[N]E[N] and the conditional expectation in Rule 2 are lower Lebesgue integrals in [0,∞][0,\infty][0,∞]. Lemma 6.2 is stated additively, E[C(TB)]≤E[C(P)]+2K E[N]E[\mathcal C(TB)]\le E[\mathcal C(P)]+2K\,E[N]E[C(TB)]≤E[C(P)]+2KE[N], which is the paper's inequality whenever the expectations are finite.
  • The comparison policy is an arbitrary feasible policy, not an optimal one. The paper's proofs use only feasibility, and this form implies the paper's whenever an optimum exists, without any existence hypothesis.
  • TB is the predicate "feasible and satisfies Rules 1 and 2 at every period and outcome". The rules determine the policy uniquely. Rule 1 uses a strict "exceeds KKK", and the period-TTT order is DT−xTD_T-x_TDT​−xT​.

Several trivializing formalizations are ruled out. Junk conditional expectations cannot make Rule 2 hold for every qqq, because it uses kernel integrals in [0,∞][0,\infty][0,∞]. Infinite expected costs cannot be read as 000. The policy class is not empty, because a separate theorem gives existence under hT>0h_T>0hT​>0 (without some positive holding cost on [s,T][s,T][s,T] the maximum in Rule 2 does not exist).

Contributions welcome: proofs of the existence theorems (measurable selection of qsBq_s^BqsB​, versions of regular conditional distributions), the stopping-time decomposition of the cost over TB's order intervals, and Lemmas 6.1 and 6.2.

Selected references

  • R. Levi, M. Pál, R. O. Roundy, D. B. Shmoys, Approximation Algorithms for Stochastic Inventory Control Models, Mathematics of Operations Research 32(2):284–302, 2007. https://doi.org/10.1287/moor.1060.0205
  • H. Scarf, The Optimality of (S, s) Policies in the Dynamic Inventory Problem, in Mathematical Methods in the Social Sciences, Stanford University Press, 1960.
7 thms2 active usersReviewed
Linear OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Smoothed Analysis of Algorithms: Why the Simplex Algorithm Usually Takes Polynomial Time 2: The Two-Phase Shadow-Vertex Simplex Method Has Polynomial Smoothed ComplexityResearch Paper

Motivation

The simplex method solves linear programs by moving between vertices of a feasible polyhedron. Its worst-case number of moves can grow exponentially, yet it often performs well on ordinary inputs. Worst-case examples alone therefore give an incomplete account of the method’s behavior. Spielman and Teng introduced smoothed analysis to measure expected performance after small random perturbations of an arbitrary input. Their result for a two-phase shadow-vertex simplex method gives a polynomial bound in the input dimensions and inverse perturbation scale. The pinned preprint is the source for every theorem number and constant in this mission.

The paper separates a geometric result about the expected size of a polytope’s shadow (Theorem 4.0.1) from the algorithmic result here (Theorem 5.0.1). That separation matters: a plane chosen before perturbation and a plane chosen by a running algorithm have different distributions. This mission addresses the latter. It complements the standard-form simplex theorems already formalized in the Introduction to Linear Optimization series and the worst-case Klee–Minty result in the Smale’s Ninth Problem mission; those results concern different algorithms or input models and are context rather than imported statements.

Setting

A linear program is specified by vectors a1,…,an∈Rda_1,\ldots,a_n\in\mathbb R^da1​,…,an​∈Rd, right-hand sides y1,…,yn∈Ry_1,\ldots,y_n\in\mathbb Ry1​,…,yn​∈R, and an objective vector z∈Rdz\in\mathbb R^dz∈Rd:

max⁡x⟨z,x⟩subject to⟨ai,x⟩≤yi(1≤i≤n).\max_x\langle z,x\rangle\quad\text{subject to}\quad \langle a_i,x\rangle\le y_i\qquad(1\le i\le n).xmax​⟨z,x⟩subject to⟨ai​,x⟩≤yi​(1≤i≤n).

The paper’s two-phase shadow-vertex method first draws a collection I\mathcal II of ddd-element subsets of [n][n][n] and chooses one whose constraint matrix AIA_IAI​ has the largest smallest singular value. It sets a power-of-two scale MMM from the input norm and a power-of-two scale κ\kappaκ from that singular value. These determine positive relaxed right-hand sides yi′y'_iyi′​: MMM for i∈Ii\in Ii∈I and dM2/(4κ)\sqrt d M^2/(4\kappa)d​M2/(4κ) otherwise. A coefficient vector α\alphaα is chosen uniformly from A1/d2={α:∑i∈Iαi=1, αi≥1/d2}A_{1/d^2}=\{\alpha:\sum_{i\in I}\alpha_i=1,\ \alpha_i\ge1/d^2\}A1/d2​={α:∑i∈I​αi​=1, αi​≥1/d2}. The first phase solves the relaxed program LP′ from the objective AIαA_I\alphaAI​α.

The second phase uses a lifted program LP⁺ in Rd+1\mathbb R^{d+1}Rd+1. For each original constraint it forms ai+=((yi′−yi)/2,ai)a_i^+=((y'_i-y_i)/2,a_i)ai+​=((yi′​−yi​)/2,ai​) and yi+=(yi′+yi)/2y_i^+=(y'_i+y_i)/2yi+​=(yi′​+yi​)/2, together with two artificial constraints at first coordinates 111 and −1-1−1. LP⁺ connects LP′ to the original program and makes infeasibility detectable. Its shadow is taken in the plane of (0,z)(0,z)(0,z) and z+=(1,0,…,0)z^+=(1,0,\ldots,0)z+=(1,0,…,0).

For positive right-hand sides, an optimal polar simplex is a ddd-subset of constraints whose scaled vectors ai/yia_i/y_iai​/yi​ form a facet of ConvHull⁡(0,a1/y1,…,an/yn)\operatorname{ConvHull}(0,a_1/y_1,\ldots,a_n/y_n)ConvHull(0,a1​/y1​,…,an​/yn​) and whose unscaled cone contains an objective qqq. The shadow for objectives t,zt,zt,z is the union of these simplices over all qqq in Span⁡(t,z)\operatorname{Span}(t,z)Span(t,z). Its size bounds the number of polar pivots. In Section 5 the paper writes Sz′S'_zSz′​ for the first-phase shadow size and Sz+S_z^+Sz+​ for the second-phase shadow size without the two artificial pivots.

The input is perturbed by independent Gaussians: each coordinate of aia_iai​ and each yiy_iyi​ has its prescribed center and common standard deviation σR\sigma RσR, where R=max⁡i∥(yˉi,aˉi)∥2R=\max_i\|(\bar y_i,\bar a_i)\|_2R=maxi​∥(yˉ​i​,aˉi​)∥2​. The algorithm has separate random choices of I\mathcal II and α\alphaα.

Formalization targets

The immediate targets bound the two phases: Lemma 5.2.1 gives an explicit expectation bound for Sz′S'_zSz′​ and Lemma 5.3.1 gives one for Sz+S_z^+Sz+​. Lemma 5.1.1 and its corollaries control the chance that the chosen basis has a very small singular value. Corollary 4.3.3 extends the geometric shadow bound to positive, unequal right-hand sides and general Gaussian covariance. These are the mission’s milestone targets.

The goal is the shape of Theorem 5.0.1. With C(A,y,z)=EI,α(Sz′+Sz++2)C(A,y,z)=\mathbb E_{\mathcal I,\alpha}(S'_z+S_z^++2)C(A,y,z)=EI,α​(Sz′​+Sz+​+2), there are a single polynomial P\mathcal PP and a positive constant σ0\sigma_0σ0​ such that, for all n>d≥3n>d\ge3n>d≥3 and all centers and objectives,

EA,yC(A,y,z)≤min⁡{P(d,n,1min⁡(σ,σ0)),(nd)+(nd+1)+2}.\mathbb E_{A,y}C(A,y,z)\le \min\left\{\mathcal P\left(d,n,\frac1{\min(\sigma,\sigma_0)}\right), \binom nd+\binom n{d+1}+2\right\}.EA,y​C(A,y,z)≤min{P(d,n,min(σ,σ0​)1​),(dn​)+(d+1n​)+2}.

The polynomial is uniform over the dimensions and inputs; its coefficients are not prescribed. The bound on CCC implies the corresponding result for the actual pivot count through the paper’s step-to-shadow comparison. The goal is stated with a positive center scale RRR, the case in which the paper’s Gaussian rescaling applies.

Significance

The theorem places the number of pivots of a complete simplex method under one explicit perturbation model, including the work needed to find a starting feasible basis and handle an arbitrary right-hand side. The trivial binomial bound is retained because it controls rare events in the proof and is part of the stated result. The polynomial bound says that even when the unperturbed LP is adversarial, Gaussian noise of a controlled scale makes the expected shadow-size cost polynomial.

The paper proves the mathematical result. This mission asks for machine-checked proofs of its statement and the listed milestones; the draft Lean declarations are targets with sorry, not completed proofs. The reusable formal infrastructure is the finite polar simplex and shadow construction, product Gaussian input law, smallest-singular-value events for sampled minors, and the uniform truncated-simplex coefficient law. The two shadow-size lemmas also require explicit handling of measurable finite-valued counts and their expectations.

Difficulty

The basic shadow estimate fixes its projection plane before perturbing the constraints. In LP′, the initial objective AIαA_I\alphaAI​α uses a basis selected after the perturbation, so the relevant plane depends on the random LP. The fixed-plane theorem cannot be substituted directly. For LP⁺, the normalized lifted vectors ai+/yi+a_i^+/y_i^+ai+​/yi+​ are nonlinear functions of Gaussian data; they are generally not Gaussian vectors. Thus the same shadow estimate does not apply directly to their law either. A further issue is that a poor sampled basis can make y′y'y′ very large. These are distinct obstacles, reflected in the milestone groups from Sections 5.1, 5.2, and 5.3.

Formalization scope

Vectors are EuclideanSpace ℝ (Fin d), constraints are Fin n → EuclideanSpace ℝ (Fin d), and index families are finite sets of Fin n. The paper’s [n][n][n] starts at one; Fin n starts at zero. The Gaussian constructor receives variance σ2\sigma^2σ2, not standard deviation σ\sigmaσ. The 3ndln⁡n3nd\ln n3ndlnn draws are rounded upward and are independent uniform draws with replacement. Equal singular values are resolved by the first sampled set. The uniform law on AδA_\deltaAδ​ is represented by normalized independent exponential weights followed by the affine shift that imposes αi≥δ\alpha_i\ge\deltaαi​≥δ.

The Lean definition of CCC is exactly the Section 5 shadow-size upper bound E(Sz′+Sz++2)\mathbb E(S'_z+S_z^++2)E(Sz′​+Sz+​+2), computed from the sampled LP data. It is not an arbitrary cost variable. The actual algorithmic step bound needs the paper’s polar algorithm and Lemma 3.3.5. The goal explicitly asks for inner and outer integrability so Lean’s default value for a nonintegrable Bochner integral cannot make the result vacuous. The source’s all-zero center scale is excluded because it gives zero perturbation and defeats the rescaling used in Theorem 5.0.1.

For LP⁺ the vectors live in Rd+1\mathbb R^{d+1}Rd+1, so the two LP⁺ milestone bounds use D(n,d+1,⋅)\mathcal D(n,d+1,\cdot)D(n,d+1,⋅). The preprint prints ddd in those calls even though the preceding extension theorem would be applied in dimension d+1d+1d+1. Lemma 5.2.1 is written as an inequality: its printed equality is stronger than the bound established on page 71. These corrections are visible in the theorem titles and notes. Contributions that prove the exact statements, establish the measurability and Gaussian law facts, or formalize the step-to-shadow comparison are welcome.

Selected references

  • Daniel A. Spielman and Shang-Hua Teng, Smoothed Analysis of Algorithms: Why the Simplex Algorithm Usually Takes Polynomial Time, arXiv:cs/0111050v7, 2003, preprint. The PDF used here is the 96-page version with printed and PDF page numbers aligned.
22 thms2 active usersReviewed
Machine LearningQuantum Information·Captain: mikedeng1

Shadow Tomography of Quantum States 1: Polylogarithmically Many Copies Suffice to Estimate Every Acceptance Probability to Within εResearch Paper

Motivation

Learning an unknown quantum state is expensive. Full quantum state tomography of a DDD-dimensional mixed state ρ\rhoρ to accuracy ε\varepsilonε in trace distance needs on the order of D2/ε2D^2/\varepsilon^2D2/ε2 copies of ρ\rhoρ (O'Donnell–Wright 2016; Haah et al. 2017), and this is optimal. For a system of nnn qubits, D=2nD = 2^nD=2n, so full tomography is out of reach beyond a few dozen qubits.

Often one does not need the whole density matrix, only the behaviour of ρ\rhoρ on a fixed list of tests: acceptance probabilities of verification circuits, expectation values of observables, or the answers a piece of quantum advice gives to a set of questions. Aaronson (arXiv:1711.01053, STOC 2018) named this task shadow tomography and asked whether the number of copies can be polylogarithmic in both the dimension and the number of tests. Measuring each test on separate copies costs O~(M/ε2)\tilde O(M/\varepsilon^2)O~(M/ε2) copies, which is linear in MMM.

Timeline.

  • 2016: the question was posed at a mini-course without a name (Aaronson, The Complexity of Quantum States and Transformations, §8.3.1).
  • 2016: Harrow, Lin and Montanaro gave a correct "quantum OR" test, repairing an earlier flawed claim (arXiv:1607.03236, Corollary 11).
  • 2017–2018: Aaronson proved the first polylogarithmic bound, the theorem of this mission.
  • Later work improved the exponents, notably Bădescu–O'Donnell 2021, and introduced the related "classical shadows" of Huang–Kueng–Preskill 2020.

Setting

A mixed state of dimension DDD is a D×DD\times DD×D Hermitian positive semidefinite matrix ρ\rhoρ with Tr ρ=1\mathrm{Tr}\,\rho = 1Trρ=1. A two-outcome measurement is a D×DD\times DD×D Hermitian matrix EEE with all eigenvalues in [0,1][0,1][0,1]. Equivalently, 0⪯E⪯10 \preceq E \preceq \mathbb 10⪯E⪯1. It accepts ρ\rhoρ with probability Tr(Eρ)\mathrm{Tr}(E\rho)Tr(Eρ).

The state ρ⊗k\rho^{\otimes k}ρ⊗k consists of kkk independent copies of ρ\rhoρ. A measurement of ρ⊗k\rho^{\otimes k}ρ⊗k with classical output is a POVM: a finite family of positive semidefinite matrices PωP_\omegaPω​ on the kkk-register space with ∑ωPω=1\sum_\omega P_\omega = \mathbb 1∑ω​Pω​=1. Outcome ω\omegaω occurs with probability Tr(Pωρ⊗k)\mathrm{Tr}(P_\omega\rho^{\otimes k})Tr(Pω​ρ⊗k). An adaptive procedure that measures the copies one after another is described by one such POVM.

Problem 1 (shadow tomography). Given an unknown ρ\rhoρ and known two-outcome measurements E1,…,EME_1,\dots,E_ME1​,…,EM​, output numbers b1,…,bM∈[0,1]b_1,\dots,b_M\in[0,1]b1​,…,bM​∈[0,1] with ∣bi−Tr(Eiρ)∣≤ε|b_i-\mathrm{Tr}(E_i\rho)|\le\varepsilon∣bi​−Tr(Ei​ρ)∣≤ε for all iii, with success probability at least 1−δ1-\delta1−δ. The output must come from a measurement of ρ⊗k\rho^{\otimes k}ρ⊗k, with k=k(D,M,ε,δ)k=k(D,M,\varepsilon,\delta)k=k(D,M,ε,δ) as small as possible. The measurement may depend on the EiE_iEi​, but not on ρ\rhoρ.

Formalization targets

Goal: Theorem 2, in the explicit form proved in §5

There is a universal constant CCC such that, for M≥2M\ge2M≥2 and 0<ε,δ≤1/20<\varepsilon,\delta\le 1/20<ε,δ≤1/2, Problem 1 is solvable with

k≤C log⁡Dε(log⁡log⁡D+log⁡1εε2)2log⁡4M(log⁡log⁡M+log⁡log⁡D+log⁡1ε+log⁡1δ)=O~(log⁡1/δε5log⁡4Mlog⁡D)k \le C\,\frac{\log D}{\varepsilon}\Big(\frac{\log\log D+\log\frac1\varepsilon}{\varepsilon^{2}}\Big)^{2}\log^4 M\Big(\log\log M+\log\log D+\log\frac1\varepsilon+\log\frac1\delta\Big) = \tilde O\Big(\frac{\log 1/\delta}{\varepsilon^5}\log^4 M\log D\Big)k≤CεlogD​(ε2loglogD+logε1​​)2log4M(loglogM+loglogD+logε1​+logδ1​)=O~(ε5log1/δ​log4MlogD)

copies. This is the last display of the proof (p. 19). The goal fixes no constant, so any improvement of CCC remains consistent with it.

Milestones

  • Theorem 13 (Harrow–Lin–Montanaro). A one-copy test that accepts with probability at least (1−ϵ)2/7(1-\epsilon)^2/7(1−ϵ)2/7 if some Tr(Eiρ)≥1−ϵ\mathrm{Tr}(E_i\rho)\ge1-\epsilonTr(Ei​ρ)≥1−ϵ, and at most 4ΔM4\Delta M4ΔM if ∑iTr(Eiρ)≤ΔM\sum_i\mathrm{Tr}(E_i\rho)\le\Delta M∑i​Tr(Ei​ρ)≤ΔM.
  • Lemma 14 (Quantum OR Bound). Deciding whether max⁡iTr(Eiρ)≥c\max_i\mathrm{Tr}(E_i\rho)\ge cmaxi​Tr(Ei​ρ)≥c or ≤c−ε\le c-\varepsilon≤c−ε with O(log⁡(1/δ)log⁡M/ε2)O(\log(1/\delta)\log M/\varepsilon^2)O(log(1/δ)logM/ε2) copies, independent of DDD.
  • Lemma 15 (Gentle Search). Finding jjj with Tr(Ejρ)≥c−ε\mathrm{Tr}(E_j\rho)\ge c-\varepsilonTr(Ej​ρ)≥c−ε with O(log⁡4Mε2(log⁡log⁡M+log⁡1δ))O(\frac{\log^4M}{\varepsilon^2}(\log\log M+\log\frac1\delta))O(ε2log4M​(loglogM+logδ1​)) copies.
  • Amplification claims (p. 16). The threshold tests Ei,t,±∗E^*_{i,t,\pm}Ei,t,±∗​ on ρ⊗q\rho^{\otimes q}ρ⊗q accept with probability at least 5/65/65/6 when the hypothesis is off by ε\varepsilonε, and at most 1/31/31/3 when it is within ε/2\varepsilon/2ε/2.
  • Markov claim (p. 17). The postselection test FtF_tFt​ on an arbitrary, possibly entangled, qqq-register state accepts with probability at most aq(a+ε/4)q\frac{a q}{(a+\varepsilon/4)q}(a+ε/4)qaq​.
  • Lemma 12 (Quantum Union Bound, probability part). Measurements each accepting with probability at least 1−ε1-\varepsilon1−ε all accept in succession with probability at least 1−2Mε1-2M\sqrt\varepsilon1−2Mε​.
  • Chernoff claim (p. 18). 1−Tr(Ftρ⊗q)≤ε4/log⁡2D1-\mathrm{Tr}(F_t\rho^{\otimes q})\le\varepsilon^4/\log^2D1−Tr(Ft​ρ⊗q)≤ε4/log2D.
  • Proposition 20. Promise-gap thresholds for all iii at once can be decided with O(log⁡(M/δ)/ε2)O(\log(M/\delta)/\varepsilon^2)O(log(M/δ)/ε2) copies.

Significance

The result. Theorem 2 shows that a state of exponential dimension can be learned "for all practical purposes" on exponentially many tests from polynomially many copies. Applications in the paper include a bound on quantum advice and one-way communication, and implications for quantum money and copy-protection. It also shows that the information needed to predict many measurement outcomes is far smaller than the description of ρ\rhoρ.

Formalizing it. The theorem is proved in the paper, and later work improves its exponents. As far as is known it has not been machine-checked. A complete development formalizes the gentle-measurement toolkit (Lemma 12, Lemma 14, Lemma 15), the amplification of two-outcome measurements on tensor powers, and the postselection argument. These are standard tools of quantum learning theory and quantum complexity with no formal counterpart yet. Lemma 14 and Lemma 15 are reusable beyond this mission.

Difficulty

The naive approach measures the EiE_iEi​ directly on shared copies. A measurement that is likely to reject disturbs the state, so later measurements see a damaged state, and separate copies per measurement cost MMM copies.

The proof needs three ingredients:

  • a gentle search that finds a measurement on which the current hypothesis is wrong while damaging the copies only slightly;
  • a potential argument showing that postselection cannot happen too often;
  • a uniform control of the damage.

The potential argument has to hold for the state after postselection, which is correlated or entangled across registers. Independence-based concentration fails there, which is why the Markov claim, not a Chernoff bound, governs that step. Theorem 13 itself rests on a delicate ancilla-based procedure of Harrow, Lin and Montanaro, and the mission cites it as a milestone without its proof.

Formalization scope

  • Representation.
    • Operators are complex matrices over a finite index type, and states use the published WildeQIT.IsDensityOperator (positive semidefinite, trace one).
    • A two-outcome measurement is IsEffect E: both EEE and 1−E\mathbb 1-E1−E are positive semidefinite.
    • ρ⊗k\rho^{\otimes k}ρ⊗k is a matrix indexed by kkk-tuples Fin k → n.
    • A measurement with output is a POVM structure with a finite outcome type. Probabilities are real parts of traces.
  • Quantifier order of the goal. ∃C\exists C∃C, then for all D,M,ε,δD,M,\varepsilon,\deltaD,M,ε,δ there is kkk; then for all EiE_iEi​ there are a POVM and outputs bbb; then for all ρ\rhoρ. Choosing the measurement after ρ\rhoρ would make the goal trivial (output the true values with k=0k=0k=0), and this order rules that out.
  • Disclosed hypotheses.
    • Theorem 2 assumes M≥2M\ge2M≥2, ε≤1/2\varepsilon\le1/2ε≤1/2 and δ≤1/2\delta\le1/2δ≤1/2. These keep the logarithmic factors positive; at M=1M=1M=1 the bound would force k=0k=0k=0.
    • Lemma 14 assumes M≥2M\ge2M≥2, and Lemmas 14 and 15 bound δ\deltaδ.
    • Theorem 13 assumes ϵ≤1/2\epsilon\le1/2ϵ≤1/2, as in Harrow–Lin–Montanaro's Corollary 11.
    • The Chernoff claim assumes D≥2D\ge2D≥2.
  • Conventions.
    • All logarithms are natural, including inside log⁡log⁡\log\logloglog.
    • Amplified tests use real thresholds.
    • "Applied in succession" in Lemma 12 uses Lüders instruments (E\sqrt{E}E​ Kraus operators), in the order E1,E2,…E_1,E_2,\dotsE1​,E2​,….
    • The hypothesis ρt\rho_tρt​ enters the amplification claims only as the number a=Tr(Eρt)a=\mathrm{Tr}(E\rho_t)a=Tr(Eρt​).
  • Printed steps not drafted.
    • The printed ε−4\varepsilon^{-4}ε−4 form of Theorem 2 relies on an external online-learning algorithm that is only sketched.
    • The halting rule of §5 is unspecified, because Lemma 15 always returns an index.
    • The asymptotic claims pt≥0.9/Dqp_t\ge0.9/D^qpt​≥0.9/Dq for t=o(log⁡2D/ε4)t=o(\log^2D/\varepsilon^4)t=o(log2D/ε4) and t=O(qlog⁡D/ε)t=O(q\log D/\varepsilon)t=O(qlogD/ε) use a circular o(⋅)o(\cdot)o(⋅).
    • The trace-distance part of Lemma 12 has an unquantified O(⋅)O(\cdot)O(⋅).
    • Lemma 12's printed bound 1−2Mε1-2M\sqrt\varepsilon1−2Mε​ is weaker than its use on p. 18. It is stated as printed. The proof of the goal must retune constants or use Wilde's stronger 1−2Mε1-2\sqrt{M\varepsilon}1−2Mε​-type bound.
  • Contributions welcome. Proofs of any milestone; a formal Hoeffding bound for binomial counts of product effects; the gentle measurement lemma for Lüders instruments; Naimark dilation for effects.

Selected references

  • S. Aaronson, Shadow Tomography of Quantum States, STOC 2018; arXiv:1711.01053v2, 2018. https://arxiv.org/abs/1711.01053
  • A. W. Harrow, C. Y.-Y. Lin, A. Montanaro, Sequential measurements, disturbance and property testing, SODA 2017. https://arxiv.org/abs/1607.03236
  • M. M. Wilde, Sequential decoding of a general classical-quantum channel, Proc. R. Soc. A, 2013. https://arxiv.org/abs/1303.0808
  • R. O'Donnell, J. Wright, Efficient quantum tomography, STOC 2016. https://arxiv.org/abs/1508.01907
  • J. Haah, A. W. Harrow, Z. Ji, X. Wu, N. Yu, Sample-optimal tomography of quantum states, IEEE Trans. Inf. Theory, 2017. https://arxiv.org/abs/1508.01797
  • C. Bădescu, R. O'Donnell, Improved quantum data analysis, STOC 2021. https://arxiv.org/abs/2011.10908
  • H.-Y. Huang, R. Kueng, J. Preskill, Predicting many properties of a quantum system from very few measurements, Nature Physics, 2020. https://arxiv.org/abs/2002.08953
16 thms2 active usersReviewed
Linear OptimizationNumerical Analysis·Captain: Lucas

Extended Smale's 9th Problem I: no algorithm computes K digits of LP minimisersResearch Paper

Motivation

Linear programming is usually described as "solvable in polynomial time", but that statement is about rational inputs given exactly. In Smale's list of problems for the 21st century (Smale 1998), Problem 9 asks for a polynomial-time algorithm over the reals deciding the feasibility of Ax≥yAx \ge yAx≥y, and Smale explicitly calls for "models which process approximate inputs and which permit round-off computations". Real data such as 2\sqrt 22​, entries of a discrete cosine transform, or even 1/31/31/3 in floating point can only be accessed approximately.

Bastounis, Hansen and Vlačić pose the extended Smale's 9th problem: in a model where the algorithm can only query approximations of the input to any requested accuracy, can one compute minimisers of linear programming, basis pursuit and Lasso to KKK correct digits? Their Main Theorem I (Theorem 3.4) shows that the answer depends on KKK in a sharp way: for a suitable class of well-conditioned, bounded inputs, no algorithm at all (not only no efficient one) produces KKK correct digits, while K−1K-1K−1 digits are computable (but not in bounded time) and K−2K-2K−2 digits are computable in polynomial time.

This mission targets the first, impossibility, half of Theorem 3.4(i) for linear programming.

Setting

Linear program. For A∈Rm×NA \in \mathbb R^{m\times N}A∈Rm×N, y∈Rmy\in\mathbb R^my∈Rm and c=1N=(1,…,1)c = \mathbf 1_N=(1,\dots,1)c=1N​=(1,…,1), the solution set is

Ξ(y,A)=argmin⁡x∈RN ⟨x,c⟩subject toAx=y, x≥0.\Xi(y,A) = \operatorname*{argmin}_{x\in\mathbb R^N}\ \langle x, c\rangle \quad\text{subject to}\quad Ax = y,\ x\ge 0 .Ξ(y,A)=x∈RNargmin​ ⟨x,c⟩subject toAx=y, x≥0.

It is a subset of MN=RNM_N = \mathbb R^NMN​=RN with the ℓp\ell^pℓp norm, p∈[1,∞]p\in[1,\infty]p∈[1,∞]. An input is a pair ι=(y,A)\iota = (y,A)ι=(y,A), and the evaluations of ι\iotaι are its coordinates yiy_iyi​ and entries AijA_{ij}Aij​.

Extended model (Δ1\Delta_1Δ1​-information). Let Dn={k2−n:k∈Z}D_n = \{k2^{-n} : k\in\mathbb Z\}Dn​={k2−n:k∈Z}. An oracle representation of ι\iotaι is a family ι~=(ι~j,n)\tilde\iota = (\tilde\iota_{j,n})ι~=(ι~j,n​), indexed by evaluations jjj and accuracies n=1,2,…n = 1,2,\dotsn=1,2,…, with ι~j,n∈Dn+iDn\tilde\iota_{j,n}\in D_n + iD_nι~j,n​∈Dn​+iDn​ and ∣ι~j,n−fj(ι)∣≤2−n|\tilde\iota_{j,n} - f_j(\iota)|\le 2^{-n}∣ι~j,n​−fj​(ι)∣≤2−n. An algorithm must succeed on every oracle representation of every input.

General algorithm. To make impossibility results independent of the machine model, the paper uses general algorithms (Definition 9.3): a map Γ\GammaΓ from inputs to M∪{NH}M\cup\{\mathrm{NH}\}M∪{NH} (NH\mathrm{NH}NH = no output) together with a nonempty set ΛΓ(ι)\Lambda_\Gamma(\iota)ΛΓ​(ι) of evaluations read on ι\iotaι. This set is finite whenever Γ\GammaΓ halts. The output is determined by the values read, and any input that agrees on those values reads the same set. Turing machines and BSS machines with an oracle are special cases; general algorithms can even solve the halting problem.

Error and breakdown epsilon. The error is dist⁡(Γ(ι),Ξ(ι))=inf⁡ξ∈Ξ(ι)d(Γ(ι),ξ)\operatorname{dist}(\Gamma(\iota),\Xi(\iota)) = \inf_{\xi\in\Xi(\iota)} d(\Gamma(\iota),\xi)dist(Γ(ι),Ξ(ι))=infξ∈Ξ(ι)​d(Γ(ι),ξ), with distance ∞\infty∞ from NH\mathrm{NH}NH. The strong breakdown epsilon εBs\varepsilon_B^sεBs​ is the supremum of all ε≥0\varepsilon\ge 0ε≥0 such that every general algorithm has error >ε>\varepsilon>ε on some input (Definition 9.17).

Formalization targets

Goal: Theorem 3.4(i), deterministic part, for LP

For every integer K≥1K\ge1K≥1, all dimensions 4≤m<N4\le m<N4≤m<N and every p∈[1,∞]p\in[1,\infty]p∈[1,∞] there is a nonempty class Ωm,N\Omega_{m,N}Ωm,N​ of inputs (y,A)(y,A)(y,A) with nonempty solution sets, ∥y∥∞≤2\|y\|_\infty\le 2∥y∥∞​≤2 and ∥A∥max⁡=1\|A\|_{\max}=1∥A∥max​=1, such that

¬ ∃ Γ general algorithm on oracle representations:∀ ι~,  dist⁡ℓp(Γ(ι~), Ξ(ι))≤10−K.\neg\,\exists\,\Gamma\ \text{general algorithm on oracle representations}:\quad \forall\,\tilde\iota,\ \ \operatorname{dist}_{\ell^p}\big(\Gamma(\tilde\iota),\,\Xi(\iota)\big)\le 10^{-K}.¬∃Γ general algorithm on oracle representations:∀ι~,  distℓp​(Γ(ι~),Ξ(ι))≤10−K.

Milestones

  1. Lemma 11.1: the explicit solution sets of the LP inputs (y1e1,A(α,β,m,N))(y_1e_1, A(\alpha,\beta,m,N))(y1​e1​,A(α,β,m,N)).
  2. Proposition 10.5 (ii), deterministic part: two input sequences that converge in evaluation to a common input and whose solutions stay κ\kappaκ apart force εBs≥κ/2\varepsilon_B^s\ge\kappa/2εBs​≥κ/2 for a suitable choice of Δ1\Delta_1Δ1​-information.
  3. §9.6, (i) ⇒ (ii): a lower bound on εBs\varepsilon_B^sεBs​ for one specific Δ1\Delta_1Δ1​-information transfers to the problem with all oracle representations.
  4. Proposition 9.32 (i) (deterministic consequence via Proposition 10.1): εBs>10−K\varepsilon_B^s>10^{-K}εBs​>10−K for LP on a suitable Ωm,N\Omega_{m,N}Ωm,N​.

Significance

The theorem shows that for LP with inexact input, being non-computable in Turing's sense does not rule out a finer complexity theory. The paper builds a "KKK / K−1K-1K−1 / K−2K-2K−2 digits" classification on this. It also explains why established solvers can return wrong answers with a success flag on small, well-conditioned LPs (§4 of the paper), and it bears on computer-assisted proofs that rely on inexact LP, such as the Flyspeck proof of the Kepler conjecture.

The result is proved on paper. As far as the proposer knows, it has not been machine-checked. This mission formalizes the deterministic impossibility part for LP and puts in place reusable infrastructure: general algorithms, breakdown epsilons and Δ1\Delta_1Δ1​-information. That infrastructure is the base for later missions on the randomised parts of Theorem 3.4(i)–(ii), the weak breakdown epsilon (iii), the exit-flag theorem (Theorem 5.1), and basis pursuit and Lasso.

Difficulty

The obvious objection is that LP is in P for rational inputs, so some rounding scheme ought to work. It fails because an algorithm must halt after reading finitely many approximations. Two inputs that agree to that accuracy but have minimisers far apart then receive the same output. Setting this up needs a notion of algorithm strong enough to cover every computational model, a precise Δ1\Delta_1Δ1​-information model in which the adversary controls the approximations, and explicit LP geometry in which an arbitrarily small perturbation of AAA moves the minimiser by a fixed amount.

Formalization scope

  • Inputs are (y,A)∈(Fin m→R)×Matrix(Fin m)(Fin N) R(y,A)\in(\mathrm{Fin}\,m\to\mathbb R)\times\mathrm{Matrix}(\mathrm{Fin}\,m)(\mathrm{Fin}\,N)\,\mathbb R(y,A)∈(Finm→R)×Matrix(Finm)(FinN)R. Evaluations are complex-valued, as in Definition 9.2. Outputs lie in PiLp p (Fin N → ℝ).
  • A general algorithm is a structure with an output run : Ω → Option M (none = NH) and a read set queried, satisfying the axioms (i)–(iii) of Definition 9.3.
  • Errors take values in [0,∞][0,\infty][0,∞] (ℝ≥0∞), and the error of NH is ∞\infty∞. The infimum over an empty solution set is ∞\infty∞. The goal also requires nonempty solution sets, so no junk value enters.
  • Oracle accuracies are indexed by n∈{1,2,… }n\in\{1,2,\dots\}n∈{1,2,…} (ℕ+). An oracle input is stored as a pair (input, oracle family), and algorithms can read only the oracle family.
  • Out of scope: randomised algorithms, the positive statements (iii)–(iv), runtime, and the condition-number bounds Cond(AA∗)≤3.2\mathrm{Cond}(AA^*)\le3.2Cond(AA∗)≤3.2, CFP≤4C_{FP}\le4CFP​≤4, Cond(Ξ)≤179\mathrm{Cond}(\Xi)\le179Cond(Ξ)≤179.

Selected references

  • A. Bastounis, A. C. Hansen, V. Vlačić, The extended Smale's 9th problem — On computational barriers and paradoxes in estimation, regularisation, computer-assisted proofs, and learning, preprint (2021).
  • S. Smale, Mathematical problems for the next century, Math. Intelligencer 20 (1998). https://doi.org/10.1007/BF03025291
8 thms2 active usersReviewed
PreviousPage 3 of 10Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me