Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Graph Theory

343 missions · 141 completed

Missions

Open202Completed141All343
🏆Completed
CombinatoricsNumber TheoryTheoretical Computer Science·Captain: mikedeng1

Fast Algorithms for Finding Nearest Common Ancestors II: Nearest Common Ancestors in a Complete Binary Tree by Symmetric-Order ArithmeticResearch Paper

Motivation

The nearest common ancestor (nca) problem asks, for a fixed rooted tree and a sequence of vertex pairs (v,w)(v, w)(v,w), for the deepest vertex that is an ancestor of both. It is a basic step in suffix-tree string algorithms and is equivalent to range-minimum queries (Bender, Farach-Colton, 2000). Harel and Tarjan, Fast Algorithms for Finding Nearest Common Ancestors, SIAM J. Comput. 13 (1984) 338–355, gave the first algorithm answering each query on a static tree in constant time on a random-access machine after linear preprocessing.

Their construction reduces the general problem to the case of a complete binary tree, where §3 of the paper shows that nca queries can be answered "by direct calculation" on vertex numbers: multiplication, division, powers of two, the base-two logarithm and bitwise exclusive or. The later simplification of Schieber and Vishkin (1988) is built on the same in-order numbering of a complete binary tree. This mission formalizes that arithmetic core.

Timeline, as reviewed in the paper's §1 (pp. 338–340):

  • 1976: Aho, Hopcroft and Ullman (SIAM J. Comput. 5) give an O(n+mα(m+n,n))O(n + m\alpha(m+n, n))O(n+mα(m+n,n))-time off-line algorithm on a pointer machine, and for static trees a random-access algorithm with O(nlog⁡log⁡n)O(n \log\log n)O(nloglogn) preprocessing and O(log⁡log⁡n)O(\log\log n)O(loglogn) time per query.
  • 1976: van Leeuwen (unpublished report) gives an O(n+mlog⁡log⁡n)O(n + m \log\log n)O(n+mloglogn)-time algorithm for linking roots and static trees that runs on a pointer machine in O(n)O(n)O(n) space.
  • 1980: Harel (Proc. 21st FOCS) gives a preliminary version of the paper's results.
  • 1984: Harel and Tarjan prove that pointer machines need Ω(log⁡log⁡n)\Omega(\log\log n)Ω(loglogn) time per query on static trees (Theorem 1), and give the O(n)O(n)O(n)-preprocessing, O(1)O(1)O(1)-query random-access algorithm whose base case is the subject of this mission.

Setting

Fix d≥0d \ge 0d≥0 and let TTT be the complete binary tree of depth ddd. A vertex is identified with the path from the root to it, a word of at most ddd left or right turns; the root is the empty word and TTT has n=2d+1−1n = 2^{d+1} - 1n=2d+1−1 vertices. Following the paper's Appendix (pp. 354–355):

  • www is an ancestor of vvv (vvv a descendant of www) if the word www is a prefix of the word vvv; every vertex is its own ancestor. vvv and www are unrelated if neither is an ancestor of the other.
  • The depth of vvv is its distance to the root; its height h(v)h(v)h(v) is the length of the longest path from a leaf to vvv, which in TTT is d−depth⁡(v)d - \operatorname{depth}(v)d−depth(v).
  • nca⁡(v,w)\operatorname{nca}(v, w)nca(v,w) is the vertex of greatest depth that is an ancestor of both: the longest common prefix.

The vertices of TTT are numbered from 111 to nnn in symmetric order (in-order): at every vertex, first the left subtree, then the vertex, then the right subtree. sym(v)\mathrm{sym}(v)sym(v) is the number of vvv and sym−1(i)\mathrm{sym}^{-1}(i)sym−1(i) the vertex numbered iii. For d=4d = 4d=4 (Fig. 1 of the paper) the root is 161616, its children 888 and 242424, and the leaves 1,3,5,…,311, 3, 5, \dots, 311,3,5,…,31. i⊕ji \oplus ji⊕j denotes bitwise exclusive or and lg⁡\lglg the base-two logarithm.

Two procedures of §3 use only numbers, heights and ddd:

  • the nca depth algorithm: return d−h(v)d - h(v)d−h(v) if sym(w)∈[sym(v)−2h(v)+1,sym(v)+2h(v)−1]\mathrm{sym}(w) \in [\mathrm{sym}(v) - 2^{h(v)} + 1, \mathrm{sym}(v) + 2^{h(v)} - 1]sym(w)∈[sym(v)−2h(v)+1,sym(v)+2h(v)−1]; else d−h(w)d - h(w)d−h(w) if the same holds with v,wv, wv,w exchanged; else d−⌊lg⁡(sym(v)⊕sym(w))⌋d - \lfloor \lg(\mathrm{sym}(v) \oplus \mathrm{sym}(w)) \rfloord−⌊lg(sym(v)⊕sym(w))⌋;
  • the depth algorithm: given vvv and a depth d2≤depth⁡(v)d_2 \le \operatorname{depth}(v)d2​≤depth(v), with h=d−d2h = d - d_2h=d−d2​, return sym−1(2h+1⌊sym(v)/2h+1⌋+2h)\mathrm{sym}^{-1}\bigl(2^{h+1}\lfloor \mathrm{sym}(v)/2^{h+1}\rfloor + 2^h\bigr)sym−1(2h+1⌊sym(v)/2h+1⌋+2h).

Formalization targets

Goal: the nca algorithm is correct

The algorithm to compute nca⁡(v,w)\operatorname{nca}(v,w)nca(v,w) (p. 342) runs the nca depth algorithm to obtain d0d_0d0​ and then the depth algorithm on (v,d0)(v, d_0)(v,d0​). The goal states that it returns the nearest common ancestor: for all vertices v,wv, wv,w of TTT, with d0d_0d0​ the output of the nca depth algorithm and h=d−d0h = d - d_0h=d−d0​,

sym(nca⁡(v,w))=2h+1⌊sym(v)2h+1⌋+2h.\mathrm{sym}(\operatorname{nca}(v,w)) = 2^{h+1}\left\lfloor \frac{\mathrm{sym}(v)}{2^{h+1}} \right\rfloor + 2^h .sym(nca(v,w))=2h+1⌊2h+1sym(v)​⌋+2h.

Milestones

In the order the paper uses them:

  1. Numbers at height hhh (p. 341): the vertices of height hhh are numbered 2h,3⋅2h,5⋅2h,…2^h, 3\cdot 2^h, 5\cdot 2^h, \dots2h,3⋅2h,5⋅2h,… from left to right.
  2. Lemma 1: h(v)h(v)h(v) is the largest hhh with 2h∣sym(v)2^h \mid \mathrm{sym}(v)2h∣sym(v).
  3. Lemma 2: the descendants of vvv are the vertices numbered in [sym(v)−2h(v)+1,sym(v)+2h(v)−1][\mathrm{sym}(v) - 2^{h(v)} + 1, \mathrm{sym}(v) + 2^{h(v)} - 1][sym(v)−2h(v)+1,sym(v)+2h(v)−1].
  4. Lemma 3: for a height h≥h(v)h \ge h(v)h≥h(v), the height-hhh ancestor of vvv has number 2h+1⌊sym(v)/2h+1⌋+2h2^{h+1}\lfloor \mathrm{sym}(v)/2^{h+1}\rfloor + 2^h2h+1⌊sym(v)/2h+1⌋+2h.
  5. Lemma 4: for unrelated v,wv, wv,w,
h(nca⁡(v,w))=⌊lg⁡(sym(v)⊕sym(w))⌋.h(\operatorname{nca}(v,w)) = \lfloor \lg(\mathrm{sym}(v) \oplus \mathrm{sym}(w)) \rfloor .h(nca(v,w))=⌊lg(sym(v)⊕sym(w))⌋.
  1. The nca depth algorithm returns depth⁡(nca⁡(v,w))\operatorname{depth}(\operatorname{nca}(v,w))depth(nca(v,w)).
  2. The depth algorithm returns the number of the depth-d2d_2d2​ ancestor of vvv.

Two supporting statements pin the definitions to the paper: sym\mathrm{sym}sym is a bijection onto {1,…,2d+1−1}\{1, \dots, 2^{d+1} - 1\}{1,…,2d+1−1}, and the longest common prefix is the deepest common ancestor.

Significance

The constant-time nca computation on complete binary trees is the base case of the whole paper: §§4–5 embed an arbitrary tree into a moderately sized complete binary tree through a compressed tree and a balanced binary tree, and every query ends with the arithmetic of §3. The same idea, that in-order numbers encode ancestry in their low-order bits, underlies the Schieber–Vishkin algorithm. Lemma 1 identifies the height with the 2-adic valuation of the number, and Lemma 4 identifies the nca height with the position of the highest differing bit.

The results are proved in the paper, with the proofs left as "easy to verify". No machine-checked version of this numbering or of these four lemmas is known to exist in Mathlib or on this platform. A formal development supplies proofs of the four lemmas and the two algorithms, and a reusable library connecting in-order ranks of a complete binary tree to binary arithmetic (Nat.log, bitwise xor, 2-adic valuation).

Difficulty

The numbering is defined by a traversal order, while the lemmas speak about divisibility, floor division and exclusive or. The work lies in connecting the rank of a vertex in symmetric order to its closed form (2j+1)⋅2h(v)(2j+1)\cdot 2^{h(v)}(2j+1)⋅2h(v), where jjj is its left-to-right position. That counting argument sums the sizes of the subtrees that precede vvv and is where most of the effort goes. Lemma 4 then needs the observation that two unrelated numbers agree in all bits above the height of their nca and differ in the bit at that height. This is a statement about Nat.testBit of the exclusive or, and it fails for related vertices. The algorithm statements add a case analysis whose first two cases overlap when v=wv = wv=w.

Formalization scope

  • A vertex of the tree of depth ddd is a List Bool of length at most ddd (false = left). Ancestry is the prefix relation, nca⁡\operatorname{nca}nca the longest common prefix, depth the length, and height d−lengthd - \text{length}d−length. None of these structural notions uses the numbering.
  • sym(v)\mathrm{sym}(v)sym(v) is the number of vertices whose in-order sort key is lexicographically at most that of vvv. The key is the path with left ↦0\mapsto 0↦0, right ↦2\mapsto 2↦2, followed by 111. The numbering is not defined by the closed form or by a recursion on numbers: a definition of that kind would make the height-hhh numbering and Lemma 1 immediate and move the content of the mission into an uncheckable definition.
  • ⌊lg⁡x⌋\lfloor \lg x \rfloor⌊lgx⌋ is Nat.log 2 x, which agrees for x≥1x \ge 1x≥1. ⊕\oplus⊕ is ^^^ on N\mathbb NN, and floor division is / on N\mathbb NN.
  • Interval tests a∈[b−c+1,b+c−1]a \in [b - c + 1, b + c - 1]a∈[b−c+1,b+c−1] are written additively as b+1≤a+cb + 1 \le a + cb+1≤a+c and a+1≤b+ca + 1 \le b + ca+1≤b+c. The subtractions d−h(v)d - h(v)d−h(v) and d−d2d - d_2d−d2​ never truncate for heights and depths of vertices.
  • Lemma 3 states explicitly that h≤dh \le dh≤d ("hhh is a height") and that the ancestor exists. The depth algorithm assumes d2≤depth⁡(v)d_2 \le \operatorname{depth}(v)d2​≤depth(v), as printed.
  • sym−1\mathrm{sym}^{-1}sym−1 is not defined as a function. The goal and the depth algorithm state that a vertex has the computed number if and only if it is the nearest common ancestor (respectively the ancestor at depth d2d_2d2​), which says that sym−1\mathrm{sym}^{-1}sym−1 of that number is that vertex.
  • The O(1)O(1)O(1) time bounds are not formalized, since the random-access machine model is out of scope.

Proofs of any milestone are welcome.

Selected references

  • D. Harel and R. E. Tarjan, Fast Algorithms for Finding Nearest Common Ancestors, SIAM J. Comput. 13(2) (1984), 338–355. https://doi.org/10.1137/0213024
  • A. V. Aho, J. E. Hopcroft and J. D. Ullman, On Finding Lowest Common Ancestors in Trees, SIAM J. Comput. 5(1) (1976), 115–132. https://doi.org/10.1137/0205011
  • B. Schieber and U. Vishkin, On Finding Lowest Common Ancestors: Simplification and Parallelization, SIAM J. Comput. 17(6) (1988), 1253–1262. https://doi.org/10.1137/0217079
  • M. A. Bender and M. Farach-Colton, The LCA Problem Revisited, LATIN 2000, LNCS 1776, 88–94. https://doi.org/10.1007/10719839_9
11 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimizationTheoretical Computer Science·Captain: mikedeng1

A New Approach to the Maximum-Flow Problem 2: The Nonsaturating-Push Bound for FIFO Push-RelabelResearch Paper

Motivation

The maximum-flow problem asks how much of a commodity can be sent from a source to a sink through a network whose edges carry capacities. It is a basic model of operations research. Transportation, scheduling, bipartite matching and image segmentation reduce to it, and it is the inner step of many combinatorial algorithms.

Goldberg and Tarjan introduced the push–relabel (preflow) method in A New Approach to the Maximum-Flow Problem (J. ACM 35(4), 1988). Ford–Fulkerson-type algorithms augment along whole source–sink paths. The push–relabel method instead moves excess flow across single edges, guided by integer distance labels on the vertices. Whatever order its local operations are applied in, it is correct and performs O(n2m)O(n^2 m)O(n2m) of them (§3 of the paper). Section 4 shows that one particular order, processing the active vertices first-in, first-out, cuts the dominant term, the number of nonsaturating pushes, to O(n3)O(n^3)O(n3). The method and its FIFO and highest-label variants are the standard practical maximum-flow codes.

Timeline:

  • 1956: Ford and Fulkerson, augmenting paths and max-flow min-cut.
  • 1970–72: Dinic, and Edmonds and Karp, give polynomial augmenting-path bounds.
  • 1974: Karzanov introduces preflows and obtains O(n3)O(n^3)O(n3).
  • 1982: Shiloach and Vishkin give a parallel O(n2log⁡n)O(n^2 \log n)O(n2logn) preflow algorithm with a first-in, first-out flavour.
  • 1988: Goldberg and Tarjan, the generic push–relabel method, the FIFO bound of this mission, and O(nmlog⁡(n2/m))O(nm \log(n^2/m))O(nmlog(n2/m)) with dynamic trees.

Setting

A flow network has a finite vertex set VVV with n=∣V∣n = |V|n=∣V∣, a capacity c(v,w)≥0c(v,w) \ge 0c(v,w)≥0 on every ordered pair, a source sss and a sink t≠st \neq st=s. The edges are the pairs with c(v,w)>0c(v,w) > 0c(v,w)>0, and there are no loops. A preflow is a function fff on vertex pairs with f(v,w)≤c(v,w)f(v,w) \le c(v,w)f(v,w)≤c(v,w) and f(v,w)=−f(w,v)f(v,w) = -f(w,v)f(v,w)=−f(w,v). Its excess e(v)=∑uf(u,v)e(v) = \sum_u f(u,v)e(v)=∑u​f(u,v) must be nonnegative at every v≠sv \neq sv=s. The residual capacity is rf(v,w)=c(v,w)−f(v,w)r_f(v,w) = c(v,w) - f(v,w)rf​(v,w)=c(v,w)−f(v,w). A labeling ddd assigns each vertex a value in N∪{∞}\mathbb{N} \cup \{\infty\}N∪{∞}. A vertex v∉{s,t}v \notin \{s,t\}v∈/{s,t} is active if d(v)<∞d(v) < \inftyd(v)<∞ and e(v)>0e(v) > 0e(v)>0.

The two basic operations (Fig. 1 of the paper) are:

  • push(v,w)(v,w)(v,w), applicable when vvv is active, rf(v,w)>0r_f(v,w) > 0rf​(v,w)>0 and d(v)=d(w)+1d(v) = d(w)+1d(v)=d(w)+1. It sends δ=min⁡(e(v),rf(v,w))\delta = \min(e(v), r_f(v,w))δ=min(e(v),rf​(v,w)) from vvv to www. The push is saturating if rf(v,w)=0r_f(v,w) = 0rf​(v,w)=0 afterwards and nonsaturating otherwise.
  • relabel(v)(v)(v), applicable when vvv is active and d(v)≤d(w)d(v) \le d(w)d(v)≤d(w) for every residual edge (v,w)(v,w)(v,w). It sets d(v)←min⁡{d(w)+1:rf(v,w)>0}d(v) \leftarrow \min\{d(w)+1 : r_f(v,w) > 0\}d(v)←min{d(w)+1:rf​(v,w)>0}.

The algorithm starts by saturating every edge leaving sss, with d(s)=nd(s) = nd(s)=n and d(v)=0d(v) = 0d(v)=0 for v≠sv \neq sv=s.

In the first-in, first-out algorithm (§4), each vertex vvv scans a fixed list L(v)L(v)L(v) of its neighbours through a current edge. The push/relabel(v)(v)(v) operation pushes through the current edge if possible. Otherwise it advances the current edge, or, at the end of the list, returns to the first edge and relabels vvv. Active vertices wait in a queue QQQ, initially {v∈V−{s,t}:c(s,v)>0}\{v \in V - \{s,t\} : c(s,v) > 0\}{v∈V−{s,t}:c(s,v)>0}. The discharge operation removes the front vertex vvv and repeats push/relabel(v)(v)(v) until e(v)=0e(v) = 0e(v)=0 or d(v)d(v)d(v) increases. Every vertex that becomes active meanwhile is appended to QQQ, and vvv is appended too if it is still active. Passes over the queue are defined inductively. Pass 1 consists of the discharges of the initially queued vertices. Pass i+1i+1i+1 consists of the discharges of vertices added during pass iii.

Formalization targets

Goal: Corollary 4.4 (p. 931)

For every network, every edge-list order, every initial queue order, and every run of the FIFO algorithm,

#{nonsaturating pushes}≤4n3.\#\{\text{nonsaturating pushes}\} \le 4n^3 .#{nonsaturating pushes}≤4n3.

The constant is the printed one.

Milestones

  • Lemma 4.1 (p. 929): the push/relabel operation relabels only when relabeling is applicable.
  • Lemma 3.5 (p. 926): from any vertex with positive excess, the source is reachable in the residual graph.
  • Lemma 3.7 (p. 927): at any time, d(v)≤2n−1d(v) \le 2n-1d(v)≤2n−1 for every vertex.
  • Lemma 3.8 (p. 927): at most 2n−12n-12n−1 relabelings per vertex and at most (2n−1)(n−2)<2n2(2n-1)(n-2) < 2n^2(2n−1)(n−2)<2n2 in total.
  • Lemma 4.3 (p. 930): at most 4n24n^24n2 passes over the queue.

Significance

Corollary 4.4 is the combinatorial core of Theorem 4.5, which states that the FIFO algorithm runs in O(n3)O(n^3)O(n3) time. Theorem 4.2 shows that the remaining work of the implementation is O(nm)O(nm)O(nm) plus constant time per nonsaturating push. The bound of Corollary 4.4 is therefore what separates the O(n3)O(n^3)O(n3) FIFO method from the O(n2m)O(n^2 m)O(n2m) bound of the generic method, which matters on dense networks. The same pass-counting argument is reused for the parallel algorithm of §6 and underlies later analyses of highest-label and wave variants.

The results are proved in the paper. Formalizing them adds an analysis of a push–relabel algorithm, which the platform does not yet have. Its existing network-flow material states max-flow min-cut and Ford–Fulkerson termination in an arc-based model with nonnegative flows (the Introduction to Linear Optimization missions). The mission builds a precise operational model of the FIFO implementation, with edge lists, current edges and a queue carrying pass numbers, and states an explicit operation count for it. A companion mission in this series treats the generic algorithm's correctness and its (2n−1)(n−2)+2nm+4n2m(2n-1)(n-2) + 2nm + 4n^2m(2n−1)(n−2)+2nm+4n2m operation bound.

Difficulty

The obvious argument is the potential-function count of §3, over the sum of the labels of active vertices. It yields only 4n2m4n^2 m4n2m and does not use the queue discipline at all. The 4n34n^34n3 bound has to charge nonsaturating pushes to passes over the queue, and then bound the number of passes by the total growth of the labels. Neither step is visible in the generic algorithm, because both depend on the order in which vertices are processed.

Making this rigorous requires invariants of the implementation that the paper uses silently:

  • a vertex is in the queue exactly when it is active, and at most once;
  • pass numbers are nondecreasing along the queue;
  • current edges only move forward between relabelings.

Lemma 4.1 in particular depends on the current-edge scan: an edge passed over earlier stays inadmissible until vvv is relabeled.

Formalization scope

The Lean development works in namespace GoldbergTarjan.FIFO. Vertices form a type V with [Fintype V] [DecidableEq V], and nnn is Fintype.card V. Capacities are c : V → V → ℝ with c ≥ 0 and c v v = 0. Flows are antisymmetric real functions on all ordered pairs, not nonnegative arc flows. Excess is computed from the flow. Labels are in ℕ∞, and the empty minimum in relabel is ⊤.

The state of the algorithm consists of the flow, the labels, the current-edge index cur v into the edge list L v, and the queue Q : List (V × ℕ), each entry tagged with its pass number. Push/relabel (Fig. 3) is a total function, and a discharge (Fig. 4) is a relation carrying the number of push/relabel operations it performs. A run consists of the states S 0, …, S K with S 0 the initial state and consecutive states related by one discharge. The printed variant of Fig. 4, which stops as soon as vvv is relabeled, is the one formalized. Counts are natural numbers over all push/relabel operations of all discharges. The number of passes is the largest pass tag of a discharged entry.

All constants are explicit, exactly as printed:

  • 2n−12n-12n−1 (Lemmas 3.7, 3.8);
  • (2n−1)(n−2)(2n-1)(n-2)(2n−1)(n−2) and 2n22n^22n2 (Lemma 3.8);
  • 4n24n^24n2 (Lemma 4.3);
  • 4n34n^34n3 (Corollary 4.4).

No asymptotic notation is used, and no m≥n−1m \ge n-1m≥n−1 assumption is made.

A model without current edges, where relabeling happens whenever no push applies, would make Lemma 4.1 vacuous and change the algorithm. Pass numbers that are not propagated by the "added during pass iii" rule would make the pass count arbitrary. Both are ruled out by the definitions. A sorry-free check, outside the proposal, exhibits a three-vertex network with two legal discharges, two passes and no nonsaturating push, so the run hypotheses are satisfiable.

Reusable beyond this mission are the network, preflow, push and relabel definitions and Lemma 3.5, which is about an arbitrary preflow. Contributions welcome: invariants of FIFO runs (preflow, valid labeling, queue = active set, cur within bounds), proofs of the milestones, and the reduction of Corollary 4.4 to Lemma 4.3.

Selected references

  • A. V. Goldberg, R. E. Tarjan, A New Approach to the Maximum-Flow Problem, Journal of the ACM 35(4):921–940, 1988. https://doi.org/10.1145/48014.61051
  • A. V. Karzanov, Determining the maximal flow in a network by the method of preflows, Soviet Math. Doklady 15:434–437, 1974.
  • Y. Shiloach, U. Vishkin, An O(n² log n) parallel max-flow algorithm, Journal of Algorithms 3(2):128–146, 1982. https://doi.org/10.1016/0196-6774(82)90013-X
  • L. R. Ford, D. R. Fulkerson, Maximal flow through a network, Canadian Journal of Mathematics 8:399–404, 1956. https://doi.org/10.4153/CJM-1956-045-5
  • J. Edmonds, R. M. Karp, Theoretical improvements in algorithmic efficiency for network flow problems, Journal of the ACM 19(2):248–264, 1972. https://doi.org/10.1145/321694.321699
10 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimizationTheoretical Computer Science·Captain: mikedeng1

A New Approach to the Maximum-Flow Problem 1: The Generic Push-Relabel Algorithm and Its Operation BoundResearch Paper

Motivation

The maximum-flow problem asks how much of a commodity can be sent from a source to a sink through a network whose edges have capacities. It is a basic model in operations research (transportation, scheduling, bipartite matching) and a standard subroutine in combinatorial optimization.

Classical algorithms, from Ford and Fulkerson (1956) through Edmonds–Karp and Dinic (1970–1972) and Karzanov (1974), increase a feasible flow along augmenting paths or blocking flows. Goldberg and Tarjan, A New Approach to the Maximum-Flow Problem (J. ACM 35(4), 1988, doi:10.1145/48014.61051), replaced this global view by a local one: the push-relabel method maintains a preflow, which may violate conservation at intermediate vertices, and moves excess along edges toward vertices with smaller distance labels. The generic method, with the basic operations applied in any order, is the starting point of the FIFO, highest-label and dynamic-tree implementations analysed later in the same paper, and push-relabel codes remain among the fastest practical maximum-flow solvers.

This mission formalizes §2–§3 of the paper: the generic algorithm is correct, and it stops after a number of basic operations bounded by an explicit polynomial in the numbers of vertices and edges, whatever order of operations is chosen.

Setting

A flow network has a finite vertex set VVV with n=∣V∣n = |V|n=∣V∣, a source sss and a sink t≠st \ne st=s, and a capacity c(v,w)≥0c(v,w) \ge 0c(v,w)≥0 for every ordered pair of vertices, positive exactly on the edges E={(v,w):c(v,w)>0}E = \{(v,w) : c(v,w) > 0\}E={(v,w):c(v,w)>0}; m=∣E∣m = |E|m=∣E∣, and there are no loops, c(v,v)=0c(v,v) = 0c(v,v)=0.

Flows are real functions on all vertex pairs. A function fff satisfies the capacity constraint if f(v,w)≤c(v,w)f(v,w) \le c(v,w)f(v,w)≤c(v,w) and antisymmetry if f(v,w)=−f(w,v)f(v,w) = -f(w,v)f(v,w)=−f(w,v) for all pairs. The excess of vvv is e(v)=∑uf(u,v)e(v) = \sum_{u} f(u,v)e(v)=∑u​f(u,v). A flow also has e(v)=0e(v) = 0e(v)=0 for v∉{s,t}v \notin \{s,t\}v∈/{s,t}; a preflow only e(v)≥0e(v) \ge 0e(v)≥0 for v≠sv \ne sv=s. The value of a flow is ∣f∣=∑vf(v,t)|f| = \sum_v f(v,t)∣f∣=∑v​f(v,t), and a maximum flow is a flow of maximum value.

The residual capacity is rf(v,w)=c(v,w)−f(v,w)r_f(v,w) = c(v,w) - f(v,w)rf​(v,w)=c(v,w)−f(v,w); pairs with rf(v,w)>0r_f(v,w) > 0rf​(v,w)>0 are the edges of the residual graph GfG_fGf​. A valid labeling is d:V→N∪{∞}d : V \to \mathbb{N} \cup \{\infty\}d:V→N∪{∞} with d(s)=nd(s) = nd(s)=n, d(t)=0d(t) = 0d(t)=0 and d(v)≤d(w)+1d(v) \le d(w) + 1d(v)≤d(w)+1 on every residual edge. A vertex vvv is active if v∉{s,t}v \notin \{s,t\}v∈/{s,t}, d(v)<∞d(v) < \inftyd(v)<∞ and e(v)>0e(v) > 0e(v)>0.

The two basic operations (Fig. 1 of the paper) are:

  • Push(v,w)(v,w)(v,w), applicable when vvv is active, rf(v,w)>0r_f(v,w) > 0rf​(v,w)>0 and d(v)=d(w)+1d(v) = d(w)+1d(v)=d(w)+1: send δ=min⁡(e(v),rf(v,w))\delta = \min(e(v), r_f(v,w))δ=min(e(v),rf​(v,w)), i.e. f(v,w)+=δf(v,w) \mathrel{+}= \deltaf(v,w)+=δ, f(w,v)−=δf(w,v) \mathrel{-}= \deltaf(w,v)−=δ. It is saturating if rf(v,w)=0r_f(v,w) = 0rf​(v,w)=0 afterwards and nonsaturating otherwise.
  • Relabel(v)(v)(v), applicable when vvv is active and d(v)≤d(w)d(v) \le d(w)d(v)≤d(w) for every residual edge (v,w)(v,w)(v,w): set d(v)←min⁡{d(w)+1:(v,w)∈Ef}d(v) \leftarrow \min\{d(w)+1 : (v,w) \in E_f\}d(v)←min{d(w)+1:(v,w)∈Ef​} (∞\infty∞ if there is none).

The generic algorithm (Fig. 2) starts from the preflow that saturates every edge leaving sss and is zero elsewhere, with the simple labeling d(s)=nd(s) = nd(s)=n, d(v)=0d(v) = 0d(v)=0 otherwise, and applies applicable basic operations in any order while one exists. An execution with KKK basic operations is a sequence of states (f0,d0),…,(fK,dK)(f_0,d_0),\dots,(f_K,d_K)(f0​,d0​),…,(fK​,dK​) from the initial state, each obtained from the previous one by one applicable operation.

Formalization targets

Goal: Theorems 3.11 and 3.4

Assume the paper's standing assumption m≥n−1m \ge n-1m≥n−1. For every execution with KKK basic operations,

K≤(2n−1)(n−2)+2nm+4n2m,K \le (2n-1)(n-2) + 2nm + 4n^2 m,K≤(2n−1)(n−2)+2nm+4n2m,

and if no basic operation applies in the final state, then fKf_KfK​ is a maximum flow. The paper states the bound as O(n2m)O(n^2m)O(n2m) and proves it as "immediate from Lemmas 3.8, 3.9, and 3.10"; the goal states the sum of those three printed bounds. Since every execution is this short, no order of operations runs forever.

Milestones

In the order the proof uses them: Lemma 2.1 (at an active vertex a push or a relabel applies); Lemma 3.1 (the labeling stays valid); Theorem 3.2 (Ford–Fulkerson: a flow is maximum iff ttt is unreachable from sss in GfG_fGf​); Lemma 3.3 (under a valid labeling ttt is unreachable from sss); Lemma 3.5 (from any vertex with positive excess, sss is reachable); Lemma 3.6 (labels never decrease; a relabeling increases the label); Lemma 3.7 (d(v)≤2n−1d(v) \le 2n-1d(v)≤2n−1 throughout); Theorem 3.4 (termination with finite labels gives a maximum flow); Lemma 3.8 (≤2n−1\le 2n-1≤2n−1 relabelings per vertex, ≤(2n−1)(n−2)<2n2\le (2n-1)(n-2) < 2n^2≤(2n−1)(n−2)<2n2 in total); Lemma 3.9 (≤2nm\le 2nm≤2nm saturating pushes); Lemma 3.10 (≤4n2m\le 4n^2m≤4n2m nonsaturating pushes, under m≥n−1m \ge n-1m≥n−1). A further, non-milestone item states the unnumbered invariant that every fkf_kfk​ is a preflow.

Significance

The generic bound shows that push-relabel terminates in a polynomial number of steps without any rule for choosing the next operation; the specific orderings of §4–§5 of the paper (first-in first-out, O(n3)O(n^3)O(n3); dynamic trees, O(nmlog⁡(n2/m))O(nm\log(n^2/m))O(nmlog(n2/m))) refine only the count of nonsaturating pushes, and reuse Lemmas 3.1–3.9 unchanged. The correctness argument, a valid labeling excludes augmenting paths, is the template for the push-relabel minimum-cost flow and assignment algorithms that followed.

These results are proved in the paper and are textbook material. Their machine-checked counterparts are, as far as is known here, not on the Prove2Me platform: the platform's network-flow statements (from Introduction to Linear Optimization, e.g. LinearOptimization.max_flow_min_cut) use a different model, with arc-indexed nonnegative flows and extended-real capacities, and contain nothing about preflows, labels or operation counts. This mission produces a formal account of the antisymmetric-flow model, of Ford–Fulkerson in that model, and of the amortized counting arguments, with the constants the paper prints.

Difficulty

The correctness half is short once the invariants are in place; the difficulty is in the counting. The label bound (Lemma 3.7) is a statement about the whole execution, and it depends on a structural fact about preflows (Lemma 3.5) whose truth rests on antisymmetry and on the nonnegativity of excesses. The obvious first idea for the push counts, bounding pushes per edge or per vertex locally, fails for nonsaturating pushes: flow pushed across a pair can be pushed back later, and nothing local limits how often this happens, so Lemma 3.10 holds only as an amortized statement over the entire execution and depends on both earlier counts. Saturating pushes on a pair can also recur, in both directions, and Lemma 3.9 has to control the interaction between the two directions.

Formally, all of this is reasoning about arbitrary interleavings of operations, with labels in N∪{∞}\mathbb{N} \cup \{\infty\}N∪{∞} and real-valued flows.

Formalization scope

  • Vertices form a finite type with decidable equality; nnn is its cardinality, s≠ts \ne ts=t, so n≥2n \ge 2n≥2 and the natural-number subtractions 2n−12n-12n−1 and n−2n-2n−2 are exact. Capacities are a real function on all pairs, nonnegative, zero on the diagonal; EEE is its support and mmm its cardinality.
  • Flows and preflows are antisymmetric real functions on all pairs (not nonnegative arc flows); the excess is computed from fff, never stored. A maximum flow is a flow whose value is at least that of every flow.
  • Labels live in ℕ∞, with ∞+1=∞\infty + 1 = \infty∞+1=∞; the relabel value is an infimum, which is ∞\infty∞ on the empty set.
  • An execution is a sequence of states σ : ℕ → State V with a length KKK, starting at the Fig. 2 state with the simple labeling (the paper's own assumption for its proofs), each step an applicable push or relabel. "Terminates" means that no basic operation applies, the loop guard of Fig. 2. The three counts are cardinalities of the sets of step indices of each kind.
  • Explicit constants: 2n−12n-12n−1 per-vertex relabelings, (2n−1)(n−2)<2n2(2n-1)(n-2) < 2n^2(2n−1)(n−2)<2n2 total relabelings, 2nm2nm2nm saturating pushes, 4n2m4n^2m4n2m nonsaturating pushes, label bound 2n−12n-12n−1, and the total (2n−1)(n−2)+2nm+4n2m(2n-1)(n-2)+2nm+4n^2m(2n−1)(n−2)+2nm+4n2m. The standing assumption m≥n−1m \ge n-1m≥n−1 appears only on Lemma 3.10 and the goal.
  • A trivializing formalization is ruled out: the step relation fixes the pushed amount δ=min⁡(e(v),rf(v,w))\delta = \min(e(v), r_f(v,w))δ=min(e(v),rf​(v,w)) and the new label exactly as in Fig. 1, termination is the loop guard rather than "the result is a flow", and a sorry-free check exhibits a concrete network s→a→ts \to a \to ts→a→t with a two-step execution (relabel aaa, then push (a,t)(a,t)(a,t)), so the run hypotheses are satisfiable.

Welcome contributions: proofs of the invariants (preflow, valid labeling, label monotonicity), of Ford–Fulkerson for antisymmetric flows (reusable beyond this mission), and of the counting lemmas. The FIFO bound of §4 is the subject of a companion mission.

Selected references

  • A. V. Goldberg, R. E. Tarjan, A New Approach to the Maximum-Flow Problem, Journal of the ACM 35(4):921–940, 1988. doi:10.1145/48014.61051
  • L. R. Ford, D. R. Fulkerson, Flows in Networks, Princeton University Press, 1962.
  • J. Edmonds, R. M. Karp, Theoretical improvements in algorithmic efficiency for network flow problems, Journal of the ACM 19(2):248–264, 1972. doi:10.1145/321694.321699
  • R. K. Ahuja, T. L. Magnanti, J. B. Orlin, Network Flows: Theory, Algorithms, and Applications, Prentice Hall, 1993.
17 thms3 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Theoretical Improvements in Algorithmic Efficiency for Network Flow Problems 2: The Augmentation Bound for Maximum-Augmentation PathsResearch Paper

Motivation

The maximum flow problem asks how much of a commodity can be sent from a source to a sink through a network whose arcs have capacities. It underlies bipartite matching, transportation, scheduling and many reductions in combinatorial optimization. The classical method for it, the labeling method of Ford and Fulkerson (Flows in Networks, 1962), repeatedly finds an augmenting path and pushes flow along it. With integer capacities it terminates, but the number of augmentations can be as large as the maximum flow value itself, and Edmonds and Karp exhibit a four-node network on which this happens (p. 250). With irrational capacities the method need not terminate at all.

Edmonds and Karp, Theoretical Improvements in Algorithmic Efficiency for Network Flow Problems, J. ACM 19(2):248–264, 1972 (doi:10.1145/321694.321699), showed that two simple rules for choosing the augmenting path repair this. The first, augmenting along a path with fewest arcs, is the subject of mission 1 of this series. This mission covers the second (§1.3): augment along a path that gives the largest possible augmentation. For integer capacities the number of augmentations then grows only logarithmically in the maximum flow value.

Setting

A network NNN has a finite set VVV of nodes, a source sss and a sink t≠st \neq st=s, and a set of arcs, ordered pairs (u,v)(u,v)(u,v) with u≠vu \neq vu=v, at most one from each node to another. One arc is the return arc (t,s)(t,s)(t,s); the other arcs form the set AAA, and each (u,v)∈A(u,v) \in A(u,v)∈A has a capacity c(u,v)>0c(u,v) > 0c(u,v)>0. A flow is a nonnegative function fff on the arcs of NNN with f(u,v)≤c(u,v)f(u,v) \le c(u,v)f(u,v)≤c(u,v) on AAA and flow conservation at every node, sss and ttt included. Its value is f(t,s)f(t,s)f(t,s), the flow returned along the return arc; a maximum flow has the largest value among all flows, and f∗(t,s)f^*(t,s)f∗(t,s) denotes that value.

The residual network NfN^fNf has an arc (u,v)(u,v)(u,v) whenever (u,v)∈A(u,v) \in A(u,v)∈A and c(u,v)−f(u,v)>0c(u,v) - f(u,v) > 0c(u,v)−f(u,v)>0, or (v,u)∈A(v,u) \in A(v,u)∈A and f(v,u)>0f(v,u) > 0f(v,u)>0. An augmenting path is a directed path s=u1,…,up=ts = u_1, \dots, u_p = ts=u1​,…,up​=t of distinct nodes in NfN^fNf. Each of its arcs (u,v)(u,v)(u,v) has a residual amount e(u,v)e(u,v)e(u,v), equal to c(u,v)−f(u,v)c(u,v) - f(u,v)c(u,v)−f(u,v), f(v,u)f(v,u)f(v,u), or c(u,v)−f(u,v)+f(v,u)c(u,v) - f(u,v) + f(v,u)c(u,v)−f(u,v)+f(v,u) according to which of (u,v)(u,v)(u,v), (v,u)(v,u)(v,u) lie in AAA, and the path's augmentation is ε=min⁡e(ui,ui+1)\varepsilon = \min e(u_i, u_{i+1})ε=mine(ui​,ui+1​). Augmenting increases f(t,s)f(t,s)f(t,s) by ε\varepsilonε and changes the flow on the arcs of the path accordingly, with the paper's own rule when both (u,v)(u,v)(u,v) and (v,u)(v,u)(v,u) are arcs. The labeling method produces flows f0,f1,…f^0, f^1, \dotsf0,f1,… by augmenting along a path relative to fkf^kfk as long as one exists.

The rule studied here chooses, at every step, an augmenting path whose ε\varepsilonε is at least that of every other augmenting path relative to the current flow. The bound involves an integer M>1M > 1M>1 such that every partition of the nodes into X∋sX \ni sX∋s and Xˉ∋t\bar X \ni tXˉ∋t has at most MMM arcs of NNN with one end on each side.

Formalization targets

Goal: Theorem 2 (p. 253)

For a network with integer capacities, MMM as above, and a run f0,…,fKf^0, \dots, f^Kf0,…,fK of the labeling method with maximum augmentations started from an integer-valued flow,

K  ≤  1+log⁡M/(M−1)f∗(t,s),K \;\le\; 1 + \log_{M/(M-1)} f^*(t,s),K≤1+logM/(M−1)​f∗(t,s),

and if no augmenting path relative to fKf^KfK exists, then fKf^KfK is a maximum flow.

Milestones

The milestone list follows the paper's argument:

  1. augmentation produces a flow of value f(t,s)+εf(t,s) + \varepsilonf(t,s)+ε (§1.1, p. 249);
  2. a flow is maximum if and only if it has no augmenting path (§1.1, pp. 249–250);
  3. with integer capacities, ε\varepsilonε is a positive integer and the flows of the method stay integer-valued (§1.1, p. 250);
  4. the cut inequality c(X,Xˉ)≥f(X,Xˉ)−f(Xˉ,X)=f(t,s)c(X,\bar X) \ge f(X,\bar X) - f(\bar X,X) = f(t,s)c(X,Xˉ)≥f(X,Xˉ)−f(Xˉ,X)=f(t,s) (p. 254);
  5. f∗(t,s)−fk(t,s)≤εkMf^*(t,s) - f^k(t,s) \le \varepsilon^k Mf∗(t,s)−fk(t,s)≤εkM, where εk=fk+1(t,s)−fk(t,s)\varepsilon^k = f^{k+1}(t,s) - f^k(t,s)εk=fk+1(t,s)−fk(t,s) (p. 254);
  6. f∗(t,s)−fk+1(t,s)≤[f∗(t,s)−fk(t,s)](1−M−1)f^*(t,s) - f^{k+1}(t,s) \le [f^*(t,s) - f^k(t,s)](1 - M^{-1})f∗(t,s)−fk+1(t,s)≤[f∗(t,s)−fk(t,s)](1−M−1) (p. 254);
  7. f∗(t,s)−fk(t,s)≤f∗(t,s)(1−M−1)kf^*(t,s) - f^k(t,s) \le f^*(t,s)(1 - M^{-1})^kf∗(t,s)−fk(t,s)≤f∗(t,s)(1−M−1)k (p. 254).

Significance

Theorem 2 was among the first bounds showing that a maximum flow algorithm can be made polynomial in the size of the numbers rather than in their values: since M≤n2/2M \le n^2/2M≤n2/2 and f∗(t,s)f^*(t,s)f∗(t,s) is at most n2n^2n2 times the average capacity, the bound is O(n2log⁡(n2cˉ))O(n^2 \log(n^2 \bar c))O(n2log(n2cˉ)) in terms of the number of nodes nnn and the average capacity cˉ\bar ccˉ (p. 254). The largest-augmentation rule, often called the fattest-path or maximum-capacity augmenting path rule, is a standard textbook variant, and its geometric-decrease argument is the model for later capacity-scaling methods, including the scaling algorithm for the Hitchcock problem in §2 of the same paper (mission 3 of this series).

The theorem has been proved since 1972 and appears in standard texts. As far as a platform search shows (2026-09-26), no machine-checked proof of it exists on Prove2Me. The platform does contain LinearOptimization.max_flow_min_cut and LinearOptimization.max_flow_ford_fulkerson_integer_termination, which state max-flow min-cut and termination of the generic method in a different network model (parallel arcs, extended nonnegative capacities, no return arc); they give no count of augmentations and are related work only. This mission would contribute a formal proof of the counting bound together with the general labeling-method facts (milestones 1–3), which mission 1 needs as well.

Difficulty

The obvious argument, that each augmentation raises the value by at least 1, gives only the bound f∗(t,s)f^*(t,s)f∗(t,s), and on the four-node example of p. 250 that bound is attained by an arbitrary choice of paths. The logarithmic bound needs a lower bound on the size of the largest augmentation in terms of the remaining gap f∗(t,s)−fk(t,s)f^*(t,s) - f^k(t,s)f∗(t,s)−fk(t,s). The largest augmentation is defined by comparison with all augmenting paths relative to the current flow, while the gap is a global quantity of the network, and neither integrality nor the maximum-augmentation rule alone controls it. Milestone 2's converse, that a non-maximum flow always admits an augmenting path, is itself the max-flow min-cut theorem in this model, and the formal proof has to establish it for the paper's return-arc model rather than import it from a different one.

Formalization scope

  • Nodes form a finite type V with decidable equality. A : Finset (V × V) contains no loops and not (t,s)(t,s)(t,s). Capacities are real, c : V → V → ℝ, positive on A. Integrality is the hypothesis IntegralCaps N, and for the initial flow IsIntegralOn N (f 0) (integer values on the arcs of NNN, the return arc included).
  • Flows are functions V → V → ℝ constrained only on the arcs of NNN. A maximum flow is the predicate IsMaxFlow, comparing f(t,s)f(t,s)f(t,s) with every flow, not a supremum. The goal takes a maximum flow g as a hypothesis and sets f∗(t,s)=g(t,s)f^*(t,s) = g(t,s)f∗(t,s)=g(t,s); every network has one.
  • Augmenting paths are duplicate-free node lists whose consecutive pairs are arcs of NfN^fNf. The page prints Case (b) of the definition of εi\varepsilon_iεi​ with the same hypothesis as Case (c); the corrected Case (b), (u,v)∉A(u,v) \notin A(u,v)∈/A and (v,u)∈A(v,u) \in A(v,u)∈A, is used, as the definition of NfN^fNf (p. 251) and the list for e(u,v)e(u,v)e(u,v) (p. 253) confirm.
  • A run is IsMaxAugRun N K f P. Its initial flow is arbitrary except for integrality, and each later flow is the augmentation of the previous one along a path of maximum ε\varepsilonε among all augmenting paths.
  • The crossing bound CrossArcsBounded N M counts the arcs of NNN, return arc included, with one end on each side of every sss–ttt partition. This is the literal reading of p. 253.
  • Explicit constants. The bound is exactly 1+log⁡M/(M−1)f∗(t,s)1 + \log_{M/(M-1)} f^*(t,s)1+logM/(M−1)​f∗(t,s), written (K : ℝ) ≤ 1 + Real.logb ((M : ℝ) / ((M : ℝ) - 1)) (g N.t N.s) with M>1M > 1M>1 a natural number. When f∗(t,s)=0f^*(t,s) = 0f∗(t,s)=0, Real.logb gives 000 and the bound reads K≤1K \le 1K≤1. The contraction factor is 1 - (M : ℝ)⁻¹.
  • A statement that bounds only runs of an unsatisfiable step predicate, drops the integrality of f0f^0f0 or of the capacities (the bound is false without them), or compares ε\varepsilonε only among paths of some restricted class does not formalize Theorem 2. A sorry-free check exhibits a four-node network with integer capacities and a valid maximum-augmentation step.
  • Reusable beyond this mission: the return-arc network model, the augmentation step with the paper's opposite-arc rule, the integrality lemma, and the cut inequality. Proofs of any milestone are welcome, as are proofs of the converse in milestone 2 that could later be shared with mission 1.

Selected references

  • J. Edmonds, R. M. Karp, Theoretical Improvements in Algorithmic Efficiency for Network Flow Problems, Journal of the ACM 19(2):248–264, 1972. https://doi.org/10.1145/321694.321699
  • L. R. Ford, D. R. Fulkerson, Flows in Networks, RAND report R-375-PR, 1962; Princeton University Press, 1962. https://www.rand.org/pubs/reports/R375.html
11 thms3 active usersReviewed
🏆Completed
CombinatoricsDynamic ProgrammingOperations Research·Captain: mikedeng1

The Steiner Problem in Graphs: Algorithm A Computes the Length of the Steiner TreeResearch Paper

Motivation

The Steiner problem in graphs asks for the cheapest way to connect a prescribed set of nodes of a network, where intermediate nodes may be used freely. It is the network version of the classical Euclidean Steiner tree problem surveyed by Gilbert and Pollak (SIAM J. Appl. Math. 16, 1968), and it arises wherever a few sites must be joined through an existing network at minimum total cost: communication and pipeline layout, VLSI routing, and phylogenetics. With two terminals it is the shortest-path problem; with all nodes as terminals it is the minimum spanning tree problem; in between it is NP-hard.

Dreyfus and Wagner (Networks 1(3):195–207, 1971) gave the first exact algorithm whose running time is exponential only in the number kkk of terminals and polynomial in the number nnn of nodes. The paper states it, as Algorithm A, together with its proof of correctness and an exact count of its elementary operations.

Timeline. 1968: Gilbert and Pollak survey Steiner minimal trees. 1971: Dreyfus and Wagner, a dynamic program over subsets of terminals running in time proportional to n3/2+n2(2k−1−k−1)+n(3k−1−2k+3)/2n^3/2 + n^2(2^{k-1}-k-1) + n(3^{k-1}-2^k+3)/2n3/2+n2(2k−1−k−1)+n(3k−1−2k+3)/2. 1987: Erickson, Monma and Veinott give the same subset recursion for general network flow problems. 2007: Björklund, Husfeldt, Kaski and Koivisto (STOC 2007) improve the exponential dependence on kkk for small integer weights. The Dreyfus–Wagner recursion remains the standard exact method and the basis of the fixed-parameter tractability of the problem in kkk.

Setting

A graph G=(N,A)G = (N, A)G=(N,A) has a finite set NNN of nodes and a set AAA of undirected arcs, each arc aaa having a positive length ∣a∣|a|∣a∣; GGG is connected. For a set S⊆AS \subseteq AS⊆A of arcs, ∣S∣=∑s∈S∣s∣|S| = \sum_{s \in S} |s|∣S∣=∑s∈S​∣s∣. A set SSS connects a node set XXX if all members of XXX are joined by paths composed only of arcs in SSS.

Given Y⊆NY \subseteq NY⊆N, a Steiner path (or Steiner tree) connecting YYY is a set S⊆AS \subseteq AS⊆A that connects YYY with ∣S∣|S|∣S∣ minimum. Its length is the Steiner length St⁡(Y)\operatorname{St}(Y)St(Y). For nodes i,ji, ji,j, D(i,j)D(i,j)D(i,j) is the length of a shortest path from iii to jjj; D(i,j)=St⁡({i,j})D(i,j) = \operatorname{St}(\{i,j\})D(i,j)=St({i,j}).

Algorithm A fixes a linear order of NNN (so that each nonempty set DDD has a first element D[1]D[1]D[1]), picks q∈Yq \in Yq∈Y, sets C=Y−{q}C = Y - \{q\}C=Y−{q}, and fills a table S[D,I]S[D, I]S[D,I] for nonempty D⊊CD \subsetneq CD⊊C and I∈NI \in NI∈N:

S[{t},I]=D(t,I),S[D,I]=min⁡J∈N(D(I,J)+min⁡D[1]∈E⊊D(S[E,J]+S[D−E,J])),S[\{t\}, I] = D(t, I), \qquad S[D, I] = \min_{J \in N}\Big(D(I,J) + \min_{D[1] \in E \subsetneq D}\big(S[E,J] + S[D-E,J]\big)\Big),S[{t},I]=D(t,I),S[D,I]=J∈Nmin​(D(I,J)+D[1]∈E⊊Dmin​(S[E,J]+S[D−E,J])),

and returns

v=min⁡J∈N(D(q,J)+min⁡C[1]∈E⊊C(S[E,J]+S[C−E,J])).v = \min_{J \in N}\Big(D(q,J) + \min_{C[1] \in E \subsetneq C}\big(S[E,J] + S[C-E,J]\big)\Big).v=J∈Nmin​(D(q,J)+C[1]∈E⊊Cmin​(S[E,J]+S[C−E,J])).

A minimum over an empty set is +∞+\infty+∞. In the Lean development these objects are steinerLength, pathDist, tableA and algorithmA in the namespace DreyfusWagner.Steiner.

Formalization targets

Goal: Algorithm A is exact

For every finite connected graph with positive arc lengths, every linear order on its nodes, every YYY with ∥Y∥≥3\|Y\| \ge 3∥Y∥≥3 and every q∈Yq \in Yq∈Y,

v=St⁡(Y).v = \operatorname{St}(Y).v=St(Y).

This is the caption of Algorithm A ("Computes the length of the Steiner tree connecting YYY", p. 203). The statement is an equality, not a bound.

Milestones

In the order the proof uses them:

  1. A Steiner path is a tree (§1, p. 197): a minimum connecting arc set contains no cycle.
  2. The two-node case (Appendix A, p. 205): St⁡({i,j})=D(i,j)\operatorname{St}(\{i,j\}) = D(i,j)St({i,j})=D(i,j).
  3. Theorem 1 (Appendix A, p. 206): for a Steiner tree SSS, a node xxx on it, and a set CCC of arcs of SSS at xxx, the arcs of SSS connecting xxx to the terminals reached through CCC form a Steiner tree for those terminals together with xxx.
  4. Optimal Decomposition Theorem (Appendix A, p. 206): if ∥Y∥≥3\|Y\| \ge 3∥Y∥≥3 and q∈Yq \in Yq∈Y, a Steiner tree for YYY splits into three disjoint Steiner paths, for {p,q}\{p,q\}{p,q}, {p}∪D\{p\} \cup D{p}∪D and {p}∪(Y−D−{q})\{p\} \cup (Y - D - \{q\}){p}∪(Y−D−{q}), where p∈Np \in Np∈N and ∅≠D⊊Y−{q}\emptyset \ne D \subsetneq Y - \{q\}∅=D⊊Y−{q}.
  5. The recurrence (§2, pp. 199–200): for ∥D∥≥2\|D\| \ge 2∥D∥≥2 and any node mmm,
St⁡({m}∪D)=min⁡k∈N(D(m,k)+min⁡∅≠E⊊D(St⁡({k}∪E)+St⁡({k}∪(D−E)))).\operatorname{St}(\{m\} \cup D) = \min_{k \in N}\Big(D(m,k) + \min_{\emptyset \ne E \subsetneq D}\big(\operatorname{St}(\{k\} \cup E) + \operatorname{St}(\{k\} \cup (D - E))\big)\Big).St({m}∪D)=k∈Nmin​(D(m,k)+∅=E⊊Dmin​(St({k}∪E)+St({k}∪(D−E)))).
  1. The table invariant (§2, p. 200): S[D,I]=St⁡({I}∪D)S[D, I] = \operatorname{St}(\{I\} \cup D)S[D,I]=St({I}∪D) for every nonempty DDD and every III.

Two companion items accompany the goal: the numerical illustration of §3 (seven nodes, St⁡(Y)=5\operatorname{St}(Y) = 5St(Y)=5, Algorithm A returns 555), and the exact count of elementary statements of §5, n2(2k−1−k−1)+n(3k−1−2k+3)/2n^2(2^{k-1}-k-1) + n(3^{k-1}-2^k+3)/2n2(2k−1−k−1)+n(3k−1−2k+3)/2.

Significance

The result turns the Steiner problem with few terminals into a polynomial computation in the size of the network: for fixed kkk the running time is O(n3)O(n^3)O(n3) including all-pairs shortest paths. It is the reference exact algorithm against which heuristics and approximation algorithms for Steiner trees are evaluated, a standard example of dynamic programming over subsets, and the origin of the fixed-parameter tractability of the Steiner tree problem parameterized by the number of terminals. The subset recurrence reappears in group Steiner, prize-collecting and directed Steiner variants.

The paper's proof is complete and the result is classical; it has not, to our knowledge, been machine-checked. This mission produces a checked account of the exactness of the recursion: the structural facts about minimum connecting arc sets (acyclicity, optimality of branches, the three-way decomposition) and the passage from these to the algorithm's table. These facts about weighted graphs, minimum connecting arc sets and shortest paths are reusable well beyond this paper.

Difficulty

The upper bound v≥St⁡(Y)v \ge \operatorname{St}(Y)v≥St(Y) is routine: each term of each minimum is the length of some connecting arc set, so no term can beat the optimum. The content is the reverse inequality, which needs the Optimal Decomposition Theorem: one must show that some optimal tree actually splits at a single node ppp into a shortest path to qqq and two optimal subtrees whose terminal sets partition Y−{q}Y - \{q\}Y−{q} into two nonempty parts. The naive choice p=qp = qp=q fails when qqq is a leaf, and the choice of the first branching node fails when the path from qqq meets another terminal first; the paper handles these as separate cases. A second difficulty is the passage from arc sets to trees: minimum connecting sets are forests only because lengths are positive, and "the arcs of SSS involved in connecting" a set of terminals must be identified with a subtree. Finally the table recursion must be matched with the recurrence, including the restriction D[1]∈ED[1] \in ED[1]∈E that enumerates each splitting once.

Formalization scope

Nodes are a finite type V with a LinearOrder (the paper's "(ordered) set"; the goal holds for every order). The graph is a SimpleGraph V with decidable adjacency, arcs are unordered pairs Sym2 V, and lengths are ℓ : Sym2 V → ℝ. Every theorem assumes the paper's standing hypotheses of p. 195: all arcs of GGG have positive length (∀ e ∈ G.edgeSet, 0 < ℓ e) and GGG is connected. The paper allows several arcs between the same two nodes; the simple-graph model keeps one, which does not change any Steiner length since an optimal set uses only the shortest of parallel arcs. Connecting means reachability in the graph formed by the arcs of SSS. Steiner lengths, D(i,j)D(i,j)D(i,j) and all minima of the algorithm take values in WithTop ℝ, where ⊤ is +∞+\infty+∞, ⊤ + x = ⊤ and an empty minimum is ⊤; no real-valued infimum with a junk value is used. D(i,j)D(i,j)D(i,j) is a minimum over paths of GGG.

The goal assumes ∥Y∥≥3\|Y\| \ge 3∥Y∥≥3, the paper's own hypothesis (Appendix A, p. 205). For ∥Y∥=2\|Y\| = 2∥Y∥=2 Algorithm A as printed returns +∞+\infty+∞ because line (18) admits no set EEE; the two-node case is covered by milestone 2. The algorithm is defined from D(i,j)D(i,j)D(i,j), addition and minima only: a formalization in which tableA or algorithmA refers to Steiner lengths, or in which the goal only asserts v≥St⁡(Y)v \ge \operatorname{St}(Y)v≥St(Y), would be trivial and is ruled out. The loop order of lines (4)–(14) is replaced by recursion on ∥D∥\|D\|∥D∥, which the paper states is immaterial (p. 203).

Useful infrastructure: sums of lengths along walks and paths, reachability in edge-subgraphs, acyclicity of minimum connecting sets, and splitting a tree at a node. Contributions of these as reusable lemmas are welcome, as are proofs of individual milestones in any order. Tree reconstruction (§2, p. 200) and the empirical running times (p. 205) are out of scope.

Selected references

  • S. E. Dreyfus, R. A. Wagner, The Steiner Problem in Graphs, Networks 1(3):195–207, 1971. https://doi.org/10.1002/net.3230010302
  • E. N. Gilbert, H. O. Pollak, Steiner Minimal Trees, SIAM Journal on Applied Mathematics 16(1):1–29, 1968. https://doi.org/10.1137/0116001
  • R. W. Floyd, Algorithm 97: Shortest Path, Communications of the ACM 5(6):345, 1962. https://doi.org/10.1145/367766.368168
  • R. E. Erickson, C. L. Monma, A. F. Veinott Jr., Send-and-Split Method for Minimum-Concave-Cost Network Flows, Mathematics of Operations Research 12(4):634–664, 1987. https://doi.org/10.1287/moor.12.4.634
  • A. Björklund, T. Husfeldt, P. Kaski, M. Koivisto, Fourier Meets Möbius: Fast Subset Convolution, STOC 2007, 67–74. https://doi.org/10.1145/1250790.1250801
10 thms3 active usersReviewed
CombinatoricsTheoretical Computer Science·Captain: mikedeng1

Sorting in c log n Parallel Steps: Sorting Networks of Logarithmic DepthResearch Paper

Motivation

A sorting network is a sorting procedure whose sequence of comparisons is fixed in advance, independently of the data. Its depth, the number of rounds of simultaneous comparisons on disjoint pairs, is the parallel running time. Sorting networks are used in parallel and hardware sorting, in switching networks, and in cryptography, where a data-independent (oblivious) sequence of operations is required. How small the depth can be as a function of the number of inputs nnn is a basic question of parallel computation.

Timeline:

  • 1968. Batcher's odd-even merge sort and bitonic sort give networks of depth O((log⁡n)2)O((\log n)^2)O((logn)2) and size O(n(log⁡n)2)O(n(\log n)^2)O(n(logn)2) (K. E. Batcher, Sorting networks and their applications, AFIPS Spring Joint Computer Conference, 1968). For nnn a power of two they remain the best explicit networks in practice.
  • 1973. Knuth's The Art of Computer Programming, Vol. 3, §5.3.4, surveys sorting networks. A simple counting argument gives the lower bound: every sorting network has depth at least log⁡2n\log_2 nlog2​n, since each output depends on at most 2depth2^{\text{depth}}2depth inputs.
  • 1983. Ajtai, Komlós and Szemerédi construct networks of depth O(log⁡n)O(\log n)O(logn) and size O(nlog⁡n)O(n\log n)O(nlogn) (Combinatorica 3 (1983) 1–19, doi:10.1007/BF02579338), matching the lower bound up to a constant. The constant is not computed in the paper and is known to be very large.
  • 1990. Paterson simplifies the construction and gives the first explicit, still very large, depth constant (M. S. Paterson, Improved sorting networks with O(log N) depth, Algorithmica 5 (1990) 75–92, doi:10.1007/BF01840378).
  • 2014. Goodrich gives Zig-zag sort, a simpler deterministic data-oblivious sorting algorithm with O(nlog⁡n)O(n\log n)O(nlogn) comparisons that avoids the AKS machinery but is not of logarithmic depth (arXiv:1403.2777).

Setting

There are nnn registers R1,…,RnR_1,\dots,R_nR1​,…,Rn​ holding elements of a linearly ordered set. An elementary step (a comparator) (i,j)(i,j)(i,j) with i≠ji\neq ji=j compares the contents of RiR_iRi​ and RjR_jRj​ and exchanges them if the content of RiR_iRi​ is larger. Afterwards RiR_iRi​ holds the minimum and RjR_jRj​ the maximum of the two, and every other register is unchanged. A parallel step is a set of comparators in which no register occurs twice, so it has at most n/2n/2n/2 comparators. A comparator network NNN is a finite sequence of parallel steps, fixed before the input is seen. Its depth depth⁡(N)\operatorname{depth}(N)depth(N) is the number of parallel steps and its size size⁡(N)\operatorname{size}(N)size(N) the total number of comparators. NNN sorts if for every input x=(x1,…,xn)x=(x_1,\dots,x_n)x=(x1​,…,xn​) the output N(x)N(x)N(x) satisfies N(x)1≤⋯≤N(x)nN(x)_1\le\cdots\le N(x)_nN(x)1​≤⋯≤N(x)n​.

The construction runs on the tree TTT of finite 000-111 sequences, whose levels are ordered lexicographically. A chain on level iii assigns to every node of that level a set of registers, with the sets pairwise disjoint and of a common size N(C)N(C)N(C). A ⟨k, ε⟩ expander on ⟨A, B⟩, for disjoint register sets AAA and BBB, is a bipartite graph between AAA and BBB of maximum degree kkk in which every nonempty X⊆AX\subseteq AX⊆A has more than (1−ε)ε−1min⁡{∣X∣,ε∣B∣}(1-\varepsilon)\varepsilon^{-1}\min\{|X|,\varepsilon|B|\}(1−ε)ε−1min{∣X∣,ε∣B∣} neighbours, and symmetrically for BBB. The Lean development uses the names ComparatorNetwork, compareExchange, IsChain, chainN, IsExpander, IsLowerSection for these objects.

Formalization targets

Goal: the AKS theorem (Abstract and §1, p. 1)

∃ c>0  ∀n≥2  ∃N:N sorts,depth⁡(N)≤clog⁡2n,size⁡(N)≤c nlog⁡2n.\exists\, c>0\ \ \forall n\ge 2\ \ \exists N:\quad N \text{ sorts},\qquad \operatorname{depth}(N)\le c\log_2 n,\qquad \operatorname{size}(N)\le c\,n\log_2 n .∃c>0  ∀n≥2  ∃N:N sorts,depth(N)≤clog2​n,size(N)≤cnlog2​n.

The constant is absolute and is not fixed. Any explicit value would be invalidated by the next improvement, and the paper gives none.

Milestones (the paper's numbered lemmas that hold as stated)

  • Lemma 3 (p. 6): for 0<ε<10<\varepsilon<10<ε<1 and c≥1c\ge1c≥1 there is k(ε,c)k(\varepsilon,c)k(ε,c) such that every pair of disjoint sets with 1/c≤∣A∣/∣B∣≤c1/c\le|A|/|B|\le c1/c≤∣A∣/∣B∣≤c carries a ⟨k,ε⟩\langle k,\varepsilon\rangle⟨k,ε⟩ expander.
  • Lemma 4 (p. 7): performing every comparator of such an expander once, in any order, from AAA to BBB leaves all but an ε\varepsilonε-fraction of any lower section SSS with ∣S∣≤∣A∣|S|\le|A|∣S∣≤∣A∣ in AAA, and symmetrically for upper sections in BBB:
∣S∖Cont(A)∣≤ε∣S∣.|S\setminus\mathrm{Cont}(A)|\le\varepsilon|S| .∣S∖Cont(A)∣≤ε∣S∣.
  • Lemma 1 (pp. 3–4): the splitting V(C,k)V(C,k)V(C,k) of a chain, which moves one register of each leaf set up the tree, produces chains with properties (1.1)–(1.5).
  • Lemma 2 (p. 4): chains W(C,k)W(C,k)W(C,k) with ak−1≤N(W(C,k))≤aka_k-1\le N(W(C,k))\le a_kak​−1≤N(W(C,k))≤ak​ exist under conditions (2a), (2.b).
  • Lemma 12(a) (p. 14): a violation of the order relation RGβR^\beta_GRGβ​ between two nodes of a level is witnessed by two consecutive nodes.

Significance

The result. The AKS theorem settles the asymptotic depth of sorting networks at Θ(log⁡n)\Theta(\log n)Θ(logn) and their size at Θ(nlog⁡n)\Theta(n\log n)Θ(nlogn). It gives an O(log⁡n)O(\log n)O(logn)-time sorting algorithm with nnn processors that performs only data-independent comparisons. It is the standard reference point for oblivious sorting in parallel algorithms, circuit complexity (sorting is in NC1\mathsf{NC}^1NC1 via comparators) and oblivious RAM constructions. Lemma 4, the ε-halver property of expander comparisons, is the component that later constructions (Paterson) reuse.

Formalizing it. The theorem has been proved since 1983. No Lean proof of the AKS theorem is known. Mathlib has no expander graphs in the ⟨k, ε⟩ sense and no sorting networks. The mission asks for a formal proof of the headline theorem by any route (the AKS construction or Paterson's variant), and for formal proofs of the paper's verified lemmas as reusable components. The expander lemma needs either an explicit family (Margulis; Gabber–Galil) or a probabilistic existence argument, both substantial on their own.

Difficulty

Every elementary argument stalls at depth O((log⁡n)2)O((\log n)^2)O((logn)2): recursive merging needs log⁡n\log nlogn merge rounds, and merging two sorted lists by a comparator network needs depth Ω(log⁡n)\Omega(\log n)Ω(logn). A depth of O(log⁡n)O(\log n)O(logn) therefore cannot come from exact merging. It must come from constant-depth approximate operations (ε-halvers, which require bounded-degree expanders) combined with a mechanism that corrects the errors they leave. In the paper this mechanism is a movement of registers up and down a binary tree, controlled by a family of constants chosen in a fixed order ("ε1≪q2≪1−g≪q1≪1/c1≪1\varepsilon_1\ll q_2\ll1-g\ll q_1\ll 1/c_1\ll1ε1​≪q2​≪1−g≪q1​≪1/c1​≪1", p. 2). The accounting that shows the misplaced elements decay geometrically is the hard part. Several intermediate lemmas of the paper are false as printed, so the paper's text is not a checklist to transcribe.

Formalization scope

Conventions committed to in Lean:

  • Registers are Fin n, and contents lie in an arbitrary linearly ordered type. A network is a List of layers, each a List (Fin n × Fin n) of comparators with distinct endpoints, and no register occurs twice in a layer. A comparator (i,j)(i,j)(i,j) puts the minimum into iii, and both directions i<ji<ji<j and i>ji>ji>j are allowed. Sorts means the output is monotone for every linearly ordered type and every input, not only for permutations.
  • log⁡2n\log_2 nlog2​n is Real.logb 2 n, and the goal is stated for n≥2n\ge2n≥2. The constant ccc is quantified before nnn.
  • Tree levels are Fin (2^i), with numeric order equal to lexicographic order. A chain is a Fin (2^i) → Finset R.
  • Definition 2.2 of the paper, read literally, requires ∣Γ∅∣>0|\Gamma_\emptyset|>0∣Γ∅​∣>0, which fails, so no graph would be an expander. The expansion inequalities are imposed on nonempty sets only, and the strict inequality is kept.

Trivializing formalizations are ruled out. The goal is not "for every nnn there is a network of depth O(log⁡n)O(\log n)O(logn)" with the constant chosen after nnn, which is true for trivial reasons. Layers without the disjointness condition would let a single layer contain a whole insertion sort. A bound on the number of comparisons alone, with unbounded depth, is a different and much older result; the goal states both the depth and the size bound.

The mission states the AKS theorem and the paper's lemmas that are correct as stated. It does not formalize the AKS algorithm itself (SαS^\alphaSα, PαP^\alphaPα, the operations CH1–CH4, IMP) or its intermediate Lemmas 5–11 and 13–15. Those depend on unspecified constants constrained only by "sufficiently small" chains, and Lemmas 5, 10 and 12(b) are false as printed. A solver may of course define the algorithm, with pinned constants, as part of a proof.

Contributions welcome: a library of comparator networks (composition, the 0-1 principle, depth of Batcher's networks), existence of bounded-degree bipartite expanders, the ε-halver lemma, and any complete proof of the goal. The network and expander definitions are independent of this paper and reusable.

Selected references

  • M. Ajtai, J. Komlós, E. Szemerédi, Sorting in c log n parallel steps, Combinatorica 3(1) (1983) 1–19. doi:10.1007/BF02579338
  • K. E. Batcher, Sorting networks and their applications, Proc. AFIPS Spring Joint Computer Conference 32 (1968) 307–314. doi:10.1145/1468075.1468121
  • D. E. Knuth, The Art of Computer Programming, Vol. 3: Sorting and Searching, Addison-Wesley, 1973, §5.3.4.
  • G. A. Margulis, Explicit constructions of concentrators, Problems of Information Transmission 9 (1973) 325–332.
  • O. Gabber, Z. Galil, Explicit constructions of linear-sized superconcentrators, J. Computer and System Sciences 22(3) (1981) 407–420. doi:10.1016/0022-0000(81)90040-4
  • M. S. Paterson, Improved sorting networks with O(log N) depth, Algorithmica 5 (1990) 75–92. doi:10.1007/BF01840378
  • M. T. Goodrich, Zig-zag sort: a simple deterministic data-oblivious sorting algorithm running in O(n log n) time, STOC 2014. arXiv:1403.2777
13 thms3 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Shortest Connection Networks And Some Generalizations: Construction Principles P1 and P2 Yield a Shortest Spanning Subtree of Every Connected Labelled GraphResearch Paper

Motivation

Connecting a set of terminals by a network of direct links of least total length is one of the oldest problems of combinatorial optimization. R. C. Prim's 1957 paper in the Bell System Technical Journal (DOI) was motivated by the rate structure for Bell System leased-line services, in which the charge for connecting a set of terminals depends on the length of a shortest network connecting them. The paper states two local construction principles, P1 and P2, and shows that any sequence of their applications produces a shortest network, first for points in the plane and then for arbitrary connected labelled graphs with arbitrary real edge lengths. The paper's §V specialization of the principles, growing a single fragment, is what is now called Prim's algorithm, and its §IV statement is the form of the minimum spanning tree theorem used throughout network design, clustering and approximation algorithms.

Timeline. O. Borůvka (1926) solved the problem for an electrical network in Moravia; V. Jarník (1930) gave the single-fragment procedure; J. B. Kruskal (1956, Proc. AMS 7, 48–50) proved that adding globally shortest links avoiding cycles yields a shortest spanning tree; Prim (1957) gave the more permissive principles P1 and P2, which contain both the Jarník procedure and Kruskal's rule as special orders of application; E. W. Dijkstra (1959) rediscovered the single-fragment procedure.

Setting

Let VVV be a finite set of NNN terminals and GGG a simple graph on VVV, the labelled graph whose edges are the possible links. Each edge eee carries a real length w(e)w(e)w(e); lengths may be negative, zero, or tie. For a finite set FFF of links, H(F)H(F)H(F) denotes the graph on VVV whose edges are the links of FFF.

  • A spanning subtree of GGG is a set FFF of edges of GGG such that H(F)H(F)H(F) is a tree on VVV. Its length is ℓw(F)=∑e∈Fw(e)\ell_w(F) = \sum_{e \in F} w(e)ℓw​(F)=∑e∈F​w(e).
  • A shortest spanning subtree (SSS) is a spanning subtree of least length among all spanning subtrees of GGG. Prim's dictionary is "shortest connection network (SCN) ↔ shortest spanning subtree (SSS)". L(G,w)L(G,w)L(G,w) denotes that least length.
  • Given the links FFF made so far, the connected components of H(F)H(F)H(F) are the isolated terminals (one terminal) and isolated fragments (two or more terminals).
  • Principle 1: any isolated terminal ttt can be connected to a nearest neighbor, a GGG-neighbor nnn with w({t,n})≤w({t,m})w(\{t,n\}) \le w(\{t,m\})w({t,n})≤w({t,m}) for all GGG-neighbors mmm of ttt.
  • Principle 2: any isolated fragment CCC can be connected to a nearest neighbor n∉Cn \notin Cn∈/C by a shortest available link {u,n}\{u,n\}{u,n}, u∈Cu \in Cu∈C; equivalently {u,n}\{u,n\}{u,n} is a shortest edge of GGG with one end in CCC and the other outside.
  • A construction is a sequence of links e0,e1,…e_0, e_1, \dotse0​,e1​,…, each an application of P1 or P2 with respect to the links before it. It is complete when it has N−1N-1N−1 links.

Only edges of GGG are possible links; in Prim's distance table a missing edge has length ∞\infty∞.

Formalization targets

Goal (§IV, p. 1396)

For every finite connected graph GGG and every www,

(∃ a complete construction) ∧ (∀ complete constructions e0,…,eN−2: {e0,…,eN−2} is a SSS of G).\Bigl(\exists\ \text{a complete construction}\Bigr) \ \wedge\ \Bigl(\forall\ \text{complete constructions } e_0,\dots,e_{N-2}:\ \{e_0,\dots,e_{N-2}\} \text{ is a SSS of } G\Bigr).(∃ a complete construction) ∧ (∀ complete constructions e0​,…,eN−2​: {e0​,…,eN−2​} is a SSS of G).

This is the sentence "P1 and P2 will provide a SSS for any connected labelled graph with any set of real edge lengths." It fixes nothing about the order of applications, the component chosen, or the tie-breaking.

Milestones

  1. Counting (§II, p. 1392): after any construction with kkk links, H(F)H(F)H(F) is acyclic with N−kN-kN−k components; a complete construction is a spanning subtree; a construction with fewer than N−1N-1N−1 links can be extended.
  2. Necessary Condition 1 (p. 1392): every terminal of a SSS is linked in it to at least one nearest neighbor.
  3. Necessary Condition 2 (p. 1392): every fragment SSS of a SSS, ∅≠S≠V\emptyset \ne S \ne V∅=S=V, is linked in it to a nearest neighbor by a shortest available link.
  4. Distinct lengths (§III, p. 1393): if the edge lengths are pairwise distinct, every link of every construction belongs to every SSS.
  5. Continuity (§III, p. 1394): w↦L(G,w)w \mapsto L(G,w)w↦L(G,w) is continuous.

Significance

The goal is the correctness theorem of a whole family of greedy minimum spanning tree procedures at once: Jarník–Prim (one growing fragment), Kruskal (globally shortest link first) and Borůvka-style interleavings all produce sequences of P1/P2 applications. Because lengths are arbitrary reals, it also covers maximum spanning trees by a sign change (p. 1397) and graphs that are not complete.

The result is classical and fully proved in the literature. What this mission adds is a machine-checked statement in exactly Prim's generality. Mathlib has spanning trees of connected graphs (SimpleGraph.Connected.exists_isTree_le) and the edge count of trees, but no minimum spanning tree theory. Existing Prove2Me items on minimum spanning trees are either restricted to complete graphs with distance matrices or state a cut property in existence form at a single vertex; none states Prim's principles or his necessary conditions.

Difficulty

The obvious argument, "each link P1 or P2 adds belongs to the shortest network", uses a unique shortest network, and that fails with ties: when two links tie, a P1/P2 link need not lie in a given SSS. Prim's own treatment of ties (§III) is an informal perturbation argument; the formal statement must hold for every tie-breaking choice made during a construction, not only for a generic perturbed instance. Negative lengths remove the easy reading "shortest connected spanning subgraph": the minimum must range over trees only. The statements also involve the component structure of H(F)H(F)H(F) as it changes during a construction, and tree paths in an arbitrary, not necessarily complete, graph.

Formalization scope

Namespace ShortestConnection.Principles, Mathlib SimpleGraph. Conventions:

  • VVV is a Fintype with decidable equality; GGG is a SimpleGraph V (at most one link per pair, no loops, which is Prim's setting). Lengths are w : Sym2 V → ℝ; only values on edges of GGG matter.
  • Link sets are Finset (Sym2 V); linkGraph F is SimpleGraph.fromEdgeSet F. A spanning subtree requires ↑F ⊆ G.edgeSet and (linkGraph F).IsTree.
  • An isolated fragment is a whole connected component of linkGraph F; the P2 condition is a single inequality against every GGG-edge leaving it, which is equivalent to "nearest neighbor and shortest link" in Prim's sense.
  • A construction is a List (Sym2 V) checked entrywise against l.take i; complete means length Fintype.card V - 1 (natural subtraction, used only for nonempty VVV).
  • LLL is sInf of the lengths of spanning subtrees; continuity is in the product topology.

Implicit hypotheses made explicit: GGG connected (hence V≠∅V \ne \emptysetV=∅) wherever an SSS or a complete construction is involved; at least two terminals for Necessary Condition 1; SSS nonempty and S≠VS \ne VS=V for Necessary Condition 2; pairwise distinct edge lengths only in milestone 4, as in the paper's temporary assumption.

The goal's existence clause rules out a vacuous formalization in which no complete construction exists; the step predicates are defined from lengths and components only, never through shortest spanning subtrees, and they are not restricted to one growing fragment or to the globally shortest link.

Needed infrastructure: tree exchange (adding an edge to a spanning tree creates one cycle; removing any other cycle edge yields a spanning tree), component counts under edge addition, and minima of finitely many continuous functions. The exchange and counting lemmas are reusable for any matroid-greedy or spanning-tree mission. Contributions of intermediate lemmas, and proofs of the milestones in any order, are welcome.

Selected references

  • R. C. Prim, Shortest Connection Networks And Some Generalizations, Bell System Technical Journal 36 (1957), 1389–1401. https://doi.org/10.1002/j.1538-7305.1957.tb01515.x
  • J. B. Kruskal, On the shortest spanning subtree of a graph and the traveling salesman problem, Proceedings of the AMS 7 (1956), 48–50. https://doi.org/10.1090/S0002-9939-1956-0078686-7
  • V. Jarník, O jistém problému minimálním, Práce Moravské Přírodovědecké Společnosti 6 (1930), 57–63.
  • O. Borůvka, O jistém problému minimálním, Práce Moravské Přírodovědecké Společnosti 3 (1926), 37–58.
  • R. L. Graham, P. Hell, On the history of the minimum spanning tree problem, Annals of the History of Computing 7 (1985), 43–57. https://doi.org/10.1109/MAHC.1985.10011
10 thms3 active usersReviewed
🏆Completed
CombinatoricsProbabilityTheoretical Computer Science·Captain: mikedeng1

A Simple Parallel Algorithm for the Maximal Independent Set Problem II: The Round Bound of the Derandomized AlgorithmResearch Paper

Motivation

A maximal independent set (MIS) of a graph is a set of pairwise non-adjacent vertices to which no further vertex can be added. Sequentially an MIS is found greedily in linear time, but the greedy scan is inherently serial. Whether an MIS can be computed by a fast parallel algorithm was a central question of parallel complexity in the early 1980s: Karp and Wigderson gave the first NC algorithm (STOC 1984), and Luby's paper, SIAM J. Comput. 15(4):1036–1053, 1986, gave a much simpler one. MIS is a subroutine of many parallel and distributed graph algorithms (colouring, matching, symmetry breaking), and Luby's randomized algorithm remains the standard one in distributed computing.

The paper's second contribution, the subject of this mission, is a general method for removing randomness: analyse the randomized algorithm under pairwise independence only, then realize pairwise independent random variables on a sample space of polynomial size and try every sample point in parallel. The same method, often attributed jointly to Luby (1986) and to Alon, Babai and Itai (J. Algorithms 7, 1986), became a standard tool of derandomization.

Setting

Let G=(V,E)G = (V, E)G=(V,E) be a finite simple graph with n=∣V∣n = |V|n=∣V∣ vertices labelled 0,…,n−10, \dots, n-10,…,n−1. The algorithm keeps a set III (initially empty) and the current graph G′=(V′,E′)G' = (V', E')G′=(V′,E′), the subgraph of GGG induced on V′V'V′ (initially V′=VV' = VV′=V). For W⊆V′W \subseteq V'W⊆V′ the neighbourhood is N(W)={i∈V′:∃j∈W,(i,j)∈E′}N(W) = \{ i \in V' : \exists j \in W, (i,j) \in E' \}N(W)={i∈V′:∃j∈W,(i,j)∈E′}. Each execution of the loop body selects an independent set I′⊆V′I' \subseteq V'I′⊆V′, adds it to III, and deletes I′∪N(I′)I' \cup N(I')I′∪N(I′) from V′V'V′; the loop runs while V′≠∅V' \ne \emptysetV′=∅. Write d(i)d(i)d(i) for the degree of iii in G′G'G′, YkY_kYk​ for the number of edges of G′G'G′ before the kkk-th execution, and sum(i)=∑j∈adj(i)1/d(j)\mathrm{sum}(i) = \sum_{j \in \mathrm{adj}(i)} 1/d(j)sum(i)=∑j∈adj(i)​1/d(j).

Algorithm B's select step draws a coin coin(i)∈{0,1}\mathrm{coin}(i) \in \{0,1\}coin(i)∈{0,1} for each vertex, with Pr⁡[coin(i)=1]=1/2d(i)\Pr[\mathrm{coin}(i) = 1] = 1/2d(i)Pr[coin(i)=1]=1/2d(i), puts X={i:coin(i)=1}X = \{ i : \mathrm{coin}(i) = 1 \}X={i:coin(i)=1}, and removes from XXX the endpoint of smaller degree of every edge inside XXX (both endpoints on a tie).

The sample space. Fix a prime qqq with n≤q≤2nn \le q \le 2nn≤q≤2n. The sample points are the pairs (x,y)(x, y)(x,y) with 0≤x,y≤q−10 \le x, y \le q-10≤x,y≤q−1, each of probability 1/q21/q^21/q2. With n(i)=⌊q/2d(i)⌋n(i) = \lfloor q/2d(i) \rfloorn(i)=⌊q/2d(i)⌋, the coin of vertex iii at (x,y)(x,y)(x,y) is 111 iff (x+y⋅i) mod q<n(i)(x + y \cdot i) \bmod q < n(i)(x+y⋅i)modq<n(i), so Pr⁡[coin(i)=1]=pi′=⌊q/2d(i)⌋/q\Pr[\mathrm{coin}(i) = 1] = p'_i = \lfloor q/2d(i) \rfloor / qPr[coin(i)=1]=pi′​=⌊q/2d(i)⌋/q, and distinct coins are pairwise independent.

Algorithm D. Each execution of the loop body first moves the isolated vertices of G′G'G′ into III. Then:

  • Case 1. If a vertex iii of maximum degree has d(i)≥n/16d(i) \ge n/16d(i)≥n/16, it joins III, and {i}∪N({i})\{i\} \cup N(\{i\}){i}∪N({i}) is deleted.
  • Case 2. Otherwise all q2q^2q2 sample points are tried, the one whose coins make Algorithm B's select step eliminate the most edges is kept, and its I′I'I′ is used.

No random bits are used.

Formalization targets

Goal: the round bound and correctness of Algorithm D

For every graph GGG on nnn vertices, every prime qqq with n≤q≤2nn \le q \le 2nn≤q≤2n, and every run of Algorithm D (every tie-break among maximum-degree vertices and every maximizing sample point), the loop body is executed exactly kkk times, with

k ≤ log⁡(n2)log⁡(18/17)+16 ≤ 25⋅log⁡2n+16,k \ \le\ \frac{\log(n^2)}{\log(18/17)} + 16 \ \le\ 25 \cdot \log_2 n + 16,k ≤ log(18/17)log(n2)​+16 ≤ 25⋅log2​n+16,

and the output III is a maximal independent set of GGG.

Milestones

  1. The sample space: Lemma 1, Pr⁡[Xi=Rj]=nij/q\Pr[X_i = R_j] = n_{ij}/qPr[Xi​=Rj​]=nij​/q, and Lemma 2, Pr⁡[Xi=Rj,Xi′=Rj′]=nijni′j′/q2\Pr[X_i = R_j, X_{i'} = R_{j'}] = n_{ij} n_{i'j'}/q^2Pr[Xi​=Rj​,Xi′​=Rj′​]=nij​ni′j′​/q2 for i≠i′i \ne i'i=i′.
  2. The Technical Lemma: for p1≥⋯≥pn≥0p_1 \ge \dots \ge p_n \ge 0p1​≥⋯≥pn​≥0 and c>0c > 0c>0, max⁡l(αl−cβl)≥12min⁡{αn,1/c}\max_l (\alpha_l - c\beta_l) \ge \tfrac12 \min\{\alpha_n, 1/c\}maxl​(αl​−cβl​)≥21​min{αn​,1/c}.
  3. The two steps of the proof of Theorem 1: E[Yk−Yk+1]≥12∑id(i)Pr⁡[i∈N(I′)]E[Y_k - Y_{k+1}] \ge \tfrac12 \sum_i d(i) \Pr[i \in N(I')]E[Yk​−Yk+1​]≥21​∑i​d(i)Pr[i∈N(I′)], and 12∑sum(i)≤2d(i) sum(i)+∑sum(i)>2d(i)≥∣E′∣\tfrac12 \sum_{\mathrm{sum}(i) \le 2} d(i)\,\mathrm{sum}(i) + \sum_{\mathrm{sum}(i) > 2} d(i) \ge |E'|21​∑sum(i)≤2​d(i)sum(i)+∑sum(i)>2​d(i)≥∣E′∣.
  4. Lemma C and Theorem 2: with pairwise independent coins of law 1/2d(i)1/2d(i)1/2d(i),
Pr⁡[i∈N(I′)]≥18min⁡{sum(i),1},E[Yk−Yk+1]≥116Yk.\Pr[i \in N(I')] \ge \tfrac18 \min\{\mathrm{sum}(i), 1\}, \qquad E[Y_k - Y_{k+1}] \ge \tfrac{1}{16} Y_k .Pr[i∈N(I′)]≥81​min{sum(i),1},E[Yk​−Yk+1​]≥161​Yk​.
  1. The rounding bound 89pi≤pi′≤pi\tfrac89 p_i \le p'_i \le p_i98​pi​≤pi′​≤pi​ when d(i)<n/16d(i) < n/16d(i)<n/16.
  2. Lemma D and Theorem 3: with pairwise independent coins of law pi′p'_ipi′​ and all d(i)<n/16d(i) < n/16d(i)<n/16,
Pr⁡[i∈N(I′)]≥19min⁡{sum(i),1},E[Yk−Yk+1]≥118Yk.\Pr[i \in N(I')] \ge \tfrac19 \min\{\mathrm{sum}(i), 1\}, \qquad E[Y_k - Y_{k+1}] \ge \tfrac{1}{18} Y_k .Pr[i∈N(I′)]≥91​min{sum(i),1},E[Yk​−Yk+1​]≥181​Yk​.
  1. In Case 2 some sample point eliminates at least 1/181/181/18 of the edges; Case 1 occurs at most 16 times in any run before it terminates.

Significance

The goal is the deterministic half of Luby's result: an MIS is computed in O(log⁡n)O(\log n)O(logn) parallel rounds with no randomness, which places MIS in deterministic NC. The pairwise-independent analysis (Lemmas C, D, Theorems 2, 3) is the reusable part: it shows that the Monte Carlo algorithm's progress guarantee survives when mutual independence is weakened to pairwise independence, which is what makes a sample space of size q2=O(n2)q^2 = O(n^2)q2=O(n2) sufficient. Lemmas 1 and 2 are the standard construction of pairwise independent variables with prescribed rational marginals.

All of these results are proved in the paper. None is formalized on the platform. A related but different object is the platform's dot-product hash family (AlmostLossless.pairwiseIndependent_dotHash), which has uniform marginals over a field and is not the q2q^2q2-point matrix space with prescribed marginals nij/qn_{ij}/qnij​/q. The companion mission A Simple Parallel Algorithm for the Maximal Independent Set Problem I formalizes Theorem 1, the mutually independent analysis of Algorithms A and B.

Difficulty

The obvious route to Theorem 2 repeats the proof of Lemma B, which lower-bounds Pr⁡[i∈N(I′)]\Pr[i \in N(I')]Pr[i∈N(I′)] by a product over independent events. Under pairwise independence the probability of an intersection of three or more coin events is not determined by the marginals, so that product argument fails, and the constant degrades from 18\tfrac1881​ to 116\tfrac1{16}161​.

The round bound needs a separate argument for high-degree vertices. The rounded probabilities pi′p'_ipi′​ are close to pip_ipi​ only when q/2d(i)q/2d(i)q/2d(i) is large, which is why vertices of degree at least n/16n/16n/16 are handled by Case 1. Counting the Case 1 rounds uses the vertex count nnn of the original graph, not of the current one. Correctness at termination requires an invariant linking III, V′V'V′ and GGG across both kinds of rounds and the deletion of isolated vertices.

Formalization scope

Vertices are Fin n with labels 0,…,n−10, \dots, n-10,…,n−1, which is §4.2's indexing of X0,…,Xn−1X_0, \dots, X_{n-1}X0​,…,Xn−1​; the label enters Z/qZ\mathbb{Z}/q\mathbb{Z}Z/qZ as a residue, and labels are distinct mod qqq because n≤qn \le qn≤q. The current graph is the induced subgraph kept on the full vertex type, with deleted vertices isolated. One execution of the loop body is a relation between states (I,V′)(I, V')(I,V′) that leaves the maximizing vertex (Case 1) and the maximizing sample point (Case 2) free, as the page does, and a run is any sequence of states starting at (∅,V)(\emptyset, V)(∅,V) that follows the relation while V′≠∅V' \ne \emptysetV′=∅. The goal asks for the first index kkk with V′=∅V' = \emptysetV′=∅, so a statement about a later state or a bound on kkk without termination does not meet it.

The conditions d(i)≥n/16d(i) \ge n/16d(i)≥n/16 and d(i)<n/16d(i) < n/16d(i)<n/16 are encoded exactly as n≤16 d(i)n \le 16\,d(i)n≤16d(i) and 16 d(i)<n16\,d(i) < n16d(i)<n in N\mathbb{N}N. ⌊q/2d(i)⌋\lfloor q/2d(i) \rfloor⌊q/2d(i)⌋ is natural-number division. The printed code tests (x+y⋅i) mod q≤n(i)(x + y\cdot i) \bmod q \le n(i)(x+y⋅i)modq≤n(i), which puts n(i)+1n(i) + 1n(i)+1 residues in XXX and contradicts pi′=⌊piq⌋/qp'_i = \lfloor p_i q \rfloor / qpi′​=⌊pi​q⌋/q stated on the same page; the formalization uses the strict test.

Lemmas C, D and Theorems 2, 3 quantify over every probability space carrying measurable, pairwise independent (IndepFun for each pair of distinct vertices) coins with the stated marginals at vertices of positive degree. Replacing pairwise by mutual independence, or fixing the probability space, would weaken them. They are stated for a fixed current graph, that is, as the expectation conditional on the state before the round, which is what their proofs establish. Expectations are Bochner integrals of a function with finitely many values and are therefore genuine. Lemma 2 carries the hypothesis i≠i′i \ne i'i=i′, implicit on the page.

The development needs the induced subgraph and degree bookkeeping from Mathlib's SimpleGraph, pairwise independence from ProbabilityTheory.IndepFun, finite counting in ZMod q, and real logarithms. The pairwise-independent analysis (Lemma C to Theorem 3) and the sample-space lemmas are reusable beyond this mission. Contributions to any milestone are welcome.

Selected references

  • M. Luby, A Simple Parallel Algorithm for the Maximal Independent Set Problem, SIAM J. Comput. 15(4):1036–1053, 1986. https://doi.org/10.1137/0215074
  • R. M. Karp and A. Wigderson, A Fast Parallel Algorithm for the Maximal Independent Set Problem, J. ACM 32(4):762–773, 1985. https://doi.org/10.1145/4221.4226
  • N. Alon, L. Babai and A. Itai, A Fast and Simple Randomized Parallel Algorithm for the Maximal Independent Set Problem, J. Algorithms 7(4):567–583, 1986. https://doi.org/10.1016/0196-6774(86)90019-2
16 thms3 active usersReviewed
🏆Completed
ProbabilityTheoretical Computer Science·Captain: mikedeng1

A Simple Parallel Algorithm for the Maximal Independent Set Problem I: One Round of Monte Carlo Algorithm A or B Removes an Expected Eighth of the EdgesResearch Paper

Motivation

A maximal independent set (MIS) of a graph is a set of vertices, no two adjacent, to which no further vertex can be added. Sequentially an MIS is found greedily in linear time, but the greedy scan is inherently serial. Whether an MIS can be found fast in parallel was a central question of parallel complexity in the early 1980s: an MIS algorithm is a subroutine for maximal matching, vertex colouring with Δ+1\Delta + 1Δ+1 colours, and many other symmetry-breaking tasks.

  • Karp and Wigderson (STOC 1984; J. ACM 32, 1985) gave the first fast parallel algorithms for MIS: a randomized one and a deterministic one, both with running time O((log⁡n)4)O((\log n)^4)O((logn)4), placing MIS in NC4^44.
  • Luby (SIAM J. Comput. 15(4), 1986) gave the Monte Carlo algorithms analysed in this mission, together with a derandomization that yields a deterministic EREW P-RAM algorithm with O((log⁡n)2)O((\log n)^2)O((logn)2) running time, placing MIS in NC2^22. Alon, Babai and Itai (J. Algorithms 7, 1986) independently found a Monte Carlo algorithm similar to Algorithm B.

Luby's algorithm is the standard textbook example of a randomized parallel algorithm and remains the basis of distributed MIS algorithms in the LOCAL model. Its analysis rests on one statement, Theorem 1 of the paper, which this mission formalizes.

Setting

All algorithms in the paper run the same loop on a finite simple undirected input graph G=(V,E)G = (V, E)G=(V,E) with n=∣V∣n = |V|n=∣V∣ vertices. The current graph is G′=(V′,E′)G' = (V', E')G′=(V′,E′), initially GGG. For W⊆V′W \subseteq V'W⊆V′ the neighbourhood is N(W)={i∈V′:∃j∈W, (i,j)∈E′}N(W) = \{ i \in V' : \exists j \in W,\ (i,j) \in E' \}N(W)={i∈V′:∃j∈W, (i,j)∈E′}. One execution of the loop body selects a set I′⊆V′I' \subseteq V'I′⊆V′ independent in G′G'G′, adds it to the output, and replaces G′G'G′ by the subgraph induced on V′−(I′∪N(I′))V' - (I' \cup N(I'))V′−(I′∪N(I′)). The loop stops when G′G'G′ is empty.

For i∈V′i \in V'i∈V′ write adj(i)\mathrm{adj}(i)adj(i) for its neighbours and d(i)=∣adj(i)∣d(i) = |\mathrm{adj}(i)|d(i)=∣adj(i)∣ for its degree. The two Monte Carlo select steps are:

  • Algorithm A. Every vertex draws a priority π(i)\pi(i)π(i) uniformly from {1,…,n4}\{1, \dots, n^4\}{1,…,n4}, independently. A vertex enters I′I'I′ when its priority is strictly smaller than the priority of each of its neighbours.
  • Algorithm B. Every vertex independently sets coin(i)=1\mathrm{coin}(i) = 1coin(i)=1 with probability 1/(2d(i))1/(2d(i))1/(2d(i)), or always if d(i)=0d(i) = 0d(i)=0. Let XXX be the set of vertices with coin 111. A vertex of XXX enters I′I'I′ when each of its neighbours in XXX has strictly smaller degree.

Let YkY_kYk​ be the number of edges of E′E'E′ before the kkk-th execution of the loop body. The number of edges eliminated by that execution is Yk−Yk+1Y_k - Y_{k+1}Yk​−Yk+1​: exactly the edges of G′G'G′ with at least one endpoint in I′∪N(I′)I' \cup N(I')I′∪N(I′). For d(i)≥1d(i) \ge 1d(i)≥1 the paper uses the weight sum(i)=∑j∈adj(i)1/d(j)\mathrm{sum}(i) = \sum_{j \in \mathrm{adj}(i)} 1/d(j)sum(i)=∑j∈adj(i)​1/d(j).

Formalization targets

Goal: Theorem 1

For the current graph G′G'G′ and n≥max⁡(1,∣V′∣)n \ge \max(1, |V'|)n≥max(1,∣V′∣),

E[YkA−Yk+1A]≥18 YkA−116,E[YkB−Yk+1B]≥18 YkB.E\big[Y_k^A - Y_{k+1}^A\big] \ge \tfrac18\, Y_k^A - \tfrac1{16}, \qquad E\big[Y_k^B - Y_{k+1}^B\big] \ge \tfrac18\, Y_k^B .E[YkA​−Yk+1A​]≥81​YkA​−161​,E[YkB​−Yk+1B​]≥81​YkB​.

The constants are those printed in the paper. No connectivity, degree or size condition on G′G'G′ is assumed.

Milestones

  1. §3.2, p. 1040. The priorities of Algorithm A are pairwise distinct with probability at least 1−1/(2n2)1 - 1/(2n^2)1−1/(2n2).
  2. TECHNICAL LEMMA, p. 1043. For p1≥⋯≥pn≥0p_1 \ge \dots \ge p_n \ge 0p1​≥⋯≥pn​≥0 and c>0c > 0c>0, with αl=∑j≤lpj\alpha_l = \sum_{j \le l} p_jαl​=∑j≤l​pj​, βl=∑j<k≤lpjpk\beta_l = \sum_{j < k \le l} p_j p_kβl​=∑j<k≤l​pj​pk​ and γl=αl−cβl\gamma_l = \alpha_l - c\beta_lγl​=αl​−cβl​,
max⁡1≤l≤nγl≥12min⁡{αn,1/c}.\max_{1 \le l \le n} \gamma_l \ge \tfrac12 \min\{\alpha_n, 1/c\}.1≤l≤nmax​γl​≥21​min{αn​,1/c}.
  1. LEMMA A (Beame), p. 1041. For Algorithm A and d(i)≥1d(i) \ge 1d(i)≥1,
Pr⁡[i∈N(I′)]≥[14min⁡{sum(i),1}](1−12n2).\Pr[i \in N(I')] \ge \big[\tfrac14\min\{\mathrm{sum}(i), 1\}\big]\big(1 - \tfrac{1}{2n^2}\big).Pr[i∈N(I′)]≥[41​min{sum(i),1}](1−2n21​).
  1. LEMMA B, p. 1042. For Algorithm B and d(i)≥1d(i) \ge 1d(i)≥1,
Pr⁡[i∈N(I′)]≥14min⁡{sum(i)/2,1}.\Pr[i \in N(I')] \ge \tfrac14 \min\{\mathrm{sum}(i)/2, 1\}.Pr[i∈N(I′)]≥41​min{sum(i)/2,1}.
  1. Proof of Theorem 1, first display, p. 1041. For any random choice of I′I'I′,
E[Yk−Yk+1]≥12∑id(i)Pr⁡[i∈I′∪N(I′)]≥12∑id(i)Pr⁡[i∈N(I′)].E[Y_k - Y_{k+1}] \ge \tfrac12 \sum_i d(i)\Pr[i \in I' \cup N(I')] \ge \tfrac12 \sum_i d(i) \Pr[i \in N(I')].E[Yk​−Yk+1​]≥21​i∑​d(i)Pr[i∈I′∪N(I′)]≥21​i∑​d(i)Pr[i∈N(I′)].
  1. Proof of Theorem 1, closing chain, p. 1041.
12∑sum(i)≤2d(i) sum(i)+∑sum(i)>2d(i)≥∣E′∣.\tfrac12 \sum_{\mathrm{sum}(i) \le 2} d(i)\,\mathrm{sum}(i) + \sum_{\mathrm{sum}(i) > 2} d(i) \ge |E'|.21​sum(i)≤2∑​d(i)sum(i)+sum(i)>2∑​d(i)≥∣E′∣.

Significance

Theorem 1 says that each round removes, in expectation, a constant fraction of the remaining edges. From it the paper derives that the expected number of rounds of either algorithm is O(log⁡n)O(\log n)O(logn), and hence that MIS has a Monte Carlo algorithm running in O(log⁡n)O(\log n)O(logn) expected time on a CRCW P-RAM and O((log⁡n)2)O((\log n)^2)O((logn)2) on an EREW P-RAM with O(m)O(m)O(m) processors. Algorithm B and the proof of part (2) are also the basis of the paper's deterministic algorithm: the analysis of Lemma B uses only pairwise independence of the coins. The companion mission (A Simple Parallel Algorithm for the Maximal Independent Set Problem II) formalizes that derandomization and reuses the statements of milestones 2, 5 and 6.

The results are proved in the paper and reproduced in textbooks (e.g. Motwani and Raghavan, Randomized Algorithms), but not formalized: no statement of Theorem 1, Lemma A or Lemma B was found on the platform. A formal proof would make the per-round analysis of a standard parallel randomized algorithm reusable. That includes the degree-weighted counting of milestone 6 and the Bonferroni-type bound of the Technical Lemma, both of which recur in later analyses of distributed symmetry breaking.

Difficulty

The obvious argument tries to show that a fixed vertex enters I′I'I′ with good probability. That fails, because a high-degree vertex rarely wins against all its neighbours. The analysis instead bounds the probability that a vertex is removed, i.e. lands in N(I′)N(I')N(I′). This event is a union over neighbours of dependent events, so the first Bonferroni inequality alone does not give a lower bound: the pairwise-intersection terms must be controlled. The union bound can also be very lossy when sum(i)\mathrm{sum}(i)sum(i) is large, which is why the conclusion involves a minimum with a constant.

A second obstacle is the passage from vertices to edges: vertices of small sum(i)\mathrm{sum}(i)sum(i) can have high degree while contributing little probability. The per-vertex bounds therefore have to be summed with degree weights and redistributed over edges. For Algorithm A there is an additional complication: priorities from {1,…,n4}\{1, \dots, n^4\}{1,…,n4} can collide, so the argument about a uniformly random order holds only on the event that π\piπ is injective. That event appears as the factor 1−1/(2n2)1 - 1/(2n^2)1−1/(2n2).

Formalization scope

  • Graph. The current graph G′G'G′ is a SimpleGraph V on a finite type with decidable adjacency, and V′=VV' = VV′=V. The degree is SimpleGraph.degree, adj(i)\mathrm{adj}(i)adj(i) is neighborFinset, and Yk=∣E′∣Y_k = |E'|Yk​=∣E′∣ is edgeFinset.card.
  • Conditional form. Theorem 1 is stated for a fixed current graph G′G'G′, i.e. conditionally on the first k−1k - 1k−1 rounds, as in the paper's proof. The unconditional statement follows by averaging.
  • Input size. nnn is a parameter with 1≤n1 \le n1≤n and ∣V′∣≤n|V'| \le n∣V′∣≤n. It is not fixed to ∣V′∣|V'|∣V′∣, which would cover only the first round.
  • Select steps. Both endpoints' ALGEDGE runs are applied to every edge, since E′E'E′ contains each edge in both orientations. Hence Algorithm A keeps iii iff π(i)<π(j)\pi(i) < \pi(j)π(i)<π(j) for all neighbours jjj. Algorithm B keeps i∈Xi \in Xi∈X iff d(j)<d(i)d(j) < d(i)d(j)<d(i) for all neighbours j∈Xj \in Xj∈X. Algorithm B's I′I'I′ starts at XXX; the page leaves I′I'I′ uninitialized in §3.3, and Algorithm D's code (p. 1047) has I′←XI' \leftarrow XI′←X.
  • Laws. Probabilities and expectations are explicit finite sums: uniform over the (n4)∣V∣(n^4)^{|V|}(n4)∣V∣ priority vectors, and the product law over the 2∣V∣2^{|V|}2∣V∣ coin vectors. A coin of an isolated vertex is 111 with probability 111, as on the page.
  • Milestones. Milestone 5 is stated for an arbitrary finite distribution of I′I'I′, which contains both algorithms' laws. Milestone 6 divides out the common factor 18\tfrac1881​ of the printed chain.

Theorem 1 is false for arbitrary distributions of priorities or coins. A formalization that takes "Pr" as an unconstrained parameter, conditions on the event of interest, or replaces nnn by ∣V′∣|V'|∣V′∣ does not state the paper's theorem.

A complete development needs finite product probability spaces, inclusion–exclusion (Bonferroni) inequalities for finite unions, the symmetry of uniform priorities conditioned on injectivity, and degree-sum identities (SimpleGraph.sum_degrees_eq_twice_card_edges). The Technical Lemma and milestones 5 and 6 are reusable beyond this mission. Proofs of any milestone, and alternative proofs of Lemmas A and B, are welcome.

Selected references

  • M. Luby, A Simple Parallel Algorithm for the Maximal Independent Set Problem, SIAM J. Comput. 15(4):1036–1053, 1986. https://doi.org/10.1137/0215074
  • R. M. Karp and A. Wigderson, A Fast Parallel Algorithm for the Maximal Independent Set Problem, J. ACM 32(4):762–773, 1985. https://doi.org/10.1145/4221.4226
  • N. Alon, L. Babai and A. Itai, A Fast and Simple Randomized Parallel Algorithm for the Maximal Independent Set Problem, J. Algorithms 7(4):567–583, 1986. https://doi.org/10.1016/0196-6774(86)90019-2
  • R. Motwani and P. Raghavan, Randomized Algorithms, Cambridge University Press, 1995. https://doi.org/10.1017/CBO9780511814075
8 thms3 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

Critical-Path Planning and Scheduling I: Critical Jobs Occur Only When the Completion Time Is the Earliest, and Then Form a Path from Origin to TerminusResearch Paper

Motivation

The Critical-Path Method (CPM) was introduced by J. E. Kelley, Jr. (Remington Rand) and M. R. Walker (du Pont) in Critical-Path Planning and Scheduling (Proc. Eastern Joint Computer Conference, 1959, pp. 160–173, doi:10.1145/1460299.1460318). Together with PERT, developed at the same time for the Polaris programme, it became the standard way to plan and schedule large projects in construction, maintenance and engineering, and it is taught in every introductory operations research course.

The paper reduces project scheduling to arithmetic on a directed acyclic graph: the earliest and latest times of the project's events are computed by two recursions, and the jobs whose timing has no slack, the critical jobs, are singled out by an equation. Its central structural claim is that critical jobs, when they exist, form a path from the start of the project to its end. The paper states this without proof ("a detailed development being reserved for a separate paper", p. 161). This mission formalizes that claim and the facts about the two recursions on which it rests.

Setting

A project network has n+1n+1n+1 events labelled 0,1,…,n0,1,\dots,n0,1,…,n with n≥1n \ge 1n≥1: event 000 is the origin and event nnn the terminus. A job is an arrow from an event iii to an event jjj, written job (i,j)(i,j)(i,j); the jobs form a finite set PPP of ordered pairs of events. Two standing assumptions of the paper (pp. 161–162) are part of the model:

  1. every job has i<ji < ji<j (events are labelled so that the head of an arrow has the larger label);
  2. origin precedes and terminus follows every event: for every event kkk there are chains of jobs from 000 to kkk and from kkk to nnn.

Each job has a real duration yijy_{ij}yij​. The earliest event times t(0)t^{(0)}t(0) are given by display (1) of the paper,

t0(0)=0,tj(0)=max⁡ [ yij+ti(0)∣i<j, (i,j)∈P ],1≤j≤n,t_0^{(0)} = 0,\qquad t_j^{(0)} = \max\,[\,y_{ij} + t_i^{(0)} \mid i<j,\ (i,j)\in P\,],\quad 1\le j\le n,t0(0)​=0,tj(0)​=max[yij​+ti(0)​∣i<j, (i,j)∈P],1≤j≤n,

and, for a project completion time λ≥tn(0)\lambda \ge t_n^{(0)}λ≥tn(0)​, the latest event times t(1)t^{(1)}t(1) by display (2),

tn(1)=λ,ti(1)=min⁡ [ tj(1)−yij∣i<j, (i,j)∈P ],0≤i≤n−1.t_n^{(1)} = \lambda,\qquad t_i^{(1)} = \min\,[\,t_j^{(1)} - y_{ij} \mid i<j,\ (i,j)\in P\,],\quad 0\le i\le n-1.tn(1)​=λ,ti(1)​=min[tj(1)​−yij​∣i<j, (i,j)∈P],0≤i≤n−1.

The maximum time available for job (i,j)(i,j)(i,j) is tj(1)−ti(0)t_j^{(1)} - t_i^{(0)}tj(1)​−ti(0)​. The job is critical if this equals its duration, tj(1)−ti(0)=yijt_j^{(1)} - t_i^{(0)} = y_{ij}tj(1)​−ti(0)​=yij​, and a floater if it exceeds it. A critical path is a contiguous path of critical jobs from origin to terminus: events 0=v0,v1,…,vk=n0 = v_0, v_1, \dots, v_k = n0=v0​,v1​,…,vk​=n with every (vr−1,vr)(v_{r-1}, v_r)(vr−1​,vr​) a critical job of PPP.

In the Lean development these are ProjectNetwork n (with field P), earliest N y, latest N y λ, maxTimeAvailable, IsCritical, IsFloater and IsCriticalPath, in the namespace CriticalPath.Events.

Formalization targets

Goal: critical jobs force λ=tn(0)\lambda = t_n^{(0)}λ=tn(0)​ and a critical path (p. 163)

For every project network, durations yyy and completion time λ≥tn(0)\lambda \ge t_n^{(0)}λ≥tn(0)​,

(∃(i,j)∈P, tj(1)−ti(0)=yij)  ⟹  λ=tn(0) ∧ ∃ a critical path.\bigl(\exists (i,j)\in P,\ t_j^{(1)} - t_i^{(0)} = y_{ij}\bigr) \;\Longrightarrow\; \lambda = t_n^{(0)} \ \wedge\ \exists\ \text{a critical path}.(∃(i,j)∈P, tj(1)​−ti(0)​=yij​)⟹λ=tn(0)​ ∧ ∃ a critical path.

This is the paper's "A project will contain critical jobs only when λ=tn(0)\lambda = t_n^{(0)}λ=tn(0)​. If a project does contain critical jobs, then it also contains at least one contiguous path of critical jobs through the project diagram from origin to terminus." Only the "only when" direction is asserted, as on the page.

Milestones

  1. Display (1), pp. 162–163. t(0)t^{(0)}t(0) is the least vector ttt with t0=0t_0 = 0t0​=0 and yij≤tj−tiy_{ij} \le t_j - t_iyij​≤tj​−ti​ for every job.
  2. Display (2), p. 163. For λ≥tn(0)\lambda \ge t_n^{(0)}λ≥tn(0)​, tn(1)=λt_n^{(1)} = \lambdatn(1)​=λ and t(1)t^{(1)}t(1) is the greatest vector ttt with tn≤λt_n \le \lambdatn​≤λ and yij≤tj−tiy_{ij} \le t_j - t_iyij​≤tj​−ti​ for every job.
  3. Critical or floater, p. 163. For λ≥tn(0)\lambda \ge t_n^{(0)}λ≥tn(0)​, ti(0)≤ti(1)t_i^{(0)} \le t_i^{(1)}ti(0)​≤ti(1)​ for every event, and every job is critical or a floater: tj(1)−ti(0)≥yijt_j^{(1)} - t_i^{(0)} \ge y_{ij}tj(1)​−ti(0)​≥yij​.
  4. Delay of a critical job, p. 163. Lengthening a critical job by δ≥0\delta \ge 0δ≥0 raises tn(0)t_n^{(0)}tn(0)​ by exactly δ\deltaδ.

Significance

The result. The theorem is what makes the method's name meaningful: it says that the jobs without slack are not scattered but line up along an origin–terminus path, and that such jobs exist only when the project is scheduled at its earliest possible completion time. Project managers use this to decide which jobs to watch, which to expedite, and which may slip; the delay statement (milestone 4) is the quantitative form of that advice. The characterisations of (1) and (2) as least and greatest feasible schedules are the bridge between CPM and linear programming: they identify t(0)t^{(0)}t(0) and t(1)t^{(1)}t(1) with extreme solutions of the system of difference constraints yij≤tj−tiy_{ij} \le t_j - t_iyij​≤tj​−ti​, which the paper's own §3 uses to build the project cost curve.

Formalizing it. The results are classical and folklore, but the paper proves none of them, and textbook treatments usually define the critical path as a longest path, which makes the goal a tautology. This mission states the claims with the paper's own definitions: criticality by the float equation, event times by the recursions. To the best of current knowledge no machine-checked version of these statements for activity-on-arrow networks exists; the platform has a related activity-on-node development (Brucker and Knust, Complex Scheduling) in which the critical path is defined as a longest path.

Difficulty

The recursions (1) and (2) are local: each event looks only at its immediate predecessors or successors. The goal is global: from one critical job it asserts a statement about the whole completion time and a whole origin–terminus path. The float equation tj(1)−ti(0)=yijt_j^{(1)} - t_i^{(0)} = y_{ij}tj(1)​−ti(0)​=yij​ mixes a quantity computed forward from the origin with one computed backward from the terminus, and neither recursion alone says anything about the other. The naive reading "a critical job lies on a longest path" is not available as a definition: it is, in substance, what has to be established from the recursions. The formal overhead is the well-founded recursion on the labels, in both directions, and the bookkeeping of lists of events forming a path.

Formalization scope

Events are Fin (n + 1), origin 0, terminus Fin.last n, with 1 ≤ n. Jobs are a Finset of ordered pairs, so there is at most one job per ordered pair. The standing assumptions (labels increase along jobs; origin precedes and terminus follows every event, via Relation.ReflTransGen) are fields of the structure ProjectNetwork and are never dropped. Durations and times are real numbers; durations are a function Fin (n+1) → Fin (n+1) → ℝ read only on jobs of P, with no sign condition, as in the paper's deterministic case.

The event times are defined by the recursions (1) and (2) themselves, by well-founded recursion on the label with Finset.sup'/Finset.inf' over the predecessor/successor set; these sets are nonempty by the standing assumptions, so no fallback value exists. The latest times are defined for every real λ\lambdaλ; the paper's assumption λ≥tn(0)\lambda \ge t_n^{(0)}λ≥tn(0)​ is a hypothesis of every theorem that uses them.

Disclosed readings: "earliest time occurance" (milestone 1) and "latest time … relative to a fixed project completion time" (milestone 2) are read as least and greatest vectors satisfying the job constraints yij≤tj−tiy_{ij} \le t_j - t_iyij​≤tj​−ti​ (the paper's constraint (8), p. 165); milestone 3 is the fact implicit in the dichotomy "critical or floater"; "comparable delay" (milestone 4) is read as an exact delay of δ\deltaδ in tn(0)t_n^{(0)}tn(0)​ for δ≥0\delta \ge 0δ≥0.

A trivializing formalization is ruled out: defining a critical job or path through longest paths, or taking t(0)t^{(0)}t(0) and t(1)t^{(1)}t(1) as arbitrary functions satisfying (1) and (2), would make the goal a restatement of its definitions; here criticality is the float equation and the times are computed by the recursions. Dropping the reachability assumptions would make (2) ill-defined at events without successors.

Contributions welcome: proofs of the milestones, general lemmas on longest paths in finite labelled DAGs and on difference constraints yij≤tj−tiy_{ij} \le t_j - t_iyij​≤tj​−ti​, which are reusable for the companion mission on the project cost curve.

Selected references

  • J. E. Kelley, Jr. and M. R. Walker, Critical-Path Planning and Scheduling, Papers presented at the December 1–3, 1959, Eastern Joint IRE-AIEE-ACM Computer Conference, pp. 160–173, 1959. doi:10.1145/1460299.1460318
  • J. E. Kelley, Jr., Critical-Path Planning and Scheduling: Mathematical Basis, Operations Research 9(3), pp. 296–320, 1961. doi:10.1287/opre.9.3.296
  • P. Brucker and S. Knust, Complex Scheduling, 2nd ed., Springer, 2012. doi:10.1007/978-3-642-23929-8
7 thms3 active usersReviewed
🏆Completed
CombinatoricsLinear OptimizationOperations Research·Captain: mikedeng1

Optimum Branchings: The Vertices of the Branching Polyhedron Are Exactly the BranchingsResearch Paper

Motivation

A branching in a directed graph is a set of edges that contains no cycle (even ignoring directions) and in which no two edges point to the same node; a connected branching is an arborescence, a tree rooted at one node with all edges directed away from the root. The optimum branching problem asks, for real weights on the edges, for a branching of maximum total weight. It contains the minimum-cost spanning arborescence problem (the directed analogue of the minimum spanning tree), which appears in network design, in the analysis of broadcast and routing structures, in phylogenetics, and in dependency parsing in computational linguistics, where maximum spanning arborescences are the standard decoding step of graph-based parsers.

J. Edmonds solved the problem in Optimum branchings (J. Res. Nat. Bur. Standards 71B (1967) 233–240). The paper gives an algorithm (the shrinking algorithm usually attributed to Chu–Liu and Edmonds) and, proved together with it, a polyhedral theorem: the linear system that every branching obviously satisfies has no other vertices. This was one of the first integral polyhedron theorems beyond bipartite matching and network flows, and together with Edmonds' matching polytope (1965) it set the pattern of polyhedral combinatorics: describe the convex hull of the combinatorial objects by linear inequalities, and prove optimality by a linear programming dual.

Timeline:

  • 1965: Y. J. Chu and T. H. Liu describe the shrinking algorithm for the maximum arborescence.
  • 1965: Edmonds, Paths, trees, and flowers and Maximum matching and a polyhedron with 0,1-vertices: the matching polytope.
  • 1967: Edmonds, Optimum branchings: the algorithm, Theorem 2 (vertices of the branching polyhedron), and the dual certificate built along the algorithm.
  • 1970–1971: Edmonds' matroid intersection theorem, which contains the branching polyhedron theorem as the intersection of a graphic matroid and a partition matroid.
  • 1977–1986: faster implementations (Tarjan; Gabow, Galil, Spencer and Tarjan).

Setting

A graph GGG consists of a finite set VVV of nodes and a finite set EEE of edges. Each edge eee is directed toward a node front(e)\mathrm{front}(e)front(e), its front end, and away from a different node rear(e)\mathrm{rear}(e)rear(e), its rear end. Parallel edges are allowed; loops are not.

For F⊆EF\subseteq EF⊆E, a node vvv meets kkk edges of FFF if #{e∈F:front(e)=v}+#{e∈F:rear(e)=v}=k\#\{e\in F:\mathrm{front}(e)=v\}+\#\{e\in F:\mathrm{rear}(e)=v\}=k#{e∈F:front(e)=v}+#{e∈F:rear(e)=v}=k. A set B⊆EB\subseteq EB⊆E is a forest if it contains no polygon, i.e. no nonempty F⊆BF\subseteq BF⊆B in which every node meets zero or two edges of FFF; it is a branching if in addition distinct edges of BBB have distinct front ends. The incidence vector xB∈REx^B\in\mathbb R^ExB∈RE of BBB has xeB=1x^B_e=1xeB​=1 for e∈Be\in Be∈B and 000 otherwise.

The branching polyhedron PG⊆REP_G\subseteq\mathbb R^EPG​⊆RE is the set of xxx with

  • (L1)(L_1)(L1​) xe≥0x_e\ge0xe​≥0 for every edge eee;
  • (L2)(L_2)(L2​) ∑e: front(e)=vxe≤1\sum_{e:\,\mathrm{front}(e)=v}x_e\le1∑e:front(e)=v​xe​≤1 for every node vvv;
  • (L3)(L_3)(L3​) ∑e: front(e),rear(e)∈Sxe≤∣S∣−1\sum_{e:\,\mathrm{front}(e),\mathrm{rear}(e)\in S}x_e\le|S|-1∑e:front(e),rear(e)∈S​xe​≤∣S∣−1 for every set SSS of two or more nodes.

A vertex of a set P⊆REP\subseteq\mathbb R^EP⊆RE is a point of PPP that is the unique maximizer over PPP of some linear function x↦∑ecexex\mapsto\sum_e c_ex_ex↦∑e​ce​xe​.

For weights c∈REc\in\mathbb R^Ec∈RE, the dual variables are yhy_hyh​ for each node vhv_hvh​ and ySy_SyS​ for each SSS with ∣S∣≥2|S|\ge2∣S∣≥2; write we=∑S∋front(e),rear(e)ySw_e=\sum_{S\ni\mathrm{front}(e),\mathrm{rear}(e)}y_Swe​=∑S∋front(e),rear(e)​yS​ and (b,y)=∑hyh+∑S(∣S∣−1)yS(b,y)=\sum_hy_h+\sum_S(|S|-1)y_S(b,y)=∑h​yh​+∑S​(∣S∣−1)yS​. Edmonds' conditions are (15) yh≥0y_h\ge0yh​≥0, (16) yS≥0y_S\ge0yS​≥0, (17) yfront(e)+we≥cey_{\mathrm{front}(e)}+w_e\ge c_eyfront(e)​+we​≥ce​ for every edge, and, for a branching BBB, (18) yh≠0⇒y_h\ne0\Rightarrowyh​=0⇒ some edge of BBB enters vhv_hvh​, (19) yS≠0⇒y_S\ne0\RightarrowyS​=0⇒ exactly ∣S∣−1|S|-1∣S∣−1 edges of BBB lie inside SSS, (20) yfront(e)+we=cey_{\mathrm{front}(e)}+w_e=c_eyfront(e)​+we​=ce​ for e∈Be\in Be∈B.

Formalization targets

Goal: Theorem 2 (p. 235)

{x: x is a vertex of PG}  =  {xB: B is a branching of G}.\{x:\ x\text{ is a vertex of }P_G\}\;=\;\{x^B:\ B\text{ is a branching of }G\}.{x: x is a vertex of PG​}={xB: B is a branching of G}.

Both inclusions, for every finite loopless directed multigraph.

Milestones

  1. §5, p. 236: for every branching BBB, xB∈PGx^B\in P_GxB∈PG​.
  2. §5, p. 236: for every branching BBB, xBx^BxB is a vertex of PGP_GPG​.
  3. §6, (12)–(14): if BBB is a branching and yyy satisfies (15)–(20), then (c,xB)=(b,y)(c,x^B)=(b,y)(c,xB)=(b,y), xBx^BxB maximizes (c,x)(c,x)(c,x) over PGP_GPG​, and yyy minimizes (b,y)(b,y)(b,y) subject to (15)–(17).
  4. §7, p. 237: for every c∈REc\in\mathbb R^Ec∈RE there are a branching BBB and a yyy satisfying (15)–(20).
  5. Lemma 1, p. 236: for every c∈REc\in\mathbb R^Ec∈RE some branching vector lies in PGP_GPG​ and maximizes ∑ecexe\sum_ec_ex_e∑e​ce​xe​ over PGP_GPG​.

Significance

Theorem 2 says that the linear program max⁡{(c,x):x∈PG}\max\{(c,x):x\in P_G\}max{(c,x):x∈PG​} always has an optimal solution that is a branching, and that every vertex of PGP_GPG​ is one. Consequently optimum branchings, and after the reductions of the paper's §2 optimum spanning and rooted arborescences, can be computed by linear programming, and their optimality is certified by a dual vector satisfying (15)–(20). The same statement underlies the separation-based treatment of arborescence constraints in integer programming formulations of network design and of the asymmetric travelling salesman problem. The integrality of the dual for integer weights (the paper's §8) yields min–max theorems of König type for branchings.

The result is proved and classical; no machine-checked proof of it in a proof assistant is known. The mission asks for the paper's own proof chain: branching vectors are points and vertices of PGP_GPG​, linear programming optimality from complementary slackness, existence of a dual certificate for every weight vector, and the deduction of Theorem 2. Proofs through matroid intersection or total dual integrality would also establish the goal and are welcome as alternative routes.

Difficulty

The inclusion "branching vectors are vertices" and the certificate criterion are short. The substance is Milestone 4: for arbitrary real weights, a branching and a dual vector satisfying the complementary slackness conditions must exist simultaneously. Finiteness gives an optimum branching at once, but that says nothing about optimality over the fractional points of PGP_GPG​; the difficulty is the dual. The natural attempt, taking yS=0y_S=0yS​=0 for all sets and yhy_hyh​ the largest positive weight entering vhv_hvh​, violates (20) as soon as the greedy choice closes a circuit: the (L3)(L_3)(L3​) duals of nested node sets, arising from repeatedly shrinking circuits, are needed, and they must be kept nonnegative through weight changes of the form c3+c0−c4c_3+c_0-c_4c3​+c0​−c4​ on edges entering a shrunk circuit.

Formalization scope

A graph is a structure Graph V E with front rear : E → V and a proof that front e ≠ rear e; V and E carry Fintype and DecidableEq. Edge sets are Finset E; vectors are E → ℝ; the linear function with weights c is ∑ e, c e * x e. A branching is defined combinatorially (no nonempty edge subset in which every node meets zero or two edges, and distinct front ends), never by counting edges inside node sets, and PGP_GPG​ is the solution set of (L1)(L_1)(L1​)–(L3)(L_3)(L3​), never a convex hull; either shortcut would make half of Theorem 2 true by definition. A vertex is a unique maximizer of a linear function, as on p. 236 (Mathlib's Set.exposedPoints has the same content); the set variables of the dual are a function Finset V → ℝ whose values on sets of fewer than two nodes are ignored. The right side of (L3)(L_3)(L3​) is the real number ∣S∣−1|S|-1∣S∣−1.

Implicit conventions made explicit: the no-loop condition is part of the graph (with a loop eee, the vector of {e}\{e\}{e} is a vertex of PGP_GPG​ but not a branching); parallel edges are allowed; weights have arbitrary sign and the empty branching is allowed. The mission does not model the algorithm of §4 or Theorem 1's notion of a "good" algorithm; Milestone 4 states only the existence of a certificate, which is what Lemma 1 uses.

Useful reusable infrastructure: finite directed multigraphs with an edge type, forests via polygons, and a finite LP duality lemma for max⁡{c⊤x:x≥0, Ax≤b}\max\{c^\top x: x\ge0,\ Ax\le b\}max{c⊤x:x≥0, Ax≤b}; contributions of either are welcome.

Selected references

  • J. Edmonds, Optimum branchings, J. Res. Nat. Bur. Standards Sect. B 71B (1967), 233–240. https://doi.org/10.6028/jres.071b.032
  • Y. J. Chu and T. H. Liu, On the shortest arborescence of a directed graph, Scientia Sinica 14 (1965), 1396–1400.
  • J. Edmonds, Maximum matching and a polyhedron with 0,1-vertices, J. Res. Nat. Bur. Standards 69B (1965), 125–130. https://doi.org/10.6028/jres.069B.013
  • R. E. Tarjan, Finding optimum branchings, Networks 7 (1977), 25–35. https://doi.org/10.1002/net.3230070103
  • H. N. Gabow, Z. Galil, T. Spencer and R. E. Tarjan, Efficient algorithms for finding minimum spanning trees in undirected and directed graphs, Combinatorica 6 (1986), 109–122. https://doi.org/10.1007/BF02579168
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer (2003), Chapter 52.
9 thms3 active usersReviewed
🏆Completed
CombinatoricsLinear OptimizationOperations Research·Captain: mikedeng1

On Certain Polytopes Associated with Graphs V: Zero-One Optima of the Odd-Cycle Relaxation on Series-Parallel GraphsResearch Paper

Motivation

The stable set problem asks for a largest set of pairwise non-adjacent vertices in a graph; its size is the stability number α(G)\alpha(G)α(G). It is NP-hard in general, and a standard way to attack it in integer programming is to write down linear inequalities valid for all stable sets and solve the resulting linear program. The weakest such relaxation uses only the edge inequalities xv+xw≤1x_v+x_w\le 1xv​+xw​≤1; its optimum can be as large as ∣V∣/2|V|/2∣V∣/2 on graphs with small α(G)\alpha(G)α(G). Adding, for every odd circuit CCC, the inequality ∑u∈Cxu≤12(∣C∣−1)\sum_{u\in C}x_u\le\frac12(|C|-1)∑u∈C​xu​≤21​(∣C∣−1) gives the odd-cycle relaxation, the first strengthening that cuts off the fractional point x≡12x\equiv\frac12x≡21​ on odd cycles.

Section 7 of V. Chvátal, On certain polytopes associated with graphs (J. Combin. Theory Ser. B 18 (1975) 138–154, doi:10.1016/0095-8956(75)90041-6) identifies a graph class on which this relaxation is exact for the all-ones objective, with an integral certificate on the dual side: the series-parallel networks. The paper conjectures (Conjecture 7.3) that for these graphs the odd-cycle inequalities describe the whole stable set polytope; graphs with that property were later called t-perfect.

Timeline:

  • 1960: G. A. Dirac, in "In abstrakten Graphen vorhandene vollständige 4-Graphen und ihre Unterteilungen" (Math. Nachr. 22), proves that graphs containing no subdivided K4K_4K4​ have at least two vertices of degree at most two.
  • 1975: Chvátal introduces the system (7.1) and proves Theorem 7.1 (this mission): on series-parallel networks, max⁡∑uxu\max\sum_u x_umax∑u​xu​ subject to (7.1) and its dual both have zero–one optima. He conjectures the full polyhedral statement.
  • 1979: M. Boulala and J.-P. Uhry, "Polytope des indépendants d'un graphe série-parallèle" (Discrete Math. 27), prove the conjecture: (7.1) defines the stable set polytope of every series-parallel graph.
  • 1986: A. M. H. Gerards and A. Schrijver, "Matrices with the Edmonds–Johnson property" (Combinatorica 6), extend this to graphs with no odd-K4K_4K4​ subdivision.

Setting

All graphs G=(V,E)G=(V,E)G=(V,E) are finite, undirected and loopless, with no parallel edges. A stable set is a set of vertices no two of which are adjacent. We write d(u)d(u)d(u) for the degree of uuu.

A set C⊆VC\subseteq VC⊆V induces an odd circuit if the induced subgraph G[C]G[C]G[C] is a cycle of length 2k+12k+12k+1 with k≥1k\ge1k≥1; triangles count, and such a cycle has no chords. Z(G)Z(G)Z(G) is the set of all such CCC. The odd-cycle system of GGG is

0≤xu≤1(u∈V),xv+xw≤1(vw∈E),∑u∈Cxu≤12(∣C∣−1)(C∈Z(G)).(7.1)\begin{aligned} 0\le x_u&\le 1 && (u\in V),\\ x_v+x_w&\le 1 && (vw\in E),\\ \textstyle\sum_{u\in C}x_u&\le \tfrac12(|C|-1) && (C\in Z(G)). \end{aligned}\tag{7.1}0≤xu​xv​+xw​∑u∈C​xu​​≤1≤1≤21​(∣C∣−1)​​(u∈V),(vw∈E),(C∈Z(G)).​(7.1)

Its linear programming dual for the objective ∑uxu\sum_u x_u∑u​xu​, with x≥0x\ge0x≥0 read as sign constraints, has variables yu≥0y_u\ge0yu​≥0, ze≥0z_e\ge0ze​≥0, wC≥0w_C\ge0wC​≥0 and reads

min⁡ ∑uyu+∑eze+∑C∈Z(G)12(∣C∣−1) wCs.t.yu+∑e∋uze+∑C∋uwC≥1  (u∈V).\min\ \sum_{u}y_u+\sum_{e}z_e+\sum_{C\in Z(G)}\tfrac12(|C|-1)\,w_C\quad\text{s.t.}\quad y_u+\sum_{e\ni u}z_e+\sum_{C\ni u}w_C\ge 1\ \ (u\in V).min u∑​yu​+e∑​ze​+C∈Z(G)∑​21​(∣C∣−1)wC​s.t.yu​+e∋u∑​ze​+C∋u∑​wC​≥1  (u∈V).

A homeomorph of K4K_4K4​ is a graph obtained from K4K_4K4​ by subdividing its edges into paths through new vertices of degree two. GGG is a series-parallel network if no subgraph of GGG is a homeomorph of K4K_4K4​.

Formalization targets

Goal: Theorem 7.1

For every series-parallel network GGG,

∃ x∈{0,1}V feasible for (7.1):  ∑uxu=max⁡{∑uxu′:x′∈RV satisfies (7.1)},\exists\,x\in\{0,1\}^V\ \text{feasible for (7.1)}:\ \ \sum_u x_u=\max\Big\{\sum_u x'_u : x'\in\mathbb R^V\text{ satisfies (7.1)}\Big\},∃x∈{0,1}V feasible for (7.1):  u∑​xu​=max{u∑​xu′​:x′∈RV satisfies (7.1)},

and there is a zero–one dual feasible (y,z,w)(y,z,w)(y,z,w) whose dual objective equals the minimum over all real dual feasible points. Both optimality claims are against real points. Chvátal's statement has no constants to improve; the formal goal is his theorem as printed.

Milestones

  1. Dirac's theorem (§7, p. 150): a series-parallel network with at least two vertices has two distinct vertices of degree at most two.
  2. Case 4 closure (p. 151): if d(u)=2d(u)=2d(u)=2 and the neighbours v,wv,wv,w of uuu are non-adjacent, deleting uuu and identifying vvv with www yields a series-parallel network.
  3. The combinatorial core (p. 151, (i)–(ii)): there are a stable set SSS and a spanning subgraph F≤GF\le GF≤G whose components are isolated vertices, isolated edges and odd circuits, such that with aaa isolated vertices, bbb isolated edges and ckc_kck​ circuits of length 2k+12k+12k+1,
a+b+∑kk ck=∣S∣.a+b+\sum_k k\,c_k=|S|.a+b+k∑​kck​=∣S∣.

Significance

The result. Theorem 7.1 says that on series-parallel networks the odd-cycle relaxation computes α(G)\alpha(G)α(G) exactly, and that the optimum is certified by a covering of the vertex set by single vertices, edges and chordless odd circuits whose total weight equals ∣S∣|S|∣S∣. This is a min–max theorem of König type for a non-bipartite, non-perfect class: odd cycles of length at least five are series-parallel and not perfect, so the clique inequalities of the perfect-graph theory (mission I of this series) do not suffice here. The statement is the unweighted case of the later polyhedral results of Boulala–Uhry and Gerards–Schrijver, and the combinatorial core (milestone 3) is the basis of a polynomial algorithm for α(G)\alpha(G)α(G) on this class, as the paper remarks.

Formalizing it. The theorem has been proved since 1975; neither Mathlib nor the Prove2Me library contains a formal proof of it. A formal proof needs a working notion of graph subdivision (topological minor), which Mathlib does not have, Dirac's degree theorem, the induction of the paper with its four cases, and the passage from the combinatorial core to a pair of LP optima through weak duality. Each of these is reusable: topological minors and the K4K_4K4​-subdivision-free class appear throughout structural graph theory.

Difficulty

The combinatorial core is proved by induction on ∣V∣|V|∣V∣ removing a vertex of degree at most two, and three of the four cases are routine. The obstacle is Case 4 (d(u)=2d(u)=2d(u)=2, neighbours non-adjacent): deleting uuu alone loses the information needed to recover SSS and FFF, so the proof identifies the two neighbours. That requires the class to be closed under this identification, a statement about subdivisions that is not a local edge count, and a lifting of (S′,F′)(S',F')(S′,F′) from the reduced graph with a case split on the component of F′F'F′ containing the merged vertex. A second gap is between FFF and the dual: an odd-circuit component of FFF may have chords in GGG and so need not lie in Z(G)Z(G)Z(G), and the zero–one dual solution must be extracted from it. Finally, Dirac's theorem itself is the one place where the absence of K4K_4K4​ subdivisions is used positively, and it is not a consequence of a degree-counting argument.

Formalization scope

Graphs are SimpleGraph V on a Fintype V with decidable equality and decidable adjacency. Z(G)Z(G)Z(G) is a Finset (Finset V) whose members induce a subgraph isomorphic to Mathlib's cycleGraph (2k+1), k≥1k\ge1k≥1. The dual variables are indexed by V, by the edge set G.edgeSet, and by the subtype of Z(G)Z(G)Z(G); x≥0x\ge0x≥0 is a sign constraint with no dual variable. "Contains a homeomorph of K4K_4K4​" is encoded by four distinct branch vertices and six paths (Walk.IsPath) that avoid other branch vertices and meet only at common endpoints; it is not the K4K_4K4​-minor notion and not the series–parallel composition notion, whose equivalence with it is not part of the paper.

Conventions and implicit hypotheses made explicit:

  • Dirac's theorem is stated with ∣V∣≥2|V|\ge 2∣V∣≥2; as printed it fails for graphs with fewer than two vertices.
  • In Case 4 the identified graph has vertex set V∖{u,w}V\setminus\{u,w\}V∖{u,w}, with vvv representing v≡wv\equiv wv≡w; parallel edges merge.
  • Optimality in the goal is against every real feasible point of each program. A statement comparing the zero–one points only with other zero–one points would reduce the primal half to α(G)≤α(G)\alpha(G)\le\alpha(G)α(G)≤α(G) and is ruled out.
  • In milestone 3 the sum a+b+∑kkcka+b+\sum_k k c_ka+b+∑k​kck​ is written as a sum over the connected components of FFF of 111 (one or two vertices) or (n−1)/2(n-1)/2(n−1)/2 (n≥3n\ge3n≥3 vertices).

Corollary 7.2 (stated without proof) and Conjecture 7.3 are not part of this mission. Contributions welcome: a general topological-minor library, Dirac's theorem, and a proof of the combinatorial core.

Selected references

  • V. Chvátal, On certain polytopes associated with graphs, J. Combin. Theory Ser. B 18 (1975) 138–154. https://doi.org/10.1016/0095-8956(75)90041-6
  • G. A. Dirac, In abstrakten Graphen vorhandene vollständige 4-Graphen und ihre Unterteilungen, Math. Nachr. 22 (1960) 61–85 (reference [6], Satz 5, of the paper).
  • R. J. Duffin, Topology of series-parallel networks, J. Math. Anal. Appl. 10 (1965) 303–318 (reference [7] of the paper).
  • M. Boulala, J.-P. Uhry, Polytope des indépendants d'un graphe série-parallèle, Discrete Math. 27 (1979) 225–243.
  • A. M. H. Gerards, A. Schrijver, Matrices with the Edmonds–Johnson property, Combinatorica 6 (1986) 365–379.
8 thms3 active usersReviewed
🏆Completed
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

The Design of Competitive Online Algorithms via a Primal-Dual Approach VII: Online Group Steiner TreesTextbook

Motivation

The group Steiner tree problem generalizes the ordinary Steiner tree problem: given a rooted tree and several groups of vertices, find a minimum-cost subtree that connects at least one vertex of each group to the root. It is a canonical instance of the generalized-connectivity family this survey studies in Chapter 11 — a family that also contains the online set-cover problem (Chapter 5 of this series) as a special case. Buchbinder and Naor's chapter shows how to convert the celebrated offline randomized-rounding algorithm of Garg, Konjevod and Ravi [56] into an online one, by imitating its per-edge coupling structure one iteration at a time as the online fractional solution (obtained from this survey's own Chapter 4 framework) evolves. This mission formalizes that online rounding scheme's three defining probabilistic guarantees and the resulting competitive-ratio theorem.

Setting

Fix a rooted tree T = (V, E, r) with non-negative edge costs c : E → ℝ, and k groups g₁, …, g_k ⊆ V, each request (r, gᵢ) arriving online. An online covering algorithm (from Chapter 4's framework, applied to the LP relaxation of this connectivity problem) maintains a monotonically increasing fractional weight w : E → ℝ on the edges, reinterpreted so that wₑ is the maximum flow that can be routed through e to any vertex of its subtree — a technical substitution needed so weights are monotone non-increasing along any root-to-leaf path, the property the rounding algorithm requires. At the end of each iteration in which some weights are augmented from w to w' = w + δ, the rounding algorithm processes every edge e with δₑ > 0, in topological order starting from the root, and randomly decides whether to add it to a growing random edge-cover C ⊆ E: deterministically, if w'ₑ > 1; via a single coin flip, if e is incident to the root or its parent edge's inclusion in C is already certain; via a coin flip conditional on the parent edge already being in C, otherwise. Because a coin is only ever flipped for a child once its parent is (or is already known to be) in C, C always induces a connected subtree containing the root.

Formalization targets

Theorem 11.4 (the goal, p. 231): there is a randomized online algorithm for the group Steiner problem in trees with competitive ratio O(log²n log k), where n is the number of leaves. It is built by running T independent trials of the rounding scheme in parallel and taking the union of the resulting covers, for T chosen (this mission's own explicit derivation — the book gives only the narrative "we run O(log k log N) independent trials... using simple probabilistic analysis") so that every group fails to be covered with probability at most 1/(2k), while the union's expected cost stays at T · log(n) · OPT.

Three milestones, in attack order, each stated exactly as the book states it (p. 230-231), with the book's own caveat "we state the main lemmas and omit the proofs" preserved — no in-source proof exists for any of the three beyond the algorithm's own description, so each is left sorry with no invented proof strategy:

  • Lemma 11.1: at the end of an iteration, ℙ[e ∈ C] = w'ₑ for every edge, and ℙ[e ∈ C] = 1 whenever wₑ > 1 already.
  • Lemma 11.2: the expected cost of C is at most ∑_{e∈T} cₑ w'ₑ (linearity of expectation applied to Lemma 11.1).
  • Lemma 11.3: for a group g of size at most N with total routable flow wg ≥ 1, the probability some vertex of g is covered is Ω(1/log N).

Significance

This is the survey's most involved application of the primal-dual framework: unlike Chapters 5, 9, 10 and 13, which round a single scalar decision per online step, the group Steiner algorithm must couple an entire iteration's worth of edge decisions so that the resulting random set stays a connected subtree — the coin-flip probabilities in the Algorithm box are exactly the minimal adjustment needed to keep marginal probabilities matching the fractional solution while preserving this connectivity invariant online. No formal development of the group Steiner problem (online or offline) was found on the platform as of 2026-09-20; this mission is the first.

Difficulty

Two distinct obstacles. First, faithfully representing "the probability that e ∈ C" for an online, coupled random process without assuming its proof: the mission represents the algorithm's random cover as an abstract finite probability distribution RandomCover E and states each lemma as an implication from the Algorithm box's three coupling rules (transcribed as hypotheses on marginal and conditional probabilities) to the claimed marginal or expected-value conclusion — capturing exactly what the book asserts without proof, rather than either assuming the conclusion trivially or constructing a full multi-iteration coupled process (which the source's own "we omit the proofs" indicates is genuinely nontrivial, citing [56]). Second, Theorem 11.4's own competitive ratio is stated in the book only asymptotically, with a purely narrative derivation ("we run O(log k log N) independent trials... we get a competitive ratio of O(log n log k log N)... probability at least 1 − 1/k") and no displayed formula anywhere in the chapter. Per this series' explicit-constants rule, this mission supplies its own explicit closed form for the number of trials T and the resulting bounds via a standard Chernoff/union-bound argument applied to Lemma 11.3's constant α; this derivation is the mission's own (documented below), not a transcription, since none exists in the source to transcribe.

Formalization scope

RandomCover E is a finite pmf p : Finset E → ℝ (Finset E itself finite since E is Fintype), with marg, condProb and expectedCost/probHits derived from it by ordinary Finset sums — no measure theory, since the sample space is always finite. RoundedTree E bundles parent : E → Option E (e(p)) and a non-negative cost. Lemma 11.3's wg (the flow routable to a group's vertices simultaneously) is left as hypothesis-supplied data rather than defined via an explicit max-flow formalization, which this mission's scope does not require (welcome contribution). Theorem 11.4's number of trials is the explicit closed form T = ⌈(log N · log(2k)) / α⌉, α the (existentially quantified, uniform) constant from Lemma 11.3; its coverage guarantee is 1 − 1/(2k) per group (this mission's own union-bound derivation), not the book's stated 1 − 1/k — the book reaches the stronger bound via an additional shortest-path fallback mechanism for any group the trials miss, which is out of scope here (welcome contribution, along with completing any of the four sorrys and formalizing Theorem 11.5's extension to general graphs via HST embedding, out of scope since it depends on an external embedding result not proved in this book).

Selected references

  • N. Buchbinder, J. Naor. The Design of Competitive Online Algorithms via a Primal-Dual Approach. Foundations and Trends in Theoretical Computer Science, 3(2-3):93-263, 2009. https://doi.org/10.1561/0400000024
  • N. Garg, G. Konjevod, R. Ravi. A polylogarithmic approximation algorithm for the group Steiner tree problem. Journal of Algorithms, 37(1):66-84, 2000 (cited as [56] in the survey).
  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor. A general approach to online network optimization problems. ACM Transactions on Algorithms, 2(4):640-660, 2006 (cited as [4], the source of this chapter's results per the Notes, p. 231).
11 thms3 active usersReviewed
CombinatoricsOperations Research·Captain: Shuze Chen

Flows in Networks V: Common Systems of Restricted RepresentativesTextbook

Motivation

Assignment questions ask whether every member of a family can be served by a different resource: committees that each need a distinct member as representative, or tasks that each need an admissible worker. The classical answer is Hall's theorem (Hall 1935): a family of sets has a system of distinct representatives exactly when every kkk of its sets together contain at least kkk elements. Operations research needs more than that. Representatives may be allowed to serve several sets within prescribed bounds, some elements may be required to appear, two families may have to be served by one common list, and the representatives may have to meet each class of a partition a bounded number of times.

Chapter II, §10 of Ford and Fulkerson's Flows in Networks (RAND Report R-375-PR, 1962; Princeton University Press, 1962) derives all of these as feasibility statements for network flows. The section collects results of Hall (1935), Mann and Ryser (1953), Hoffman and Kuhn (1956) and Ford and Fulkerson (1958). Its last results are the common system of restricted representatives theorem and the partition-constrained theorem of Hoffman and Kuhn.

Setting

Fix a fundamental set E={e1,…,em}E = \{e_1, \dots, e_m\}E={e1​,…,em​}, with the element eie_iei​ identified with its index iii. A family S={S1,…,Sn}\mathcal S = \{S_1, \dots, S_n\}S={S1​,…,Sn​} is a list of nnn subsets of EEE indexed by j=1,…,nj = 1, \dots, nj=1,…,n; two indices may carry the same set. For X⊆{1,…,n}X \subseteq \{1, \dots, n\}X⊆{1,…,n}, the index set I(X)⊆{1,…,m}I(X) \subseteq \{1, \dots, m\}I(X)⊆{1,…,m} is the set of indices of the elements of ⋃j∈XSj\bigcup_{j \in X} S_j⋃j∈X​Sj​, and I(∅)=∅I(\emptyset) = \emptysetI(∅)=∅.

A list of representatives is a choice r1,…,rnr_1, \dots, r_nr1​,…,rn​ of elements of EEE, where rjr_jrj​ represents SjS_jSj​. The number of occurrences of eie_iei​ is the number of indices jjj with rj=eir_j = e_irj​=ei​.

  • A system of distinct representatives (SDR) has rj∈Sjr_j \in S_jrj​∈Sj​ for all jjj and pairwise distinct entries.
  • Given integers 0≤ai≤ai′0 \le a_i \le a'_i0≤ai​≤ai′​, a system of restricted representatives (SRR) has rj∈Sjr_j \in S_jrj​∈Sj​ for all jjj, and each eie_iei​ occurs at least aia_iai​ and at most ai′a'_iai′​ times. The entries need not be distinct. With ai=0a_i = 0ai​=0 and ai′=1a'_i = 1ai′​=1 an SRR is exactly an SDR.
  • For a second family T={T1,…,Tn}\mathcal T = \{T_1, \dots, T_n\}T={T1​,…,Tn​}, a common SRR is a single list r1,…,rnr_1, \dots, r_nr1​,…,rn​ together with a permutation σ\sigmaσ of {1,…,n}\{1, \dots, n\}{1,…,n} such that rj∈Sjr_j \in S_jrj​∈Sj​ and rj∈Tσ(j)r_j \in T_{\sigma(j)}rj​∈Tσ(j)​ for every jjj, with the same occurrence bounds. Each representative represents exactly one set of each family, and every set of either family is represented exactly once. A common SDR is a common SRR with distinct entries.

For Y⊆{1,…,n}Y \subseteq \{1, \dots, n\}Y⊆{1,…,n}, I(Y)I(Y)I(Y) denotes the index set of ⋃j∈YTj\bigcup_{j \in Y} T_j⋃j∈Y​Tj​ when it refers to T\mathcal TT.

Formalization targets

Goal: the common SRR theorem (Chapter II, Theorem 10.8, p. 67)

A common SRR for S\mathcal SS and T\mathcal TT in which eie_iei​ occurs at least aia_iai​ and at most ai′a'_iai′​ times exists if and only if, for every X,Y⊆{1,…,n}X, Y \subseteq \{1, \dots, n\}X,Y⊆{1,…,n},

∣X∣+∣Y∣≤n−∑i=1mai+∑i∈I(X)∪I(Y)ai+∑i∈I(X)∩I(Y)ai′.(10.8)|X| + |Y| \le n - \sum_{i=1}^m a_i + \sum_{i \in I(X) \cup I(Y)} a_i + \sum_{i \in I(X) \cap I(Y)} a'_i. \tag{10.8}∣X∣+∣Y∣≤n−i=1∑m​ai​+i∈I(X)∪I(Y)∑​ai​+i∈I(X)∩I(Y)∑​ai′​.(10.8)

The bounds are integers with 0≤ai≤ai′0 \le a_i \le a'_i0≤ai​≤ai′​; the instance X=Y=∅X = Y = \emptysetX=Y=∅ reads ∑iai≤n\sum_i a_i \le n∑i​ai​≤n.

Milestones

In attack order:

  1. Hall's theorem (Theorem 10.1, p. 56). It is referenced from the platform's existing statement, which is the same result for an arbitrary index type.
  2. A sufficient condition through set sizes and element frequencies (Corollary 10.2, p. 58): if SjS_jSj​ has sjs_jsj​ elements, eie_iei​ lies in rir_iri​ sets, S=∑jsjS = \sum_j s_jS=∑j​sj​ and M=max⁡(r1,…,rm,s1,…,sn)M = \max(r_1, \dots, r_m, s_1, \dots, s_n)M=max(r1​,…,rm​,s1​,…,sn​), then (n−1)M<S(n - 1)M < S(n−1)M<S implies an SDR.
  3. The decomposition of an n×nn \times nn×n (0,1)(0,1)(0,1)-matrix with k>0k > 0k>0 ones in each row and column into kkk permutation matrices (Corollary 10.4, p. 59).
  4. The SRR theorem (Theorem 10.5, p. 59): an SRR exists iff for every XXX,
∣X∣≤min⁡(n−∑i=1mai+∑i∈I(X)ai, ∑i∈I(X)ai′).(10.1)|X| \le \min\Bigl(n - \sum_{i=1}^m a_i + \sum_{i \in I(X)} a_i,\ \sum_{i \in I(X)} a'_i\Bigr). \tag{10.1}∣X∣≤min(n−i=1∑m​ai​+i∈I(X)∑​ai​, i∈I(X)∑​ai′​).(10.1)
  1. SDRs containing a prescribed set MMM of marginal elements, in Hoffman and Kuhn's form (Theorem 10.6, p. 62: Hall's condition, and every M′⊆MM' \subseteq MM′⊆M meets at least ∣M′∣|M'|∣M′∣ of the sets) and through index sets (Corollary 10.7, p. 63: ∣X∣≤min⁡(n−ℓ+∣L∩I(X)∣,∣I(X)∣)|X| \le \min(n - \ell + |L \cap I(X)|, |I(X)|)∣X∣≤min(n−ℓ+∣L∩I(X)∣,∣I(X)∣) with LLL the index set of MMM and ℓ=∣M∣\ell = |M|ℓ=∣M∣).
  2. The common SDR theorem (Corollary 10.9, p. 68): ∣X∣+∣Y∣≤n+∣I(X)∩I(Y)∣|X| + |Y| \le n + |I(X) \cap I(Y)|∣X∣+∣Y∣≤n+∣I(X)∩I(Y)∣ for all X,YX, YX,Y.
  3. SDRs that meet each block PkP_kPk​ of a partition of EEE between integer bounds ak≤∣R∩Pk∣≤ak′a_k \le |R \cap P_k| \le a'_kak​≤∣R∩Pk​∣≤ak′​ (Theorem 10.10, p. 68). The condition is
∣(⋃k∈UPk)∩(⋃j∈VSj)∣≥max⁡(∣V∣−∑k∈Uˉak′, ∣V∣−n+∑k∈Uak)\Bigl|\Bigl(\bigcup_{k \in U} P_k\Bigr) \cap \Bigl(\bigcup_{j \in V} S_j\Bigr)\Bigr| \ge \max\Bigl(|V| - \sum_{k \in \bar U} a'_k,\ |V| - n + \sum_{k \in U} a_k\Bigr)​(k∈U⋃​Pk​)∩(j∈V⋃​Sj​)​≥max(∣V∣−k∈Uˉ∑​ak′​, ∣V∣−n+k∈U∑​ak​)

for all U⊆{1,…,p}U \subseteq \{1, \dots, p\}U⊆{1,…,p} and V⊆{1,…,n}V \subseteq \{1, \dots, n\}V⊆{1,…,n}.

Significance

These theorems are the combinatorial face of the integral flow theorems of the same chapter. The SRR theorem governs many-to-one assignment with quotas, where each resource must be used between a minimum and a maximum number of times. The marginal-element theorems decide when a prescribed set of resources can all be used; Mann and Ryser applied their sufficient condition for this to Ryser's theorem on extending Latin rectangles to Latin squares (p. 62). The common SRR theorem decides when two families can be served by one list, the setting of simultaneous assignment along two classifications. Theorem 10.10 adds quotas per class of a partition of the resources. Corollary 10.4 is König's edge-colouring theorem for regular bipartite graphs, in matrix form.

All of these results are classical and proved. Hall's theorem is in Mathlib and is referenced here. As far as a search of the platform shows, none of the quota, marginal-element, common-representative or partition versions has a machine-checked statement or proof. The mission produces faithful statements of the book's §10 results on a shared set of definitions, and invites formal proofs of them.

Difficulty

Necessity of each condition is a counting argument. Sufficiency is the content, and the natural first idea does not work. Applying Hall's theorem to a family in which each set is repeated according to its bounds handles upper bounds but not lower bounds. The two families of the common problem cannot be treated separately either: an SRR for S\mathcal SS and an SRR for T\mathcal TT with the same occurrence counts need not combine into one list, because the identification of positions must respect both families at once. In the book every sufficiency proof passes through an integral feasible flow or circulation, and the cut conditions of the circulation theorem must be reduced case by case to the stated inequalities.

Formalization scope

EEE is Fin m and a family is Fin n → Finset (Fin m), indexed from 000. A list of representatives is a function Fin n → Fin m, an SDR is an injective one, and the occurrence count is a Finset.card. A common SRR is a pair of a list and an Equiv.Perm (Fin n). The index set I(X)I(X)I(X) is X.biUnion S. The occurrence bounds are natural numbers. The page states only 0≤ai≤ai′0 \le a_i \le a'_i0≤ai​≤ai′​, but the bounds count occurrences, and with real bounds Theorems 10.5 and 10.8 are false. Every inequality involving subtraction is evaluated in Z\mathbb ZZ, so no term truncates at zero. The partition in Theorem 10.10 has nonempty, pairwise disjoint blocks covering EEE. In Corollary 10.2 the maximum runs over all rir_iri​ (i=1,…,mi = 1, \dots, mi=1,…,m); the page prints rnr_nrn​ as the last index. In Theorem 10.10 the first union is over k∈Uk \in Uk∈U; the page prints j∈Uj \in Uj∈U.

The trivializing formalizations are ruled out explicitly. An SRR without the occurrence bounds, and a "common SRR" consisting of two unrelated SRRs, are both excluded: the definitions carry the bounds, and a common SRR is one list whose entries each represent one set of each family through the permutation σ\sigmaσ.

Beyond the paper. Two sharpness probes restate Theorems 10.5 and 10.8 with real bounds 0≤ai≤ai′0 \le a_i \le a'_i0≤ai​≤ai′​. Both are expected to be false: with m=2m = 2m=2, n=1n = 1n=1, S1=T1={e1,e2}S_1 = T_1 = \{e_1, e_2\}S1​=T1​={e1​,e2​} and a=(12,12)a = (\tfrac12, \tfrac12)a=(21​,21​), a′=(1,1)a' = (1, 1)a′=(1,1), the conditions hold while no list of length one contains both elements. Disproofs are the sought outcome.

A complete development needs Hall's theorem (available in Mathlib) and, for the book's route, an integral flow or circulation feasibility theorem; purely combinatorial proofs by induction are equally welcome. The definitions are reusable for the zero-one matrix results of the following sections. Proofs of individual milestones are welcome, in any order.

Selected references

  • P. Hall, On representatives of subsets, Journal of the London Mathematical Society 10 (1935), 26–30. https://doi.org/10.1112/jlms/s1-10.37.26
  • L. R. Ford, Jr. and D. R. Fulkerson, Network flow and systems of representatives, Canadian Journal of Mathematics 10 (1958), 78–84. https://doi.org/10.4153/CJM-1958-009-4
  • A. J. Hoffman and H. W. Kuhn, Systems of distinct representatives and linear programming, American Mathematical Monthly 63 (1956), 455–460. https://doi.org/10.2307/2309399
  • L. R. Ford, Jr. and D. R. Fulkerson, Flows in Networks, RAND Report R-375-PR, 1962; Princeton University Press, 1962. https://www.rand.org/pubs/reports/R375.html
10 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

The Buck-Passing Game: Every Deterministic Buck-Passing Game Has a Prior-Free Pure Nash EquilibriumResearch Paper

Why the game matters

In a buck-passing game, each participant chooses who will receive a task, burden, or token next. The eventual share of time spent holding it depends on every participant's choice. This makes a small network into a game: a local change of one outgoing edge can alter the long-run burden across an entire part of the network. Cominetti, Quattropani, and Scarsini study this setting in The Buck-Passing Game, including deterministic and stochastic versions. The deterministic result targeted here says that players can choose their outgoing edges without knowing where the buck will start and still reach a pure Nash equilibrium.

That independence from the starting distribution matters because an initial probability law can be unknown or disputed. A Nash equilibrium found for one chosen law may cease to be an equilibrium under another. The paper calls a profile that works for every law a prior-free Nash equilibrium. Its existence is the subject of Theorem 2 on p. 10 of arXiv:1808.03206v4.

The deterministic setting

Start with a finite directed graph G=(V,E)G=(V,E)G=(V,E) without loops. Each vertex iii is a player and has a nonempty set Ni+N_i^+Ni+​ of outgoing neighbors. Player iii chooses one neighbor si∈Ni+s_i\in N_i^+si​∈Ni+​; the collection s=(si)i∈Vs=(s_i)_{i\in V}s=(si​)i∈V​ is a strategy profile. Once these choices are fixed, the graph becomes a functional graph: from each vertex there is exactly one selected outgoing edge, and the buck moves according to the map fs(i)=sif_s(i)=s_ifs​(i)=si​.

At time zero, Nature places the buck at a vertex drawn from a probability distribution μ\muμ on VVV. At time t≥1t\geq1t≥1, the buck is at fst(j)f_s^t(j)fst​(j) if it started at jjj. The cost ci(s)c_i(s)ci​(s) of player iii is the expected limiting fraction of positive times for which iii holds it. Players minimize their own costs. The definition follows equation (3) on p. 6: for each possible start jjj, count visits at times 1,…,T1,\ldots,T1,…,T, divide by TTT, take the limit, and average the resulting value with weights μj\mu_jμj​.

Every orbit on a finite functional graph eventually enters a directed cycle. The vertices whose orbits enter the same cycle form its basin, called a unicycle in the paper. The cycles CsℓC_s^\ellCsℓ​ are pairwise disjoint, and their basins AsℓA_s^\ellAsℓ​ partition the vertices. Equation (6) on p. 7 says that a player outside a cycle has zero long-run cost, while a player on cycle CsℓC_s^\ellCsℓ​ has cost μ(Asℓ)/∣Csℓ∣\mu(A_s^\ell)/|C_s^\ell|μ(Asℓ​)/∣Csℓ​∣. A unilateral change is profitable when it strictly lowers the changing player's cost; a profile with no profitable change is a pure Nash equilibrium. Definitions 1–3 and equations (3)–(6) fix these terms.

Formalization targets

The main target is Theorem 2. The order of its quantifiers is essential: one profile must work for every initial probability distribution. Writing Δ(V)\Delta(V)Δ(V) for the probability distributions on VVV, the claim is

∃s∈∏i∈VNi+∀μ∈Δ(V)∀i∈V∀x∈Ni+,ci(s)≤ci(x,s−i).\exists s\in\prod_{i\in V}N_i^+\quad\forall\mu\in\Delta(V)\quad\forall i\in V\quad\forall x\in N_i^+,\qquad c_i(s)\leq c_i(x,s_{-i}).∃s∈i∈V∏​Ni+​∀μ∈Δ(V)∀i∈V∀x∈Ni+​,ci​(s)≤ci​(x,s−i​).

The proposed milestones match the claims leading up to this result in §3.1 of the paper. A component-wise minimizer of a generalized ordinal potential is a Nash equilibrium. Proposition 1 guarantees an equilibrium for a finite generalized ordinal potential game and also for the compact, lower semicontinuous case. Equation (6) identifies costs from the limiting visit frequencies. The p. 9 classification describes the two types of profitable deviation. Theorem 1 supplies a generalized ordinal potential that depends only on the selected cycles:

Ψ(s)=∑ℓ=1M(s)(∣V∣−∣Csℓ∣),ci(x,s−i)<ci(s)  ⟹  Ψ(x,s−i)<Ψ(s).\Psi(s)=\sum_{\ell=1}^{M(s)}\bigl(|V|-|C_s^\ell|\bigr),\qquad c_i(x,s_{-i})<c_i(s)\;\Longrightarrow\;\Psi(x,s_{-i})<\Psi(s).Ψ(s)=ℓ=1∑M(s)​(∣V∣−∣Csℓ​∣),ci​(x,s−i​)<ci​(s)⟹Ψ(x,s−i​)<Ψ(s).

The full-support assertion in the second sentence of Theorem 1 is outside this mission's milestone list. The existence target uses its first assertion. Theorem 3's bound on improvement-path length and the paper's stochastic, constrained, and buck-holding games are also outside this target.

What the result provides

Theorem 2 guarantees a pure strategy profile with stability across all starting distributions, including distributions concentrated at a single vertex. It strengthens the statement that each fixed distribution has some equilibrium, which could choose a different profile each time. In this deterministic model the same strategy choices serve all initial laws. The paper's proof ties that claim to a graph quantity, Ψ\PsiΨ, whose value has no μ\muμ parameter. Theorems 1–2, pp. 9–10 state the potential and equilibrium conclusions.

The research result is already proved in the paper. The work here is to give its definitions and statements precise Lean types and to establish machine-checked proofs of the limit identity, graph-change classification, potential property, and existence theorem. The drafted theorem files currently contain sorry, so their compilation checks statement well-formedness rather than proving the claims. The finite cost-game definitions and orbit-frequency statement can also support later formalizations of deterministic dynamics and potential games.

Where the proof is difficult

A finite orbit is eventually periodic, but the cost is defined using a limit of averages from time 111 through TTT. The formal development must establish that limit for every initial vertex before substituting the cycle-and-basin formula. It must then track what a one-player change does to the cycles of a functional graph. The changed edge can lengthen one cycle or remove it by sending its vertices toward a different cycle; costs also depend on how much initial mass reaches the affected basin. Merely knowing that a player's new out-neighbor is in the same basin does not show an improvement, because the new cycle may be shorter or unchanged. These are the concrete issues behind equation (6) and Theorem 1.

Formalization scope

Lean gives the general cost-game predicates their own definition module. The deterministic model represents VVV by a finite type, with the paper's loopless and nonempty out-neighborhood assumptions bundled into BPGraph. A strategy is an out-neighbor subtype, so every profile selects only legal edges. The distribution is a real vector with nonnegative coordinates summing to one. Costs and the potential are real-valued. The cost is built from the orbit's Cesàro limit in equation (3); equation (6) is a separate theorem asserting convergence and the resulting value. Cycles are finite sets of periodic points, deduplicated so that Ψ\PsiΨ has exactly one summand per cycle; basins contain the vertices whose orbits reach that cycle. Classical decidability constructs these finite sets.

The empty vertex type is permitted by the Lean representation; it has one empty strategy profile and no probability distribution. A one-vertex graph cannot satisfy both the loopless and nonempty out-neighborhood assumptions. The prior-free goal explicitly places the profile before the quantifier over distributions. Defining cost by the cycle formula, or choosing a separate equilibrium after seeing each distribution, would change the target. Proposition 1 makes nonempty strategy sets explicit, as an empty compact strategy set has no profile. The first profitable-deviation case requires that the changed edge lengthen the cycle; membership in the basin alone does not do so.

The development needs reusable results on finite function iteration, periodic points, Cesàro frequencies, finite products, and lower semicontinuous minimization. The goal and its milestones invite proofs of those statements under the recorded hypotheses. All mission items are drafted locally and remain unproved until solvers supply proofs.

Selected references

  • R. Cominetti, M. Quattropani, and M. Scarsini, The Buck-Passing Game, Mathematics of Operations Research, 2022. arXiv:1808.03206v4. The formalization cites the version 4 preprint's pages and numbering.
9 thms2 active usersReviewed
Quantum Error CorrectionQuantum Information·Captain: mikedeng1

Decoding Quantum Tanner Codes: The Parallel Decoder Corrects Every Error of Weight Linear in the Code Length in Logarithmically Many RoundsResearch Paper

Why decoding good quantum LDPC codes matters

Quantum computers must correct errors faster than they accumulate, and quantum low-density parity-check (LDPC) codes are the leading candidates for doing so with little overhead: every check involves a bounded number of qubits, so syndromes can be measured by local circuits. In 2021–2022 the first asymptotically good quantum LDPC codes appeared, with dimension and minimum distance both linear in the code length nnn: the expander lifted product codes of Panteleev and Kalachev (arXiv:2111.03654) and the quantum Tanner codes of Leverrier and Zémor (arXiv:2202.13641). A code is only useful if errors can be corrected efficiently. Leverrier and Zémor (arXiv:2208.05537) give two decoders for quantum Tanner codes that correct every error of weight up to a constant fraction of nnn: a sequential one running in linear time, and a parallel decoder running in a logarithmic number of rounds of local updates. This mission is about the parallel decoder.

Timeline:

  • 2021, Panteleev–Kalachev: asymptotically good quantum LDPC codes and locally testable classical codes (arXiv:2111.03654).
  • 2022, Leverrier–Zémor: quantum Tanner codes, a simpler construction on left-right Cayley complexes (arXiv:2202.13641).
  • 2022, Gu–Pattison–Tang, Leverrier–Zémor and Dinur–Hsieh–Lin–Vidick: efficient decoders for linear-distance quantum LDPC codes (arXiv:2206.06557, arXiv:2206.07571, arXiv:2206.07750).
  • 2022, Leverrier–Zémor, Decoding quantum Tanner codes: sequential and parallel decoders up to a constant fraction of nnn, with a revised parallel analysis in v3 (arXiv:2208.05537v3).

The code and the decoder

Let GGG be a finite group and A=A−1A=A^{-1}A=A−1, B=B−1⊆GB=B^{-1}\subseteq GB=B−1⊆G with ∣A∣=∣B∣=Δ|A|=|B|=\Delta∣A∣=∣B∣=Δ. The quadripartite left-right Cayley complex has four copies of GGG as vertices, Vij=G×{ij}V_{ij}=G\times\{ij\}Vij​=G×{ij}, and one square {(g,00),(ag,01),(gb,10),(agb,11)}\{(g,00),(ag,01),(gb,10),(agb,11)\}{(g,00),(ag,01),(gb,10),(agb,11)} for every (g,a,b)∈G×A×B(g,a,b)\in G\times A\times B(g,a,b)∈G×A×B. The set of squares QQQ has n=∣G∣Δ2n=|G|\Delta^2n=∣G∣Δ2 elements, and every vertex vvv sees its QQQ-neighbourhood Q(v)Q(v)Q(v) as an A×BA\times BA×B array: columns are indexed by bbb, rows by aaa. The left Cayley graph Cay(G,A)\mathrm{Cay}(G,A)Cay(G,A) and the right Cayley graph Cay(G,B)\mathrm{Cay}(G,B)Cay(G,B) are assumed to be non-bipartite Ramanujan graphs: every adjacency eigenvalue other than ±Δ\pm\Delta±Δ has absolute value at most 2Δ−12\sqrt{\Delta-1}2Δ−1​.

Two local codes CA⊆F2AC_A\subseteq\mathbb F_2^ACA​⊆F2A​, CB⊆F2BC_B\subseteq\mathbb F_2^BCB​⊆F2B​ with dim⁡CA+dim⁡CB=Δ\dim C_A+\dim C_B=\DeltadimCA​+dimCB​=Δ are fixed. Write V0=V00∪V11V_0=V_{00}\cup V_{11}V0​=V00​∪V11​ and V1=V01∪V10V_1=V_{01}\cup V_{10}V1​=V01​∪V10​. The code C1⊆F2Q\mathcal C_1\subseteq\mathbb F_2^QC1​⊆F2Q​ consists of the vectors whose view on every Q(v)Q(v)Q(v), v∈V1v\in V_1v∈V1​, lies in the dual tensor code CA⊗F2B+F2A⊗CBC_A\otimes\mathbb F_2^B+\mathbb F_2^A\otimes C_BCA​⊗F2B​+F2A​⊗CB​: every local view is a sum of a word whose columns are in CAC_ACA​ and a word whose rows are in CBC_BCB​. C0\mathcal C_0C0​ is defined in the same way on V0V_0V0​ with CA⊥C_A^\perpCA⊥​, CB⊥C_B^\perpCB⊥​. The local codes and their duals have distance at least δΔ\delta\DeltaδΔ. Both dual tensor codes are κ\kappaκ-product-expanding: every codeword xxx splits as x=c+rx=c+rx=c+r with ∣x∣≥κΔ(∥c∥+∥r∥)|x|\ge\kappa\Delta(\|c\|+\|r\|)∣x∣≥κΔ(∥c∥+∥r∥), where ∥c∥\|c\|∥c∥ counts non-zero columns and ∥r∥\|r\|∥r∥ non-zero rows.

A σx\sigma_xσx​-type error e∈F2Qe\in\mathbb F_2^Qe∈F2Q​ is decoded in three phases. In the preprocessing phase every v∈V1v\in V_1v∈V1​ chooses a minimum-weight local error εv\varepsilon_vεv​ with the local syndrome of eee; the mismatch is Z=∑v∈V1εvZ=\sum_{v\in V_1}\varepsilon_vZ=∑v∈V1​​εv​. The mismatch decomposition writes Z=C^0+R^0+C^1+R^1Z=\hat C_0+\hat R_0+\hat C_1+\hat R_1Z=C^0​+R^0​+C^1​+R^1​, with C^j\hat C_jC^j​ a sum of CAC_ACA​-columns and R^i\hat R_iR^i​ a sum of CBC_BCB​-rows. Postprocessing outputs e^=∑v∈V10εv+C^0+R^1\hat e=\sum_{v\in V_{10}}\varepsilon_v+\hat C_0+\hat R_1e^=∑v∈V10​​εv​+C^0​+R^1​. The parallel decoder (Algorithm 3) runs rounds of four substeps, one for each of V00,V01,V10,V11V_{00},V_{01},V_{10},V_{11}V00​,V01​,V10​,V11​. In a substep, every vertex vvv of the current class simultaneously looks for a non-zero local dual tensor codeword xvx_vxv​ on Q(v)Q(v)Q(v) with ∣Z^∣−∣Z^+xv∣≥∣xv∣/2|\hat Z|-|\hat Z+x_v|\ge|x_v|/2∣Z^∣−∣Z^+xv​∣≥∣xv​∣/2, picks one of maximum weight, splits it as cv+rvc_v+r_vcv​+rv​ with ∥cv∥+∥rv∥\|c_v\|+\|r_v\|∥cv​∥+∥rv​∥ minimal, and updates C^j\hat C_jC^j​, R^i\hat R_iR^i​ and Z^\hat ZZ^.

Formalization targets

Goal: Theorem 20 (= Theorem 3)

Fix ε∈(0,1/6)\varepsilon\in(0,1/6)ε∈(0,1/6) and δ,κ>0\delta,\kappa>0δ,κ>0. For all Δ\DeltaΔ large enough, every error with

∣e∣<1212min⁡(ε316,κ4)δ2κ2nΔ|e|<\frac1{2^{12}}\min\Big(\frac{\varepsilon^3}{16},\frac\kappa4\Big)\delta^2\kappa^2\frac n\Delta∣e∣<2121​min(16ε3​,4κ​)δ2κ2Δn​

is corrected by every run of the parallel decoder. With θ=14(14−32ε)\theta=\frac14\big(\frac14-\frac32\varepsilon\big)θ=41​(41​−23​ε), each round satisfies ∣Z^k+1∣≤(1−θ)∣Z^k∣|\hat Z_{k+1}|\le(1-\theta)|\hat Z_k|∣Z^k+1​∣≤(1−θ)∣Z^k​∣, so Z^k=0\hat Z_k=0Z^k​=0 once (1−θ)k⋅4∣e∣<1(1-\theta)^k\cdot4|e|<1(1−θ)k⋅4∣e∣<1, and then e+e^e+\hat ee+e^ lies in the span C0⊥\mathcal C_0^\perpC0⊥​ of the σx\sigma_xσx​-generators.

Milestones

  • Lemma 4 (expander mixing) and Lemma 5: λ(G0□),λ(G1□)≤4Δ\lambda(\mathcal G^\square_0),\lambda(\mathcal G^\square_1)\le4\Deltaλ(G0□​),λ(G1□​)≤4Δ.
  • Lemmas 7, 10, 11, 8 and Theorem 9: the minimum distance, dmin⁡≥δ2κ2n/(1024Δ)d_{\min}\ge\delta^2\kappa^2n/(1024\Delta)dmin​≥δ2κ2n/(1024Δ).
  • Lemmas 14, 15, 16 and Theorem 12: if a minimum decomposition of a non-zero mismatch has few active vertices, some local codeword lowers ∣Z∣|Z|∣Z∣ by (1−ε)∣xv∣(1-\varepsilon)|x_v|(1−ε)∣xv​∣.
  • Lemma 17: ∣Z∣≤4∣e∣|Z|\le4|e|∣Z∣≤4∣e∣ and ∥Z∥≤4∣e∣/(κΔ)\|Z\|\le4|e|/(\kappa\Delta)∥Z∥≤4∣e∣/(κΔ).
  • Lemma 19: below 2−16ε3κ2δ2n/Δ2^{-16}\varepsilon^3\kappa^2\delta^2n/\Delta2−16ε3κ2δ2n/Δ, sequential decoding with parameter 1/21/21/2 never stalls, and switching to ε\varepsilonε still converges.
  • Lemma 18: if the ε\varepsilonε-sequential decoder converges, one parallel round removes at least θ∣Z∣\theta|Z|θ∣Z∣.

Significance

The theorem shows that asymptotically good quantum LDPC codes can be decoded against adversarial errors of linear weight by O(log⁡n)O(\log n)O(logn) rounds of local computation, each vertex acting only on its own QQQ-neighbourhood. This matters for fault tolerance, where decoding latency is a bottleneck. The milestones carry independent value. Theorem 9 is a linear minimum distance bound for quantum Tanner codes in the quadripartite setting. Theorem 12 is the local-to-global "weight reduction" principle on which both decoders rest. Lemmas 4–5 are spectral facts about Cayley graphs and square complexes that are reusable for any expander-based code.

The paper's results are proved, not open; none has been machine-checked. The sequential decoder's correctness (Theorem 13) is posed separately on the platform as an open goal in the mission Decoding quantum Tanner codes (Leverrier, Zemor), which shares this mission's published definitions; this mission does not restate it. Formalizing the present chain would give a complete, checked proof that a parallel decoder exists for good quantum LDPC codes, and would expose the constants. Two printed constants are corrected here (see the scope section), and sharper constants or simpler arguments are welcome.

Difficulty

The obvious argument is to bound the mismatch and its norm, apply Theorem 12 repeatedly, and let all vertices of a class flip at once. That argument fails because parallel flips are not sequential flips. A vertex's best local move against the mismatch at its turn need not be the move a converging sequential run would make, and a round could stall even though a sequential run never does. Lemma 18 resolves this with a virtual sequential run, a partition of its increments into "good" and "bad" ones (Claim 1), and the maximum-weight rule at every vertex. Without that rule the lemma is false. Theorem 12 itself is a counting contradiction. It uses robustness, the expander mixing lemma twice, and two notions of "exceptional" vertices, and it needs Δ\DeltaΔ large. Theorem 9 needs the coset-minimization of Lemma 7 before the same counting can start.

Formalization scope

The development builds on the published layers QAlgorithms_Defs_TensorCode and QAlgorithms_Defs_TannerDecoder. These define the complex, φv\varphi_vφv​, C0\mathcal C_0C0​, C1\mathcal C_1C1​, the σx\sigma_xσx​ span, minimum local corrections, the mismatch, Algorithm 2 and the output e^\hat ee^. The conventions are:

  • A vertex (g,ij)(g,ij)(g,ij) is (g, (i, j)) : G × (Bool × Bool), squares are G × A × B, and weights are hammingNorm cast to ℝ.
  • One new definitions file holds Algorithm 3 (admissible move, parallel choice, substep, round, run), decompositions and their norm, active, exceptional and ordinary vertices, the clustering sets TTT, stalled and converging sequential decoders, C1⊥\mathcal C_1^\perpC1⊥​, and the square graphs Gk□\mathcal G^\square_kGk□​.
  • "Δ\DeltaΔ large enough" is ∃Δ0 ∀Δ≥Δ0\exists\Delta_0\,\forall\Delta\ge\Delta_0∃Δ0​∀Δ≥Δ0​, with Δ0\Delta_0Δ0​ depending only on the constants fixed before it.
  • Only σx\sigma_xσx​-type errors are treated; the σz\sigma_zσz​ case is symmetric.
  • Non-bipartiteness of the Cayley graphs (the standing choice of p. 10) is assumed wherever spectral bounds are used.
  • Theorem 12 assumes Z≠0Z\ne0Z=0 and asks for a non-zero xvx_vxv​.

Corrected constants. Theorem 9 is stated with 102410241024 instead of the printed 256256256, because Lemma 8 and the proof's ∣x∣≥κΔ2∥x∥|x|\ge\frac{\kappa\Delta}2\|x\|∣x∣≥2κΔ​∥x∥ give 102410241024. The goal's error bound uses min⁡(ε3/16,κ/4)\min(\varepsilon^3/16,\kappa/4)min(ε3/16,κ/4) instead of min⁡(ε3/16,κ)\min(\varepsilon^3/16,\kappa)min(ε3/16,κ), which is what the corrected distance supports. Both corrected statements are weaker than the printed ones.

No trivialization. Every vertex must flip a maximum-weight admissible move whenever one exists, and runs range over all such choices. "Logarithmic time" is the per-round contraction factor, not mere eventual termination. Validity is membership of e+e^e+\hat ee+e^ in the σx\sigma_xσx​-generator span, with e^\hat ee^ the paper's postprocessing output. A formalization that lets vertices idle, drops the maximum-weight rule, or proves only eventual termination does not prove this theorem.

Needed and reusable infrastructure:

  • spectral graph theory for regular multigraphs (expander mixing, eigenvalues of commuting Cayley adjacencies);
  • product expansion and local minimality of decompositions;
  • the combinatorics of the left-right complex (shared rows and columns).

Contributions proving the graph lemmas or Lemma 18, whose proof is pure counting, are especially welcome.

Selected references

  • A. Leverrier, G. Zémor, Decoding quantum Tanner codes, IEEE Transactions on Information Theory; arXiv:2208.05537v3, 2022. https://arxiv.org/abs/2208.05537
  • A. Leverrier, G. Zémor, Quantum Tanner codes, FOCS 2022; arXiv:2202.13641. https://arxiv.org/abs/2202.13641
  • P. Panteleev, G. Kalachev, Asymptotically good quantum and locally testable classical LDPC codes, STOC 2022; arXiv:2111.03654. https://arxiv.org/abs/2111.03654
  • S. Gu, C. A. Pattison, E. Tang, An efficient decoder for a linear distance quantum LDPC code, STOC 2023; arXiv:2206.06557. https://arxiv.org/abs/2206.06557
  • A. Leverrier, G. Zémor, Efficient decoding up to a constant fraction of the code length for asymptotically good quantum codes, SODA 2023; arXiv:2206.07571. https://arxiv.org/abs/2206.07571
  • I. Dinur, M.-H. Hsieh, T.-C. Lin, T. Vidick, Good quantum LDPC codes with linear time decoders, arXiv:2206.07750, 2022. https://arxiv.org/abs/2206.07750
  • G. Kalachev, P. Panteleev, Two-sided robustly testable codes, arXiv:2206.09973, 2022. https://arxiv.org/abs/2206.09973
18 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

Hypergraph k-Cut for Fixed k in Deterministic Polynomial Time: A Maximal Minimum k-Partition's First Part Is the Source-Maximal Minimum (S, T)-Terminal Cut for Some |S| = 2k − 2Research Paper

Why this question matters

The hypergraph k-cut problem asks for a least-cost way to split the vertices of a hypergraph into kkk nonempty groups. An edge of a hypergraph may contain more than two vertices, so the graph version does not capture the behavior of every input. For fixed kkk, randomized polynomial-time algorithms for hypergraph k-cut were known before the deterministic result of Chandrasekaran and Chekuri. Their paper identifies a structural property of optimal partitions that makes one of their deterministic approaches possible. This mission isolates that property as a mathematical theorem about finite hypergraphs.

The same paper explains why the distinction between hypergraph k-cut and partitioning by a general symmetric submodular set function matters. The hypergraph cut function is symmetric and submodular, but the cost of a k-partition counts each crossing hyperedge once; it is generally different from the sum of the cut values of the parts. The paper also gives a counterexample to a proposed extension of its uncrossing theorem to general submodular functions. The target here therefore uses the actual hyperedge crossing cost throughout. Chandrasekaran and Chekuri, §§1.1 and 3.

Finite hypergraphs and terminal cuts

Let G=(V,E)G=(V,E)G=(V,E) be a finite unit-cost hypergraph. A hyperedge is a subset of the vertex set VVV, and EEE may contain parallel copies. For a vertex set AAA, its cut value d(A)d(A)d(A) is the number of edge copies meeting both AAA and its complement A‾=V∖A\overline A=V\setminus AA=V∖A. Thus empty edges, singleton edges, and edges lying entirely on one side contribute zero. This is the paper's convention after it reduces to unit costs in §1.1. Source, pp. 3 and 7.

An ordered k-partition P=(V1,…,Vk)P=(V_1,\ldots,V_k)P=(V1​,…,Vk​) has kkk nonempty, pairwise disjoint parts whose union is VVV. Its cost counts each hyperedge once if that edge meets at least two distinct parts. A minimum k-partition has least cost among all such ordered partitions. It is maximal minimum when there is no other minimum k-partition whose first part strictly contains V1V_1V1​. The order matters because the theorem singles out V1V_1V1​. Source, p. 4.

For disjoint vertex sets (S,T)(S,T)(S,T), an (S,T)(S,T)(S,T)-terminal cut is a source set UUU with S⊆U⊆V∖TS\subseteq U\subseteq V\setminus TS⊆U⊆V∖T. A minimum terminal cut has the smallest d(U)d(U)d(U) among these sets. The source-maximal minimum terminal cut is the minimum cut whose source set contains the source set of every other minimum (S,T)(S,T)(S,T)-terminal cut. This condition identifies one set, even when several minimum cuts have the same value. Source, p. 3.

Formalization targets

The structural theorem

For k≥2k\ge 2k≥2, let P=(V1,…,Vk)P=(V_1,\ldots,V_k)P=(V1​,…,Vk​) be a maximal minimum k-partition with ∣V1∣≥2k−2|V_1|\ge 2k-2∣V1​∣≥2k−2. For every T⊆V1‾T\subseteq\overline{V_1}T⊆V1​​ that meets every VjV_jVj​ with j≥2j\ge 2j≥2, the goal is

∃S⊆V1,∣S∣=2k−2andV1 is the source-maximal minimum (S,T)-terminal cut.\exists S\subseteq V_1,\quad |S|=2k-2 \quad\text{and}\quad V_1\text{ is the source-maximal minimum }(S,T)\text{-terminal cut}.∃S⊆V1​,∣S∣=2k−2andV1​ is the source-maximal minimum (S,T)-terminal cut.

This is Theorem 1.2, p. 4. The size is an equality, and the set SSS may depend on TTT. Source maximality is part of the conclusion.

Supporting statements

The milestone list includes symmetry and submodularity of ddd, uniqueness of the source-maximal minimum terminal cut, the counting statements of §3 (Proposition 3.1, the identity d(Y1∪W)+d(Y2∪W)=σ(Y1,Y2,W,Z)d(Y_1\cup W)+d(Y_2\cup W)=\sigma(Y_1,Y_2,W,Z)d(Y1​∪W)+d(Y2​∪W)=σ(Y1​,Y2​,W,Z); Lemma 3.1, the one-step refinement bound on σ\sigmaσ; Lemma 3.2, the σ\sigmaσ bound for uncrossed minimum terminal cuts; Lemma 3.3, the selection of k−1k-1k−1 parts), and the containment and extremal claims used in §4 (Lemma 4.1, Claims 4.1 and 4.2). The principal intermediate target is Theorem 3.1: under its specified family of minimum terminal cuts, it produces a k-partition PPP whose last part strictly contains a given complement U‾\overline UU, and whose cost is at most half of every pair sum d(Ai)+d(Aj)d(A_i)+d(A_j)d(Ai​)+d(Aj​). These are separate theorem statements with the same finite hypergraph model.

What the result provides

Theorem 1.2 says that a part of a suitably chosen optimum partition can be specified by a bounded-size source set and a sink set meeting the other parts. It gives a finite certificate for recovering that part via a minimum terminal-cut problem. Unlike a statement about one specially chosen low-cut-value part, it applies to the first part of any maximal minimum k-partition that meets the size condition. The paper uses this theorem to derive its first deterministic polynomial-time algorithm. Chandrasekaran and Chekuri, Theorem 2.1 and §2.

This mission formalizes the known structural result, not a new conjecture. The Lean statements are compiled with proof placeholders; the mathematical proofs remain work for solvers. A complete development would produce reusable definitions and lemmas for hypergraph cut values, minimum terminal cuts, uncrossing, and counting edges crossing a partition. These objects are also useful for checking related claims about graph cuts and constrained partitions.

Where the proof is difficult

For a graph edge, crossing a partition has only two endpoints to track. A hyperedge may meet several parts at once, and the relationship between the sum of part cut values and the cost of the whole partition changes with that pattern. A direct submodularity argument does not control all the needed costs. Section 3 introduces an auxiliary count σ\sigmaσ that distinguishes edge patterns, and Theorem 3.1 combines minimum terminal cuts with a partition cost bound. Section 4 then uses that bound to rule out a failed choice of the source set in Theorem 1.2. The paper explicitly shows that the corresponding uncrossing statement fails for arbitrary symmetric submodular functions. Source, §§3–4, especially Remark 3.2.

Formalization scope

Vertices have a finite Lean type, vertex subsets are Finset V, and hyperedges form a Multiset (Finset V). The multiset preserves parallel copies under unit costs. Partitions are functions Fin k → Finset V; their parts are required to be nonempty, disjoint, and exhaustive, with P 0 representing V1V_1V1​. Complements are relative to all vertices. All counts are natural numbers. The theorem assumes k≥2k\ge2k≥2, so 2k−22k-22k−2 is the ordinary nontruncated value. It counts a crossing edge when that edge meets at least two parts, following the explicit mathematical test in the paper's definition.

The source-maximal predicate requires both minimum cut value and containment of every other minimum terminal source set. Neither a merely minimum cut nor an arbitrary maximal minimum cut is accepted as the target. The cost and d functions count edge copies, including duplicate hyperedges, so replacing the multiset by a set would change the problem. The published predicates for symmetric and submodular real-valued set functions are reused after casting the cut counts to real numbers.

Theorem 1.1, the polynomial-time algorithm claim, is outside this mission. It would need a precise machine and running-time model; an unqualified existential algorithm claim would also be satisfied by exhaustive search. The algorithms and running-time theorems of §§2 and 6, and the distinct structural results of §§5–6, are not represented here. Contributions toward proofs of the source-maximal cut theorem, the §3 counting estimates, and the §4 containment argument are within scope.

Selected references

  • Karthekeyan Chandrasekaran and Chandra Chekuri, Hypergraph k-cut for fixed k in deterministic polynomial time, arXiv:2009.12442v1, 2020; published in Mathematics of Operations Research, 2022. arXiv.
15 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

A Dynamic Contagion Risk Model with Recovery Features: Fluid Limit for the Final Fraction of Failed Nodes in Threshold Contagion with Growth on the Configuration ModelResearch Paper

Motivation

Financial networks, supply chains and contact networks share a failure mode: a node fails when enough of its counterparties have failed, and its failure in turn weakens its own counterparties. Threshold contagion on random graphs is the standard mathematical model of this. Amini, Cont and Minca (Resilience to contagion in financial networks, Mathematical Finance 2016) proved that on a configuration-model network the final fraction of failed nodes concentrates, as the network grows, around an explicit value determined by the smallest fixed point of a one-dimensional map.

In that model thresholds are fixed. In practice institutions recover while a crisis unfolds: capital is raised, earnings accrue, and a node that survives long enough can absorb more losses than at the start. Amini, Minca and Sulem (A Dynamic Contagion Risk Model with Recovery Features, Mathematics of Operations Research 2022; the mission follows the authors' preprint of February 2021) add this recovery feature: every surviving node's threshold grows linearly in calendar time, at a rate proportional to its connectivity. The main result, Theorem 5, identifies the scaling limit of the cascade with growth. It is the basis of the paper's analysis of equilibrium connectivity choice (§3), where agents trade off the rewards of links against contagion risk.

Setting

A network has nnn nodes. Node iii has a connectivity λi∈N\lambda_i\in\mathbb Nλi​∈N (in-degree and out-degree both equal λi\lambda_iλi​) and an integer initial threshold θi∈N\theta_i\in\mathbb Nθi​∈N. The empirical type distribution is μλ,θ(n)=#{i:θi=θ,λi=λ}/n\mu^{(n)}_{\lambda,\theta}=\#\{i:\theta_i=\theta,\lambda_i=\lambda\}/nμλ,θ(n)​=#{i:θi​=θ,λi​=λ}/n and the mean connectivity is λˉ(n)=∑λ,θλμλ,θ(n)\bar\lambda^{(n)}=\sum_{\lambda,\theta}\lambda\mu^{(n)}_{\lambda,\theta}λˉ(n)=∑λ,θ​λμλ,θ(n)​. Two regularity conditions are assumed: (C1) μλ,θ(n)→μλ,θ\mu^{(n)}_{\lambda,\theta}\to\mu_{\lambda,\theta}μλ,θ(n)​→μλ,θ​ for a probability distribution μ\muμ on N2\mathbb N^2N2; (C2) λˉ(n)→λˉ=∑λμλ,θ∈(0,∞)\bar\lambda^{(n)}\to\bar\lambda=\sum\lambda\mu_{\lambda,\theta}\in(0,\infty)λˉ(n)→λˉ=∑λμλ,θ​∈(0,∞).

Each node owns λi\lambda_iλi​ out-going and λi\lambda_iλi​ in-coming half-edges. The directed configuration model matches out-half-edges to in-half-edges by a uniformly random bijection; self-loops and multiple links are allowed.

The cascade: at time 000 the nodes with θi=0\theta_i=0θi​=0 fail. Interactions happen at times Tk(n)T^{(n)}_kTk(n)​ whose gaps are i.i.d. exponential with rate nnn. At each interaction one unrevealed out-link of a failed node, chosen uniformly, is revealed; its counterparty jjj gains one failed link and fails if its count of failed links reaches its current threshold θj+αλjTk(n)/λˉ(n)\theta_j+\alpha\lambda_jT^{(n)}_k/\bar\lambda^{(n)}θj​+αλj​Tk(n)​/λˉ(n), where 0<α<10<\alpha<10<α<1 is the growth rate. Only surviving nodes grow. The cascade stops at kstop(n)k^{(n)}_{\rm stop}kstop(n)​, when no unrevealed failed link remains; ∣Df(n)∣|\mathcal D^{(n)}_f|∣Df(n)​∣ is the number of failed nodes and Sλ,θ(n)(kstop(n))S^{(n)}_{\lambda,\theta}(k^{(n)}_{\rm stop})Sλ,θ(n)​(kstop(n)​) the number of survivors of type (λ,θ)(\lambda,\theta)(λ,θ).

The limit objects: Pλ,θ,ℓ(π)P_{\lambda,\theta,\ell}(\pi)Pλ,θ,ℓ​(π) is the probability that the order statistics of ℓ\ellℓ i.i.d. uniform variables on [0,π][0,\pi][0,π] satisfy U(u)>(u−θ)/(αλ)U_{(u)}>(u-\theta)/(\alpha\lambda)U(u)​>(u−θ)/(αλ) for u=θ+1,…,ℓu=\theta+1,\dots,\ellu=θ+1,…,ℓ; Bλ,0α=1B^\alpha_{\lambda,0}=1Bλ,0α​=1 and, for θ≥1\theta\ge1θ≥1,

Bλ,θα(π)=1−∑ℓ=0min⁡{⌈θ+αλπ⌉−1,λ}(λℓ)πℓ(1−π)λ−ℓPλ,θ,ℓ(π);B^\alpha_{\lambda,\theta}(\pi)=1-\sum_{\ell=0}^{\min\{\lceil\theta+\alpha\lambda\pi\rceil-1,\lambda\}}\binom{\lambda}{\ell}\pi^\ell(1-\pi)^{\lambda-\ell}P_{\lambda,\theta,\ell}(\pi);Bλ,θα​(π)=1−ℓ=0∑min{⌈θ+αλπ⌉−1,λ}​(ℓλ​)πℓ(1−π)λ−ℓPλ,θ,ℓ​(π);

Jα(π)=∑λ,θλμλ,θBλ,θα(π)/λˉJ^\alpha(\pi)=\sum_{\lambda,\theta}\lambda\mu_{\lambda,\theta}B^\alpha_{\lambda,\theta}(\pi)/\bar\lambdaJα(π)=∑λ,θ​λμλ,θ​Bλ,θα​(π)/λˉ; and the relaxed fixed point π∗=min⁡{π∈[0,1]:Jα(π)≤π}\pi^*=\min\{\pi\in[0,1]:J^\alpha(\pi)\le\pi\}π∗=min{π∈[0,1]:Jα(π)≤π}.

Formalization targets

Goal: Theorem 5 (corrected)

With L=∑λ,θμλ,θBλ,θα(π∗)L=\sum_{\lambda,\theta}\mu_{\lambda,\theta}B^\alpha_{\lambda,\theta}(\pi^*)L=∑λ,θ​μλ,θ​Bλ,θα​(π∗): for every ε>0\varepsilon>0ε>0, with high probability ∣Df(n)∣/n≥L−ε|\mathcal D^{(n)}_f|/n\ge L-\varepsilon∣Df(n)​∣/n≥L−ε. (i) If π∗=1\pi^*=1π∗=1 and μ0,θ=0\mu_{0,\theta}=0μ0,θ​=0 for θ≥1\theta\ge1θ≥1, then ∣Df(n)∣/n→1|\mathcal D^{(n)}_f|/n\to1∣Df(n)​∣/n→1 in probability. (ii) If π∗<1\pi^*<1π∗<1 is a stable fixed point (Jα(π)<πJ^\alpha(\pi)<\piJα(π)<π just to the right of π∗\pi^*π∗), then

∣Df(n)∣n→pL,Sλ,θ(n)(kstop(n))n→pμλ,θ(1−Bλ,θα(π∗)).\frac{|\mathcal D^{(n)}_f|}{n}\xrightarrow{p}L,\qquad\frac{S^{(n)}_{\lambda,\theta}(k^{(n)}_{\rm stop})}{n}\xrightarrow{p}\mu_{\lambda,\theta}\big(1-B^\alpha_{\lambda,\theta}(\pi^*)\big).n∣Df(n)​∣​p​L,nSλ,θ(n)​(kstop(n)​)​p​μλ,θ​(1−Bλ,θα​(π∗)).

Milestones

  1. Lemma 16: a recursion in ℓ\ellℓ for Pλ,θ,ℓ(t)P_{\lambda,\theta,\ell}(t)Pλ,θ,ℓ​(t), for 0<α<10<\alpha<10<α<1 and θ<ℓ≤λ\theta<\ell\le\lambdaθ<ℓ≤λ, valid for t≥t^λ,θ,ℓ=(ℓ−θ)λˉ/(αλ)t\ge\hat t_{\lambda,\theta,\ell}=(\ell-\theta)\bar\lambda/(\alpha\lambda)t≥t^λ,θ,ℓ​=(ℓ−θ)λˉ/(αλ).
  2. Lemma 15: for 0<α<10<\alpha<10<α<1 and 0<θ≤λ0<\theta\le\lambda0<θ≤λ, the piecewise linear system (DE) for the rescaled numbers of surviving nodes with ℓ\ellℓ failed links has a unique continuous solution on [0,λˉ)[0,\bar\lambda)[0,λˉ), in closed form.
  3. (24)–(25): the limiting failed fraction of a class is μλ,θBλ,θα(t/λˉ)\mu_{\lambda,\theta}B^\alpha_{\lambda,\theta}(t/\bar\lambda)μλ,θ​Bλ,θα​(t/λˉ), and the limiting number of unrevealed failed links is λˉ(Jα(t/λˉ)−t/λˉ)\bar\lambda(J^\alpha(t/\bar\lambda)-t/\bar\lambda)λˉ(Jα(t/λˉ)−t/λˉ).
  4. (27)–(28): for k=γλˉ(n)n+o(n)k=\gamma\bar\lambda^{(n)}n+o(n)k=γλˉ(n)n+o(n), Tk(n)→γλˉT^{(n)}_k\to\gamma\bar\lambdaTk(n)​→γλˉ in probability.
  5. Remark 6: the minimum defining π∗\pi^*π∗ is attained.

Significance

Theorem 5 gives the final size of a cascade with recovery as an explicit function of the type distribution and the growth rate. The paper uses it to define each agent's expected reward as a function of its connectivity and to study the equilibrium of the resulting connectivity game (§3). Without the theorem, the equilibrium analysis would rest on the heuristic of §2.3 alone.

On the formal side, the platform has no random graph model of configuration type, no network contagion process and no fluid limit of a random cascade. This mission introduces all three. The result is proved on paper (by Wormald's differential-equation method); none of it is machine-checked. The work is to formalize the proof, and the milestones are self-contained pieces of it: an order-statistic identity, an explicit ODE solution, an algebraic identification of the limit, a concentration bound for sums of exponentials, and a fixed-point existence result.

Difficulty

The obvious approach is to view the cascade as a Markov chain in the counts of surviving nodes by type and number of failed links, and to apply Wormald's theorem directly. Two things break. First, with growth a node's survival depends on the whole history of its failed-link count, not on its current value, so the state space grows with time: new states become relevant at each growth time t^λ,θ,ℓ\hat t_{\lambda,\theta,\ell}t^λ,θ,ℓ​, and the fluid limit has to be established inductively on successive time intervals. Second, the cascade stops at a random time, near the first zero of the limiting number of unrevealed failed links. Showing that the stopping time concentrates requires the stability condition on π∗\pi^*π∗ and a truncation of the type distribution in the degree, since μ\muμ may have infinite support. The fixed point need not be a crossing point of a smooth map, so the identification of the stopping time is delicate even when the drift is known.

Formalization scope

  • Network. Half-edges of node iii are pairs (i,a)(i,a)(i,a) with a<λia<\lambda_ia<λi​; the matching is a uniformly random permutation of the half-edges. Each nnn has its own probability space: the matching, m=nλˉ(n)m=n\bar\lambda^{(n)}m=nλˉ(n) i.i.d. Exp(n)\mathrm{Exp}(n)Exp(n) gaps, and mmm i.i.d. uniform variables on [0,1)[0,1)[0,1) that choose the revealed link (uniform among the available ones given the past). The probability of an event averages over permutations the product law of gaps and choices. "With high probability" and "in probability" are stated with explicit ε\varepsilonε and limits of these probabilities.
  • Cascade. Computed step by step from the randomness and run for mmm steps; ∣Df(n)∣|\mathcal D^{(n)}_f|∣Df(n)​∣ and Sλ,θ(n)(kstop)S^{(n)}_{\lambda,\theta}(k_{\rm stop})Sλ,θ(n)​(kstop​) are read off the final state. A node fails when its failed links reach (not exceed) its threshold, as in every formula of the paper. Initially failed nodes are those with θi=0\theta_i=0θi​=0.
  • Limit objects. Order statistics are encoded by counting (U(u)>sU_{(u)}>sU(u)​>s iff fewer than uuu variables are ≤s\le s≤s), and probabilities as Lebesgue measures of subsets of [0,π]ℓ[0,\pi]^\ell[0,π]ℓ. Sums over types are tsums with summability hypotheses; μ\muμ is nonnegative with total mass 111.
  • Corrections, all labelled. (a) Bλ,0α:=1B^\alpha_{\lambda,0}:=1Bλ,0α​:=1; the printed formula gives a value below 111 for π>0\pi>0π>0, contradicting the paper's p. 9, and makes the theorem false. (b) Part (i) assumes no isolated nodes with a positive threshold. (c) Lemma 16 assumes t≥t^λ,θ,ℓt\ge\hat t_{\lambda,\theta,\ell}t≥t^λ,θ,ℓ​. (d) Lemma 15 is stated for 0<θ≤λ0<\theta\le\lambda0<θ≤λ, with uniqueness among continuous solutions, and reads the printed λˉ−u\bar\lambda-uλˉ−u as λˉ−t\bar\lambda-tλˉ−t. (e) (24) ends in μλ,θBλ,θα(t/λˉ)\mu_{\lambda,\theta}B^\alpha_{\lambda,\theta}(t/\bar\lambda)μλ,θ​Bλ,θα​(t/λˉ), not μλ,θ(1−Bλ,θα(t/λˉ))\mu_{\lambda,\theta}(1-B^\alpha_{\lambda,\theta}(t/\bar\lambda))μλ,θ​(1−Bλ,θα​(t/λˉ)). "Stable fixed point" means Jα(π)<πJ^\alpha(\pi)<\piJα(π)<π on some interval (π∗,π∗+η)(\pi^*,\pi^*+\eta)(π∗,π∗+η).
  • No trivialization. ∣Df(n)∣|\mathcal D^{(n)}_f|∣Df(n)​∣ and Sλ,θ(n)S^{(n)}_{\lambda,\theta}Sλ,θ(n)​ are computed from the random matching, the gaps and the revelation order, never from BαB^\alphaBα or JαJ^\alphaJα; π∗\pi^*π∗ is defined from μ\muμ and α\alphaα, not taken as a parameter.
  • Not included. Theorem 3 (the case α=0\alpha=0α=0, cited from earlier work), the equilibrium results of §3, Wormald's theorem (Lemma 17, an external result), the in/out-degree extension (Theorem 18) and the displays (32)–(41) of the inductive argument.
  • Infrastructure. A complete proof needs Wormald's differential-equation method for Markov chains with bounded increments, concentration of the configuration model, and the elementary facts in the milestones. A general Wormald theorem and the configuration model are reusable well beyond this mission; contributions of either, as separate theorems, are welcome.

Selected references

  • H. Amini, A. Minca, A. Sulem, A dynamic contagion risk model with recovery features, Mathematics of Operations Research, 2022 (preprint February 2021). https://doi.org/10.1287/moor.2021.1174
  • H. Amini, R. Cont, A. Minca, Resilience to contagion in financial networks, Mathematical Finance, 2016. https://doi.org/10.1111/mafi.12051
  • N. C. Wormald, Differential equations for random processes and random graphs, Annals of Applied Probability, 1995. https://doi.org/10.1214/aoap/1177004612
  • L. Warnke, On Wormald's differential equation method, arXiv:1905.08928, 2019. https://arxiv.org/abs/1905.08928
  • B. Bollobás, A probabilistic proof of an asymptotic formula for the number of labelled regular graphs, European Journal of Combinatorics, 1980. https://doi.org/10.1016/S0195-6698(80)80030-8
8 thms2 active usersReviewed
Quantum Error CorrectionQuantum Information·Captain: mikedeng1

Quantum Tanner Codes 1: On a Ramanujan Left-Right Cayley Complex with Robust Dual Tensor Codes, the Quantum Tanner Code Has Rate at Least (1−2ρ)² and Distance at Least δn/(4Δ^{3/2+ε})Research Paper

Why quantum Tanner codes matter

An error-correcting code protects information by adding redundancy. A quantum code must also account for two kinds of errors, commonly called XXX and ZZZ errors. Quantum low-density parity-check codes use checks that each touch only a bounded number of qubits, while each qubit participates in only a bounded number of checks. Such locality matters when the number of qubits grows. For years it was difficult to make both the number of encoded qubits and the minimum distance proportional to the block length while retaining bounded-weight checks. Leverrier and Zémor's quantum Tanner construction gives a route through local codes placed on an expanding square complex; its main distance theorem is the target of this mission Leverrier and Zémor, 2022.

The construction combines two earlier ingredients. Left-right Cayley complexes provide the squares and expansion properties used by the code Dinur, Evra, Livne, Lubotzky, and Mozes, 2021. Robustness of a dual tensor code, including after puncturing coordinates, controls local words Panteleev and Kalachev, 2021. The paper states the local reduction property as Theorem 1 and derives the rate and distance bounds as Theorem 17. This mission formalizes that implication under the paper's stated component-code and expansion conditions; the separate random-code result that supplies robust examples belongs to the second mission of this series.

The square complex and its codes

Let GGG be a finite group and let A,B⊆GA,B\subseteq GA,B⊆G be inverse-closed sets, each of size Δ\DeltaΔ. The total no-conjugacy condition says ag≠gbag\ne gbag=gb for every a∈Aa\in Aa∈A, b∈Bb\in Bb∈B, and g∈Gg\in Gg∈G. Vertices are two copies of the group, V=G×{0,1}V=G\times\{0,1\}V=G×{0,1}. A square associated with v=(g,i)v=(g,i)v=(g,i) and (a,b)∈A×B(a,b)\in A\times B(a,b)∈A×B has vertices vvv, (ag,1−i)(ag,1-i)(ag,1−i), (gb,1−i)(gb,1-i)(gb,1−i), and (agb,i)(agb,i)(agb,i). The set of squares is QQQ, and a binary word on QQQ has length n=∣Q∣n=|Q|n=∣Q∣. At a vertex vvv, the incident squares are indexed by A×BA\times BA×B; this indexing makes the local view xvx_vxv​ of a word x∈F2Qx\in\mathbb F_2^Qx∈F2Q​ an A×BA\times BA×B matrix Leverrier and Zémor, §§3.2 and 4.1.

A binary linear code CAC_ACA​ has coordinates indexed by AAA, and CBC_BCB​ has coordinates indexed by BBB. Their tensor code CA⊗CBC_A\otimes C_BCA​⊗CB​ consists of matrices whose columns lie in CAC_ACA​ and whose rows lie in CBC_BCB​. The dual tensor code CA⊗F2B+F2A⊗CBC_A\otimes\mathbb F_2^B+\mathbb F_2^A\otimes C_BCA​⊗F2B​+F2A​⊗CB​ is the sum of the column and row codes. In Definition 5, it is www-robust when every member of weight at most www is supported on a union of few rows and columns, with the bounds determined by the two component minimum distances. Definition 8 requires this property after deleting up to ppp coordinates from each side. These are conditions on all relevant codewords and all permitted puncturings, including the unpunctured pair Leverrier and Zémor, pp. 15–16.

The two Tanner codes are C0=T(G0□,(CA⊗CB)⊥)\mathcal C_0=T(\mathcal G^\square_0,(C_A\otimes C_B)^\perp)C0​=T(G0□​,(CA​⊗CB​)⊥) and C1=T(G1□,(CA⊥⊗CB⊥)⊥)\mathcal C_1=T(\mathcal G^\square_1,(C_A^\perp\otimes C_B^\perp)^\perp)C1​=T(G1□​,(CA⊥​⊗CB⊥​)⊥). Here Gi□\mathcal G^\square_iGi□​ is the square-adjacency graph on the vertices in copy iii. Together they define the quantum CSS code Q=(C0,C1)\mathcal Q=(\mathcal C_0,\mathcal C_1)Q=(C0​,C1​). Its dimension counts encoded qubits. Its distance is the smaller of the minimum weights in C0∖C1⊥\mathcal C_0\setminus\mathcal C_1^\perpC0​∖C1⊥​ and C1∖C0⊥\mathcal C_1\setminus\mathcal C_0^\perpC1​∖C0⊥​ Leverrier and Zémor, pp. 14, 18.

Formalization targets

The goal is Theorem 17. Fix 0<ρ<1/20<\rho<1/20<ρ<1/2, 0<ε<1/20<\varepsilon<1/20<ε<1/2, 1/2+ε<γ<11/2+\varepsilon<\gamma<11/2+ε<γ<1, and δ>0\delta>0δ>0. For sufficiently large Δ\DeltaΔ, take a left-right Cayley complex satisfying total no-conjugacy and the paper's Ramanujan conditions. Require 0<dim⁡CA≤ρΔ0<\dim C_A\le\rho\Delta0<dimCA​≤ρΔ, dim⁡CB=Δ−dim⁡CA\dim C_B=\Delta-\dim C_AdimCB​=Δ−dimCA​, minimum distance at least δΔ\delta\DeltaδΔ for CA,CBC_A,C_BCA​,CB​ and both duals, and Δ3/2−ε/2\Delta^{3/2-\varepsilon/2}Δ3/2−ε/2 robustness with Δγ\Delta^\gammaΔγ resistance to puncturing for both relevant dual tensor codes. The target is

k≥(1−2ρ)2n,d≥δn4Δ3/2+ε.k\ge (1-2\rho)^2 n,\qquad d\ge \frac{\delta n}{4\Delta^{3/2+\varepsilon}}.k≥(1−2ρ)2n,d≥4Δ3/2+εδn​.

The milestones mirror the paper's route to this result. Lemma 4 bounds the nontrivial eigenvalues of the union and square graphs. Propositions 6 and 7 turn dual-tensor robustness into a decomposition and a 3/23/23/2 closeness bound. Theorem 1 supplies a weight-reducing local codeword for every sufficiently light nonzero Tanner-code word. Display (5) supplies the dimension lower bound. Theorem 17 combines the two distance directions with that rate estimate Leverrier and Zémor, pp. 12, 15–16, 18–23.

What the result supplies

The lower bound on kkk ensures a positive fraction of qubits can carry logical information when ρ<1/2\rho<1/2ρ<1/2. The lower bound on ddd rules out small undetectable logical errors. For a fixed allowable degree Δ\DeltaΔ, both bounds scale linearly with nnn. The paper also shows that random component codes can satisfy the robustness assumptions; that probabilistic result is a separate formalization target Leverrier and Zémor, Theorems 9 and 17.

A checked development would make explicit how the square indexing, duals, punctured codes, and CSS quotient fit together. The source proves the mathematical result; the statements here remain open Lean theorems. Reusable contributions include the tensor-code interface, spectral bounds for the graph construction, and lemmas connecting local views to the global Tanner codes. A proof of the existence of infinite Ramanujan complex families is outside this mission's stated target.

Where the proof is difficult

A light global codeword need not have a local view that is itself close to a tensor-code word. Some square-graph vertices have unusually large local weight, and puncturing is needed to isolate coordinates shared with those exceptional vertices. The paper's small-set expansion estimates and robustness conditions control those interactions. Simply averaging local weights does not yield the weight-reducing local codeword asserted by Theorem 1 Leverrier and Zémor, §4.2.

Formalization scope

Words are functions into ZMod 2, codes are submodules, and a matrix is a function on A×BA\times BA×B with AAA indexing rows. The square coordinates are four-element vertex sets. The construction uses V=G×Fin⁡(2)V=G\times\operatorname{Fin}(2)V=G×Fin(2) and counts nnn as the number of squares rather than building n=Δ2∣G∣/2n=\Delta^2|G|/2n=Δ2∣G∣/2 into a definition. The minimum distance of the zero code is infinity, and robustness uses inequalities involving that extended value. Powers of Δ\DeltaΔ and the parameters w,pw,pw,p are real; the paper uses integer w,pw,pw,p in Definition 8, while the theorem's power thresholds need real comparisons. The formal robustness predicate includes Definition 5's range 0≤w≤Δ20\le w\le\Delta^20≤w≤Δ2; the theorem thresholds satisfy it for sufficiently large Δ\DeltaΔ. These conventions are recorded with each item.

The goal quantifies over every finite complex satisfying inverse closure, total no-conjugacy, and Ramanujan conditions, with a uniform threshold Δ0\Delta_0Δ0​ chosen before the group and codes. This pins the complexes in the cited infinite family without formalizing their existence. In particular, the goal contains no auxiliary set or local reduction assumption that could make the distance bound immediate. The published CodingTheory and TillichZemor.HGP.Setting definitions supply dual codes and CSS dimension; the paper-specific setting supplies the square complex, local views, Tanner codes, and robustness. Contributions that keep these conventions and close any milestone theorem are welcome.

Selected references

  • A. Leverrier and G. Zémor, Quantum Tanner codes, arXiv preprint, 2022. arXiv:2202.13641v3.
  • I. Dinur, S. Evra, R. Livne, A. Lubotzky, and S. Mozes, Locally Testable Codes with constant rate, distance, and locality, arXiv preprint, 2021. arXiv:2111.04808.
  • P. Panteleev and G. Kalachev, Asymptotically good quantum and locally testable classical LDPC codes, arXiv preprint, 2021. arXiv:2111.03654.
9 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations Research·Captain: mikedeng1

Linear Programming and Community Detection 4: A Distance-Based Condition Under Which the Metric LP Relaxation Fails to Recover the Planted BisectionResearch Paper

Motivation

The minimum bisection problem asks, for a graph on an even number nnn of vertices, for a split of the vertices into two halves that cuts as few edges as possible. It is NP-hard, and it is the maximum a posteriori estimator for the two-community stochastic block model (SBM), the standard benchmark for community detection (Abbe, 2018). Convex relaxations are the usual way to make such estimators tractable while keeping guarantees. For the semidefinite relaxation, exact-recovery thresholds are known (Abbe, Bandeira, Hall, 2016; Hajek, Wu, Xu, 2016). Linear programming relaxations are cheaper and much used in combinatorial optimization, but their recovery properties were not understood.

Del Pia, Khajavirad and Kunisky (arXiv:2006.03213v2, Mathematics of Operations Research, 2023) study the best-known LP relaxation of minimum bisection, the metric relaxation. They give a sufficient condition for it to recover a planted bisection (Theorem 4) and a necessary one (Theorem 5). This mission formalizes the necessary condition. Its consequence, developed in §4 of the paper, is that the metric relaxation fails with high probability in most SBM regimes, including those where the minimum bisection itself succeeds.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a simple graph on V={1,…,n}V=\{1,\dots,n\}V={1,…,n}, and write (i,j)(i,j)(i,j) for an edge with i<ji<ji<j; set aij=1a_{ij}=1aij​=1 if (i,j)∈E(i,j)\in E(i,j)∈E and aij=0a_{ij}=0aij​=0 otherwise. A bisection is a partition of VVV into two sets V1,V2V_1,V_2V1​,V2​ with ∣V1∣=∣V2∣=n/2|V_1|=|V_2|=n/2∣V1​∣=∣V2​∣=n/2. One fixed bisection, unknown to the solver, is the planted bisection; E0E_0E0​ is the set of edges with one end in V1V_1V1​ and the other in V2V_2V2​.

The cut vector xˉ∈{0,1}(n2)\bar x\in\{0,1\}^{\binom n2}xˉ∈{0,1}(2n​) of the planted bisection has xˉij=1\bar x_{ij}=1xˉij​=1 exactly when iii and jjj lie on different sides. The metric relaxation is the linear program, with xji:=xijx_{ji}:=x_{ij}xji​:=xij​,

min⁡x ∑1≤i<j≤naijxijs.t.xij≤xik+xjk (1),xij+xik+xjk≤2 (2),∑1≤i<j≤nxij=n24 (3),\min_x\ \sum_{1\le i<j\le n}a_{ij}x_{ij}\quad\text{s.t.}\quad x_{ij}\le x_{ik}+x_{jk}\ (1),\qquad x_{ij}+x_{ik}+x_{jk}\le 2\ (2),\qquad \sum_{1\le i<j\le n}x_{ij}=\frac{n^2}{4}\ (3),xmin​ 1≤i<j≤n∑​aij​xij​s.t.xij​≤xik​+xjk​ (1),xij​+xik​+xjk​≤2 (2),1≤i<j≤n∑​xij​=4n2​ (3),

where (1) ranges over distinct i,j,ki,j,ki,j,k with i<ji<ji<j and (2) over i<j<ki<j<ki<j<k. The LP recovers the planted bisection if xˉ\bar xxˉ is its unique optimal solution. The objective at xˉ\bar xxˉ is ∣E0∣|E_0|∣E0​∣.

The graph distance ρG(i,j)\rho_G(i,j)ρG​(i,j) is the length of a shortest iii–jjj path (+∞+\infty+∞ across components). The diameter and the average distance are

ρmax⁡(G)=max⁡i,j∈VρG(i,j),ρavg(G)=2n2∑1≤i<j≤nρG(i,j).\rho_{\max}(G)=\max_{i,j\in V}\rho_G(i,j),\qquad \rho_{\mathrm{avg}}(G)=\frac{2}{n^2}\sum_{1\le i<j\le n}\rho_G(i,j).ρmax​(G)=i,j∈Vmax​ρG​(i,j),ρavg​(G)=n22​1≤i<j≤n∑​ρG​(i,j).

The average is over all n2n^2n2 ordered pairs, the diagonal included. For n≥5n\ge5n≥5 define

c(G)=max⁡{0, 3ρmax⁡(G)−4ρavg(G)1−4/n}.(17)c(G)=\max\Big\{0,\ \frac{3\rho_{\max}(G)-4\rho_{\mathrm{avg}}(G)}{1-4/n}\Big\}.\qquad(17)c(G)=max{0, 1−4/n3ρmax​(G)−4ρavg​(G)​}.(17)

Formalization targets

Goal: Theorem 5

For a connected graph GGG on n≥5n\ge5n≥5 nodes with a planted bisection,

1+c(G)2ρavg(G)+2c(G)(1−1n) ∣E∣<∣E0∣(18)⟹(LP-P) does not recover the planted bisection.\frac{1+c(G)}{2\rho_{\mathrm{avg}}(G)+2c(G)(1-\frac1n)}\,|E|<|E_0|\quad(18)\qquad\Longrightarrow\qquad\text{(LP-P) does not recover the planted bisection.}2ρavg​(G)+2c(G)(1−n1​)1+c(G)​∣E∣<∣E0​∣(18)⟹(LP-P) does not recover the planted bisection.

Milestones

The proof of Theorem 5 works with the point x~∈R(n2)\tilde x\in\mathbb R^{\binom n2}x~∈R(2n​),

x~ij=ρG(i,j)+c(G)2ρavg(G)+2c(G)(1−1n).\tilde x_{ij}=\frac{\rho_G(i,j)+c(G)}{2\rho_{\mathrm{avg}}(G)+2c(G)(1-\frac1n)}.x~ij​=2ρavg​(G)+2c(G)(1−n1​)ρG​(i,j)+c(G)​.

The mission poses three statements about it, for a connected GGG on n≥5n\ge5n≥5 nodes:

  1. display (19), p. 12: for i<j<ki<j<ki<j<k, x~ij+x~ik+x~jk≤32⋅ρmax⁡(G)+c(G)ρavg(G)+c(G)(1−1n)\displaystyle\tilde x_{ij}+\tilde x_{ik}+\tilde x_{jk}\le\frac32\cdot\frac{\rho_{\max}(G)+c(G)}{\rho_{\mathrm{avg}}(G)+c(G)(1-\frac1n)}x~ij​+x~ik​+x~jk​≤23​⋅ρavg​(G)+c(G)(1−n1​)ρmax​(G)+c(G)​;
  2. p. 13: x~\tilde xx~ is feasible for (LP-P);
  3. p. 13: the objective of (LP-P) at x~\tilde xx~ equals 1+c(G)ρavg(G)+c(G)(1−1n)⋅∣E∣2\displaystyle\frac{1+c(G)}{\rho_{\mathrm{avg}}(G)+c(G)(1-\frac1n)}\cdot\frac{|E|}{2}ρavg​(G)+c(G)(1−n1​)1+c(G)​⋅2∣E∣​.

Significance

The result. Theorem 5 is a deterministic certificate of failure, stated for any connected graph, not for a random model. It reduces the question "does the LP recover?" to comparing two numbers that depend only on the distance profile of GGG and on the fraction of edges cut by the planted bisection. When typical distances are close to the diameter, c(G)c(G)c(G) is small and (18) asks only that ∣E0∣/∣E∣|E_0|/|E|∣E0​∣/∣E∣ exceed roughly 1/(2ρavg(G))1/(2\rho_{\mathrm{avg}}(G))1/(2ρavg​(G)). In random graphs typical distances are close to the diameter. The paper's Theorems 7 and 8 combine Theorem 5 with known distance asymptotics of Erdős–Rényi graphs (Bollobás, Random Graphs, 2001; Chung, Lu, 2001). They show that the metric relaxation fails with high probability in the dense and logarithmic-degree SBM, in contrast with the semidefinite relaxation. Those theorems are separate missions of this series and use Theorem 5 as a black box.

Formalizing it. The result is proved in the paper; no machine-checked version is known. The mission produces a formal metric relaxation of minimum bisection, with LP recovery defined as uniqueness of the optimum, and links it to graph distances through Mathlib's SimpleGraph.edist/ediam. The definitions are written to coincide with those of the other missions of this series, so that one model layer serves the sufficient condition (Theorem 4), the necessary condition (this mission), and the random-graph consequences.

Difficulty

Theorem 5 is not deep, but it is exact. The milestones fix the witness x~\tilde xx~; the work is in checking it. The obvious candidate, the graph metric ρG\rho_GρG​ itself rescaled to satisfy the equality (3), satisfies the triangle inequalities (1). It can violate the perimeter constraints (2) whenever some triangle of vertices is spread out compared with the average distance. The shift by c(G)c(G)c(G), which depends on ρmax⁡\rho_{\max}ρmax​ and on the factor 1−4/n1-4/n1−4/n, is tuned so that (2) holds with no slack in the worst case. A proof has to keep track of the normalization 2/n22/n^22/n2 (ordered pairs, diagonal included), the factor 1−1/n1-1/n1−1/n, and the sign of 3ρmax⁡−4ρavg3\rho_{\max}-4\rho_{\mathrm{avg}}3ρmax​−4ρavg​, and must use n≥5n\ge5n≥5 wherever it divides by 1−4/n1-4/n1−4/n. In Lean the further work is converting between sums over ordered pairs, unordered pairs and the edge set, and between extended-valued distances and their real values for a connected graph.

Formalization scope

  • Vertices and bisections. Vertices are Fin n (0-based). The planted bisection is a finset V1V_1V1​ with 2∣V1∣=n2|V_1|=n2∣V1​∣=n, and V2=V1cV_2=V_1^{c}V2​=V1c​. ∣E0∣|E_0|∣E0​∣ is the number of pairs i<ji<ji<j adjacent in GGG and on different sides.
  • LP variables. A point of R(n2)\mathbb R^{\binom n2}R(2n​) is an array x:Fin n→Fin n→Rx:\texttt{Fin } n\to\texttt{Fin } n\to\mathbb Rx:Fin n→Fin n→R. Feasibility includes symmetry and a zero diagonal, so the free diagonal and lower-triangle entries cannot break uniqueness of the optimum. No bounds 0≤x≤10\le x\le10≤x≤1 are added; they are not constraints of (LP-P).
  • Recovery. LPRecovers G V1 says that the cut vector of V1V_1V1​ is optimal and every optimal point equals it.
  • Distances. ρG\rho_GρG​ is SimpleGraph.edist (in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞}), ρmax⁡\rho_{\max}ρmax​ is SimpleGraph.ediam, and ρavg\rho_{\mathrm{avg}}ρavg​ is the printed formula computed in [0,∞][0,\infty][0,∞]. c(G)c(G)c(G) and x~\tilde xx~ use their real values. All statements assume GGG connected, where these values are finite and ρavg(G)>0\rho_{\mathrm{avg}}(G)>0ρavg​(G)>0.
  • Standing hypotheses. Every statement carries exactly the page's hypotheses: GGG connected and n≥5n\ge5n≥5, plus, for Theorem 5, the planted bisection. The bisection forces nnn even, so in effect n≥6n\ge6n≥6; n≥5n\ge5n≥5 is kept as printed. x~\tilde xx~ is indexed by i<ji<ji<j on the page and is extended symmetrically with zero diagonal.
  • Ruled out. A formalization that adds box constraints, drops the symmetric zero-diagonal normalization, averages over n(n−1)/2n(n-1)/2n(n−1)/2 pairs instead of the printed 2/n22/n^22/n2, or omits connectivity (where the real value of an infinite distance would be 000) states a different theorem. None of these is used here.

Contributions welcome: proofs of the three milestones and the goal. Reusable lemmas include the identity ∑i<jaijxij=∑(i,j)∈Exij\sum_{i<j}a_{ij}x_{ij}=\sum_{(i,j)\in E}x_{ij}∑i<j​aij​xij​=∑(i,j)∈E​xij​ for SimpleGraph.edgeFinset, the finiteness of ediam for connected graphs on Fin n, and the bound ρavg(G)≤(1−1n)ρmax⁡(G)\rho_{\mathrm{avg}}(G)\le(1-\frac1n)\rho_{\max}(G)ρavg​(G)≤(1−n1​)ρmax​(G).

Selected references

  • A. Del Pia, A. Khajavirad, D. Kunisky, Linear Programming and Community Detection, Mathematics of Operations Research, 2023; arXiv:2006.03213v2 (2022). https://arxiv.org/abs/2006.03213
  • E. Abbe, Community Detection and Stochastic Block Models: Recent Developments, Journal of Machine Learning Research 18 (2018). https://arxiv.org/abs/1703.10146
  • E. Abbe, A. S. Bandeira, G. Hall, Exact Recovery in the Stochastic Block Model, IEEE Transactions on Information Theory 62 (2016). https://arxiv.org/abs/1405.3267
  • B. Hajek, Y. Wu, J. Xu, Achieving Exact Cluster Recovery Threshold via Semidefinite Programming, IEEE Transactions on Information Theory 62 (2016). https://arxiv.org/abs/1412.6156
  • B. Bollobás, Random Graphs, 2nd ed., Cambridge University Press, 2001. https://doi.org/10.1017/CBO9780511814068
  • F. Chung, L. Lu, The Diameter of Sparse Random Graphs, Advances in Applied Mathematics 26 (2001). https://doi.org/10.1006/aama.2001.0720
8 thms2 active usersReviewed
Algorithmic Game TheoryLinear OptimizationMechanism Design+2·Captain: mikedeng1

Designing Approximately Optimal Search on Matching Platforms 1: Some Stationary Equilibrium of Directed Search Attains a Quarter of the First-Best WelfareResearch Paper

Motivation

Two-sided platforms for dating, freelancing and housing do more than list participants: they decide whom each participant is shown. When search is costly and agents leave the market over time, the platform's choice of assortments (which types of agents meet which, and how often) determines who matches, and agents respond strategically by deciding which matches to accept. A platform that ignores those responses can design meetings that agents then decline.

Immorlica, Lucier, Manshadi and Wei (arXiv:2102.09017, Management Science 2023) model this as directed search in a stationary flow economy and ask how much welfare a platform can secure when it controls only meetings, while agents retain the decision to accept. Computing the optimal assortments is NP-hard to approximate within 24/23 (their Theorem 4.2), so the relevant question is whether a constant fraction of the best conceivable welfare is reachable at all. Their Theorem 4.1 answers it with the factor 4, measured against the platform's first best, a benchmark in which the platform also dictates acceptance.

The mission formalizes the existence part of Theorem 4.1 and the chain of results in §4 of the paper that leads to it.

Setting

There are finitely many types on two sides, a set M\mathcal MM and a set W\mathcal WW; write Θ=M∪W\Theta=\mathcal M\cup\mathcal WΘ=M∪W and let θ′\theta'θ′ denote a generic type on the side opposite to θ\thetaθ. Agents of type θ\thetaθ enter at rate αθ>0\alpha_\theta>0αθ​>0 and each agent leaves unmatched at rate δ>0\delta>0δ>0. When an agent of type mmm meets one of type www, both observe one symmetric utility uuu drawn from a law FmwF_{mw}Fmw​ on R\mathbb RR with no atoms and finite mean; they match, and leave with utility uuu each, if both accept.

The platform picks an assortment λθ(θ′)≥0\lambda_\theta(\theta')\ge0λθ​(θ′)≥0 for each type: type θ\thetaθ meets type θ′\theta'θ′ at rate λθ(θ′)\lambda_\theta(\theta')λθ​(θ′). Agents use thresholds τθ\tau_\thetaτθ​ and accept exactly when u≥τθu\ge\tau_\thetau≥τθ​, so a pair matches when u≥max⁡(τm,τw)u\ge\max(\tau_m,\tau_w)u≥max(τm​,τw​). With population masses ηθ\eta_\thetaηθ​ and matching rates ξθ\xi_\thetaξθ​, the assortments induce a stationary equilibrium when, for every type,

αθ=(δ+ξθ)ηθ,ηmλm(w)=ηwλw(m),∑θ′λθ(θ′)≤1,\alpha_\theta=(\delta+\xi_\theta)\eta_\theta,\qquad \eta_m\lambda_m(w)=\eta_w\lambda_w(m),\qquad \sum_{\theta'}\lambda_\theta(\theta')\le1,αθ​=(δ+ξθ​)ηθ​,ηm​λm​(w)=ηw​λw​(m),θ′∑​λθ​(θ′)≤1, ξθ=∑θ′λθ(θ′)∫max⁡(τθ,τθ′)∞dFθθ′,τθ=∑θ′λθ(θ′)∫max⁡(τθ,τθ′)∞u dFθθ′δ+ξθ.\xi_\theta=\sum_{\theta'}\lambda_\theta(\theta')\int_{\max(\tau_\theta,\tau_{\theta'})}^\infty dF_{\theta\theta'},\qquad \tau_\theta=\frac{\sum_{\theta'}\lambda_\theta(\theta')\int_{\max(\tau_\theta,\tau_{\theta'})}^\infty u\,dF_{\theta\theta'}}{\delta+\xi_\theta}.ξθ​=θ′∑​λθ​(θ′)∫max(τθ​,τθ′​)∞​dFθθ′​,τθ​=δ+ξθ​∑θ′​λθ​(θ′)∫max(τθ​,τθ′​)∞​udFθθ′​​.

These are constraints (6a)–(6f) of the paper; the last one, (6e), says each threshold equals the type's expected utility, which is the agents' best response. The welfare is the flow of realized utility,

SW=∑m∑w(ηmλm(w)+ηwλw(m))∫max⁡(τm,τw)∞u dFmw.\mathrm{SW}=\sum_{m}\sum_{w}\big(\eta_m\lambda_m(w)+\eta_w\lambda_w(m)\big)\int_{\max(\tau_m,\tau_w)}^\infty u\,dF_{mw}.SW=m∑​w∑​(ηm​λm​(w)+ηw​λw​(m))∫max(τm​,τw​)∞​udFmw​.

The first-best relaxation (§4.1) drops (6e) and replaces max⁡(τm,τw)\max(\tau_m,\tau_w)max(τm​,τw​) by a free pairwise threshold τmw\tau_{mw}τmw​: the platform chooses both the meetings and which matches happen. Its welfare FB\mathrm{FB}FB is the same expression with τmw\tau_{mw}τmw​.

Formalization targets

Goal: Theorem 4.1

For every market satisfying the standing assumptions there are assortments, thresholds, rates and masses satisfying (6a)–(6f) such that, for every first-best feasible candidate QQQ,

FB(Q)≤4 SW.\mathrm{FB}(Q)\le 4\,\mathrm{SW}.FB(Q)≤4SW.

Milestones

  1. Proposition 4.4. The first best equals the linear program max⁡ 2∑m,wρmwβmw\max\,2\sum_{m,w}\rho_{mw}\beta_{mw}max2∑m,w​ρmw​βmw​ subject to β≥0\beta\ge0β≥0, ∑wβmw≤αm\sum_w\beta_{mw}\le\alpha_m∑w​βmw​≤αm​, ∑mβmw≤αw\sum_m\beta_{mw}\le\alpha_w∑m​βmw​≤αw​, where ρmw=max⁡τ≥0∫τ∞u dFmw/(δ+∫τ∞dFmw)\rho_{mw}=\max_{\tau\ge0}\int_\tau^\infty u\,dF_{mw}/(\delta+\int_\tau^\infty dF_{mw})ρmw​=maxτ≥0​∫τ∞​udFmw​/(δ+∫τ∞​dFmw​).
  2. Lemma 4.5. The maximizer of A(τ)=∫τ∞u dF/(δ+∫τ∞dF)A(\tau)=\int_\tau^\infty u\,dF/(\delta+\int_\tau^\infty dF)A(τ)=∫τ∞​udF/(δ+∫τ∞​dF) over τ≥0\tau\ge0τ≥0 is a fixed point of AAA, and AAA increases before it and decreases after it.
  3. Lemma 4.6. The LP has an optimal solution whose support is a forest on Θ\ThetaΘ.
  4. Lemma 4.7. An edge-weighted forest keeps half its weight on a union of vertex-disjoint stars.
  5. Lemma 4.9. In a star-shaped market (one side has a single type) the LP is a fractional knapsack with a greedy optimum.
  6. §4.2.2 remark, Lemmas 4.10–4.12. The idealized thresholds τ^wi\hat\tau_{w_i}τ^wi​​ exist, coincide with or lie below ρmwi\rho_{mw_i}ρmwi​​, and bound the equilibrium thresholds from above and the pair thresholds max⁡(τm,τwi)\max(\tau_m,\tau_{w_i})max(τm​,τwi​​) from below.
  7. Proposition 4.8. In a star-shaped market some induced stationary equilibrium satisfies FB(Q)≤2 SW\mathrm{FB}(Q)\le2\,\mathrm{SW}FB(Q)≤2SW for every first-best feasible QQQ.

Significance

Theorem 4.1 is a price-of-anarchy statement for platform design: restricting the platform to meetings, and letting agents choose acceptance selfishly, costs at most a factor 4 against a platform that dictates everything. Since every equilibrium candidate is also a first-best candidate with the same welfare, it gives a 4-approximation to the optimal directed search as well. The construction behind it has a structure that is itself informative: the equilibrium consists of disjoint submarkets in each of which one side has a single type.

The results are proved in the paper; none of them has a machine-checked proof in Lean or another proof assistant on record. Formalizing them yields a checked model of stationary search markets with threshold play, a checked reduction of the first best to a generalized assignment LP, and two graph lemmas (forest support of LP optima, the star-forest halving) that recur in rounding arguments for generalized assignment and budgeted allocation.

Difficulty

The first best is easy to reach once Proposition 4.4 linearizes it; the obstacle is incentives. Turning a first-best solution into an equilibrium by keeping its meeting rates fails, because agents raise or lower their thresholds relative to the pairwise thresholds the platform would choose, and constraint (6e) couples every type's threshold to all thresholds on the opposite side through max⁡(τm,τw)\max(\tau_m,\tau_w)max(τm​,τw​). The paper therefore has to control equilibrium thresholds without computing them, which it does only in star-shaped markets, and it needs a case analysis there (Case 1 and Subcases 2(a), 2(b) of Proposition 4.8) in which the meetings of the first best are sometimes discarded. Each of the reductions loses a factor: 2 in the passage from a forest to stars and 2 inside each star.

Formalization scope

The sides are separate finite types M and W with one law F m w per pair, serving both sides. The standing assumptions are δ>0\delta>0δ>0; αθ>0\alpha_\theta>0αθ​>0 for every type; each FmwF_{mw}Fmw​ a probability measure with no atoms (NullSingletonClass, the paper's "continuous distribution"); and an integrable identity under each FmwF_{mw}Fmw​. The positivity of αθ\alpha_\thetaαθ​ and the integrability are added: the paper uses both implicitly. Tails are taken over [a,∞)[a,\infty)[a,∞). LP feasibility includes β≥0\beta\ge0β≥0, which the paper leaves implicit; Lemma 4.6 also assumes nonnegative capacities. ρmw\rho_{mw}ρmw​ is the supremum of AAA over [0,∞)[0,\infty)[0,∞), never defined as a fixed point.

"Approximation of the first-best optimum" is stated against every first-best feasible candidate, so no supremum appears. An induced stationary equilibrium always includes the best-response constraint (6e); a formalization that drops it, or that lets the equilibrium use pairwise thresholds, makes the goal compare the first best with itself and is ruled out. With an empty side both welfares vanish and the goal holds, as in the paper.

The "polynomial-time" part of Theorem 4.1 is not posed: the paper's computational model (oracle access to the laws, footnote 15) is not specified precisely enough to formalize. The source is the arXiv v2 preprint (18 Aug 2021); the Management Science version may number results differently. Proofs of any milestone, auxiliary lemmas about tail integrals of atomless laws, and LP vertex arguments are all welcome.

Selected references

  • N. Immorlica, B. Lucier, V. Manshadi, A. Wei, Designing Approximately Optimal Search on Matching Platforms, Management Science, 2023; preprint arXiv:2102.09017v2. https://arxiv.org/abs/2102.09017
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Mathematical Programming 46, 1990. https://doi.org/10.1007/BF01585745
  • D. Chakrabarty, G. Goel, On the approximability of budgeted allocations and improved lower bounds for submodular welfare maximization and GAP, SIAM Journal on Computing 39(6), 2010. https://doi.org/10.1137/080735503
  • S. Banerjee, S. Gollapudi, K. Kollias, K. Munagala, Segmenting two-sided markets, WWW 2017. https://doi.org/10.1145/3038912.3052578
14 thms2 active usersReviewed
OptimizationQuantum Information·Captain: mikedeng1

A Quantum Approximate Optimization Algorithm II: On v-Regular Graphs the Variance of the Cut Value in the QAOA State Is at Most 2((v−1)^(2p+2)−1)/(v−2) Times the Number of EdgesResearch Paper

Motivation

The Quantum Approximate Optimization Algorithm (QAOA) of Farhi, Goldstone and Gutmann (arXiv:1411.4028, 2014) is a family of shallow quantum circuits for combinatorial optimization, indexed by a depth ppp and 2p2p2p real angles. It has become one of the standard candidate algorithms for near-term quantum hardware, and its MaxCut instance is the usual benchmark on which it is analysed.

The algorithm is run by preparing a quantum state, measuring it in the computational basis to obtain a bit string zzz, and evaluating the classical objective C(z)C(z)C(z). Its analysis in the paper bounds the mean FpF_pFp​ of C(z)C(z)C(z). A mean alone does not say what a single run returns. Section III of the paper supplies the missing piece for MaxCut on bounded-degree graphs: the variance of C(z)C(z)C(z) grows at most linearly in the number of edges, so the measured cut values are concentrated around FpF_pFp​ and a modest number of repetitions reproduces the mean. This mission formalizes that variance bound, equation (30) of the paper, together with the locality and counting facts it rests on.

Setting

Let GGG be a simple graph on vertices {0,…,n−1}\{0,\dots,n-1\}{0,…,n−1} with edge set {⟨jk⟩}\{\langle jk\rangle\}{⟨jk⟩} of size mmm, each edge listed once. Vertices are qubits; a computational basis state is a bit string z∈{0,1}nz\in\{0,1\}^nz∈{0,1}n.

  • The clause operator of an edge is C⟨jk⟩=12(−σjzσkz+1)C_{\langle jk\rangle}=\tfrac12(-\sigma^z_j\sigma^z_k+1)C⟨jk⟩​=21​(−σjz​σkz​+1). It is diagonal: C⟨jk⟩(z)=1C_{\langle jk\rangle}(z)=1C⟨jk⟩​(z)=1 if zj≠zkz_j\ne z_kzj​=zk​ and 000 otherwise.
  • The MaxCut objective is C=∑⟨jk⟩C⟨jk⟩C=\sum_{\langle jk\rangle}C_{\langle jk\rangle}C=∑⟨jk⟩​C⟨jk⟩​; C(z)C(z)C(z) is the number of edges cut by zzz.
  • The mixer is B=∑jσjxB=\sum_j\sigma^x_jB=∑j​σjx​, and U(C,γ)=e−iγCU(C,\gamma)=e^{-i\gamma C}U(C,γ)=e−iγC, U(B,β)=e−iβBU(B,\beta)=e^{-i\beta B}U(B,β)=e−iβB.
  • The initial state is ∣s⟩=2−n/2∑z∣z⟩|s\rangle=2^{-n/2}\sum_z|z\rangle∣s⟩=2−n/2∑z​∣z⟩.
  • For p≥1p\ge1p≥1 and angles γ=(γ1,…,γp)\boldsymbol\gamma=(\gamma_1,\dots,\gamma_p)γ=(γ1​,…,γp​), β=(β1,…,βp)\boldsymbol\beta=(\beta_1,\dots,\beta_p)β=(β1​,…,βp​), the QAOA state is
∣γ,β⟩=U(B,βp) U(C,γp)⋯U(B,β1) U(C,γ1) ∣s⟩.|\boldsymbol\gamma,\boldsymbol\beta\rangle=U(B,\beta_p)\,U(C,\gamma_p)\cdots U(B,\beta_1)\,U(C,\gamma_1)\,|s\rangle .∣γ,β⟩=U(B,βp​)U(C,γp​)⋯U(B,β1​)U(C,γ1​)∣s⟩.
  • Measuring it gives zzz with probability P(z)=∣⟨z∣γ,β⟩∣2P(z)=|\langle z|\boldsymbol\gamma,\boldsymbol\beta\rangle|^2P(z)=∣⟨z∣γ,β⟩∣2. The mean is Fp(γ,β)=⟨γ,β∣C∣γ,β⟩=∑zP(z)C(z)F_p(\boldsymbol\gamma,\boldsymbol\beta)=\langle\boldsymbol\gamma,\boldsymbol\beta|C|\boldsymbol\gamma,\boldsymbol\beta\rangle=\sum_zP(z)C(z)Fp​(γ,β)=⟨γ,β∣C∣γ,β⟩=∑z​P(z)C(z) and the variance is
⟨γ,β∣C2∣γ,β⟩−⟨γ,β∣C∣γ,β⟩2.\langle\boldsymbol\gamma,\boldsymbol\beta|C^2|\boldsymbol\gamma,\boldsymbol\beta\rangle-\langle\boldsymbol\gamma,\boldsymbol\beta|C|\boldsymbol\gamma,\boldsymbol\beta\rangle^2 .⟨γ,β∣C2∣γ,β⟩−⟨γ,β∣C∣γ,β⟩2.
  • The light cone (the paper's subgraph g(j,k)g(j,k)g(j,k)) of an edge is the set of qubits at graph distance at most ppp from jjj or from kkk.

In Lean these are edgeCut, cutValue, qaoaState, expectCut and edgeTerm in the shared FarhiQAOA.Cubic setting, and edgePairs, cutVariance, edgePairTerm, edgeCov and lightCone in FarhiQAOA.Concentration, all built on the published QAlgorithms definitions of qubit registers, measurement probabilities, the uniform superposition, the problem Hamiltonian and the QAOA unitary.

Formalization targets

Goal: the variance bound (30)

For a vvv-regular graph with v≥3v\ge3v≥3, every depth p≥1p\ge1p≥1 and all real angles,

⟨γ,β∣C2∣γ,β⟩−⟨γ,β∣C∣γ,β⟩2≤2[(v−1)2p+2−1(v−1)−1]⋅m.\langle\boldsymbol\gamma,\boldsymbol\beta|C^2|\boldsymbol\gamma,\boldsymbol\beta\rangle-\langle\boldsymbol\gamma,\boldsymbol\beta|C|\boldsymbol\gamma,\boldsymbol\beta\rangle^2\le2\left[\frac{(v-1)^{2p+2}-1}{(v-1)-1}\right]\cdot m .⟨γ,β∣C2∣γ,β⟩−⟨γ,β∣C∣γ,β⟩2≤2[(v−1)−1(v−1)2p+2−1​]⋅m.

The constant is the paper's, as printed.

Milestones

  1. (27)–(28). The variance is the double sum, over ordered pairs of edges, of the covariances ⟨C⟨jk⟩C⟨j′k′⟩⟩−⟨C⟨jk⟩⟩⟨C⟨j′k′⟩⟩\langle C_{\langle jk\rangle}C_{\langle j'k'\rangle}\rangle-\langle C_{\langle jk\rangle}\rangle\langle C_{\langle j'k'\rangle}\rangle⟨C⟨jk⟩​C⟨j′k′⟩​⟩−⟨C⟨jk⟩​⟩⟨C⟨j′k′⟩​⟩.
  2. Disjoint light cones. If g(j,k)g(j,k)g(j,k) and g(j′,k′)g(j',k')g(j′,k′) share no qubit, the covariance of the two edges is 000.
  3. (26). For maximum degree v≥3v\ge3v≥3, ∣g(j,k)∣≤2[((v−1)p+1−1)/((v−1)−1)]|g(j,k)|\le2\big[((v-1)^{p+1}-1)/((v-1)-1)\big]∣g(j,k)∣≤2[((v−1)p+1−1)/((v−1)−1)].
  4. (29). For maximum degree v≥3v\ge3v≥3, at most 2[((v−1)2p+2−1)/((v−1)−1)]2\big[((v-1)^{2p+2}-1)/((v-1)-1)\big]2[((v−1)2p+2−1)/((v−1)−1)] edges ⟨j′k′⟩\langle j'k'\rangle⟨j′k′⟩ have g(j′,k′)g(j',k')g(j′,k′) meeting g(j,k)g(j,k)g(j,k).
  5. Summand bound. Each covariance is at most 111 in absolute value.

Companions, printed in the paper for v=2v=2v=2: ∣g(j,k)∣≤2p+2|g(j,k)|\le2p+2∣g(j,k)∣≤2p+2 and at most 4p+44p+44p+4 meeting edges.

Significance

The result. For fixed vvv and ppp the bound makes the standard deviation of the cut value O(m)O(\sqrt m)O(m​), while the mean is of order mmm. The algorithm's output is therefore concentrated: a single measurement already returns a cut close to FpF_pFp​ in relative terms, and the paper uses this to argue that the sample mean of polynomially many runs estimates FpF_pFp​ within 111. The same locality structure, that each edge term depends only on a bounded neighbourhood, is what makes FpF_pFp​ classically computable for fixed ppp and underlies later analyses of QAOA on bounded-degree and random regular graphs.

Formalizing it. The bound is proved in the paper in a few lines; none of it is machine-checked. A formal proof has to make the paper's operator locality argument precise (the conjugated clause operator is supported on the light cone, and the initial state is a product state), connect it to the computational-basis probabilities, and carry out the graph counting with explicit constants. The resulting locality lemma for QAOA circuits on graphs is reusable for any statement about QAOA at fixed depth.

Difficulty

The algebra of (28) and the bound by 111 are routine. The substance is in two places.

The vanishing of a covariance requires showing that U†C⟨jk⟩UU^\dagger C_{\langle jk\rangle}UU†C⟨jk⟩​U, for the full depth-ppp QAOA unitary UUU, acts only on the qubits of g(j,k)g(j,k)g(j,k), and that for two operators acting on disjoint sets of qubits the expectation in the product state ∣s⟩|s\rangle∣s⟩ factorizes. Both are statements about operators on (C2)⊗n(\mathbb C^2)^{\otimes n}(C2)⊗n, whereas the objects in the statement are probabilities of computational basis states; the formal proof must pass between the two. Matrix exponentials of commuting sums have to be split into commuting factors, which in Lean means working with NormedSpace.exp on matrices indexed by bit strings.

The counting (26) and (29) is a ball-growth bound in a graph of bounded degree. The paper's count, via (26) with ppp replaced by 2p+12p+12p+1, bounds vertices, while (29) counts edges; the passage between the two, and the extended graph distance on disconnected graphs, must be made exact with the printed constant.

Formalization scope

  • Qubits are indexed by Fin n, bit strings are Fin n → Bool with true the bit 111, and states live in EuclideanSpace ℂ (Fin n → Bool).
  • All expectations are sums ∑zP(z) f(z)\sum_zP(z)\,f(z)∑z​P(z)f(z) over the computational basis. This equals the operator expectation in the paper because every operator involved is diagonal.
  • Each edge is counted once (pairs j<kj<kj<k), in mmm, in CCC, in the double sum of (28) and in the count (29).
  • Graph distance is the extended distance SimpleGraph.edist (+∞+\infty+∞ between components).
  • The goal is stated for vvv-regular graphs with v≥3v\ge3v≥3, the domain of the printed formula. The milestones (26) and (29) assume only maximum degree ≤v\le v≤v, as printed there.
  • The angles range over all of Rp\mathbb R^pRp. The paper restricts them to [0,2π][0,2\pi][0,2π] and [0,π][0,\pi][0,π] by periodicity; the bound does not depend on that restriction.
  • The QAOA state is the state itself, not an arbitrary vector: normalisation of the measurement probabilities follows from unitarity and is part of what must be proved.

A variance defined with two different states, or a probability vector that is not normalised, would make the goal vacuous or false; the definitions use the single state ∣γ,β⟩|\boldsymbol\gamma,\boldsymbol\beta\rangle∣γ,β⟩ throughout.

Out of scope: the O(m)O(\sqrt m)O(m​) standard-deviation reading and the sampling claim after (30), which carry no explicit constant; the measurement-and-repetition procedure, running time, circuit depth and the classical search for the angles.

Welcome contributions: a general light-cone lemma for conjugation by products of exponentials of local Hamiltonians on qubits; factorization of product-state expectations over disjoint qubit sets; ball-size bounds in graphs of bounded degree.

Selected references

  • E. Farhi, J. Goldstone, S. Gutmann, A Quantum Approximate Optimization Algorithm, arXiv preprint, 2014. https://arxiv.org/abs/1411.4028 (v1; Section III, pp. 6–7)
  • E. Farhi, J. Goldstone, S. Gutmann, M. Sipser, Quantum Computation by Adiabatic Evolution, arXiv preprint, 2000. https://arxiv.org/abs/quant-ph/0001106
14 thms2 active usersReviewed
CombinatoricsProbabilityStatistics·Captain: mikedeng1

Partial Recovery in the Graph Alignment Problem II: Under Explicit Sparsity Conditions with nqs Above a Constant, Some Algorithm Recovers a Fraction α of the AlignmentResearch Paper

Motivation

Graph alignment asks for the correspondence between the vertex sets of two graphs that are noisy copies of each other. It underlies the de-anonymisation of social networks, where an anonymised graph is matched to a public one (Narayanan, Shmatikov 2009), the comparison of protein–protein interaction networks across species, and matching problems in computer vision. The standard random model for studying when alignment is possible is the correlated Erdős–Rényi model (Pedarsani, Grossglauser 2011).

In that model, exact recovery of the hidden correspondence and almost exact recovery (all but a vanishing fraction of vertices) have sharp thresholds: exact recovery by Cullina, Kiyavash 2016 and 2017; almost exact recovery when nqs=ω(1)nqs = \omega(1)nqs=ω(1) by Cullina, Kiyavash, Mittal and Poor (arXiv:1809.03553). Hall and Massoulié (arXiv:2007.00533v5, Operations Research 2023) study partial recovery, the recovery of a constant fraction α\alphaα of the correspondence, in the sparse regime nqs=Θ(1)nqs = \Theta(1)nqs=Θ(1), where almost exact recovery is impossible. This mission formalizes their possibility result, Theorem 2.3. Its companion mission (Partial Recovery in the Graph Alignment Problem I) formalizes the impossibility result, Theorem 2.1.

Setting

Fix n≥1n \ge 1n≥1 and parameters q,sq, sq,s with 0≤q<s≤10 \le q < s \le 10≤q<s≤1. A parent graph on {1,…,n}\{1, \dots, n\}{1,…,n} includes each edge independently with probability q/sq/sq/s. Two copies are made, and each copy keeps every edge independently with probability sss. The resulting graphs GAG_AGA​ and GB′G_{B'}GB′​ have adjacency matrices AAA and B′B'B′. For each unordered pair {i,j}\{i, j\}{i,j} of distinct vertices, (Aij,Bij′)(A_{ij}, B'_{ij})(Aij​,Bij′​) has the law PPP of display (3):

p00=1−2q+qs,p01=p10=q(1−s),p11=qs,p_{00} = 1 - 2q + qs, \qquad p_{01} = p_{10} = q(1-s), \qquad p_{11} = qs,p00​=1−2q+qs,p01​=p10​=q(1−s),p11​=qs,

independently over the (n2)\binom n2(2n​) pairs. The covariance of AijA_{ij}Aij​ and Bij′B'_{ij}Bij′​ is σ2=q(s−q)\sigma^2 = q(s-q)σ2=q(s−q) (display (2)), which is positive when q>0q > 0q>0.

A planted permutation π∗\pi^*π∗ relabels GB′G_{B'}GB′​ into the observed graph GBG_BGB​: Bπ∗(i)π∗(j)=Bij′B_{\pi^*(i)\pi^*(j)} = B'_{ij}Bπ∗(i)π∗(j)​=Bij′​. An algorithm sees (A,B)(A, B)(A,B) and returns a permutation π^\hat\piπ^. Its quality is the overlap

β(π^,π∗)=1n∑i=1n1{π^(i)=π∗(i)}.\beta(\hat\pi, \pi^*) = \frac1n \sum_{i=1}^n \mathbf 1\{\hat\pi(i) = \pi^*(i)\}.β(π^,π∗)=n1​i=1∑n​1{π^(i)=π∗(i)}.

For 0<α<10 < \alpha < 10<α<1, a permutation π\piπ is good (Definition 2) if at least n(1+α)/2n(1+\alpha)/2n(1+α)/2 vertices iii have degree at least nqs/2nqs/2nqs/2 in the intersection of GAG_AGA​ with GBG_BGB​ relabelled by π\piπ:

∑i=1n1{∑j≠iAijBπ(i)π(j)≥nqs2}≥n⋅1+α2.\sum_{i=1}^n \mathbf 1\Big\{\sum_{j \ne i} A_{ij} B_{\pi(i)\pi(j)} \ge \frac{nqs}{2}\Big\} \ge n\cdot\frac{1+\alpha}{2}.i=1∑n​1{j=i∑​Aij​Bπ(i)π(j)​≥2nqs​}≥n⋅21+α​.

In Lean, these objects are pLaw, Config, cfgProb, prob, A, B', B, overlap, good and Cond6 in GraphAlignment.Possible.

Formalization targets

Goal: Theorem 2.3 (pp. 8–9)

Let 0<α<10 < \alpha < 10<α<1 and let q=qnq = q_nq=qn​, s=sns = s_ns=sn​ be sequences. Suppose there exist β,γ>0\beta, \gamma > 0β,γ>0 such that, for all large nnn,

nqs≥max⁡{20, 84log⁡21−α, 16min⁡(γ,β)(1−α)},s>8q1−α,2q(1−s2)s≤n−β,qs≤n−2γ.(6)nqs \ge \max\Big\{20,\ 84\log\frac{2}{1-\alpha},\ \frac{16}{\min(\gamma,\beta)(1-\alpha)}\Big\}, \quad s > \frac{8q}{1-\alpha}, \quad \frac{2q(1-s^2)}{s} \le n^{-\beta}, \quad qs \le n^{-2\gamma}. \tag{6}nqs≥max{20, 84log1−α2​, min(γ,β)(1−α)16​},s>1−α8q​,s2q(1−s2)​≤n−β,qs≤n−2γ.(6)

Then some algorithm returns π^\hat\piπ^ with

P[β(π^,π∗)≥α]→1(n→∞).\mathbb P\big[\beta(\hat\pi, \pi^*) \ge \alpha\big] \to 1 \qquad (n \to \infty).P[β(π^,π∗)≥α]→1(n→∞).

Milestones

  1. Lemma B.3: Mn=αnM−βIα−β+βnM−αIβ−αM^n = \alpha^n \frac{M - \beta I}{\alpha - \beta} + \beta^n \frac{M - \alpha I}{\beta - \alpha}Mn=αnα−βM−βI​+βnβ−αM−αI​ for a 2×22 \times 22×2 matrix with distinct eigenvalues α,β\alpha, \betaα,β.
  2. Lemma B.2: for n+1n+1n+1 independent pairs with law PPP and W=A0B1+⋯+AnB0W = A_0B_1 + \dots + A_nB_0W=A0​B1​+⋯+An​B0​,
E[etW]=(T+T2−4D2)n+1+(T−T2−4D2)n+1,T=p11(et−1)+1, D=σ2(et−1).\mathbb E[e^{tW}] = \Big(\tfrac{T + \sqrt{T^2 - 4D}}{2}\Big)^{n+1} + \Big(\tfrac{T - \sqrt{T^2 - 4D}}{2}\Big)^{n+1}, \quad T = p_{11}(e^t - 1) + 1,\ D = \sigma^2(e^t - 1).E[etW]=(2T+T2−4D​​)n+1+(2T−T2−4D​​)n+1,T=p11​(et−1)+1, D=σ2(et−1).
  1. Lemma B.1: (αk+βk)n/k≤(α2+β2)n/2(\alpha^k + \beta^k)^{n/k} \le (\alpha^2 + \beta^2)^{n/2}(αk+βk)n/k≤(α2+β2)n/2 for 2≤k≤n2 \le k \le n2≤k≤n and α,β>0\alpha, \beta > 0α,β>0.
  2. Lemma 4.3: min⁡z>0z−τeq2(z2−1)+q1(z−1)≤ζτ\min_{z > 0} z^{-\tau} e^{q_2(z^2-1) + q_1(z-1)} \le \zeta^\tauminz>0​z−τeq2​(z2−1)+q1​(z−1)≤ζτ, with ζ=max⁡{2eq1/τ, 4e(q2/τ)1/2}\zeta = \max\{\sqrt2 e q_1/\tau,\ 4e(q_2/\tau)^{1/2}\}ζ=max{2​eq1​/τ, 4e(q2​/τ)1/2}, and the minimizer satisfies z∗2=(τ−q1z∗)/(2q2)≤τ/(2q2)z^{*2} = (\tau - q_1 z^*)/(2q_2) \le \tau/(2q_2)z∗2=(τ−q1​z∗)/(2q2​)≤τ/(2q2​).
  3. Display (10): for a permutation ppp with a fraction ϵ\epsilonϵ of fixed points, ∣S21∣≤n(1−ϵ)|S^1_2| \le n(1-\epsilon)∣S21​∣≤n(1−ϵ) and ∣Sˉ22∣≤(n2)−(nϵ2)≤n22(1−ϵ2)|\bar S^2_2| \le \binom n2 - \binom{n\epsilon}2 \le \frac{n^2}2(1-\epsilon^2)∣Sˉ22​∣≤(2n​)−(2nϵ​)≤2n2​(1−ϵ2).
  4. Lemma A.2, in particular: P(Po(2λ/3)≥λ/2−1)≥0.7\mathbb P(\mathrm{Po}(2\lambda/3) \ge \lambda/2 - 1) \ge 0.7P(Po(2λ/3)≥λ/2−1)≥0.7 for λ≥20\lambda \ge 20λ≥20.
  5. Proposition 4.2: under (6), π∗\pi^*π∗ is good with probability tending to 1.
  6. Proposition 4.4: under (6), P(∀π, [π good⇒β(π,π∗)>α])→1\mathbb P(\forall \pi,\ [\pi \text{ good} \Rightarrow \beta(\pi, \pi^*) > \alpha]) \to 1P(∀π, [π good⇒β(π,π∗)>α])→1.

Significance

The result. Theorem 2.3 shows that partial alignment is information-theoretically achievable in the sparse regime nqs=Θ(1)nqs = \Theta(1)nqs=Θ(1), provided nqsnqsnqs is above an explicit constant depending on α\alphaα. Together with Theorem 2.1, it locates partial recovery between a necessary condition stated through the divergence D(P∥Q)D(P\|Q)D(P∥Q) and a sufficient condition stated through nqsnqsnqs. It complements the almost-exact-recovery results for nqs=ω(1)nqs = \omega(1)nqs=ω(1), which do not apply when nqsnqsnqs stays bounded. The moment generating function computation of Lemma B.2 and the inequality of Lemma B.1 were reused for the sharp exact-recovery threshold by Wu, Xu, Yu (p. 9 of the source).

Formalizing it. The theorem is proved on paper; no part of it is machine-checked. The paper's route to Proposition 4.2 applies a kkk-core theorem for G(n,λ/n)G(n, \lambda/n)G(n,λ/n) with λ\lambdaλ fixed and kkk an integer, at λ=nqs\lambda = nqsλ=nqs and k=nqs/2k = nqs/2k=nqs/2, which vary with nnn and need not be integers. The statement of Proposition 4.2 remains true, but a formal proof needs a different argument. Proposition 4.4's union bound contains two repairable gaps: an infimum taken over z>0z > 0z>0 instead of z>1z > 1z>1, and the bound n!≤nlog⁡nn! \le n^{\log n}n!≤nlogn. A formal development would settle the theorem under exactly the conditions (6).

Difficulty

The natural first step is to compute P(π good)\mathbb P(\pi \text{ good})P(π good) for a fixed wrong permutation π\piπ and take a union bound over all n!n!n! permutations. The difficulty is that for π≠π∗\pi \ne \pi^*π=π∗ the terms AijBp(i)p(j)′A_{ij} B'_{p(i)p(j)}Aij​Bp(i)p(j)′​ are not independent: an edge variable enters several terms along the cycles that ppp induces on vertex pairs. A Chernoff bound therefore needs the moment generating function of a sum over each cycle of pairs. That is a transfer-matrix computation, and the per-cycle bounds must then be recombined uniformly in the cycle lengths. The resulting exponent must beat log⁡n!≈nlog⁡n\log n! \approx n \log nlogn!≈nlogn. This is where the sparsity conditions 2q(1−s2)/s≤n−β2q(1-s^2)/s \le n^{-\beta}2q(1−s2)/s≤n−β and qs≤n−2γqs \le n^{-2\gamma}qs≤n−2γ, and the constant 16/(min⁡(γ,β)(1−α))16/(\min(\gamma,\beta)(1-\alpha))16/(min(γ,β)(1−α)), enter. Proposition 4.2 is a concentration statement for the number of vertices of degree at least nqs/2nqs/2nqs/2 in the intersection graph, an Erdős–Rényi graph G(n,qs)G(n, qs)G(n,qs), when nqsnqsnqs is only a large constant.

Formalization scope

Everything is finite. Vertices are Fin n and permutations are Equiv.Perm (Fin n). A configuration assigns (Aij,Bij′)∈(A_{ij}, B'_{ij}) \in(Aij​,Bij′​)∈ Bool × Bool to each non-diagonal element of Sym2 (Fin n), and probabilities are finite sums of the product weights. They are not taken against a free measure, so the model is a genuine probability space whenever 0≤q<s≤10 \le q < s \le 10≤q<s≤1. The standing assumptions 0≤qn<sn≤10 \le q_n < s_n \le 10≤qn​<sn​≤1 for every nnn (p. 5 and the running assumption s>qs > qs>q on p. 7) are hypotheses of the asymptotic statements. The paper's remark "we assume s<1s < 1s<1" (p. 6) is used by neither result and is not imposed. Logarithms are natural, "→1\to 1→1" is a limit along n→∞n \to \inftyn→∞, and the thresholds nqs/2nqs/2nqs/2 and n(1+α)/2n(1+\alpha)/2n(1+α)/2 are real numbers, not floored.

In the goal, an algorithm is a family of maps from the observed pair (A,B)(A, B)(A,B) to a permutation. It is chosen before the planted permutations and may depend on nnn, qnq_nqn​, sns_nsn​, α\alphaα, but never on π∗\pi^*π∗. This rules out the trivial algorithm "output π∗\pi^*π∗". The theorem does not say how π∗\pi^*π∗ is drawn, so the limit is required for every sequence of planted permutations, which covers the uniform case. "Exponential time" is not formalized.

Three statements are posed in a corrected reading, each disclosed in its Formalization Note. In Lemma 4.3, τ,q2>0\tau, q_2 > 0τ,q2​>0 and z>0z > 0z>0: the paper allows τ=q2=0\tau = q_2 = 0τ=q2​=0 and z=0z = 0z=0, where ζ\zetaζ and (13) are undefined, and Lean's convention 0−τ=00^{-\tau} = 00−τ=0 would make the bound trivial. Display (10) is stated for an arbitrary permutation ppp. Only the "in particular" clause of Lemma A.2 is stated, because the paper's proof of the general normal-approximation bound does not hold as written. Lemma 4.1 (a kkk-core theorem of Pittel, Spencer and Wormald) is not posed.

A complete development needs: Chernoff bounds for finite sums of dependent Bernoulli variables via the transfer-matrix formula, binomial and Poisson tail estimates, and the cycle decomposition of the action of a permutation on unordered pairs. Lemmas B.1, B.3 and 4.3 are general-purpose and reusable. Proofs of any milestone, and alternative proofs of Proposition 4.2 that avoid kkk-cores, are welcome.

The source is the arXiv preprint v5, whose appendices contain the proofs that the main text defers to an electronic companion.

Selected references

  • G. Hall, L. Massoulié, Partial Recovery in the Graph Alignment Problem, Operations Research, 2023; preprint arXiv:2007.00533v5, 2022. https://arxiv.org/abs/2007.00533
  • D. Cullina, N. Kiyavash, P. Mittal, H. V. Poor, Partial Recovery of Erdős–Rényi Graph Alignment via k-Core Alignment, arXiv preprint, 2018. https://arxiv.org/abs/1809.03553
  • D. Cullina, N. Kiyavash, Exact Alignment Recovery for Correlated Erdős–Rényi Graphs, arXiv preprint, 2017. https://arxiv.org/abs/1711.06783
  • D. Cullina, N. Kiyavash, Improved Achievability and Converse Bounds for Erdős–Rényi Graph Matching, SIGMETRICS, 2016. https://arxiv.org/abs/1602.01042
  • B. Pittel, J. Spencer, N. Wormald, Sudden Emergence of a Giant k-Core in a Random Graph, J. Combin. Theory Ser. B, 1996. https://doi.org/10.1006/jctb.1996.0036
  • Y. Wu, J. Xu, S. H. Yu, Settling the Sharp Reconstruction Thresholds of Random Graph Matching, arXiv preprint, 2021. https://arxiv.org/abs/2102.00082
  • A. Narayanan, V. Shmatikov, De-anonymizing Social Networks, IEEE Symposium on Security and Privacy, 2009. https://doi.org/10.1109/SP.2009.22
  • P. Pedarsani, M. Grossglauser, On the Privacy of Anonymized Networks, KDD, 2011. https://doi.org/10.1145/2020408.2020596
12 thms2 active usersReviewed
OptimizationQuantum Information·Captain: mikedeng1

A Quantum Approximate Optimization Algorithm I: At p = 1 the QAOA Expected Cut Is at Least 0.6924 Times the Maximum Cut on Every Connected 3-Regular GraphResearch Paper

Motivation

The quantum approximate optimization algorithm (QAOA) of Farhi, Goldstone and Gutmann (arXiv:1411.4028, 2014) is a family of shallow quantum circuits, indexed by an integer depth p≥1p \ge 1p≥1, that prepare states whose computational-basis measurements are biased toward good solutions of a combinatorial optimization problem. It became the standard candidate for optimization on near-term quantum hardware, and its performance on MaxCut is the benchmark against which later analyses and experiments are measured.

The original paper proves one concrete performance guarantee: at depth p=1p = 1p=1, on 3-regular graphs, the algorithm achieves an approximation ratio of at least 0.69240.69240.6924. Short timeline:

  • 2014, Farhi–Goldstone–Gutmann: the p=1p = 1p=1 bound 0.69240.69240.6924 on 3-regular graphs, by reducing the expected cut to three subgraph functions and a numerical minimization (arXiv:1411.4028).
  • 2018, Wang, Hadfield, Jiang and Rieffel: closed-form expressions for the p=1p = 1p=1 MaxCut expectation on arbitrary graphs (arXiv:1706.02998, Phys. Rev. A 97, 022304).
  • Classically, Goemans and Williamson's semidefinite rounding achieves 0.8780.8780.878 on all graphs (J. ACM 42, 1995), so the p=1p = 1p=1 guarantee is, as the paper itself notes, below the best classical algorithms.

Setting

A graph GGG has vertex set {0,…,n−1}\{0, \dots, n-1\}{0,…,n−1}, and 3-regular means every vertex has exactly three neighbours. Each vertex carries a qubit; a computational basis state is a bit string z=z0⋯zn−1z = z_0 \cdots z_{n-1}z=z0​⋯zn−1​. For an edge ⟨jk⟩\langle jk\rangle⟨jk⟩ the clause C⟨jk⟩(z)C_{\langle jk\rangle}(z)C⟨jk⟩​(z) is 111 if zj≠zkz_j \neq z_kzj​=zk​ and 000 otherwise, and the cut objective is

C(z)=∑⟨jk⟩C⟨jk⟩(z),C(z) = \sum_{\langle jk\rangle} C_{\langle jk\rangle}(z),C(z)=⟨jk⟩∑​C⟨jk⟩​(z),

the number of edges cut by the bipartition zzz defines. As an operator, CCC is diagonal in the computational basis.

Let B=∑jσjxB = \sum_j \sigma^x_jB=∑j​σjx​ and let ∣s⟩=2−n/2∑z∣z⟩|s\rangle = 2^{-n/2}\sum_z |z\rangle∣s⟩=2−n/2∑z​∣z⟩. For angles γ,β∈R\gamma, \beta \in \mathbb Rγ,β∈R, the depth-one QAOA state and its expected cut are

∣γ,β⟩=e−iβB e−iγC ∣s⟩,F1(γ,β)=⟨γ,β∣ C ∣γ,β⟩=∑z∣⟨z∣γ,β⟩∣2 C(z).|\gamma,\beta\rangle = e^{-i\beta B}\, e^{-i\gamma C}\, |s\rangle, \qquad F_1(\gamma,\beta) = \langle\gamma,\beta|\,C\,|\gamma,\beta\rangle = \sum_z |\langle z|\gamma,\beta\rangle|^2\, C(z).∣γ,β⟩=e−iβBe−iγC∣s⟩,F1​(γ,β)=⟨γ,β∣C∣γ,β⟩=z∑​∣⟨z∣γ,β⟩∣2C(z).

The angles may be restricted to γ∈[0,2π]\gamma \in [0, 2\pi]γ∈[0,2π], β∈[0,π]\beta \in [0, \pi]β∈[0,π] by periodicity.

Two kinds of small subgraphs govern the analysis. A crossed square is a set of four vertices spanning exactly five edges (a 4-cycle with one diagonal). An isolated triangle is a triangle whose three outgoing edges end on three distinct vertices. SSS and TTT denote their numbers in GGG. Finally, for an edge ⟨jk⟩\langle jk\rangle⟨jk⟩ the subgraph type is the shape of the edge together with its adjacent edges; in a 3-regular graph there are three types g4,g5,g6g_4, g_5, g_6g4​,g5​,g6​, according as jjj and kkk have two, one or no common neighbours. Each type ggg defines a function fg(γ,β)f_g(\gamma, \beta)fg​(γ,β), the expectation of the clause of the central edge in the depth-one QAOA state of the subgraph ggg alone.

Formalization targets

Goal: the depth-one ratio on cubic graphs

For every connected 3-regular graph GGG there are angles γ∈[0,2π]\gamma \in [0, 2\pi]γ∈[0,2π], β∈[0,π]\beta \in [0, \pi]β∈[0,π] with

F1(γ,β)  ≥  0.6924⋅C(z)for every bit string z,F_1(\gamma, \beta) \;\ge\; 0.6924 \cdot C(z) \qquad \text{for every bit string } z,F1​(γ,β)≥0.6924⋅C(z)for every bit string z,

that is, M1=max⁡γ,βF1≥0.6924⋅max⁡zC(z)M_1 = \max_{\gamma,\beta} F_1 \ge 0.6924 \cdot \max_z C(z)M1​=maxγ,β​F1​≥0.6924⋅maxz​C(z). The constant is exactly the paper's 0.69240.69240.6924, and K4K_4K4​ is included.

Milestones

The paper's argument passes through the following claims, each a milestone:

  1. At p=1p = 1p=1 each edge term of a 3-regular graph equals fg4f_{g_4}fg4​​, fg5f_{g_5}fg5​​ or fg6f_{g_6}fg6​​ according to its subgraph type (p. 5).
  2. In a connected 3-regular graph other than K4K_4K4​, there are SSS edges of type g4g_4g4​ and 4S+3T4S + 3T4S+3T of type g5g_5g5​ (pp. 8–9).
  3. Equation (32): F1=Sfg4+(4S+3T)fg5+(3n/2−5S−3T)fg6F_1 = S f_{g_4} + (4S + 3T) f_{g_5} + (3n/2 - 5S - 3T) f_{g_6}F1​=Sfg4​​+(4S+3T)fg5​​+(3n/2−5S−3T)fg6​​ (p. 9).
  4. 3T+4S≤n3T + 4S \le n3T+4S≤n (p. 8).
  5. Every cut has at most 3n/2−S−T3n/2 - S - T3n/2−S−T edges (p. 9).
  6. For s,t≥0s, t \ge 0s,t≥0 with 4s+3t≤14s + 3t \le 14s+3t≤1, the scaled ratio (35) M1(1,s,t)/(3/2−s−t)M_1(1, s, t)/(3/2 - s - t)M1​(1,s,t)/(3/2−s−t) is at least 0.69240.69240.6924 (p. 9).
  7. On K4K_4K4​ the depth-one ratio exceeds 0.69240.69240.6924 (p. 8).

Significance

The result is the first rigorous worst-case guarantee for the QAOA, and the method behind it (the expected objective is a sum of local terms, each depending only on a bounded neighbourhood of an edge) is the template for every later analysis of fixed-depth QAOA on bounded-degree graphs. It shows that a depth-one circuit, of depth independent of nnn, achieves a constant approximation ratio uniformly over an infinite class of graphs.

The paper's proof is complete apart from one numerical step: the minimization of (35) is reported as a numerical evaluation. No machine-checked version of the result exists. A formal proof requires an exact evaluation of the three subgraph functions at suitable angles, an exact combinatorial count of edge types, and a certified inequality in place of the numerical minimization. The margin is small: the exact minimum is 12+133≈0.692450\tfrac12 + \tfrac{1}{3\sqrt 3} \approx 0.69245021​+33​1​≈0.692450, about 5⋅10−55 \cdot 10^{-5}5⋅10−5 above the paper's constant.

Difficulty

The light-cone reduction (milestone 1) is the conceptual step: one must show that conjugating a two-qubit clause by e−iγCe^{-i\gamma C}e−iγC and e−iβBe^{-i\beta B}e−iβB leaves an operator that involves only the qubits adjacent to the edge, and that the remaining qubits contribute a factor of one. In matrix form on 2n2^n2n-dimensional space this is a statement about tensor-product structure that the definitions do not make visible. The combinatorial count (milestones 2–4) needs a careful case analysis of how triangles sit in a cubic graph, including the exceptional graph K4K_4K4​, where the count fails. The final inequality (milestone 6) has a margin of order 10−410^{-4}10−4, so crude bounds on the trigonometric functions fgf_{g}fg​ do not suffice.

Formalization scope

  • Representation. Bit strings are Qubits n = Fin n → Bool from the published QAlgorithms layer, with true the bit 111. States are vectors in EuclideanSpace ℂ (Qubits n); ∣s⟩|s\rangle∣s⟩, CCC as a diagonal operator, BBB and the QAOA unitary are the published definitions uniformState, problemHamiltonian, qaoaMixer, qaoaUnitary. The latter takes mixer angles before phase angles.
  • Conventions. Graphs are SimpleGraph (Fin n) with decidable adjacency; "3-regular" is IsRegularOfDegree 3. The cut counts each edge once. F1F_1F1​ is defined as ∑zPr⁡[z] C(z)\sum_z \Pr[z]\,C(z)∑z​Pr[z]C(z), which equals ⟨γ,β∣C∣γ,β⟩\langle\gamma,\beta|C|\gamma,\beta\rangle⟨γ,β∣C∣γ,β⟩ because CCC is diagonal. The constant 0.69240.69240.6924 is the exact rational 1731/25001731/25001731/2500.
  • Added hypotheses. Milestones 2 and 3 assume GGG connected and n≠4n \ne 4n=4, which excludes K4K_4K4​, the case the paper sets aside on p. 8. No other hypothesis is added.
  • Out of scope. The goal concerns the expected cut at good angles, which is what the paper's analysis bounds. Measuring the state, repeating, and the claim that a cut of that size is then found with high probability are not formalized; nor are running time, circuit depth, or the search for optimal angles.
  • Ruled-out trivializations. A cut objective counting each edge twice, or an unnormalized state, would leave the ratio statement formally intact but about the wrong objects; the setting counts each edge once and uses the normalized uniform superposition. The goal quantifies over all bit strings, so it cannot be satisfied by bounding a particular cut.
  • Contributions welcome. Reusable lemmas on the light-cone locality of conjugated Pauli operators, closed forms of the depth-one MaxCut expectation, and counting lemmas for triangles in cubic graphs all serve beyond this mission.

Selected references

  • E. Farhi, J. Goldstone, S. Gutmann, A Quantum Approximate Optimization Algorithm, arXiv preprint, 2014. https://arxiv.org/abs/1411.4028
  • Z. Wang, S. Hadfield, Z. Jiang, E. G. Rieffel, Quantum approximate optimization algorithm for MaxCut: A fermionic view, Phys. Rev. A 97, 022304, 2018. https://arxiv.org/abs/1706.02998
  • M. X. Goemans, D. P. Williamson, Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming, J. ACM 42(6), 1995. https://doi.org/10.1145/227683.227684
14 thms2 active usersReviewed
🏆Completed
Convex OptimizationOptimization·Captain: mikedeng1

Shortest Paths in Graphs of Convex Sets I: The Perspective Mixed-Integer Convex Program (5.5) Has the Same Optimal Value as the Shortest-Path Problem in a Graph of Convex SetsResearch Paper

Motivation

Many planning problems combine a discrete choice with a continuous one. A robot moving through a cluttered room chooses which free regions to traverse and where exactly to cross between them; a vehicle chooses a sequence of operating modes and a trajectory within each mode. Marcucci, Umenberger, Parrilo and Tedrake (arXiv:2101.11565, SIAM J. Optim. 2024, doi:10.1137/22M1523790) abstract this as the shortest-path problem in a graph of convex sets (SPP in GCS): a shortest-path problem in which each vertex is not a point but a convex set, and the length of an edge depends on where in its two sets the path enters and leaves. The paper shows that the problem is NP-hard even in simple cases, and then gives a mixed-integer convex formulation that is exact and whose convex relaxation is strong in practice. That formulation underlies the GCS motion planners developed later by the same group.

Setting

A graph of convex sets consists of a finite directed graph G=(V,E)G = (\mathcal V, \mathcal E)G=(V,E), a source vertex sss, a target vertex t≠st \neq st=s, a nonempty compact convex set Xv⊆Rn\mathcal X_v \subseteq \mathbb R^nXv​⊆Rn for each vertex vvv, and for each edge e=(u,v)e = (u,v)e=(u,v) an edge length ℓe:Rn×Rn→R≥0∪{∞}\ell_e : \mathbb R^n \times \mathbb R^n \to \mathbb R_{\ge 0}\cup\{\infty\}ℓe​:Rn×Rn→R≥0​∪{∞}, which is proper, closed and convex. No symmetry or triangle inequality is assumed. An sss-ttt path is a sequence p=(v0,…,vK)p = (v_0,\dots,v_K)p=(v0​,…,vK​) of distinct vertices with v0=sv_0 = sv0​=s, vK=tv_K = tvK​=t and (vk,vk+1)∈E(v_k, v_{k+1}) \in \mathcal E(vk​,vk+1​)∈E; Ep\mathcal E_pEp​ is the set of its edges. The SPP in GCS (2.1) is

SPP⁡(G):=inf⁡{∑e=(u,v)∈Epℓe(xu,xv):p an s-t path, xv∈Xv for v∈p}.\operatorname{SPP}(G) := \inf\Big\{ \sum_{e=(u,v)\in\mathcal E_p} \ell_e(x_u,x_v) : p \text{ an } s\text{-}t\text{ path},\ x_v \in \mathcal X_v \text{ for } v \in p \Big\}.SPP(G):=inf{e=(u,v)∈Ep​∑​ℓe​(xu​,xv​):p an s-t path, xv​∈Xv​ for v∈p}.

The perspective of a set X\mathcal XX is the closed cone X~:=cl⁡{(x,λ):λ≥0, x∈λX}\tilde{\mathcal X} := \operatorname{cl}\{(x,\lambda) : \lambda \ge 0,\ x \in \lambda\mathcal X\}X~:=cl{(x,λ):λ≥0, x∈λX} (Definition 4.1). The perspective of a function fff is f~(x,λ):=inf⁡{σ:(x,σ,λ)∈epi⁡f~}\tilde f(x,\lambda) := \inf\{\sigma : (x,\sigma,\lambda) \in \widetilde{\operatorname{epi} f}\}f~​(x,λ):=inf{σ:(x,σ,λ)∈epif​}, the function whose epigraph is the perspective of the epigraph of fff (Definition 4.4). For λ>0\lambda > 0λ>0 it equals λf(x/λ)\lambda f(x/\lambda)λf(x/λ).

With Evin\mathcal E^{\mathrm{in}}_vEvin​ and Evout\mathcal E^{\mathrm{out}}_vEvout​ the edges entering and leaving vvv, the MICP (5.5) has a flow ye∈{0,1}y_e \in \{0,1\}ye​∈{0,1} and two vectors ze,ze′∈Rnz_e, z'_e \in \mathbb R^nze​,ze′​∈Rn per edge:

minimize ∑e∈Eℓ~e(ze,ze′,ye)s.t. ∑Esoutye=1, ∑Etinye=1,  ∑Evoutye≤1,  ∑Evin(ze′,ye)=∑Evout(ze,ye)  (v≠s,t),(ze,ye)∈X~u, (ze′,ye)∈X~v, ye∈{0,1}  (e=(u,v)∈E).\begin{aligned} \text{minimize}\ & \textstyle\sum_{e\in\mathcal E}\tilde\ell_e(z_e,z'_e,y_e)\\ \text{s.t.}\ & \textstyle\sum_{\mathcal E^{\mathrm{out}}_s} y_e = 1,\ \sum_{\mathcal E^{\mathrm{in}}_t} y_e = 1,\ \ \sum_{\mathcal E^{\mathrm{out}}_v} y_e \le 1,\ \ \sum_{\mathcal E^{\mathrm{in}}_v}(z'_e,y_e) = \sum_{\mathcal E^{\mathrm{out}}_v}(z_e,y_e)\ \ (v\ne s,t),\\ & (z_e,y_e)\in\tilde{\mathcal X}_u,\ (z'_e,y_e)\in\tilde{\mathcal X}_v,\ y_e\in\{0,1\}\ \ (e=(u,v)\in\mathcal E). \end{aligned}minimize s.t. ​∑e∈E​ℓ~e​(ze​,ze′​,ye​)∑Esout​​ye​=1, ∑Etin​​ye​=1,  ∑Evout​​ye​≤1,  ∑Evin​​(ze′​,ye​)=∑Evout​​(ze​,ye​)  (v=s,t),(ze​,ye​)∈X~u​, (ze′​,ye​)∈X~v​, ye​∈{0,1}  (e=(u,v)∈E).​

Its optimal value is MICP⁡(G)\operatorname{MICP}(G)MICP(G). The paper derives (5.5) from a biconvex program (5.2), the shortest-path LP (5.1) together with vertex positions xv∈Xvx_v \in \mathcal X_vxv​∈Xv​ and the bilinear constraints ze=yexuz_e = y_e x_uze​=ye​xu​, ze′=yexvz'_e = y_e x_vze′​=ye​xv​. Lemma 5.4 turns every valid linear inequality on the flows at a vertex into a valid perspective constraint.

Formalization targets

Goal: Theorem 5.7 (p. 10)

Under the standing assumptions of §2 and the assumption of p. 7 that no edge enters sss and no edge leaves ttt,

MICP⁡(G)=SPP⁡(G).\operatorname{MICP}(G) = \operatorname{SPP}(G).MICP(G)=SPP(G).

Both sides are infima in the extended reals and equal +∞+\infty+∞ when there is no sss-ttt path.

Milestones

  1. Remark 4.2 (p. 5): for bounded closed X\mathcal XX, X~={(x,λ):λ≥0, x∈λX}\tilde{\mathcal X} = \{(x,\lambda): \lambda\ge0,\ x\in\lambda\mathcal X\}X~={(x,λ):λ≥0, x∈λX}.
  2. Remark 4.5 (p. 6): f~(x,λ)=λf(x/λ)\tilde f(x,\lambda) = \lambda f(x/\lambda)f~​(x,λ)=λf(x/λ) for λ>0\lambda>0λ>0, f~=∞\tilde f = \inftyf~​=∞ for λ<0\lambda<0λ<0, f~(0,0)=0\tilde f(0,0)=0f~​(0,0)=0 for proper closed convex fff.
  3. Lemma 5.4 (p. 9): a valid inequality ∑e∈Evceye+d≥0\sum_{e\in\mathcal E_v} c_e y_e + d \ge 0∑e∈Ev​​ce​ye​+d≥0 for (5.2) lifts to the valid constraint (∑Evinceze′+∑Evoutceze+dxv, ∑Evceye+d)∈X~v\big(\sum_{\mathcal E^{\mathrm{in}}_v} c_e z'_e + \sum_{\mathcal E^{\mathrm{out}}_v} c_e z_e + d x_v,\ \sum_{\mathcal E_v} c_e y_e + d\big)\in\tilde{\mathcal X}_v(∑Evin​​ce​ze′​+∑Evout​​ce​ze​+dxv​, ∑Ev​​ce​ye​+d)∈X~v​.
  4. Remark 5.5 (p. 9): the equality version of Lemma 5.4.
  5. Path and cycles (proof of Theorem 5.7): binary flows satisfying (5.5b)–(5.5d) form the vertex-disjoint union of an sss-ttt path and cycles.
  6. Simplification of (5.5e) (proof of Theorem 5.7): ye=0y_e = 0ye​=0 forces ze=ze′=0z_e = z'_e = 0ze​=ze′​=0 at cost 000; ye=1y_e = 1ye​=1 forces ze∈Xuz_e\in\mathcal X_uze​∈Xu​, ze′∈Xvz'_e\in\mathcal X_vze′​∈Xv​ at cost ℓe(ze,ze′)\ell_e(z_e,z'_e)ℓe​(ze​,ze′​).
  7. Flow along the path (proof of Theorem 5.7): for consecutive path edges e,fe, fe,f, ze′=zfz'_e = z_fze′​=zf​.

A companion item states the recovery part of Theorem 5.7 (second and third sentences): an optimal MICP solution yields an optimal path and optimal positions xu=zex_u = z_exu​=ze​, xv=ze′x_v = z'_exv​=ze′​.

Significance

Theorem 5.7 is what makes (5.5) usable: it says that the mixed-integer program, whose only nonconvexity is ye∈{0,1}y_e\in\{0,1\}ye​∈{0,1}, solves the SPP in GCS exactly. The SPP in GCS is NP-hard by Theorem 3.1, so exactness is the most one can ask of a polynomial-size formulation, and dropping integrality gives a convex program whose value is a lower bound for branch and bound. The perspective construction of Lemma 5.4 is a general recipe, closely related to the reformulation-linearization technique, for convexifying products of flows and positions.

On the formal side, the paper's proof is half a page and leaves several points to the reader: why the integer flows decompose into a path and cycles, why the closure in the perspective cone disappears for compact sets, and why the perspective function vanishes at the origin. A machine-checked proof makes these steps explicit. The result has not been formalized before, and the mission also produces reusable statements about perspectives of sets and functions in extended-real arithmetic and about the decomposition of unit sss-ttt flows with degree bounds.

Difficulty

The inequality MICP⁡(G)≤SPP⁡(G)\operatorname{MICP}(G) \le \operatorname{SPP}(G)MICP(G)≤SPP(G) is the routine half: a path and its positions give a feasible point of (5.5) of the same cost. The other half requires reading a path out of an arbitrary feasible point. Integer flows satisfying (5.5b)–(5.5d) need not be a path: they may also contain disjoint cycles, and the degree constraint (5.5c) is what prevents a cycle from sharing a vertex with the path (Example 5.10 shows the value drops without it). The cost of a cycle must be shown to be nonnegative, and the perspective constraints must be shown to collapse to ze=ze′=0z_e = z'_e = 0ze​=ze′​=0 on zero-flow edges. That step uses compactness of Xv\mathcal X_vXv​. For unbounded sets the zero slice of X~v\tilde{\mathcal X}_vX~v​ is the recession cone, and the argument fails. The cost at zero flow is ℓ~e(0,0,0)\tilde\ell_e(0,0,0)ℓ~e​(0,0,0), defined by a closure, and its value 000 uses properness and convexity of ℓe\ell_eℓe​, not just the formula λℓe(⋅/λ)\lambda\ell_e(\cdot/\lambda)λℓe​(⋅/λ).

Formalization scope

  • Rn\mathbb R^nRn is Fin n → ℝ. Edge lengths and all optimal values are EReal; optimal values are infima (⨅/sInf), equal to +∞+\infty+∞ on an empty feasible set. Attainment is not assumed.
  • The graph is a structure with a finite edge set E : Finset (V × V) over a finite vertex type, a source, a target, sets X v and lengths ℓ e. The standing assumptions of §2 (s≠ts\ne ts=t; Xv\mathcal X_vXv​ nonempty, compact, convex; ℓe≥0\ell_e \ge 0ℓe​≥0 proper closed convex) are the predicate IsGCS. The assumption ∣Esin∣=∣Etout∣=0|\mathcal E^{\mathrm{in}}_s| = |\mathcal E^{\mathrm{out}}_t| = 0∣Esin​∣=∣Etout​∣=0 of p. 7 is the separate predicate NoInSNoOutT, a hypothesis of the goal, of the path-and-cycles milestone and of the recovery item.
  • Paths are duplicate-free vertex lists from sss to ttt along edges; Ep\mathcal E_pEp​ is the list of consecutive pairs.
  • The perspective of a function is Definition 4.4's infimum over the closed perspective cone of the epigraph. The formula λf(x/λ)\lambda f(x/\lambda)λf(x/λ) is not used as a definition: in Lean it would evaluate to 000 at λ=0\lambda = 0λ=0 for every argument and erase the content of (5.5e). The integrality constraint ye∈{0,1}y_e \in\{0,1\}ye​∈{0,1} is part of the feasible set; without it the goal is false (§9.4 reports relaxation gaps).
  • Disclosed additions: Lemma 5.4 and Remark 5.5 assume no self-loop at vvv, which the page's partition of Ev\mathcal E_vEv​ into incoming and outgoing edges presupposes. The recovery item takes the sss-ttt path contained in {e:ye=1}\{e : y_e = 1\}{e:ye​=1}, since the page's claim that this set is itself a path fails when an optimal solution carries a zero-length cycle.
  • Needed infrastructure: closures of cones over compact sets, extended-real infima, and the combinatorics of unit flows on finite digraphs. Proofs of any milestone, and reusable lemmas on perspectives, are welcome.

Selected references

  • T. Marcucci, J. Umenberger, P. A. Parrilo, R. Tedrake, Shortest Paths in Graphs of Convex Sets, SIAM Journal on Optimization 34(1), 2024; arXiv:2101.11565v5. https://arxiv.org/abs/2101.11565
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970 (perspectives and recession cones, §8). https://doi.org/10.1515/9781400873173
  • R. K. Ahuja, T. L. Magnanti, J. B. Orlin, Network Flows: Theory, Algorithms, and Applications, Prentice Hall, 1993 (flow decomposition, shortest-path LP).
  • T. Marcucci, M. Petersen, D. von Wrangel, R. Tedrake, Motion Planning around Obstacles with Convex Optimization, Science Robotics 8(84), 2023. https://doi.org/10.1126/scirobotics.adf7843
11 thms2 active usersReviewed
PreviousPage 4 of 14Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me