Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Theoretical Computer Science

464 missions · 238 completed

The mathematical foundations of computation: which problems can be solved, by what algorithms, and at what cost in time, space, or communication. Distinguished by its emphasis on rigor and unconditional lower bounds, it spans computational complexity, algorithm design, automata and computability, cryptography, and the analysis of Boolean functions.

Missions

Open226Completed238All464
CombinatoricsGraph TheoryOperations Research+1·Captain: mikedeng1

Linear-Time Approximation for Maximum Weight Matching: The Approximation Guarantee of the Scaling AlgorithmResearch Paper

Motivation

The maximum weight matching (MWM) problem asks, for a graph with edge weights, for a set of vertex-disjoint edges of largest total weight. It is a central problem of combinatorial optimization, with applications to transportation, assignment and scheduling, and as a subroutine for shortest paths, planar max cut, Chinese postman tours and metric TSP. Edmonds' blossom algorithm (1965) solves it on general graphs; the fastest implementation, due to Gabow, runs in O(mn+n2log⁡n)O(mn+n^2\log n)O(mn+n2logn) time, and the scaling algorithm of Gabow and Tarjan (1991) runs in O(mnlog⁡n log⁡(nN))O(m\sqrt{n\log n}\,\log(nN))O(mnlogn​log(nN)) time on graphs with nnn vertices, mmm edges and integer weights of magnitude at most NNN. Applications such as switch scheduling, graph clustering and sparse linear solvers accept a slightly suboptimal matching in exchange for speed. This motivates (1−ϵ)(1-\epsilon)(1−ϵ)-approximate maximum weight matchings: matchings whose weight is at least a 1−ϵ1-\epsilon1−ϵ fraction of the optimum.

Timeline of linear and near-linear time approximation for general graphs (Section 1.3 and Table IV of the paper; the entries below are as the paper attributes them):

  • Folklore: the greedy algorithm, which repeatedly takes the heaviest remaining edge, gives a 12\tfrac1221​-MWM in O(mlog⁡n)O(m\log n)O(mlogn) time.
  • Preis (STACS 1999): a 12\tfrac1221​-MWM in linear time; Drake and Hougardy (2003) gave a simpler one.
  • Drake and Hougardy (2003; journal version Vinkemeier and Hougardy, ACM Trans. Algorithms 2005): a (23−ϵ)(\tfrac23-\epsilon)(32​−ϵ)-MWM in O(mϵ−1)O(m\epsilon^{-1})O(mϵ−1) time; Pettie and Sanders (2004) improved this to O(mlog⁡ϵ−1)O(m\log\epsilon^{-1})O(mlogϵ−1).
  • Duan and Pettie (FOCS 2010) and Hanke and Hougardy (2010): a (34−ϵ)(\tfrac34-\epsilon)(43​−ϵ)-MWM in O(mlog⁡nlog⁡ϵ−1)O(m\log n\log\epsilon^{-1})O(mlognlogϵ−1) time.
  • Duan and Pettie (2014): a (1−ϵ)(1-\epsilon)(1−ϵ)-MWM in O(mϵ−1log⁡ϵ−1)O(m\epsilon^{-1}\log\epsilon^{-1})O(mϵ−1logϵ−1) time, which is linear for every fixed ϵ\epsilonϵ.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite simple graph with integer weights w:E→{1,…,N}w:E\to\{1,\dots,N\}w:E→{1,…,N}, N=2LN=2^LN=2L. A matching MMM is a set of vertex-disjoint edges, with weight w(M)=∑e∈Mw(e)w(M)=\sum_{e\in M}w(e)w(M)=∑e∈M​w(e); a vertex is free if no edge of MMM touches it. MMM is a ccc-MWM if c⋅w(M′)≤w(M)c\cdot w(M')\le w(M)c⋅w(M′)≤w(M) for every matching M′M'M′.

A blossom is built recursively: a single vertex {v}\{v\}{v} is a trivial blossom with E{v}=∅E_{\{v\}}=\emptysetE{v}​=∅; an odd number ≥3\ge3≥3 of disjoint blossoms A0,…,AℓA_0,\dots,A_\ellA0​,…,Aℓ​ joined in a cycle by edges ei∈Ai×Ai+1e_i\in A_i\times A_{i+1}ei​∈Ai​×Ai+1​ form the blossom B=⋃AiB=\bigcup A_iB=⋃Ai​ with edge set EB=⋃EAi∪{e0,…,eℓ}E_B=\bigcup E_{A_i}\cup\{e_0,\dots,e_\ell\}EB​=⋃EAi​​∪{e0​,…,eℓ​}. It is full if ∣M∩EB∣=(∣B∣−1)/2|M\cap E_B|=(|B|-1)/2∣M∩EB​∣=(∣B∣−1)/2. The algorithm keeps a laminar set Ω\OmegaΩ of full blossoms; a root blossom is a maximal one, and G/ΩG/\OmegaG/Ω contracts each root blossom to a single vertex.

Dual values y:V→Ry:V\to\mathbb Ry:V→R and zzz on odd vertex sets give each edge the value

yz(u,v)=y(u)+y(v)+∑B odd, u,v∈Bz(B).yz(u,v)=y(u)+y(v)+\sum_{B\ \text{odd},\ u,v\in B} z(B).yz(u,v)=y(u)+y(v)+B odd, u,v∈B∑​z(B).

The scaling algorithm (Figure 2 of the paper) has parameters NNN and ϵ′=2−g≤14\epsilon'=2^{-g}\le\tfrac14ϵ′=2−g≤41​. It runs scales i=0,…,Li=0,\dots,Li=0,…,L with granularity δi=ϵ′N/2i\delta_i=\epsilon'N/2^iδi​=ϵ′N/2i and truncated weights wi(e)=δi⌊w(e)/δi⌋w_i(e)=\delta_i\lfloor w(e)/\delta_i\rfloorwi​(e)=δi​⌊w(e)/δi​⌋. Each scale repeats four steps: augment along a maximal set of vertex-disjoint augmenting paths of the eligible graph GeligG_{\mathrm{elig}}Gelig​, shrink a maximal set of new blossoms, adjust the duals by ±δi/2\pm\delta_i/2±δi​/2, and dissolve root blossoms whose zzz-value has reached zero. It stops when the free vertices' yyy-values reach a scale-dependent value, which is 000 at scale LLL. Eligibility is given by Definition 3.2; the linear-time variant keeps the algorithm unchanged and uses Definition 3.10, which additionally ignores an edge eee in scales i>scale(e)+log⁡ϵ′−1i>\mathrm{scale}(e)+\log\epsilon'^{-1}i>scale(e)+logϵ′−1 unless it is a blossom edge.

Formalization targets

Goal: Theorem 3.12, approximation half

For every ϵ\epsilonϵ with ϵ′≤ϵ/7\epsilon'\le\epsilon/7ϵ′≤ϵ/7, the algorithm of Figure 2 with Definition 3.10 eligibility has a terminating run, and every terminating run returns a matching MMM with

w(M) ≥ (1−ϵ) w(M′)for every matching M′ of G.w(M)\ \ge\ (1-\epsilon)\,w(M')\qquad\text{for every matching } M' \text{ of } G .w(M) ≥ (1−ϵ)w(M′)for every matching M′ of G.

Milestones, in attack order

  • Lemma 2.3: approximate complementary slackness (yz(e)≥(1−ϵ0)w(e)yz(e)\ge(1-\epsilon_0)w(e)yz(e)≥(1−ϵ0​)w(e) everywhere, yz(e)≤(1+ϵ1)w(e)yz(e)\le(1+\epsilon_1)w(e)yz(e)≤(1+ϵ1​)w(e) on matched and blossom edges, zero free duals) gives a (1+ϵ1)−1(1−ϵ0)(1+\epsilon_1)^{-1}(1-\epsilon_0)(1+ϵ1​)−1(1−ϵ0​)-MWM.
  • Section 2 rescaling: rounding real weights to ⌊w/γr⌋\lfloor w/\gamma_r\rfloor⌊w/γr​⌋, γr=ϵwmax⁡/n\gamma_r=\epsilon w_{\max}/nγr​=ϵwmax​/n, loses at most a factor 1−ϵ/21-\epsilon/21−ϵ/2.
  • Lemma 3.5: with Definition 3.2 the algorithm preserves Property 3.1, which consists of granularity, active blossoms, near domination yz(e)≥wi(e)−δiyz(e)\ge w_i(e)-\delta_iyz(e)≥wi​(e)−δi​, near tightness yz(e)≤wi(e)+2(δj−δi)yz(e)\le w_i(e)+2(\delta_j-\delta_i)yz(e)≤wi​(e)+2(δj​−δi​) for type-jjj edges, and equal free duals.
  • Lemma 3.6: eligible edges searched up to scale iii weigh at least N/2i+1+δiN/2^{i+1}+\delta_iN/2i+1+δi​, and matched edges satisfy yz(e)≤(1+4ϵ′)w(e)yz(e)\le(1+4\epsilon')w(e)yz(e)≤(1+4ϵ′)w(e).
  • Lemma 3.7: the output under Definition 3.2 is a (1−5ϵ′)(1-5\epsilon')(1−5ϵ′)-MWM.
  • Theorem 3.8: the approximation half of Theorem 3.8, with ϵ′≤ϵ/5\epsilon'\le\epsilon/5ϵ′≤ϵ/5.
  • Lemma 3.11: the invariants under Definition 3.10, including yz(e)>(1−ϵ′)wi(e)yz(e)>(1-\epsilon')w_i(e)yz(e)>(1−ϵ′)wi​(e) and yz(e)<(1+6ϵ′)wi(e)yz(e)<(1+6\epsilon')w_i(e)yz(e)<(1+6ϵ′)wi​(e) once i>scale(e)+γi>\mathrm{scale}(e)+\gammai>scale(e)+γ.

Significance

The result. Theorem 3.12 gives the first algorithm for (1−ϵ)(1-\epsilon)(1−ϵ)-approximate maximum weight matching on general graphs that runs in linear time for every fixed ϵ\epsilonϵ; earlier linear-time algorithms achieved only 12\tfrac1221​ or 23−ϵ\tfrac23-\epsilon32​−ϵ. Its analysis is a relaxation of Edmonds' complementary slackness conditions that grows weaker over the scales, but not uniformly, and Lemma 2.3 certifies an approximate matching by approximately feasible duals.

Formalizing it. The result is proved in the paper. Mathlib (at the pinned revision) has matchings, alternating walks and Tutte's theorem, but no blossoms, contracted graphs or weighted matching algorithms. A complete development gives a Lean model of blossoms, contraction and augmenting paths through blossoms, a verified primal–dual invariant for a scaling algorithm, and a checked approximate-slackness certificate for matchings. Each of these can be reused to formalize Edmonds' exact algorithm or the Gabow–Tarjan scaling algorithm.

Difficulty

The two halves of the argument pull against each other. Lemma 2.3 needs near domination and near tightness as multiplicative bounds. The algorithm maintains only additive bounds whose slack for an edge of type jjj is 2(δj−δi)2(\delta_j-\delta_i)2(δj​−δi​), and this slack does not shrink as the scales advance. Converting it into a factor 1+O(ϵ′)1+O(\epsilon')1+O(ϵ′) requires a lower bound on the weight of every edge that ever became eligible, which in turn depends on the free vertices' duals following an exact schedule across scales.

For Definition 3.10 the obvious argument breaks down: an edge that is ignored after scale scale(e)+γ\mathrm{scale}(e)+\gammascale(e)+γ may violate near domination and near tightness by an amount that grows with every later dual adjustment. The claim is that the accumulated violation stays within an O(ϵ′)O(\epsilon')O(ϵ′) fraction of wi(e)w_i(e)wi​(e), and establishing this requires tracking every adjustment that can reach an ignored edge.

On the combinatorial side, the Augmentation and Blossom Shrinking steps work in the contracted graph G/ΩG/\OmegaG/Ω. Their correctness uses the classical facts that augmenting paths lift through full blossoms and that blossoms stay full after augmentation (Lemma 2.1), which have to be formalized from scratch.

Formalization scope

Graphs are SimpleGraph V on a Fintype V with decidable equality; edges are Sym2 V; matchings are Finset (Sym2 V) with pairwise vertex-disjoint edges of GGG; weights are w:Sym2 V→Nw:\mathrm{Sym2}\,V\to\mathbb Nw:Sym2V→N with 1≤w(e)≤2L1\le w(e)\le 2^L1≤w(e)≤2L on edges. Duals, δi\delta_iδi​ and wiw_iwi​ are real numbers. zzz is a function on all finite vertex sets and yzyzyz sums it over the odd sets that contain the edge, as on the page. N=2LN=2^LN=2L and ϵ′=2−g\epsilon'=2^{-g}ϵ′=2−g, g≥2g\ge2g≥2, are given through their exponents. scale(e)\mathrm{scale}(e)scale(e) uses the convention μ−1=+∞\mu_{-1}=+\inftyμ−1​=+∞. The paper's standing assumption N≤n2N\le n^2N≤n2 is used only for running time and is omitted.

The algorithm is a nondeterministic relation. A state holds MMM, Ω\OmegaΩ with its blossom edge sets, yyy, zzz, a ghost record of the scale in which each edge last entered M∪⋃B∈ΩEBM\cup\bigcup_{B\in\Omega}E_BM∪⋃B∈Ω​EB​, and the common free-vertex dual that drives the loop test. The maximal sets of augmenting paths and of new blossoms and the lifts of paths through blossoms are choices. Invariants are stated for states reachable by a run, and the goal asserts both that a terminating run exists and that every terminating run returns a (1−ϵ)(1-\epsilon)(1−ϵ)-MWM.

The running times O(mϵ−1log⁡N)O(m\epsilon^{-1}\log N)O(mϵ−1logN) of Theorem 3.8 and O(mϵ−1log⁡ϵ−1)O(m\epsilon^{-1}\log\epsilon^{-1})O(mϵ−1logϵ−1) of Theorem 3.12 are not formalized: the paper fixes no cost model, and its bounds rely on a modified depth-first search and on word-RAM table lookups. The explicit constants ϵ′≤ϵ/5\epsilon'\le\epsilon/5ϵ′≤ϵ/5 (Theorem 3.8) and ϵ′≤ϵ/7\epsilon'\le\epsilon/7ϵ′≤ϵ/7 (Theorem 3.12) are the ones the proofs supply.

The following trivializing formalizations are ruled out: a "matching" that may contain non-edges or repeated edges; a goal about a state only assumed to satisfy Property 3.1 rather than reached by the algorithm; a run relation with no terminating run, which the existence conjunct excludes; eligibility or blossoms chosen freely instead of by the page's rules; and comparison only against matchings of the contracted graph instead of all matchings of GGG.

Welcome contributions include a Lean treatment of blossoms and their contraction (Lemma 2.1, which is not a milestone here), the lift of augmenting paths, Lemmas 3.3 and 3.4 as auxiliary results, and proofs of the milestones in the order listed.

Selected references

  • R. Duan and S. Pettie, Linear-Time Approximation for Maximum Weight Matching, Journal of the ACM 61(1), Article 1, 2014. https://doi.org/10.1145/2529989
  • J. Edmonds, Maximum matching and a polyhedron with 0,1-vertices, Journal of Research of the National Bureau of Standards 69B, 125–130, 1965. https://doi.org/10.6028/jres.069B.013
  • H. N. Gabow and R. E. Tarjan, Faster scaling algorithms for general graph-matching problems, Journal of the ACM 38(4), 815–853, 1991. https://doi.org/10.1145/115234.115366
  • R. Preis, Linear time 1/2-approximation algorithm for maximum weighted matching in general graphs, STACS 1999, LNCS 1563, 259–269 (cited from the bibliography of Duan and Pettie 2014).
  • D. E. D. Vinkemeier and S. Hougardy, A linear-time approximation algorithm for weighted matchings in graphs, ACM Transactions on Algorithms 1(1), 107–122, 2005 (cited from the bibliography of Duan and Pettie 2014).
  • S. Pettie and P. Sanders, A simpler linear time 2/3 − ϵ approximation to maximum weight matching, Information Processing Letters 91(6), 271–276, 2004 (cited from the bibliography of Duan and Pettie 2014).
12 thms2 active usersReviewed
CombinatoricsGraph Theory·Captain: mikedeng1

Sorting in c log n Parallel Steps: Sorting Networks of Logarithmic DepthResearch Paper

Motivation

A sorting network is a sorting procedure whose sequence of comparisons is fixed in advance, independently of the data. Its depth, the number of rounds of simultaneous comparisons on disjoint pairs, is the parallel running time. Sorting networks are used in parallel and hardware sorting, in switching networks, and in cryptography, where a data-independent (oblivious) sequence of operations is required. How small the depth can be as a function of the number of inputs nnn is a basic question of parallel computation.

Timeline:

  • 1968. Batcher's odd-even merge sort and bitonic sort give networks of depth O((log⁡n)2)O((\log n)^2)O((logn)2) and size O(n(log⁡n)2)O(n(\log n)^2)O(n(logn)2) (K. E. Batcher, Sorting networks and their applications, AFIPS Spring Joint Computer Conference, 1968). For nnn a power of two they remain the best explicit networks in practice.
  • 1973. Knuth's The Art of Computer Programming, Vol. 3, §5.3.4, surveys sorting networks. A simple counting argument gives the lower bound: every sorting network has depth at least log⁡2n\log_2 nlog2​n, since each output depends on at most 2depth2^{\text{depth}}2depth inputs.
  • 1983. Ajtai, Komlós and Szemerédi construct networks of depth O(log⁡n)O(\log n)O(logn) and size O(nlog⁡n)O(n\log n)O(nlogn) (Combinatorica 3 (1983) 1–19, doi:10.1007/BF02579338), matching the lower bound up to a constant. The constant is not computed in the paper and is known to be very large.
  • 1990. Paterson simplifies the construction and gives the first explicit, still very large, depth constant (M. S. Paterson, Improved sorting networks with O(log N) depth, Algorithmica 5 (1990) 75–92, doi:10.1007/BF01840378).
  • 2014. Goodrich gives Zig-zag sort, a simpler deterministic data-oblivious sorting algorithm with O(nlog⁡n)O(n\log n)O(nlogn) comparisons that avoids the AKS machinery but is not of logarithmic depth (arXiv:1403.2777).

Setting

There are nnn registers R1,…,RnR_1,\dots,R_nR1​,…,Rn​ holding elements of a linearly ordered set. An elementary step (a comparator) (i,j)(i,j)(i,j) with i≠ji\neq ji=j compares the contents of RiR_iRi​ and RjR_jRj​ and exchanges them if the content of RiR_iRi​ is larger. Afterwards RiR_iRi​ holds the minimum and RjR_jRj​ the maximum of the two, and every other register is unchanged. A parallel step is a set of comparators in which no register occurs twice, so it has at most n/2n/2n/2 comparators. A comparator network NNN is a finite sequence of parallel steps, fixed before the input is seen. Its depth depth⁡(N)\operatorname{depth}(N)depth(N) is the number of parallel steps and its size size⁡(N)\operatorname{size}(N)size(N) the total number of comparators. NNN sorts if for every input x=(x1,…,xn)x=(x_1,\dots,x_n)x=(x1​,…,xn​) the output N(x)N(x)N(x) satisfies N(x)1≤⋯≤N(x)nN(x)_1\le\cdots\le N(x)_nN(x)1​≤⋯≤N(x)n​.

The construction runs on the tree TTT of finite 000-111 sequences, whose levels are ordered lexicographically. A chain on level iii assigns to every node of that level a set of registers, with the sets pairwise disjoint and of a common size N(C)N(C)N(C). A ⟨k, ε⟩ expander on ⟨A, B⟩, for disjoint register sets AAA and BBB, is a bipartite graph between AAA and BBB of maximum degree kkk in which every nonempty X⊆AX\subseteq AX⊆A has more than (1−ε)ε−1min⁡{∣X∣,ε∣B∣}(1-\varepsilon)\varepsilon^{-1}\min\{|X|,\varepsilon|B|\}(1−ε)ε−1min{∣X∣,ε∣B∣} neighbours, and symmetrically for BBB. The Lean development uses the names ComparatorNetwork, compareExchange, IsChain, chainN, IsExpander, IsLowerSection for these objects.

Formalization targets

Goal: the AKS theorem (Abstract and §1, p. 1)

∃ c>0  ∀n≥2  ∃N:N sorts,depth⁡(N)≤clog⁡2n,size⁡(N)≤c nlog⁡2n.\exists\, c>0\ \ \forall n\ge 2\ \ \exists N:\quad N \text{ sorts},\qquad \operatorname{depth}(N)\le c\log_2 n,\qquad \operatorname{size}(N)\le c\,n\log_2 n .∃c>0  ∀n≥2  ∃N:N sorts,depth(N)≤clog2​n,size(N)≤cnlog2​n.

The constant is absolute and is not fixed. Any explicit value would be invalidated by the next improvement, and the paper gives none.

Milestones (the paper's numbered lemmas that hold as stated)

  • Lemma 3 (p. 6): for 0<ε<10<\varepsilon<10<ε<1 and c≥1c\ge1c≥1 there is k(ε,c)k(\varepsilon,c)k(ε,c) such that every pair of disjoint sets with 1/c≤∣A∣/∣B∣≤c1/c\le|A|/|B|\le c1/c≤∣A∣/∣B∣≤c carries a ⟨k,ε⟩\langle k,\varepsilon\rangle⟨k,ε⟩ expander.
  • Lemma 4 (p. 7): performing every comparator of such an expander once, in any order, from AAA to BBB leaves all but an ε\varepsilonε-fraction of any lower section SSS with ∣S∣≤∣A∣|S|\le|A|∣S∣≤∣A∣ in AAA, and symmetrically for upper sections in BBB:
∣S∖Cont(A)∣≤ε∣S∣.|S\setminus\mathrm{Cont}(A)|\le\varepsilon|S| .∣S∖Cont(A)∣≤ε∣S∣.
  • Lemma 1 (pp. 3–4): the splitting V(C,k)V(C,k)V(C,k) of a chain, which moves one register of each leaf set up the tree, produces chains with properties (1.1)–(1.5).
  • Lemma 2 (p. 4): chains W(C,k)W(C,k)W(C,k) with ak−1≤N(W(C,k))≤aka_k-1\le N(W(C,k))\le a_kak​−1≤N(W(C,k))≤ak​ exist under conditions (2a), (2.b).
  • Lemma 12(a) (p. 14): a violation of the order relation RGβR^\beta_GRGβ​ between two nodes of a level is witnessed by two consecutive nodes.

Significance

The result. The AKS theorem settles the asymptotic depth of sorting networks at Θ(log⁡n)\Theta(\log n)Θ(logn) and their size at Θ(nlog⁡n)\Theta(n\log n)Θ(nlogn). It gives an O(log⁡n)O(\log n)O(logn)-time sorting algorithm with nnn processors that performs only data-independent comparisons. It is the standard reference point for oblivious sorting in parallel algorithms, circuit complexity (sorting is in NC1\mathsf{NC}^1NC1 via comparators) and oblivious RAM constructions. Lemma 4, the ε-halver property of expander comparisons, is the component that later constructions (Paterson) reuse.

Formalizing it. The theorem has been proved since 1983. No Lean proof of the AKS theorem is known. Mathlib has no expander graphs in the ⟨k, ε⟩ sense and no sorting networks. The mission asks for a formal proof of the headline theorem by any route (the AKS construction or Paterson's variant), and for formal proofs of the paper's verified lemmas as reusable components. The expander lemma needs either an explicit family (Margulis; Gabber–Galil) or a probabilistic existence argument, both substantial on their own.

Difficulty

Every elementary argument stalls at depth O((log⁡n)2)O((\log n)^2)O((logn)2): recursive merging needs log⁡n\log nlogn merge rounds, and merging two sorted lists by a comparator network needs depth Ω(log⁡n)\Omega(\log n)Ω(logn). A depth of O(log⁡n)O(\log n)O(logn) therefore cannot come from exact merging. It must come from constant-depth approximate operations (ε-halvers, which require bounded-degree expanders) combined with a mechanism that corrects the errors they leave. In the paper this mechanism is a movement of registers up and down a binary tree, controlled by a family of constants chosen in a fixed order ("ε1≪q2≪1−g≪q1≪1/c1≪1\varepsilon_1\ll q_2\ll1-g\ll q_1\ll 1/c_1\ll1ε1​≪q2​≪1−g≪q1​≪1/c1​≪1", p. 2). The accounting that shows the misplaced elements decay geometrically is the hard part. Several intermediate lemmas of the paper are false as printed, so the paper's text is not a checklist to transcribe.

Formalization scope

Conventions committed to in Lean:

  • Registers are Fin n, and contents lie in an arbitrary linearly ordered type. A network is a List of layers, each a List (Fin n × Fin n) of comparators with distinct endpoints, and no register occurs twice in a layer. A comparator (i,j)(i,j)(i,j) puts the minimum into iii, and both directions i<ji<ji<j and i>ji>ji>j are allowed. Sorts means the output is monotone for every linearly ordered type and every input, not only for permutations.
  • log⁡2n\log_2 nlog2​n is Real.logb 2 n, and the goal is stated for n≥2n\ge2n≥2. The constant ccc is quantified before nnn.
  • Tree levels are Fin (2^i), with numeric order equal to lexicographic order. A chain is a Fin (2^i) → Finset R.
  • Definition 2.2 of the paper, read literally, requires ∣Γ∅∣>0|\Gamma_\emptyset|>0∣Γ∅​∣>0, which fails, so no graph would be an expander. The expansion inequalities are imposed on nonempty sets only, and the strict inequality is kept.

Trivializing formalizations are ruled out. The goal is not "for every nnn there is a network of depth O(log⁡n)O(\log n)O(logn)" with the constant chosen after nnn, which is true for trivial reasons. Layers without the disjointness condition would let a single layer contain a whole insertion sort. A bound on the number of comparisons alone, with unbounded depth, is a different and much older result; the goal states both the depth and the size bound.

The mission states the AKS theorem and the paper's lemmas that are correct as stated. It does not formalize the AKS algorithm itself (SαS^\alphaSα, PαP^\alphaPα, the operations CH1–CH4, IMP) or its intermediate Lemmas 5–11 and 13–15. Those depend on unspecified constants constrained only by "sufficiently small" chains, and Lemmas 5, 10 and 12(b) are false as printed. A solver may of course define the algorithm, with pinned constants, as part of a proof.

Contributions welcome: a library of comparator networks (composition, the 0-1 principle, depth of Batcher's networks), existence of bounded-degree bipartite expanders, the ε-halver lemma, and any complete proof of the goal. The network and expander definitions are independent of this paper and reusable.

Selected references

  • M. Ajtai, J. Komlós, E. Szemerédi, Sorting in c log n parallel steps, Combinatorica 3(1) (1983) 1–19. doi:10.1007/BF02579338
  • K. E. Batcher, Sorting networks and their applications, Proc. AFIPS Spring Joint Computer Conference 32 (1968) 307–314. doi:10.1145/1468075.1468121
  • D. E. Knuth, The Art of Computer Programming, Vol. 3: Sorting and Searching, Addison-Wesley, 1973, §5.3.4.
  • G. A. Margulis, Explicit constructions of concentrators, Problems of Information Transmission 9 (1973) 325–332.
  • O. Gabber, Z. Galil, Explicit constructions of linear-sized superconcentrators, J. Computer and System Sciences 22(3) (1981) 407–420. doi:10.1016/0022-0000(81)90040-4
  • M. S. Paterson, Improved sorting networks with O(log N) depth, Algorithmica 5 (1990) 75–92. doi:10.1007/BF01840378
  • M. T. Goodrich, Zig-zag sort: a simple deterministic data-oblivious sorting algorithm running in O(n log n) time, STOC 2014. arXiv:1403.2777
13 thms2 active usersReviewed
Optimization·Captain: mikedeng1

The Design of Approximation Algorithms 11: Planar weighted independent-set PTASTextbook

Motivation

A graph records pairs of objects that cannot be chosen together. An independent set is a choice with no conflicting pair. When each vertex has a nonnegative weight, maximum weighted independent set asks for a conflict-free set with the greatest total weight. This model occurs when choices have values and pairwise incompatibilities. On general graphs the optimization problem is difficult; the planar restriction gives a concrete geometric promise under which approximation is possible. Williamson and Shmoys state a polynomial-time approximation scheme for planar maximum independent set as Theorem 10.11 of The Design of Approximation Algorithms, in the author electronic manuscript at PDF/manuscript page 271.

Setting

The instance has vertices labeled by Fin n, an adjacency table edge : Fin n → Fin n → Bool, and a real weight weight i for each vertex. SimpleGraph.fromRel turns the table into an undirected simple graph G. The theorem requires every weight to be nonnegative. A finite set S is feasible when G.IsIndepSet (S : Set (Fin n)) holds. Its value is ∑ i ∈ S, weight i.

Planarity is expressed by HasPlanarDrawing G: vertices are placed at distinct points of the real plane, and every edge is represented by a continuous simple arc. An arc has no vertex in its interior, and distinct edges can meet only at endpoints. This is a concrete local drawing convention for the planar graph promise. The drawing witnesses the hypothesis; it is not passed as part of the algorithm's input.

The computational model is a fixed finite unit-cost RAM program. Its input includes the vertex count, an integer accuracy parameter, a complete adjacency table, and the real weights in named memory cells. Its instructions include natural-number and real addition and subtraction, exact comparisons, random-access loads and stores, branches, jumps, and halt. The machine starts with the instance preloaded and produces a bitmap after the adjacency table. This precise instruction set is a formalization convention: the book states an arithmetic-operation running time but does not specify a machine language.

Formalization targets

For every real ε>0\varepsilon>0ε>0, let k=max⁡(1,⌈1/ε⌉)k=\max(1,\lceil1/\varepsilon\rceil)k=max(1,⌈1/ε⌉). The goal asserts that a single finite program and fixed positive natural constants C,dC,dC,d work for every planar instance and every vector of nonnegative real weights. The program must halt after a number ttt of operations satisfying

t+1≤C 2dk(n+1)2.t+1\le C\,2^{dk}(n+1)^2.t+1≤C2dk(n+1)2.

Its bitmap must represent an independent set AAA, and for every independent set SSS,

(1−ε)∑i∈Swi≤∑i∈Awi.(1-\varepsilon)\sum_{i\in S}w_i\le\sum_{i\in A}w_i.(1−ε)i∈S∑​wi​≤i∈A∑​wi​.

Comparison with every feasible SSS includes an optimal solution. The same program and constants precede all accuracy and instance quantifiers. The (n+1)2(n+1)^2(n+1)2 form includes the empty graph without imposing zero running time. The result corresponds to the O(2O(1/ε)n2)O(2^{O(1/\varepsilon)}n^2)O(2O(1/ε)n2) bound in Theorem 10.11; the formal statement makes the constants and accuracy parameter explicit.

Significance

The result supplies an accuracy-time tradeoff for planar weighted independent set: any fixed positive accuracy has a quadratic dependence on graph size in this operation model, while the accuracy dependence is exponential. It separates the planar setting from the general graph problem. The finite instruction set and input layout make the computational claim inspectable, including what information the program receives and what counts as an operation.

The cited result is known in the textbook. This mission asks for a Lean proof of the packaged statement; the theorem currently has sorry, and no machine construction or correctness proof is claimed. The original local statement was compiled and source reviewed before packaging. That prior result establishes statement validity in its source workspace, while the upload payload is checked separately.

Difficulty

A high-quality independent set in each planar region does not immediately give a high-quality global set: edges across regions can create conflicts, and discarding boundary vertices can lose weight. A proof must coordinate the approximation inequality with a uniform operation bound for one program across all graph sizes, accuracies, and real weight vectors. It must also show the computed bitmap is always independent and that execution reaches an explicit halt instruction within the bound. These requirements rule out treating an optimizer, an embedding, or a best solution as preloaded input.

Formalization scope

The goal uses finite labeled graphs, nonnegative arbitrary real weights, exact real arithmetic, and the concrete drawing predicate above. It does not claim a bit-complexity bound for encoded reals. The RAM starts from a complete adjacency table and weight vector, with no supplied drawing or optimum. Its step function is deterministic; an invalid program counter is stuck, so the theorem explicitly requires a halt instruction. Outputs are bits in designated natural memory cells and are checked for validity before their weighted value is compared.

The packaged definitions are the drawing predicate, instruction type, state, transition, iteration, input layout, and output decoder. They contain no proof axioms or optimization oracle. The rational-input polynomial bit-time fragment in the source workspace is a separate statement and is outside this goal. A complete contribution would construct the finite program and prove its running time and approximation guarantee in the specified model.

Selected references

  • David P. Williamson and David B. Shmoys, The Design of Approximation Algorithms, Cambridge University Press, 2011, author electronic manuscript, Theorem 10.11, PDF/manuscript p. 271; weighted independent-set setting p. 269 and context pp. 270–272. DOI.
5 thms2 active usersReviewed
CombinatoricsComplexity Theory·Captain: Lucas

4-to-1 Games with Perfect CompletenessResearch Paper

Motivation

Many approximation problems resist the standard PCP toolkit: the best known NP-hardness factors for Max-Cut, Vertex-Cover and approximate graph colouring are far from the best known polynomial-time algorithms. To explain this gap, Khot (CCC 2002) proposed the Unique-Games Conjecture and the family of ddd-to-1 Games Conjectures. The ddd-to-1 conjectures assert perfect completeness: the hard instances are either fully satisfiable, or satisfiable only to a vanishing extent. Perfect completeness is what makes these conjectures usable for colouring problems, where a "yes" instance must be genuinely 333-colourable rather than almost so.

A line of work culminating in Khot–Minzer–Safra and Dinur–Khot–Kindler–Minzer–Safra established the almost-perfect completeness version for 222-to-1 games: for every ε>0\varepsilon>0ε>0 there is an alphabet bound rrr such that distinguishing value ≥1−ε\ge 1-\varepsilon≥1−ε from value ≤ε\le\varepsilon≤ε is NP-hard. Their route goes through Håstad's hardness for linear equations, which cannot have perfect completeness, so the loss is intrinsic to the technique. The source paper of this mission removes that loss for d=4d = 4d=4.

Setting

A label-cover instance Ψ\PsiΨ (Definition 1.1 of the source) consists of a bipartite graph G=(L⊔R,E)G = (L \sqcup R, E)G=(L⊔R,E), two finite alphabets ΣL,ΣR\Sigma_L, \Sigma_RΣL​,ΣR​, and for each edge e=(u,v)e = (u,v)e=(u,v) a constraint Φe⊆ΣL×ΣR\Phi_e \subseteq \Sigma_L \times \Sigma_RΦe​⊆ΣL​×ΣR​. The constraint is a projection constraint if there is φe:ΣL→ΣR\varphi_e : \Sigma_L \to \Sigma_Rφe​:ΣL​→ΣR​ with Φe={(σ,φe(σ))}\Phi_e = \{(\sigma, \varphi_e(\sigma))\}Φe​={(σ,φe​(σ))}, and a ddd-to-1 constraint if in addition ∣φe−1(σ)∣=d|\varphi_e^{-1}(\sigma)| = d∣φe−1​(σ)∣=d for every σ∈ΣR\sigma \in \Sigma_Rσ∈ΣR​. Given assignments AL:L→ΣLA_L : L \to \Sigma_LAL​:L→ΣL​ and AR:R→ΣRA_R : R \to \Sigma_RAR​:R→ΣR​, the fraction of satisfied edges is valΨ(AL,AR)\mathrm{val}_\Psi(A_L, A_R)valΨ​(AL​,AR​), and

val(Ψ)  =  max⁡AL,ARvalΨ(AL,AR).\mathrm{val}(\Psi) \;=\; \max_{A_L, A_R} \mathrm{val}_\Psi(A_L, A_R).val(Ψ)=AL​,AR​max​valΨ​(AL​,AR​).

An instance all of whose constraints are ddd-to-1 is a ddd-to-1 game.

For 0<s<c≤10 < s < c \le 10<s<c≤1, Gap-d-to-1r(c,s)\mathrm{Gap\text{-}}d\mathrm{\text{-}to\text{-}}1_r(c,s)Gap-d-to-1r​(c,s) is the promise problem: given a ddd-to-1 game with both alphabets of size at most rrr, distinguish val(Ψ)≥c\mathrm{val}(\Psi) \ge cval(Ψ)≥c from val(Ψ)≤s\mathrm{val}(\Psi) \le sval(Ψ)≤s. Writing GapPLCr(c,s)\mathrm{GapPLC}_r(c,s)GapPLCr​(c,s) for the same promise problem over all projection instances, the PCP theorem together with the parallel repetition theorem gives that GapPLCr(1,ε)\mathrm{GapPLC}_{r}(1,\varepsilon)GapPLCr​(1,ε) is NP-hard for a suitable r=r(ε)r = r(\varepsilon)r=r(ε) (Theorem 1.2 of the source); this mission takes that statement as an external input.

Formalization targets

Goal — Theorem 1.6 of the source

∀ε>0 ∃r∈N+:Gap-4-to-1r(1,ε) is NP-hard.\forall \varepsilon > 0 \ \exists r \in \mathbb{N}^{+} : \quad \mathrm{Gap\text{-}4\text{-}to\text{-}1}_r(1,\varepsilon) \text{ is NP-hard.}∀ε>0 ∃r∈N+:Gap-4-to-1r​(1,ε) is NP-hard.

In Lean this is stated as a polynomial-time gap-preserving reduction: for every ε>0\varepsilon > 0ε>0 there is a soundness threshold s∈(0,1)s \in (0,1)s∈(0,1) such that for every source alphabet bound r0r_0r0​ there is a target alphabet bound rrr and a polynomial-time computable map sending projection label-cover instances with alphabets of size at most r0r_0r0​ and value 111 to 444-to-1 games with alphabets of size at most rrr and value 111, and instances of value at most sss to 444-to-1 games of value at most ε\varepsilonε. Combined with the NP-hardness of GapPLCr0(1,s)\mathrm{GapPLC}_{r_0}(1,s)GapPLCr0​​(1,s), this is exactly Theorem 1.6.

Supporting targets

The milestone list follows the source's own numbering: the hardness of approximate colouring of 333-uniform hypergraphs that starts the construction (Theorem 3.1), the two Grassmann decoding theorems the inner PCP rests on (Theorems 3.2 and 3.3), the sunflower bound on zoom-outs (Lemma 3.8), and the linear-algebraic layer connecting NAE-satisfying bilinear forms with their tensor decompositions (Propositions 4.13, 4.14 and Corollary 4.15).

Significance

Theorem 1.6 confirms the 444-to-1 Games Conjecture, the first of Khot's ddd-to-1 conjectures to be settled with perfect completeness. Via known reductions it yields: for every kkk, it is NP-hard to kkk-colour a 333-colourable graph (previously known for k=5k = 5k=5); for every δ>0\delta>0δ>0, it is NP-hard to find an independent set of relative size δ\deltaδ in a 222-colourable 333-uniform hypergraph; and hardness results for low-rank matrix completion.

None of this material is formalized today. Mathlib has no label cover, no PCP machinery, no Grassmann graph and no complexity classes beyond the computability layer. A complete development therefore contributes reusable infrastructure — finite two-prover games and their value, gap-preserving reductions, the Grassmann graph over F2\mathbb{F}_2F2​ and its agreement tests — well beyond this single theorem.

Difficulty

The obvious attempt is to redo the 222-to-1 construction with a perfectly complete outer PCP, namely hardness of systems of quadratic equations over F2\mathbb{F}_2F2​ in place of linear ones. This fails at composition: the Grassmann agreement test, the only known device that produces ddd-to-1 constraints, is a test for linear functions and cannot certify quadratic constraints. Linearizing the quadratic equations by a low-rank test destroys the covering property of the outer PCP, which is what makes the composed soundness analysis work. The source paper's answer is a three-layer construction (outer, middle and inner PCP) with a lazy parallel repetition in the middle layer and an inner PCP based on a tensor of the standard Grassmann encoding with Golowich's low-rank variant.

Formalization scope

All objects are finite and explicit. A label-cover instance carries left vertices {0,…,nL−1}\{0,\dots,n_L-1\}{0,…,nL​−1}, right vertices {0,…,nR−1}\{0,\dots,n_R-1\}{0,…,nR​−1}, alphabets {0,…,∣ΣL∣−1}\{0,\dots,|\Sigma_L|-1\}{0,…,∣ΣL​∣−1} and {0,…,∣ΣR∣−1}\{0,\dots,|\Sigma_R|-1\}{0,…,∣ΣR​∣−1}, a finite edge set, and a projection map for every pair of vertices; only projection instances are representable, as in Definition 1.1. The value is the supremum over all pairs of assignments of the fraction of satisfied edges, taken in R\mathbb{R}R; when there are no edges, or no assignments at all, the convention gives value 000. A tripled set (Definition 4.1) is modelled as ι×{0,1,2}\iota \times \{0,1,2\}ι×{0,1,2}, with the triple indexed by iii being {(i,0),(i,1),(i,2)}\{(i,0),(i,1),(i,2)\}{(i,0),(i,1),(i,2)}. The Grassmann objects live in F2n\mathbb{F}_2^nF2n​ modelled as Fin n→Z/2\mathrm{Fin}\,n \to \mathbb{Z}/2Finn→Z/2, and all probabilities are ratios of cardinalities of finite sets of subspaces, with the convention that an empty denominator gives 000.

Hardness is not stated as "NP-hard" — no notion of NP is available — but as the existence of a reduction. This matters: a reduction required only to preserve the gap, with no computability condition, would be trivially satisfiable by a map that inspects the value of its input and returns one of two fixed instances. The formalization therefore requires the reduction map to be computed by a Turing machine within a polynomial time bound, using Mathlib's Turing.TM2ComputableInPolyTime together with an explicit binary encoding of instances. The NP-hardness of the source problem GapPLCr0(1,s)\mathrm{GapPLC}_{r_0}(1,s)GapPLCr0​​(1,s) (Theorem 1.2, i.e. the PCP theorem plus parallel repetition) is an external input and is not part of this mission.

Contributions of intermediate infrastructure are welcome: the games of Sections 4–6 (Game1a, Game1b, Game2a, Game2b, Game2c, Game3) and their completeness and soundness lemmas are the natural next layer of milestones, as are the covering properties of Appendix C and the list-decoding bounds of Appendix E.

Selected references

  • Yumou Fei, Dor Minzer, Shuo Wang, On the Hardness of 4-to-1 Games with Perfect Completeness, ECCC TR26-179 (2026), https://eccc.weizmann.ac.il/report/2026/179/
  • Subhash Khot, On the power of unique 2-prover 1-round games, STOC 2002, https://doi.org/10.1145/509907.509985
  • Irit Dinur, Subhash Khot, Guy Kindler, Dor Minzer, Muli Safra, Towards a proof of the 2-to-1 games conjecture?, STOC 2018, https://doi.org/10.1145/3188745.3188804
  • Subhash Khot, Dor Minzer, Muli Safra, Pseudorandom sets in Grassmann graph have near-perfect expansion, FOCS 2018, https://doi.org/10.1109/FOCS.2018.00062
  • Louis Golowich, New Explicit Constant-Degree Lossless Expanders, FOCS 2023, https://arxiv.org/abs/2306.07551
12 thms2 active usersReviewed
Quantum Information·Captain: Goku

The Aaronson-Ambainis ConjectureOpen Problem

Motivation

Quantum query algorithms are known to beat classical ones on problems with algebraic structure -- period finding, hidden subgroups, forrelation. No such speedup is known for a problem with no structure at all. Aaronson and Ambainis proposed making that observation into a theorem, and reduced it to a question with no quantum content: a statement about bounded low-degree polynomials on the Boolean cube (Aaronson--Ambainis 2009).

The question has resisted since. A timeline of what is actually established:

  • 2009. Aaronson and Ambainis state the conjecture and prove that it implies almost-everywhere classical simulation of quantum query algorithms.
  • 2012. Montanaro settles the case of block-multilinear forms whose coefficients all have the same magnitude.
  • 2016. O'Donnell and Zhao reduce the general conjecture to a restricted class, the one-block decoupled polynomials.
  • 2019. Aaronson surveys a decade of partial progress (retrospective).
  • 2022. Bansal, Sinha and de Wolf prove the conjecture for completely bounded degree-ddd block-multilinear forms, obtaining influence 1/poly(d)1/\mathrm{poly}(d)1/poly(d) at constant variance (arXiv:2203.00212).
  • 2024. The conjecture is established for a non-negligible fraction of random restrictions (arXiv:2402.13952).

The cases that are settled are settled under structural hypotheses -- block-multilinearity, complete boundedness, symmetry, Boolean range. The general statement is open.

Setting

Let NNN be a positive integer. The Boolean cube is {0,1}N\{0,1\}^N{0,1}N, carrying the uniform distribution; a point xxx is identified with the 0/10/10/1 real vector it names, so a real multivariate polynomial ppp in NNN variables has a value p(x)p(x)p(x) at each cube point. For a function fff on the cube write

E[f]=2−N∑x∈{0,1}Nf(x).\mathbb{E}[f]=2^{-N}\sum_{x\in\{0,1\}^N}f(x).E[f]=2−Nx∈{0,1}N∑​f(x).

The variance of ppp is Var⁡[p]=E[(p−E[p])2]\operatorname{Var}[p]=\mathbb{E}\big[(p-\mathbb{E}[p])^2\big]Var[p]=E[(p−E[p])2]. Writing x⊕ix^{\oplus i}x⊕i for xxx with its iii-th bit flipped, the influence of coordinate iii on ppp is

Inf⁡i[p]=E[(p(x)−p(x⊕i))2].\operatorname{Inf}_i[p]=\mathbb{E}\big[(p(x)-p(x^{\oplus i}))^2\big].Infi​[p]=E[(p(x)−p(x⊕i))2].

These are the combinatorial forms of both quantities, as used in the source; no Fourier--Walsh expansion is required to state anything below. The degree of ppp is its total degree as a polynomial. Call ppp bounded when 0≤p(x)≤10\le p(x)\le 10≤p(x)≤1 at every cube point -- a condition imposed only on the cube, not on all of RN\mathbb{R}^NRN.

Target

The goal is the conjecture in the shape stated by its authors: there is an absolute constant CCC such that for all NNN, all ddd, every polynomial ppp of degree at most ddd that is bounded on the cube, and every ε>0\varepsilon>0ε>0 with Var⁡[p]≥ε\operatorname{Var}[p]\ge\varepsilonVar[p]≥ε, some coordinate iii satisfies

Inf⁡i[p]  ≥  (εd)C.\operatorname{Inf}_i[p]\;\ge\;\Big(\frac{\varepsilon}{d}\Big)^{C}.Infi​[p]≥(dε​)C.

The constant CCC is quantified outermost and may depend on nothing. That uniformity is the entire content: bounds that degrade exponentially in ddd are already known, and a goal naming a specific exponent would be superseded by the next improvement.

Significance

The result itself. Aaronson and Ambainis prove that the conjecture implies that the acceptance probability of any bounded-error TTT-query quantum algorithm on a Boolean input can be approximated, to small error on all but a small fraction of inputs, by a classical algorithm making poly(T)\mathrm{poly}(T)poly(T) queries. Quantum speedups would then require structure in a precise sense. The conjecture also has purely classical content, asserting that boundedness plus low degree forces variance to concentrate on some single coordinate rather than spread across all NNN. Without it, no such concentration is known at any rate polynomial in 1/d1/d1/d.

Formalizing it. The conjecture is open, so this mission does not formalize a known proof of the goal. What it produces is a machine-checked statement of the conjecture together with formalizations of the partial results above, each currently existing only on paper. The milestone chain also yields reusable infrastructure for analysis of Boolean functions, of which Mathlib currently contains none: no Fourier--Walsh expansion, no influence, no variance on the cube.

Difficulty

The elementary bound is the Poincare inequality on the cube, 4Var⁡[p]≤∑iInf⁡i[p]4\operatorname{Var}[p]\le\sum_i\operatorname{Inf}_i[p]4Var[p]≤∑i​Infi​[p], which yields a coordinate with influence at least 4ε/N4\varepsilon/N4ε/N. This is tight for the dictator p(x)=x1p(x)=x_1p(x)=x1​ and depends on NNN, so it says nothing: the conjecture demands a bound free of NNN entirely.

The natural repair is the route available when ppp takes only the values 000 and 111. A Boolean-valued polynomial of degree ddd depends on boundedly many coordinates, which immediately produces an influential one. That argument does not survive relaxing the range to the interval [0,1][0,1][0,1]: a bounded real-valued polynomial of low degree need not depend on boundedly many coordinates, and every known substitute loses a factor exponential in ddd. Closing the gap between exponential and polynomial dependence on ddd is the difficulty, and it is where all of the partial results stop.

Formalization scope

Polynomials are MvPolynomial (Fin N) ℝ and degree is Mathlib's totalDegree, so the statement needs no bespoke notion of degree. Expectation is a finite sum scaled by 2−N2^{-N}2−N rather than a measure-theoretic integral, keeping every definition elementary. Bit flipping is Function.update x i (!x i). Boundedness is asserted at cube points only. Variance and influence are the combinatorial definitions above, published as the definition AaronsonAmbainis.

Three points close off degenerate readings. The exponent O(1)O(1)O(1) of the source is rendered as an existentially quantified natural number with no leading multiplicative constant, since admitting one weakens the claim. Taking that exponent to be 000 would demand influence at least 111 and is therefore not a trivializing choice, while larger exponents only weaken the bound; the content is that some fixed exponent suffices for all NNN and ddd at once. The hypothesis deg⁡p≤d\deg p\le ddegp≤d is universally quantified over ddd, which is equivalent to the source's exact-degree form because the smallest admissible ddd gives the strongest conclusion. The cases N=0N=0N=0 and d=0d=0d=0 are vacuous, since 0<ε≤Var⁡[p]0<\varepsilon\le\operatorname{Var}[p]0<ε≤Var[p] fails for a constant polynomial.

A complete development needs, beyond the published definitions, a Fourier--Walsh layer with Parseval's identity, the level-kkk machinery used by the partial results, and -- for the completely bounded case -- operator-space norms on multilinear forms. All of the Boolean-analysis material is reusable well beyond this mission. Contributions of any milestone are welcome, as are alternative formalizations of the definitions in function-level rather than polynomial-level form.

Out of scope: the quantum simulation consequence is not formalized here. Stating it requires a formal quantum query model, which no Lean library currently provides.

Selected references

  • S. Aaronson, A. Ambainis, The Need for Structure in Quantum Speedups, Theory of Computing 10 (2014) 133--166; arXiv:0911.0996. Conjecture 6.
  • N. Bansal, M. Sinha, R. de Wolf, Influence in Completely Bounded Block-multilinear Forms and Classical Simulation of Quantum Algorithms, CCC 2022; arXiv:2203.00212.
  • Aaronson--Ambainis Conjecture Is True For Random Restrictions, 2024; arXiv:2402.13952.
  • S. Aaronson, The Aaronson-Ambainis Conjecture (2008-2019), blog retrospective.
  • S. Arunachalam, J. Briet, C. Palazuelos, Quantum query algorithms are completely bounded forms, SIAM J. Comput. 48 (2019); arXiv:1711.07285.
  • AIM problem list, Analysis on the hypercube with applications to quantum computing, aimpl.org/hypercubequantum.
4 thms2 active usersReviewed
ProbabilityQuantum Information·Captain: mikedeng1

Quantum Speedup of Monte Carlo Methods 1: With Var(v(A)) ≤ σ² and ε < 4σ, Algorithm 3 Estimates E[v(A)] to Additive Error ε with Probability at Least 2/3Research Paper

Why estimate a mean with a quantum algorithm?

Many computational tasks produce a real number by running a randomized procedure once, then estimate its expected value by running that procedure repeatedly. The number of repetitions needed for a given additive accuracy depends on the output variance. Montanaro's Quantum speedup of Monte Carlo methods studies the same estimation problem when the procedure can be run coherently as a quantum algorithm and its unitary part can also be inverted. The bounded-variance result gives an estimator whose dependence on the requested accuracy is approximately linear in 1/ϵ1/\epsilon1/ϵ, compared with the quadratic dependence of ordinary sampling, up to logarithmic factors and the paper's model-specific operation counts. The exact asymptotic claims are in Theorem 5 of the pinned preprint, p. 12.

This mission concentrates on the probability and accuracy claim of that theorem. It includes the mean-estimation result for a nonnegative output from Lemma 4, because Algorithm 3 invokes that estimator twice after centering a general real output. The underlying amplitude-estimation theorem is a separate, already posed result, QAmpEst.Est.theorem_12; this mission uses the accuracy guarantee stated in Montanaro's Theorem 3 as the interface to that subroutine.

Outputs, truncations, and estimates

Let X=v(A)X=v(\mathcal A)X=v(A) denote the real output of a quantum algorithm A\mathcal AA under one run, and let PPP be its probability law. The mean is E[X]\mathbb E[X]E[X], and the variance is Var⁡(X)=E[(X−E[X])2]\operatorname{Var}(X)=\mathbb E[(X-\mathbb E[X])^2]Var(X)=E[(X−E[X])2]. The result assumes a known σ>0\sigma>0σ>0 with Var⁡(X)≤σ2\operatorname{Var}(X)\le\sigma^2Var(X)≤σ2. Although the paper describes a circuit that prepares and measures XXX, its accuracy statements depend on the distribution of XXX; the Lean interface therefore represents a run as a measurable real random variable on a probability space.

For real thresholds a<ba<ba<b, the truncation X[a,b)X_{[a,b)}X[a,b)​ returns XXX when a≤X<ba\le X<ba≤X<b and zero otherwise. The variants X<aX_{<a}X<a​ and X≥bX_{\ge b}X≥b​ retain the output below aaa and at or above bbb, respectively. They do not clip a value to a threshold. The L2L^2L2 size is ∥X∥2=E[X2]\|X\|_2=\sqrt{\mathbb E[X^2]}∥X∥2​=E[X2]​. These are the output transformations defined in §2.2, p. 9, and used in Lemma 4, pp. 10–11.

Algorithm 2 estimates a nonnegative mean using the base interval [0,1)[0,1)[0,1) and the half-open bands [2ℓ−1,2ℓ)[2^{\ell-1},2^\ell)[2ℓ−1,2ℓ) for 1≤ℓ≤k1\le\ell\le k1≤ℓ≤k. It sets k=⌈log⁡2(1/ϵ)⌉k=\lceil\log_2(1/\epsilon)\rceilk=⌈log2​(1/ϵ)⌉ and t0=⌈Dlog⁡2(1/ϵ)/ϵ⌉t_0=\lceil D\sqrt{\log_2(1/\epsilon)}/\epsilon\rceilt0​=⌈Dlog2​(1/ϵ)​/ϵ⌉, then adds the base estimate to 2ℓ2^\ell2ℓ times each band estimate. A successful Algorithm 1 call means that its estimate of a [0,1][0,1][0,1]-valued output YYY differs from E[Y]\mathbb E[Y]E[Y] by at most C(E[Y]/t+1/t2)C(\sqrt{\mathbb E[Y]}/t+1/t^2)C(E[Y]​/t+1/t2), the accuracy bound of Theorem 3, pp. 8–9.

Algorithm 3 rescales XXX by σ\sigmaσ, draws one sample mmm from X/σX/\sigmaX/σ, and centers the rescaled output at mmm. It feeds the negative and nonnegative parts, each divided by four, to Algorithm 2 at accuracy ϵ/(32σ)\epsilon/(32\sigma)ϵ/(32σ) and recombines their estimates. The two calls are specified to fail with probability at most 1/91/91/9 each; the paper describes boosting Algorithm 2's initial success probability for this use on p. 11.

Formalization targets

Lemma 4: nonnegative mean accuracy

When every Algorithm 1 call satisfies its accuracy bound and 0<ϵ<1/20<\epsilon<1/20<ϵ<1/2, the output μ~\widetilde\muμ​ of Algorithm 2 obeys

∣μ~−E[X]∣≤ϵ(∥X∥2+1)2.|\widetilde\mu-\mathbb E[X]|\le\epsilon(\|X\|_2+1)^2.∣μ​−E[X]∣≤ϵ(∥X∥2​+1)2.

The constant D>0D>0D>0 is chosen once for a fixed positive universal constant CCC from Theorem 3. It is independent of XXX and ϵ\epsilonϵ.

Theorem 5: bounded-variance accuracy

For Var⁡(X)≤σ2\operatorname{Var}(X)\le\sigma^2Var(X)≤σ2, σ>0\sigma>0σ>0, and 0<ϵ<4σ0<\epsilon<4\sigma0<ϵ<4σ, Algorithm 3 returns μ^\widehat\muμ​ with

Pr⁡(∣μ^−E[X]∣≤ϵ)≥23.\Pr\bigl(|\widehat\mu-\mathbb E[X]|\le\epsilon\bigr)\ge\frac23.Pr(∣μ​−E[X]∣≤ϵ)≥32​.

This is the mission goal. Its probability is over the preliminary sample and both subsequent estimation runs. The milestone list follows the exact displayed statements used in Lemma 4 and the proof of Theorem 5, with their source pages.

What the result supplies

Theorem 5 turns an estimator for nonnegative outputs with finite second moment into one that handles signed outputs whose variance is bounded, without assuming a bound on the magnitude or mean of the output. That extension matters when the quantity being averaged can be negative or has a large offset: a second-moment bound on XXX itself would then be much stronger than the paper's variance hypothesis. The stated error and success probability are the mathematical guarantee on which the paper's resource comparison rests; the comparison itself includes quantum operations absent from the measure-theoretic statement.

The formal development supplies reusable definitions of truncations, dyadic estimates, and the centered positive and negative parts, together with precisely quantified probability claims. It leaves Lemma 4 and Theorem 5 as open Lean proof targets. The amplitude-estimation statement behind Theorem 3 is already posed separately on Prove2Me, while the composed bounded-variance result and the displayed intermediate claims are the new targets here.

Where the difficulty lies

A bound for one [0,1][0,1][0,1]-valued call does not directly bound the mean of a signed, unbounded output. Truncating after finitely many bands leaves a tail, and the sum of errors over the retained bands can grow with their weights. The theorem must control both effects while keeping DDD independent of the output distribution. For the signed case, the initial sample is random; its deviation, the two later failures, and the scale of the centered output all contribute to the final probability. Replacing that sample by the exact mean would remove a substantive part of the claim.

Formalization scope

Lean uses probability measures and measurable real outputs for the laws of v(A)v(\mathcal A)v(A) and Algorithm 3's preliminary sample. The law of that sample is fixed to the image law of X/σX/\sigmaX/σ, so it cannot be selected arbitrarily. The successful-call predicate names the actual truncated outputs and the paper's kkk and t0t_0t0​ formulas; it does not assume Lemma 4's final error bound. The sample space carrying the later estimates is allowed to encode their joint dependence on the preliminary sample. Events are measured with extended nonnegative real values.

The L2L^2L2 hypotheses state that the second moment is finite. In Mathlib the real-valued variance and the integral can return a default value on a nonintegrable input, which would make a bare variance inequality or a bare ∥X∥2\|X\|_2∥X∥2​ bound misleading. The paper implicitly uses finite variance where those quantities occur. The condition 0<ϵ0<\epsilon0<ϵ makes the divisions and logarithms in the algorithm parameters meaningful. The natural-number expression ℓ−1\ell-1ℓ−1 occurs only on bands indexed by ℓ≥1\ell\ge1ℓ≥1.

The quantum circuit for Algorithm 1, the construction of an inverse unitary, and the O(⋅)O(\cdot)O(⋅) copy and operation counts are outside the formal statements. Their interface is Theorem 3's numerical accuracy event. Contributions to the dyadic inequalities, the finite-variance probability bound, and their composition into the final event are in scope. The definitions are also useful for other mean estimators that split a real output into bounded pieces.

Selected references

  • Ashley Montanaro, Quantum speedup of Monte Carlo methods, arXiv:1504.06987v3 [quant-ph], 2017, especially §§2.1–2.3, pp. 8–12. Pinned preprint.
  • Gilles Brassard, Peter Høyer, Michele Mosca, and Alain Tapp, Quantum Amplitude Amplification and Estimation, Contemporary Mathematics 305, 2002. arXiv preprint.
9 thms1 active userReviewed
Linear algebraOptimizationQuantum Information·Captain: mikedeng1

Optimization by Decoded Quantum Interferometry 1: The Semicircle Law — the Optimal Degree-ℓ DQI State Satisfies ⟨s⟩/m → (√(μ(1−ρ)) + √(ρ(1−μ)))² When 2ℓ + 1 < d⊥Research Paper

Motivation

Decoded quantum interferometry (DQI) is a quantum algorithm, introduced by Jordan, Shutty, Wootters, Zalcman, Schmidhuber, King, Isakov, Khattar and Babbush (arXiv:2408.08292), that turns an approximate optimization problem over a finite field into a decoding problem for a linear code. It applies to max-LINSAT: given linear constraints over Fp\mathbb F_pFp​, satisfy as many of them as possible. For structured instances such as optimal polynomial intersection the authors find DQI reaching approximation ratios that no known polynomial-time classical algorithm reaches, which makes it one of the few concrete candidates for a quantum advantage in optimization.

Whether DQI is useful on an instance depends on one number: the expected fraction of constraints satisfied by the string it outputs. Theorem 4.1 of the paper computes this number, in the limit of many constraints, for the best DQI state of a given degree. Every comparison of DQI with classical algorithms in the paper (simulated annealing, Prange's algorithm, the OPI and max-XORSAT benchmarks) is a comparison against this formula, and the follow-up analysis of imperfect decoders (Theorem 10.1) is a perturbation of it.

Setting

Fix a prime ppp. A max-LINSAT instance is a matrix B∈Fpm×nB\in\mathbb F_p^{m\times n}B∈Fpm×n​ with rows b1,…,bm\mathbf b_1,\dots,\mathbf b_mb1​,…,bm​ and subsets F1,…,Fm⊆FpF_1,\dots,F_m\subseteq\mathbb F_pF1​,…,Fm​⊆Fp​; constraint iii asks that bi⋅x∈Fi\mathbf b_i\cdot\mathbf x\in F_ibi​⋅x∈Fi​ (Definition 2.1). Throughout, m>nm>nm>n and every FiF_iFi​ has the same size r∈{1,…,p−1}r\in\{1,\dots,p-1\}r∈{1,…,p−1}. Put fi(a)=+1f_i(a)=+1fi​(a)=+1 if a∈Fia\in F_ia∈Fi​ and −1-1−1 otherwise, and

f(x)=∑i=1mfi(bi⋅x),s(x)=#{i:bi⋅x∈Fi}.f(\mathbf x)=\sum_{i=1}^m f_i(\mathbf b_i\cdot\mathbf x),\qquad s(\mathbf x)=\#\{i:\mathbf b_i\cdot\mathbf x\in F_i\}.f(x)=i=1∑m​fi​(bi​⋅x),s(x)=#{i:bi​⋅x∈Fi​}.

For a real polynomial PPP of degree at most ℓ\ellℓ, the DQI state is ∣P(f)⟩=∑x∈FpnP(f(x))∣x⟩|P(f)\rangle=\sum_{\mathbf x\in\mathbb F_p^n}P(f(\mathbf x))|\mathbf x\rangle∣P(f)⟩=∑x∈Fpn​​P(f(x))∣x⟩, normalized so that ∑xP(f(x))2=1\sum_{\mathbf x}P(f(\mathbf x))^2=1∑x​P(f(x))2=1. Measuring it in the computational basis returns x\mathbf xx with probability P(f(x))2P(f(\mathbf x))^2P(f(x))2, so the expected number of satisfied constraints is

⟨s⟩=∑xP(f(x))2 s(x),\langle s\rangle=\sum_{\mathbf x}P(f(\mathbf x))^2\,s(\mathbf x),⟨s⟩=x∑​P(f(x))2s(x),

and ⟨s(m,ℓ)⟩opt\langle s^{(m,\ell)}\rangle_{\rm opt}⟨s(m,ℓ)⟩opt​ is its supremum over all such PPP.

The dual code is C⊥={d∈Fpm:BTd=0}C^\perp=\{\mathbf d\in\mathbb F_p^m:B^T\mathbf d=0\}C⊥={d∈Fpm​:BTd=0} and d⊥d^\perpd⊥ is the least Hamming weight of a nonzero codeword. The condition 2ℓ+1<d⊥2\ell+1<d^\perp2ℓ+1<d⊥ says that syndromes of errors of weight up to ℓ\ellℓ (and a little more) determine the error.

The analysis passes through rescaled constraint functions gi=(fi−fˉ)/φg_i=(f_i-\bar f)/\varphigi​=(fi​−fˉ​)/φ with Fourier transforms g~i\tilde g_ig~​i​, the elementary symmetric polynomials P(k)P^{(k)}P(k) evaluated at the gi(bi⋅x)g_i(\mathbf b_i\cdot\mathbf x)gi​(bi​⋅x), and the (ℓ+1)×(ℓ+1)(\ell+1)\times(\ell+1)(ℓ+1)×(ℓ+1) symmetric tridiagonal matrix A(m,ℓ,d)A^{(m,\ell,d)}A(m,ℓ,d) with diagonal 0,d,2d,…,ℓd0,d,2d,\dots,\ell d0,d,2d,…,ℓd and off-diagonal entries ak=k(m−k+1)a_k=\sqrt{k(m-k+1)}ak​=k(m−k+1)​, at d=(p−2r)/r(p−r)d=(p-2r)/\sqrt{r(p-r)}d=(p−2r)/r(p−r)​.

Formalization targets

Goal: Theorem 4.1 (the semicircle law)

Fix ppp, rrr and μ≥0\mu\ge0μ≥0. For any sequence of instances with m→∞m\to\inftym→∞, ℓ/m→μ\ell/m\to\muℓ/m→μ and 2ℓ+1<d⊥2\ell+1<d^\perp2ℓ+1<d⊥, writing ρ=r/p\rho=r/pρ=r/p,

lim⁡⟨s(m,ℓ)⟩optm={(μ(1−ρ)+ρ(1−μ))2,ρ≤1−μ,1,otherwise.\lim\frac{\langle s^{(m,\ell)}\rangle_{\rm opt}}{m}=\begin{cases}\big(\sqrt{\mu(1-\rho)}+\sqrt{\rho(1-\mu)}\big)^2,&\rho\le1-\mu,\\ 1,&\text{otherwise.}\end{cases}limm⟨s(m,ℓ)⟩opt​​={(μ(1−ρ)​+ρ(1−μ)​)2,1,​ρ≤1−μ,otherwise.​

For ρ=12\rho=\tfrac12ρ=21​ the curve is 12+μ(1−μ)\tfrac12+\sqrt{\mu(1-\mu)}21​+μ(1−μ)​, a semicircle, which gives the theorem its name.

Milestones

  1. The normalization of the rescaled gig_igi​, (37)–(40).
  2. Lemma A.1: under a common quadratic identity, P(x1+⋯+xm)P(x_1+\dots+x_m)P(x1​+⋯+xm​) is a fixed linear combination of elementary symmetric polynomials.
  3. The counting identity (68), ∑∣y∣=k∣g~(y)∣2=(mk)\sum_{|\mathbf y|=k}|\tilde g(\mathbf y)|^2=\binom mk∑∣y∣=k​∣g~​(y)∣2=(km​), and the Fourier picture (65) of the DQI state.
  4. Lemma 9.1 (norm =∥w∥2=\|\mathbf w\|^2=∥w∥2 when 2ℓ<d⊥2\ell<d^\perp2ℓ<d⊥) and Lemma 9.2 (the expected count is mrp+r(p−r)pwTA(m,ℓ,d)w\frac{mr}p+\frac{\sqrt{r(p-r)}}p\mathbf w^TA^{(m,\ell,d)}\mathbf wpmr​+pr(p−r)​​wTA(m,ℓ,d)w when 2ℓ+1<d⊥2\ell+1<d^\perp2ℓ+1<d⊥).
  5. The finite-size identity (131): ⟨s(m,ℓ)⟩opt/m=ρ+ρ(1−ρ) λmax⁡(m,ℓ,d)/m\langle s^{(m,\ell)}\rangle_{\rm opt}/m=\rho+\sqrt{\rho(1-\rho)}\,\lambda_{\max}^{(m,\ell,d)}/m⟨s(m,ℓ)⟩opt​/m=ρ+ρ(1−ρ)​λmax(m,ℓ,d)​/m.
  6. Lemma 9.3, λmax⁡(m,ℓ,d)/m→μd+2μ(1−μ)\lambda_{\max}^{(m,\ell,d)}/m\to\mu d+2\sqrt{\mu(1-\mu)}λmax(m,ℓ,d)​/m→μd+2μ(1−μ)​, with its lower half (114) and the Gershgorin bound (129).
  7. The algebra (132) and (136)–(137) that produce the closed form.

Significance

The result. Theorem 4.1 makes DQI's performance a closed-form function of two numbers, r/pr/pr/p and ℓ/m\ell/mℓ/m, and moves every question about an instance into coding theory: how large a d⊥d^\perpd⊥ the instance's dual code has, and whether it can be decoded efficiently up to ℓ\ellℓ errors. The OPI advantage claim of the paper, the comparison with Prange's algorithm on max-XORSAT, and the imperfect-decoding bound of Theorem 10.1 all start from this formula. The finite-size identity (131) is also useful on its own: it gives the exact optimum for any instance, not only in the limit.

Formalizing it. The theorem is proved in the paper; to our knowledge no part of it has been machine-checked. A formalization would check the Fourier bookkeeping of §8.2.1 and §9 (normalizations pn−k(mk)\sqrt{p^{n-k}\binom mk}pn−k(km​)​, character sums over Fp\mathbb F_pFp​), the claim that every degree-ℓ\ellℓ DQI state is a combination of the ∣P(k)⟩|P^{(k)}\rangle∣P(k)⟩ and conversely, and the eigenvalue asymptotics of the tridiagonal matrix. Two points of the printed text need care and are stated correctly here: Lemma 9.2 writes its decomposition in the fif_ifi​ where the normalization requires the rescaled gig_igi​, and the "otherwise =1=1=1" branch of Theorem 4.1 is argued only briefly on p. 34.

Difficulty

The algebraic steps are finite but long, and every one carries a normalization that a careless formalization gets wrong. The asymptotic step is the main obstacle. Lemma 9.3 needs a lower bound on λmax⁡\lambda_{\max}λmax​ from a test vector of growing width and a matching upper bound from Gershgorin's theorem, and the upper bound holds only under d≥−(m−2ℓ)/ℓ(m−ℓ)d\ge-(m-2\ell)/\sqrt{\ell(m-\ell)}d≥−(m−2ℓ)/ℓ(m−ℓ)​, which is exactly the regime ρ≤1−μ\rho\le1-\muρ≤1−μ. In the other regime that hypothesis fails and the Gershgorin bound overshoots, so the limit 111 needs a separate argument; the observation that ⟨s⟩opt\langle s\rangle_{\rm opt}⟨s⟩opt​ "increases in rrr", printed on p. 34, does not give it at fixed ppp and rrr. A second difficulty is that ⟨s⟩opt\langle s\rangle_{\rm opt}⟨s⟩opt​ is a supremum over polynomials, while Lemma 9.2 is a statement about weight vectors w\mathbf ww; identifying the two needs both directions of Lemma A.1's correspondence and the normalization of Lemma 9.1.

Formalization scope

All objects live in the namespace DQI.Semicircle and one definitions file. Fp\mathbb F_pFp​ is ZMod p with [Fact p.Prime]; vectors are Fin n → ZMod p; constraints are indexed by Fin m from 000. ωpa=exp⁡(2πi a/p)\omega_p^a=\exp(2\pi i\,a/p)ωpa​=exp(2πia/p) is computed from the representative of aaa in {0,…,p−1}\{0,\dots,p-1\}{0,…,p−1}. Polynomials are real with natDegree ≤ ℓ; weight vectors are real. The optimum ⟨s⟩opt\langle s\rangle_{\rm opt}⟨s⟩opt​ is the real supremum over exactly the normalized polynomials of degree at most ℓ\ellℓ evaluated at f(x)f(\mathbf x)f(x); its set is nonempty (constant polynomials) and bounded by mmm. The dual-distance condition is "every nonzero d\mathbf dd with BTd=0B^T\mathbf d=0BTd=0 has weight >t>t>t"; d⊥d^\perpd⊥ is never an infimum, and m>nm>nm>n (the paper's standing assumption) guarantees a nonzero codeword, so the condition forces 2ℓ<m2\ell<m2ℓ<m. λmax⁡\lambda_{\max}λmax​ is the supremum of the real spectrum. The limit "m→∞m\to\inftym→∞ with ℓ/m\ell/mℓ/m fixed" is any sequence of instances with mj→∞m_j\to\inftymj​→∞ and ℓj/mj→μ\ell_j/m_j\to\muℓj​/mj​→μ, with ppp and rrr fixed along it. Convergence of the ratio includes irrational μ\muμ with integer sizes.

Added hypotheses, all disclosed in the items: Lemma 9.2 decomposes in the gig_igi​ rather than the printed fif_ifi​; (129) assumes ℓ≥1\ell\ge1ℓ≥1 to avoid dividing by 0\sqrt00​; Lemma 9.3 imposes its hypothesis on ddd only when ℓj≥1\ell_j\ge1ℓj​≥1; (114) is stated as a lim inf⁡\liminfliminf with an explicit ε\varepsilonε.

A formalization that replaces ⟨s⟩opt\langle s\rangle_{\rm opt}⟨s⟩opt​ by a supremum over all states (which gives 111), drops "nonzero" from the distance condition (which makes it unsatisfiable), or states the goal at a single mmm is not this theorem and is ruled out by the definitions above.

Needed infrastructure: Fourier analysis on Fpn\mathbb F_p^nFpn​ (character orthogonality, Parseval), elementary symmetric polynomials and their reduction modulo a quadratic, Rayleigh quotients and Gershgorin discs for real symmetric matrices, and elementary limits. The tridiagonal-matrix bounds and the quadratic-reduction lemma are reusable beyond DQI. Proofs of any milestone, alternative arguments for the "otherwise" branch, and sharper finite-mmm bounds on λmax⁡\lambda_{\max}λmax​ are welcome.

Selected references

  • S. P. Jordan, N. Shutty, M. Wootters, A. Zalcman, A. Schmidhuber, R. King, S. V. Isakov, T. Khattar, R. Babbush, Optimization by Decoded Quantum Interferometry, arXiv:2408.08292v5, 2025. https://arxiv.org/abs/2408.08292
  • S. Gershgorin, Über die Abgrenzung der Eigenwerte einer Matrix, Izv. Akad. Nauk SSSR, Ser. Fiz.-Mat. 6, 749–754, 1931.
  • R. G. Gallager, Low-Density Parity-Check Codes, IRE Trans. Inform. Theory 8(1), 21–28, 1962. https://doi.org/10.1109/TIT.1962.1057683
14 thms1 active userReviewed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

Selection and Ordering Policies for Hiring Pipelines via Linear Programming 3: In Simultaneous Offering With Values at Least τ, a Truncated-LP Value-Ordered Policy Earns ≥ α^τ_k Times the LP BoundResearch Paper

Motivation

A firm that fills a fixed number of positions from a pool of applicants faces uncertainty at every stage: applicants differ in value, and an offer may be declined. When offers must go out at once, as in a recruiting season with a common deadline, the firm decides a single offer set and lives with however many candidates accept. Sending too few offers leaves positions empty; sending too many hires beyond capacity at a cost. This trade-off is the same as overbooking in revenue management (airline seats, hotel rooms), with the difference that candidates are heterogeneous in both value and acceptance probability.

Epstein and Ma (arXiv:2210.04059v3, Operations Research 2024) study three hiring-pipeline models through linear programming relaxations. This mission formalizes their lower bound for the third model, Simultaneous Offering (§3.3 and §6 of the paper). The question it answers is practical: how much is lost if the firm restricts itself to value-ordered policies, which send offers to the mmm most valuable candidates for some mmm, instead of searching over all 2n2^n2n offer sets? Value-ordered policies are natural, because a firm rarely wants to withhold offers from its best candidates, and the optimal one is computable by a short dynamic program. The paper shows (Example 1, p. 25) that they can be arbitrarily bad in general, and that they are provably good when every candidate's value is bounded below.

Setting

An instance I=(k,n,p,v)I=(k,n,p,v)I=(k,n,p,v) has kkk positions and nnn candidates, 1≤k≤n1\le k\le n1≤k≤n. Candidate iii accepts an offer independently with probability pi∈[0,1]p_i\in[0,1]pi​∈[0,1] and then contributes value vi≥0v_i\ge0vi​≥0. Candidates are labelled so that v1≥v2≥⋯≥vnv_1\ge v_2\ge\dots\ge v_nv1​≥v2​≥⋯≥vn​. The firm chooses an offer set S⊆[n]S\subseteq[n]S⊆[n]; with A⊆SA\subseteq SA⊆S the random set of acceptances, the reward is

∑i∈Avi−[ ∣A∣−k ]+,\sum_{i\in A}v_i-\big[\,|A|-k\,\big]^+,i∈A∑​vi​−[∣A∣−k]+,

the cost per candidate hired beyond capacity being normalised to 111. OPTsim(I)\mathrm{OPT}_{\mathrm{sim}}(I)OPTsim​(I) is the best expected reward over offer sets. For τ>0\tau>0τ>0 the instance is τ\tauτ-bounded, I∈IsimτI\in\mathcal I^\tau_{\mathrm{sim}}I∈Isimτ​, if vi≥τv_i\ge\tauvi​≥τ for all iii; the interesting range is τ∈(0,1)\tau\in(0,1)τ∈(0,1), since for τ≥1\tau\ge1τ≥1 offering to everyone is optimal.

The benchmark is the LP relaxation

LPsim(I)=max⁡y,z ∑ivipiyi+zs.t.z≤k−∑ipiyi,  z≤0,  0≤yi≤1,\mathrm{LP}_{\mathrm{sim}}(I)=\max_{y,z}\ \sum_{i}v_ip_iy_i+z\quad\text{s.t.}\quad z\le k-\sum_ip_iy_i,\ \ z\le0,\ \ 0\le y_i\le1,LPsim​(I)=y,zmax​ i∑​vi​pi​yi​+zs.t.z≤k−i∑​pi​yi​,  z≤0,  0≤yi​≤1,

which charges the overage cost on the expected number of hires. Write Vhigh={i:vi>1}V_{\mathrm{high}}=\{i:v_i>1\}Vhigh​={i:vi​>1} and Phigh=∑i∈VhighpiP_{\mathrm{high}}=\sum_{i\in V_{\mathrm{high}}}p_iPhigh​=∑i∈Vhigh​​pi​.

The algorithm ALGsims\mathrm{ALG}^s_{\mathrm{sim}}ALGsims​, for s∈[0,1]s\in[0,1]s∈[0,1], takes an optimal LP solution yyy, scales its total mass ∑iyipi\sum_iy_ip_i∑i​yi​pi​ by sss to κ\kappaκ, and fills mass κ\kappaκ from the most valuable candidate down: yi′=1y'_i=1yi′​=1 while the prefix mass ∑l≤ipl\sum_{l\le i}p_l∑l≤i​pl​ stays at most κ\kappaκ, one fractional entry, then zeros. Offers are then sent independently with probabilities yi′y'_iyi′​, so the algorithm randomises between two value-ordered policies. Its expected reward is RALGsims(I)R_{\mathrm{ALG}^s_{\mathrm{sim}}}(I)RALGsims​​(I).

The guarantee involves the truncated Poisson mean E[min⁡{Pois(λ),k}]=∑j≥0min⁡{j,k}e−λλj/j!\mathbb E[\min\{\mathrm{Pois}(\lambda),k\}]=\sum_{j\ge0}\min\{j,k\}e^{-\lambda}\lambda^j/j!E[min{Pois(λ),k}]=∑j≥0​min{j,k}e−λλj/j! and

αkτ=sup⁡0≤s≤1(s−sτ+E[min⁡{Pois(sk),k}]τk).\alpha^\tau_k=\sup_{0\le s\le1}\Big(s-\frac{s}{\tau}+\frac{\mathbb E[\min\{\mathrm{Pois}(sk),k\}]}{\tau k}\Big).αkτ​=0≤s≤1sup​(s−τs​+τkE[min{Pois(sk),k}]​).

Formalization targets

Goal: Theorem 3 (p. 30)

For τ∈(0,1)\tau\in(0,1)τ∈(0,1), every I∈IsimτI\in\mathcal I^\tau_{\mathrm{sim}}I∈Isimτ​, every optimal solution of LPsim(I)\mathrm{LP}_{\mathrm{sim}}(I)LPsim​(I) and a maximiser s∗∈[0,1]s^*\in[0,1]s∗∈[0,1] of the objective defining αkτ\alpha^\tau_kαkτ​,

RALGsims∗(I) ≥ αkτ LPsim(I).R_{\mathrm{ALG}^{s^*}_{\mathrm{sim}}}(I)\ \ge\ \alpha^\tau_k\,\mathrm{LP}_{\mathrm{sim}}(I).RALGsims∗​​(I) ≥ αkτ​LPsim​(I).

Milestones

  • Lemma 10 (p. 27): LPsim(I)≥OPTsim(I)\mathrm{LP}_{\mathrm{sim}}(I)\ge\mathrm{OPT}_{\mathrm{sim}}(I)LPsim​(I)≥OPTsim​(I).
  • Lemma 11 (p. 27): some optimal LP solution is a filled prefix y=(1,…,1,yj,0,…,0)y=(1,\dots,1,y_j,0,\dots,0)y=(1,…,1,yj​,0,…,0) with yj>0y_j>0yj​>0.
  • Lemma 12 (p. 28): the total mass of such a solution is PhighP_{\mathrm{high}}Phigh​ if Phigh>kP_{\mathrm{high}}>kPhigh​>k and min⁡{k,Ptotal}\min\{k,P_{\mathrm{total}}\}min{k,Ptotal​} otherwise (posed under the disclosed hypothesis vi>0v_i>0vi​>0, vi≠1v_i\ne1vi​=1, pi>0p_i>0pi​>0).
  • Monotonicity (App. D.5, p. ec16): E[min⁡{Pois(x),k}]/x\mathbb E[\min\{\mathrm{Pois}(x),k\}]/xE[min{Pois(x),k}]/x is decreasing in xxx.
  • Proposition EC.2 (p. ec3): E[min⁡{Pois(k),k}]=k(1−e−kkk/k!)\mathbb E[\min\{\mathrm{Pois}(k),k\}]=k(1-e^{-k}k^k/k!)E[min{Pois(k),k}]=k(1−e−kkk/k!).
  • Lemma 13 (p. 29): if Phigh≤kP_{\mathrm{high}}\le kPhigh​≤k, then RALGsims(I)≥(s−s/τ+E[min⁡{Pois(sk),k}]/(τk))LPsim(I)R_{\mathrm{ALG}^s_{\mathrm{sim}}}(I)\ge\big(s-s/\tau+\mathbb E[\min\{\mathrm{Pois}(sk),k\}]/(\tau k)\big)\mathrm{LP}_{\mathrm{sim}}(I)RALGsims​​(I)≥(s−s/τ+E[min{Pois(sk),k}]/(τk))LPsim​(I) for every s∈[0,1]s\in[0,1]s∈[0,1].
  • The ALG1\mathrm{ALG}^1ALG1 bound (p. 30): on every τ\tauτ-bounded instance, RALGsim1(I)≥(1−e−kkk/(k!τ)) LPsim(I)R_{\mathrm{ALG}^1_{\mathrm{sim}}}(I)\ge(1-e^{-k}k^k/(k!\tau))\,\mathrm{LP}_{\mathrm{sim}}(I)RALGsim1​​(I)≥(1−e−kkk/(k!τ))LPsim​(I).
  • Lemma 14 (p. 29): if Phigh>kP_{\mathrm{high}}>kPhigh​>k, deflating the acceptance probabilities to an instance with Phigh=kP_{\mathrm{high}}=kPhigh​=k does not increase the ratio RALGsims∗/LPsimR_{\mathrm{ALG}^{s^*}_{\mathrm{sim}}}/\mathrm{LP}_{\mathrm{sim}}RALGsims∗​​/LPsim​ (posed under the disclosed hypothesis vi≠1v_i\ne1vi​=1).

Significance

Theorem 3 makes value-ordered policies an αkτ\alpha^\tau_kαkτ​-approximation on τ\tauτ-bounded instances, through Lemma 10. The factor tends to 111 as k→∞k\to\inftyk→∞ for fixed τ\tauτ: at s=1s=1s=1 it is at least 1−e−kkk/(k!τ)=1−O(1/k)1-e^{-k}k^k/(k!\tau)=1-O(1/\sqrt k)1−e−kkk/(k!τ)=1−O(1/k​) (Corollary 4). The paper's Theorem 4, the subject of the companion mission in this series, shows that no value-ordered policy beats the same expression with the supremum over s≥0s\ge0s≥0, so the analysis is tight wherever the two suprema coincide. The interpretation of τ\tauτ is how soft the capacity is: the bound degrades exactly as the overage cost dominates candidate values.

The result is proved in the paper; nothing in this mission is open mathematics. To our knowledge none of it has been machine-checked. A complete development would give the platform an overbooking-type stochastic selection model with an exact expected reward, an LP benchmark, and the truncated-Poisson constant that recurs in prophet-inequality and online-matching analyses (the kkk-uniform correlation gap of Yan 2011). Proposition EC.2 and the monotonicity of E[min⁡{Pois(x),k}]/x\mathbb E[\min\{\mathrm{Pois}(x),k\}]/xE[min{Pois(x),k}]/x are reusable on their own.

Difficulty

The obvious argument compares the algorithm's random number of hires with the LP's expected number and loses everything to the overage term: the LP pays [E∣A∣−k]+[\mathbb E|A|-k]^+[E∣A∣−k]+, the algorithm pays E[∣A∣−k]+\mathbb E[|A|-k]^+E[∣A∣−k]+, and Jensen's inequality points the wrong way. The gap must be controlled by a sum of independent Bernoulli variables against a Poisson variable of the same mean, uniformly over how the mass is spread across candidates. A second difficulty is the regime Phigh>kP_{\mathrm{high}}>kPhigh​>k, where the LP optimum deliberately exceeds capacity; a direct bound there does not reduce to the first case, and the paper's reduction (Lemma 14) changes the instance rather than the algorithm. Tie cases vi=1v_i=1vi​=1 make the LP optimum non-unique, which the formal statements must handle explicitly.

Formalization scope

Candidates are Fin n (0-based), all quantities are real. The sorted labelling v1≥⋯≥vnv_1\ge\dots\ge v_nv1​≥⋯≥vn​ is part of instance validity (Antitone I.v), as the paper assumes after relabelling; ties may be ordered arbitrarily. Every expectation is an explicit finite sum over the 2n2^n2n hire sets with independent probabilities yi′piy'_ip_iyi′​pi​; there is no measure theory. The truncated Poisson mean is the series of the Poisson pmf. LPsim(I)\mathrm{LP}_{\mathrm{sim}}(I)LPsim​(I) is the supremum of the objective over the feasible set, which is the LP value; αkτ\alpha^\tau_kαkτ​ is the supremum over [0,1][0,1][0,1]. s∗s^*s∗ is any maximiser of the αkτ\alpha^\tau_kαkτ​ objective over [0,1][0,1][0,1]; one exists by continuity. A candidate with pi=0p_i=0pi​=0 receives yi′=0y'_i=0yi′​=0, which changes no reward.

The algorithm's reward is the exact expected reward of the run with independent offers, never the bound produced in the paper's proof, and the comparison is with the LP value at an optimal solution, not with the objective at an arbitrary feasible point; αkτ\alpha^\tau_kαkτ​ is the supremum of the specific Poisson expression, not a free constant.

Two statements carry disclosed hypotheses, because the printed versions fail at ties: Lemma 12 assumes vi>0v_i>0vi​>0, vi≠1v_i\ne1vi​=1, pi>0p_i>0pi​>0, and Lemma 14 assumes vi≠1v_i\ne1vi​=1. Counterexamples are in the items' Formalization Notes. Theorem 3 and Lemma 13 need neither and hold for every optimal LP solution.

A complete development needs Poisson series manipulations (the closed form, concavity of λ↦E[min⁡{Pois(λ),k}]\lambda\mapsto\mathbb E[\min\{\mathrm{Pois}(\lambda),k\}]λ↦E[min{Pois(λ),k}]), a Bernoulli-to-Poisson comparison for Emin⁡{∑iDi,k}\mathbb E\min\{\sum_iD_i,k\}Emin{∑i​Di​,k}, and fractional-knapsack structure for the LP. Contributions of alternative proofs of any milestone, and of the Poisson facts as standalone results, are welcome.

Selected references

  • B. Epstein, W. Ma, Selection and Ordering Policies for Hiring Pipelines via Linear Programming, arXiv:2210.04059v3 (2023); Operations Research (2024). https://arxiv.org/abs/2210.04059
  • Q. Yan, Mechanism Design via Correlation Gap, Proceedings of SODA 2011, 710–719. https://doi.org/10.1137/1.9781611973082.56
  • M. T. Goodrich, R. Tamassia, Algorithm Design: Foundations, Analysis, and Internet Examples, Wiley, 2001, Chapter 5 (fractional knapsack).
13 thms1 active userReviewed
Linear algebraLinear Optimization·Captain: mikedeng1

A Strongly Polynomial Algorithm for Linear Exchange Markets II: A Z₊-Matrix Polyhedron P_M Lies Between an M2VPI Polyhedron and Its Scaling by B²Research Paper

Motivation

In a linear exchange market every agent owns one divisible good and has linear utilities over all goods; an equilibrium is a price vector at which every agent can spend its budget on goods that maximize utility per unit of money, and all goods are sold. Computing such an equilibrium in strongly polynomial time, with a number of arithmetic operations bounded by a polynomial in the number of agents alone, was an open question until Garg and Végh (arXiv:1809.06266; Operations Research, 2023). Their algorithm alternates two kinds of phases. One identifies "revealed" edges that appear in every equilibrium (the subject of mission I of this series). The other computes good starting prices for the current set of revealed edges by solving a linear program whose constraint matrix has a special sign structure.

No strongly polynomial algorithm is known for that linear program. Systems in which every inequality has at most one positive and at most one negative coefficient, by contrast, are strongly polynomially solvable (Megiddo, 1983; Hochbaum and Naor, 1994). The paper bridges the gap with Theorem 6.4: a polyhedron given by a Z+Z_+Z+​-matrix is sandwiched between a monotone two-variable-per-inequality polyhedron and its scaling by an explicit factor B2B^2B2. This mission formalizes that theorem and the lemmas of §7 that prove it. It is a statement about matrices and polyhedra only; no market notions enter.

Setting

Matrices are rational. For integers k,t≥0k, t \ge 0k,t≥0 a matrix M∈Qk×tM \in \mathbb{Q}^{k\times t}M∈Qk×t is a Z+Z_+Z+​-matrix, written M∈Z+(k,t)M \in \mathcal{Z}_+(k,t)M∈Z+​(k,t), if every off-diagonal entry is nonpositive and every column sum is nonnegative:

Mij≤0(i≠j),∑i=1kMij≥0(j∈[t]).M_{ij} \le 0 \quad (i \ne j), \qquad \sum_{i=1}^k M_{ij} \ge 0 \quad (j \in [t]).Mij​≤0(i=j),i=1∑k​Mij​≥0(j∈[t]).

For a non-square matrix the diagonal entries are the MiiM_{ii}Mii​ with 1≤i≤min⁡{k,t}1 \le i \le \min\{k,t\}1≤i≤min{k,t}. Square Z+Z_+Z+​-matrices are exactly the transposes of weighted Laplacians of directed graphs, or such transposes with one row and column deleted.

M2(m,t)\mathcal{M}_2(m,t)M2​(m,t) is the set of m×tm\times tm×t rational matrices with at most one positive and at most one negative entry in every row. A system Mˉx≤bˉ\bar M x \le \bar bMˉx≤bˉ with Mˉ∈M2(m,t)\bar M \in \mathcal{M}_2(m,t)Mˉ∈M2​(m,t) is a monotone two-variable-per-inequality system (M2VPI).

For M∈Z+(k,t)M \in \mathcal{Z}_+(k,t)M∈Z+​(k,t) and b∈Qkb \in \mathbb{Q}^kb∈Qk with b>0b > 0b>0, the polyhedron of interest is

PM={x∈Rt:Mx≤b, x≥0}.P_M = \{x \in \mathbb{R}^t : Mx \le b,\ x \ge 0\}.PM​={x∈Rt:Mx≤b, x≥0}.

Write ℓ\ellℓ for the number of nonzero entries of MMM, αP={αx:x∈P}\alpha P = \{\alpha x : x \in P\}αP={αx:x∈P} for α>0\alpha > 0α>0, and

B=∑j=1kbjmin⁡i∈[k]bi.B = \frac{\sum_{j=1}^k b_j}{\min_{i\in[k]} b_i}.B=mini∈[k]​bi​∑j=1k​bj​​.

In §7 the right-hand side is called γ\gammaγ instead of bbb, and λi=∑j≠iγj\lambda_i = \sum_{j\ne i}\gamma_jλi​=∑j=i​γj​.

The proof works with a square M∈Z+(t,t)M \in \mathcal{Z}_+(t,t)M∈Z+​(t,t) with positive diagonal. Its digraph ([t],H)([t],H)([t],H) has an arc ijijij whenever Mij<0M_{ij} < 0Mij​<0. DiD_iDi​ is the set of vertices reachable from iii (including iii), and M(i)M^{(i)}M(i) is the submatrix of the rows MjM_jMj​, j∈Dij \in D_ij∈Di​. The vertices split into T1T_1T1​ (at most one outgoing arc), T2T_2T2​ (at least two arcs and rk⁡M(i)=∣Di∣\operatorname{rk} M^{(i)} = |D_i|rkM(i)=∣Di​∣) and T3T_3T3​ (at least two arcs and rk⁡M(i)<∣Di∣\operatorname{rk} M^{(i)} < |D_i|rkM(i)<∣Di​∣).

Formalization targets

Goal: Theorem 6.4 (p. 15)

For M∈Z+(k,t)M \in \mathcal{Z}_+(k,t)M∈Z+​(k,t) with k≥1k \ge 1k≥1 and ℓ\ellℓ nonzero entries, and b∈Qkb \in \mathbb{Q}^kb∈Qk with b>0b > 0b>0, there are ℓ′≤ℓ\ell' \le \ellℓ′≤ℓ, Mˉ∈M2(ℓ′,t)\bar M \in \mathcal{M}_2(\ell',t)Mˉ∈M2​(ℓ′,t) and bˉ∈Qℓ′\bar b \in \mathbb{Q}^{\ell'}bˉ∈Qℓ′ with

PM⊆{x∈Rt:Mˉx≤bˉ, x≥0}⊆B2PM.P_M \subseteq \{x \in \mathbb{R}^t : \bar Mx \le \bar b,\ x \ge 0\} \subseteq B^2 P_M.PM​⊆{x∈Rt:Mˉx≤bˉ, x≥0}⊆B2PM​.

Milestones (§7, pp. 16–23)

  • Lemma 7.1: for M∈Z+(t,t)M \in \mathcal{Z}_+(t,t)M∈Z+​(t,t) and pˉ≥0\bar p \ge 0pˉ​≥0 with Mpˉ≤γM\bar p \le \gammaMpˉ​≤γ,  Mpˉ≥−λ≥−(B−1)γ\ M\bar p \ge -\lambda \ge -(B-1)\gamma Mpˉ​≥−λ≥−(B−1)γ.
  • Lemma 7.2: the Gaussian elimination of the proof, run on T∈Z+(ℓ,t)T \in \mathcal{Z}_+(\ell,t)T∈Z+​(ℓ,t), returns T′=YTT' = YTT′=YT with Y≥0Y \ge 0Y≥0, T′T'T′ upper triangular with diagonal entries in {0,1}\{0,1\}{0,1} and nonpositive off-diagonal entries, and Tkk′=1T'_{kk} = 1Tkk′​=1 whenever some Tik<0T_{ik} < 0Tik​<0 with i>ki > ki>k.
  • Claim 7.3(iii): for i∈T3i \in T_3i∈T3​, MiM_iMi​ is a linear combination of {Mh:h∈Di∖{i}}\{M_h : h \in D_i \setminus\{i\}\}{Mh​:h∈Di​∖{i}}.
  • Lemma 7.4(i): for i∈T2∪T3i \in T_2\cup T_3i∈T2​∪T3​ there is a unique q(i)∈R+tq^{(i)} \in \mathbb{R}^t_+q(i)∈R+t​ with Mℓq(i)=0M_\ell q^{(i)} = 0Mℓ​q(i)=0 (ℓ∈Di∖{i}\ell \in D_i\setminus\{i\}ℓ∈Di​∖{i}), qi(i)=1q^{(i)}_i = 1qi(i)​=1 and qℓ(i)=0q^{(i)}_\ell = 0qℓ(i)​=0 off DiD_iDi​.
  • Lemma 7.4(iv) and (iii): points r(i)∈PMr^{(i)} \in P_Mr(i)∈PM​ tight on Di∖{i}D_i\setminus\{i\}Di​∖{i} (for i∈T3i \in T_3i∈T3​) and on DiD_iDi​ with ri(i)=κ(i)r^{(i)}_i = \kappa(i)ri(i)​=κ(i) (for i∈T2i \in T_2i∈T2​).
  • Claim 7.5: κ(i) Miq(i)≤Bγi\kappa(i)\,M_i q^{(i)} \le B\gamma_iκ(i)Mi​q(i)≤Bγi​ for i∈T2i \in T_2i∈T2​.
  • The reduced case (§7, p. 16): Theorem 6.4 for square MMM with positive diagonal.

Significance

Theorem 6.4 turns an LP over a Z+Z_+Z+​ constraint matrix, for which no strongly polynomial algorithm is known, into an M2VPI system that is strongly polynomially solvable, at the price of a factor B2B^2B2. In the exchange-market algorithm B≤nB \le nB≤n, so the starting prices of each phase come within a factor n2n^2n2 of optimal (the proof of Theorem 3.7, p. 15). That bound is what lets the potential argument advance in a polynomial number of phases. The construction is not specific to markets: any LP of the form max⁡∑ixi\max \sum_i x_imax∑i​xi​ over PMP_MPM​ with MMM a Z+Z_+Z+​-matrix, which includes LPs over transposed weighted Laplacians of directed graphs, inherits the same approximation.

The result is proved in the paper; to our knowledge none of it has been machine-checked. A formalization produces a checked proof of the sandwich. It also produces reusable facts about Gaussian elimination on Z+Z_+Z+​-matrices (Lemma 7.2), which hold for any matrix whose off-diagonal entries are nonpositive and whose column sums are nonnegative.

Difficulty

The obvious approach, deleting all but two variables from each inequality of PMP_MPM​, fails: the dropped negative terms make the resulting system either too weak or invalid. The paper instead derives one new constraint per arc ijijij of HHH, as a nonnegative combination of the inequalities Mpˉ≥−λM\bar p \ge -\lambdaMpˉ​≥−λ. Finding it requires an ordering of DiD_iDi​ in which every vertex but iii has an in-neighbour placed after it, and an elimination on the permuted submatrix whose penultimate row has exactly two nonzero entries. The reverse containment {Mˉpˉ≤bˉ}⊆B2PM\{\bar M\bar p \le \bar b\} \subseteq B^2P_M{Mˉpˉ​≤bˉ}⊆B2PM​ is the hard direction. It splits by whether the rows on DiD_iDi​ are linearly independent (T2T_2T2​) or not (T3T_3T3​), and the T2T_2T2​ case needs the extra constraint pˉi≤κ(i)\bar p_i \le \kappa(i)pˉ​i​≤κ(i) and the comparison of entries of the elimination multipliers Y(ij)Y^{(ij)}Y(ij) in Claim 7.5. Every step relies on a sign invariant of the elimination that Lemma 7.2 proves by induction.

Formalization scope

Indices are 0-based (Fin k, Fin t); the paper's [n]={1,…,n}[n] = \{1,\dots,n\}[n]={1,…,n}. Matrices MMM, Mˉ\bar MMˉ and right-hand sides bbb, bˉ\bar bbˉ, γ\gammaγ are rational (ℚ), as on p. 15, and act on real vectors x∈Rtx \in \mathbb{R}^tx∈Rt through the cast. A diagonal entry of a rectangular matrix is one whose two indices agree as natural numbers. B2PMB^2P_MB2PM​ is the image {B2x:x∈PM}\{B^2x : x \in P_M\}{B2x:x∈PM​}. BBB is defined for k≥1k \ge 1k≥1 only, and every statement using it assumes k≥1k \ge 1k≥1 (resp. t≥1t \ge 1t≥1).

Not formalized: the running time O(ℓ(min⁡{k,t})3)O(\ell(\min\{k,t\})^3)O(ℓ(min{k,t})3) and the polynomial bound on the encoding size of Mˉ\bar MMˉ, bˉ\bar bbˉ in Theorem 6.4. The goal is the existence statement that the construction (13) witnesses. The standing assumptions of §7 (γ>0\gamma > 0γ>0; positive diagonal after the reduction) appear as hypotheses of the milestones that live in that setting.

Lemma 7.2 is stated about the specific elimination of the proof (p. 17), defined explicitly; an existential "there is Y≥0Y \ge 0Y≥0" form would be nearly trivial, since Y=0Y = 0Y=0 satisfies all but one clause. In the goal, Mˉ\bar MMˉ must have at most one positive and at most one negative entry per row, and ℓ′≤ℓ\ell' \le \ellℓ′≤ℓ. Dropping either requirement makes the goal weaker than the paper's theorem.

κ(i)\kappa(i)κ(i), defined in (12) through the elimination for an arbitrarily chosen arc, is restated intrinsically as the iii-th entry of (MDi,Di)−1γDi(M_{D_i,D_i})^{-1}\gamma_{D_i}(MDi​,Di​​)−1γDi​​, a number the paper shows equal (proof of Lemma 7.4(iii)). It is used only for i∈T2i \in T_2i∈T2​, where that block is invertible. Claim 7.3(i)–(ii) and Lemma 7.4(ii), which concern the elimination output for a particular arc, are not milestones.

A complete development needs the elimination and its invariants, reachability in a finite digraph, ranks of row submatrices, and the construction (13). The elimination lemmas are reusable for any Z+Z_+Z+​-matrix. Contributions are welcome on any milestone, on the reduction from rectangular MMM to the square positive-diagonal case, and on the two containments of the reduced case.

Selected references

  • J. Garg and L. A. Végh, A strongly polynomial algorithm for linear exchange markets, arXiv:1809.06266v3, 2022; Operations Research, 2023. https://arxiv.org/abs/1809.06266
  • N. Megiddo, Towards a genuinely polynomial algorithm for linear programming, SIAM Journal on Computing 12(2), 1983. https://doi.org/10.1137/0212022
  • D. S. Hochbaum and J. Naor, Simple and fast algorithms for linear and integer programs with two variables per inequality, SIAM Journal on Computing 23(6), 1994. https://doi.org/10.1137/S0097539793251876
  • R. W. Cottle and A. F. Veinott, Jr., Polyhedral sets having a least element, Mathematical Programming 3, 1972. https://doi.org/10.1007/BF01584975
11 thms1 active userReviewed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

Selection and Ordering Policies for Hiring Pipelines via Linear Programming 2: An LP-Rounding Policy That Sends Offers in Parallel Lists Earns at Least (1 − 1/e) Times the LP BoundResearch Paper

Motivation

Firms that hire for several roles at once face a timing problem. An offer occupies a candidate until they answer, a candidate can hold only one offer, and the hiring season has a fixed number of decision rounds. Sending offers one at a time is slow; sending them all at once risks over-hiring. Epstein and Ma (arXiv:2210.04059v3, Operations Research 2024) study three stylised models of this pipeline: interviewing with a cap on interviews (ProbeTop-kkk), offering in parallel rounds, and offering all at once. This mission formalizes their result for the second model, the Parallel Offering problem.

The question belongs to the literature on stochastic probing and LP-based approximation of adaptive policies. The Sequential Offering model of Purohit, Gollapudi and Raghavan (2019) sends one offer per round for identical positions. Parallel Offering lets each unfilled position send one offer per round, with heterogeneous positions, and asks how much a simple, non-adaptive policy loses against the best adaptive one.

Setting

A firm fills kkk positions from nnn candidates within TTT rounds. Candidate i∈[n]i\in[n]i∈[n] accepts an offer for position j∈[k]j\in[k]j∈[k] with probability pijp_{ij}pij​ and then adds the value vijv_{ij}vij​. An instance is I=(k,T,n,p,v)I=(k,T,n,p,v)I=(k,T,n,p,v) with

1≤k≤T≤n,p∈[0,1]n×k,v∈R+n×k.1\le k\le T\le n,\qquad p\in[0,1]^{n\times k},\qquad v\in\mathbb R_+^{n\times k}.1≤k≤T≤n,p∈[0,1]n×k,v∈R+n×k​.

In each round the firm may send one offer for every unfilled position, and each candidate receives at most one offer in total. Before the rounds start, each candidate iii has decided the set Ai⊆[k]A_i\subseteq[k]Ai​⊆[k] of positions they would accept, with P(j∈Ai)=pij\mathbb P(j\in A_i)=p_{ij}P(j∈Ai​)=pij​. These decisions may be correlated across the positions of one candidate and are independent across candidates.

The linear program LPpar(I)\mathrm{LP}_{\mathrm{par}}(I)LPpar​(I) has a variable yijy_{ij}yij​ for the probability that candidate iii is offered position jjj:

max⁡ ∑j=1k∑i=1nvijyijpijs.t.∑iyij≤T,∑iyijpij≤1  (∀j),∑jyij≤1  (∀i),0≤yij≤1.\max\ \sum_{j=1}^k\sum_{i=1}^n v_{ij}y_{ij}p_{ij}\quad\text{s.t.}\quad \sum_i y_{ij}\le T,\quad \sum_i y_{ij}p_{ij}\le 1\ \ (\forall j),\qquad \sum_j y_{ij}\le 1\ \ (\forall i),\qquad 0\le y_{ij}\le 1.max j=1∑k​i=1∑n​vij​yij​pij​s.t.i∑​yij​≤T,i∑​yij​pij​≤1  (∀j),j∑​yij​≤1  (∀i),0≤yij​≤1.

The paper shows (Lemma 6) that its value bounds the expected reward of every policy.

The dependent rounding of Gandhi, Khuller, Parthasarathy and Srinivasan (2006) takes a bipartite graph with edge weights xe∈[0,1]x_e\in[0,1]xe​∈[0,1] and outputs random indicators Xe∈{0,1}X_e\in\{0,1\}Xe​∈{0,1} with (P1) EXe=xe\mathbb E X_e=x_eEXe​=xe​; (P2) every vertex degree ∑e∋uXe\sum_{e\ni u}X_e∑e∋u​Xe​ is the floor or the ceiling of its fractional degree, with probability 1; (P3) for every vertex uuu, every set SSS of edges at uuu and every c∈{0,1}c\in\{0,1\}c∈{0,1}, P(⋂e∈S{Xe=c})≤∏e∈SP(Xe=c)\mathbb P(\bigcap_{e\in S}\{X_e=c\})\le\prod_{e\in S}\mathbb P(X_e=c)P(⋂e∈S​{Xe​=c})≤∏e∈S​P(Xe​=c).

The algorithm ALGpar\mathrm{ALG}_{\mathrm{par}}ALGpar​ solves LPpar(I)\mathrm{LP}_{\mathrm{par}}(I)LPpar​(I) to optimality, rounds the optimal yyy on the complete bipartite graph candidates ×\times× positions, and puts candidate iii on the list of position jjj iff Yij=1Y_{ij}=1Yij​=1. Every list is then run in parallel, in decreasing order of vijv_{ij}vij​: position jjj offers to the next candidate on its list each round until someone accepts, the list ends or the TTT rounds are over. RALGpar(I)R_{\mathrm{ALG}_{\mathrm{par}}}(I)RALGpar​​(I) is its expected total value.

For the analysis, Dj={i:Yij=1, j∈Ai}D_j=\{i: Y_{ij}=1,\ j\in A_i\}Dj​={i:Yij​=1, j∈Ai​} is the set of candidates on list jjj who would accept, vj∗(S)=max⁡i∈Svijv^*_j(S)=\max_{i\in S}v_{ij}vj∗​(S)=maxi∈S​vij​ (zero on the empty set), D~j\tilde D_jD~j​ is the same set built from independent Bernoulli(yijy_{ij}yij​) variables instead of YijY_{ij}Yij​, and Lj∗=∑ivijyijpijL^*_j=\sum_i v_{ij}y_{ij}p_{ij}Lj∗​=∑i​vij​yij​pij​.

Formalization targets

Goal: Theorem 2

RALGpar(I) ≥ (1−1e) LPpar(I)for every I∈Ipar.R_{\mathrm{ALG}_{\mathrm{par}}}(I)\ \ge\ \Big(1-\frac1e\Big)\,\mathrm{LP}_{\mathrm{par}}(I)\qquad\text{for every } I\in\mathcal I_{\mathrm{par}}.RALGpar​​(I) ≥ (1−e1​)LPpar​(I)for every I∈Ipar​.

The constant is tight (App. C.5 of the paper), so the goal states the paper's result in its final form.

Milestones

  1. Properties (a) and (b) (§5.2): with probability 1 every list has at most TTT candidates and every candidate is on at most one list.
  2. Lj=E vj∗(D)L_j=\mathbb E\,v^*_j(D)Lj​=Evj∗​(D) (§5.3): the expected value hired for position jjj is the expected best value among the accepting list members.
  3. Lemma 7: E vj∗(D)≥E vj∗(D~)\mathbb E\,v^*_j(D)\ge\mathbb E\,v^*_j(\tilde D)Evj∗​(D)≥Evj∗​(D~) for every position jjj.
  4. Lemma 8: E vj∗(D~)≥(1−1/e)Lj∗\mathbb E\,v^*_j(\tilde D)\ge(1-1/e)L^*_jEvj∗​(D~)≥(1−1/e)Lj∗​ for every position jjj.
  5. Lemma 9 (companion, §5.4): if all positions are identical, LPpar(I)=LPseq(I′)\mathrm{LP}_{\mathrm{par}}(I)=\mathrm{LP}_{\mathrm{seq}}(I')LPpar​(I)=LPseq​(I′), where I′I'I′ is the Sequential Offering instance with the same candidates and a budget of kTkTkT offers.

Significance

Theorem 2 shows that a non-adaptive policy, fixed before any offer is answered, earns at least 1−1/e≈0.6321-1/e\approx0.6321−1/e≈0.632 of the LP bound, hence of the best adaptive policy, for heterogeneous positions and with acceptance decisions correlated across positions. Through Lemma 9 it also bounds the cost of batching: TTT parallel rounds lose at most a factor 1−1/e1-1/e1−1/e against kTkTkT sequential offers (Corollary 3 of the paper).

The results are proved in the paper; none of them is formalized. The mission adds to the platform a reusable statement of the GKPS rounding properties on bipartite graphs, an explicit finite model of a parallel offering process computed from its run, and a (1−1/e)(1-1/e)(1−1/e) LP-rounding guarantee that a solver must connect end to end: the algorithm's reward, the per-position reduction, the comparison with independent rounding, and the bound for independent rounding.

Difficulty

The obvious first step, replacing the dependent rounding by independent rounding with the same marginals, is not free: the rounding couples the candidates of a list, and an expected maximum is not linear in the indicators. Only the negative correlation of the rounding at a single position rescues it, and the paper notes (App. C.3) that (P1) and (P3) alone do not suffice once several identical positions are pooled, so the argument is genuinely per position. The written proof of Lemma 7 (p. ec10) has a sign error and a wrong indicator; the statement is correct. Independent rounding then still has to be compared with the LP: the LP only controls each list in expectation, through ∑iyijpij≤1\sum_i y_{ij}p_{ij}\le1∑i​yij​pij​≤1, while the algorithm collects at most one value per list.

Formalization scope

Candidates are Fin n, positions Fin k, all quantities real. All randomness is finite: an expectation is an explicit sum over the rounded edge set Y⊆[n]×[k]Y\subseteq[n]\times[k]Y⊆[n]×[k], weighted by a distribution μ\muμ, and over acceptance profiles (Ai)i(A_i)_i(Ai​)i​, weighted by ∏iacci(Ai)\prod_i\mathrm{acc}_i(A_i)∏i​acci​(Ai​), where acci\mathrm{acc}_iacci​ is any law on subsets of [k][k][k] with marginals pijp_{ij}pij​. The rounding is independent of the acceptance decisions.

The rounding scheme is represented by its properties: the goal holds for every distribution μ\muμ with (P1)–(P3) for the weights yyy, which includes the scheme of Gandhi et al. The LP solution is any optimal one. The order of list jjj is a permutation of the candidates that is decreasing in vijv_{ij}vij​, ties in any order. RALGparR_{\mathrm{ALG}_{\mathrm{par}}}RALGpar​​ is computed from the run: candidate iii is hired for jjj iff iii is on list jjj, would accept jjj, nobody earlier on list jjj would accept jjj, and fewer than TTT candidates precede iii on the list. It is not defined by the formula E vj∗(D)\mathbb E\,v^*_j(D)Evj∗​(D), which is a milestone, and the goal is compared with the objective at an optimal LP solution, never at an arbitrary feasible point. The degree condition (P2) is kept in the rounding predicate, not replaced by the list properties it implies.

A complete development needs finite sums over product distributions, expected maxima of random subsets of sorted values, and elementary estimates involving e−1e^{-1}e−1; no measure theory is required. The GKPS definition is generic in the two vertex sets and reusable for other dependent-rounding results. Proofs of any milestone are welcome, as is a proof of Lemma 7 for general negatively correlated roundings.

Selected references

  • B. Epstein, W. Ma, Selection and Ordering Policies for Hiring Pipelines via Linear Programming, Operations Research, 2024; preprint arXiv:2210.04059v3, 2023. https://arxiv.org/abs/2210.04059
  • R. Gandhi, S. Khuller, S. Parthasarathy, A. Srinivasan, Dependent rounding and its applications to approximation algorithms, Journal of the ACM 53(3), 2006. https://doi.org/10.1145/1147954.1147956
  • M. Purohit, S. Gollapudi, M. Raghavan, Hiring under uncertainty, ICML 2019. https://proceedings.mlr.press/v97/purohit19a.html
8 thms1 active userReviewed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

Selection and Ordering Policies for Hiring Pipelines via Linear Programming 1: A Non-Adaptive, Committed LP-Rounding Policy for ProbeTop-k Earns at Least (1 − e^{−k}k^k/k!) Times the LP BoundResearch Paper

Motivation

Hiring is a pipeline: a firm with kkk openings and a large pool of applicants cannot interview everyone, so it must decide whom to interview, in what order, and whether to hire on the spot. The ProbeTop-k problem models this. Each applicant has a random value with a known distribution, an interview reveals the value, at most TTT interviews may be conducted, and at most kkk applicants are hired. The firm maximises the expected total value of its hires.

The same structure appears in stochastic probing, sequential testing and assortment problems, and its benchmark, the best adaptive, non-committed policy (one that may choose the next interview after seeing earlier values and may hire only at the end), is hard to compute. Practical policies are non-adaptive (fix the interview order in advance) and committed (hire or reject right after each interview). Epstein and Ma (arXiv:2210.04059v3, Operations Research 2024) ask how much is lost by restricting to such policies, and answer with an LP-rounding algorithm whose guarantee improves with kkk.

Setting

An instance I=(k,T,n,F)I = (k, T, n, F)I=(k,T,n,F) has 1≤k≤T≤n1 \le k \le T \le n1≤k≤T≤n. Applicant i∈[n]i \in [n]i∈[n] has value ViV_iVi​ supported on finitely many non-negative values r1,…,rJr_1, \dots, r_Jr1​,…,rJ​, with qij=Pr⁡(Vi=rj)q_{ij} = \Pr(V_i = r_j)qij​=Pr(Vi​=rj​); values are independent across applicants.

The linear relaxation LPptk(I)\mathrm{LP}_{ptk}(I)LPptk​(I) has variables yiy_iyi​ (probability of interviewing iii) and xijx_{ij}xij​ (probability of hiring iii when Vi=rjV_i = r_jVi​=rj​):

LPptk(I)=max⁡∑i=1n∑j=1Jrjxijs.t.xij≤yiqij,  ∑iyi≤T,  ∑i,jxij≤k,  xij≥0,  0≤yi≤1.\mathrm{LP}_{ptk}(I) = \max \sum_{i=1}^n \sum_{j=1}^J r_j x_{ij} \quad \text{s.t.}\quad x_{ij} \le y_i q_{ij},\ \ \sum_i y_i \le T,\ \ \sum_{i,j} x_{ij} \le k,\ \ x_{ij} \ge 0,\ \ 0 \le y_i \le 1 .LPptk​(I)=maxi=1∑n​j=1∑J​rj​xij​s.t.xij​≤yi​qij​,  i∑​yi​≤T,  i,j∑​xij​≤k,  xij​≥0,  0≤yi​≤1.

From a solution (x,y)(x, y)(x,y) define

pi=∑jxijyi,vi=∑jrjxij∑jxij,p_i = \frac{\sum_j x_{ij}}{y_i}, \qquad v_i = \frac{\sum_j r_j x_{ij}}{\sum_j x_{ij}},pi​=yi​∑j​xij​​,vi​=∑j​xij​∑j​rj​xij​​,

each 000 when its denominator is 000.

The algorithm ALGptk solves the LP and takes a basic optimal solution (x,y)(x, y)(x,y). It then draws the interview set SSS by the dependent rounding DR: applicants with yi=1y_i = 1yi​=1 are always in SSS; a single fractional yay_aya​ puts aaa in SSS with probability yay_aya​; two fractional ya+yb=1y_a + y_b = 1ya​+yb​=1 put exactly one of them in SSS, aaa with probability yay_aya​. ALGptk interviews SSS in decreasing order of viv_ivi​, and on observing Vi=rjV_i = r_jVi​=rj​ hires iii with probability xij/(yiqij)x_{ij}/(y_i q_{ij})xij​/(yi​qij​) if a position is still open. Its expected reward is RALGptk(I)R_{ALG_{ptk}}(I)RALGptk​​(I).

Formalization targets

Goal: Theorem 1

RALGptk(I)  ≥  (1−e−kkkk!) LPptk(I)for every valid instance I with k positions.R_{ALG_{ptk}}(I) \;\ge\; \Big(1 - \frac{e^{-k}k^k}{k!}\Big)\, \mathrm{LP}_{ptk}(I) \qquad \text{for every valid instance } I \text{ with } k \text{ positions.}RALGptk​​(I)≥(1−k!e−kkk​)LPptk​(I)for every valid instance I with k positions.

The factor is 1−1/e1 - 1/e1−1/e at k=1k = 1k=1 and tends to 111 as k→∞k \to \inftyk→∞.

Milestones

The paper's own steps, in attack order:

  1. Lemma 2 (p. 16): a basic feasible solution has at most two fractional yiy_iyi​, and two fractional ones sum to 111.
  2. (P1), (P2) (p. 17): DR has marginals E(Yi)=yi\mathbb{E}(Y_i) = y_iE(Yi​)=yi​ and never exceeds TTT interviews.
  3. E(Pi)=pi\mathbb{E}(P_i) = p_iE(Pi​)=pi​ (p. 18): the hiring coin has mean pip_ipi​.
  4. Lemma 3 (p. 18): RALGptk(I)=∑ivi E(1{Ni−1<k}Zi)R_{ALG_{ptk}}(I) = \sum_i v_i\, \mathbb{E}(\mathbf 1\{N_{i-1} < k\} Z_i)RALGptk​​(I)=∑i​vi​E(1{Ni−1​<k}Zi​), where Zi=YiPiZ_i = Y_i P_iZi​=Yi​Pi​, the PiP_iPi​ are independent Bernoulli(pip_ipi​) indicators, and Ni−1N_{i-1}Ni−1​ counts the earlier applicants with Zℓ=1Z_\ell = 1Zℓ​=1.
  5. Lemma 4 (p. 18): with two fractional components, this quantity under DR is at least its value under independent rounding of yyy.
  6. LP identity (p. ec8): ∑i,jrjxij=∑iyivipi\sum_{i,j} r_j x_{ij} = \sum_i y_i v_i p_i∑i,j​rj​xij​=∑i​yi​vi​pi​.
  7. Proposition EC.1 (Yan 2011; p. ec2): the weighted rank function of a kkk-uniform matroid has correlation gap at most (1−e−kkk/k!)−1(1 - e^{-k}k^k/k!)^{-1}(1−e−kkk/k!)−1.
  8. Independent version (p. ec8): with independent rounding, the reward is at least (1−e−kkk/k!) LPptk(I)(1 - e^{-k}k^k/k!)\,\mathrm{LP}_{ptk}(I)(1−e−kkk/k!)LPptk​(I).

A companion milestone, Lemma 5 (p. 21), states that for weighted Bernoulli instances the LP has an optimal solution with xi=yiqix_i = y_i q_ixi​=yi​qi​. It does not feed Theorem 1.

Significance

Theorem 1, combined with the fact that LPptk\mathrm{LP}_{ptk}LPptk​ bounds every adaptive, non-committed policy (Lemma 1 of the paper), shows that a policy that is both non-adaptive and committed earns at least a fraction 1−e−kkk/k!1 - e^{-k}k^k/k!1−e−kkk/k! of the optimal adaptive, non-committed reward; the lost fraction e−kkk/k!e^{-k}k^k/k!e−kkk/k! vanishes as kkk grows. The factor is tight for this LP (App. B.6). The theorem also underlies a PTAS for ProbeTop-k (Corollary 1) and, through Lemma 5, the same guarantee for the Sequential Offering problem of Purohit et al. (Corollary 2).

The result is proved in the paper; to our knowledge nothing in it is machine-checked. A formalization would add to the platform:

  • an LP relaxation with basic feasible solutions as extreme points of a polytope;
  • an explicit model of a randomised, committed selection algorithm as a finite expectation;
  • the correlation gap of kkk-uniform weighted rank functions, a tool that recurs across prophet inequalities, posted pricing and stochastic probing.

Proposition EC.1 is a cited result (Yan 2011), not proved in the paper. Formalizing it is part of the work.

Difficulty

The obvious argument compares the algorithm with the LP term by term, Pr⁡(i hired)≥c yipi\Pr(i \text{ hired}) \ge c\, y_i p_iPr(i hired)≥cyi​pi​ for each iii. This fails because hiring is capped at kkk: applicants late in the order are hired only if few earlier ones were. The guarantee must be obtained in aggregate, which is what the correlation gap does.

Two steps carry the weight:

  • Proposition EC.1 is a genuine extremal inequality over all distributions on subsets with given marginals.
  • Lemma 4 must show that the negative correlation DR introduces between the two fractional applicants never hurts a committed, order-dependent selection. It is a case analysis over sample paths that uses the decreasing order of viv_ivi​.

Lemma 3 is a conditional-expectation identity, but in a fully explicit model it requires marginalising out the values and coins of all other applicants.

Formalization scope

Lean namespace HiringLP.ProbeTopK.

Representation.

  • Applicants are Fin n and support points Fin J. All quantities are real.
  • Instances are valid when 1≤k≤T≤n1 \le k \le T \le n1≤k≤T≤n, rj≥0r_j \ge 0rj​≥0, qij≥0q_{ij} \ge 0qij​≥0 and ∑jqij=1\sum_j q_{ij} = 1∑j​qij​=1.
  • Basic feasible solutions are Set.extremePoints ℝ of the feasible set in (x,y)(x, y)(x,y)-space. An optimal solution is feasible and objective-maximal among feasible points, and LPptk(I)\mathrm{LP}_{ptk}(I)LPptk​(I) is the objective at it.

Conventions.

  • pip_ipi​, viv_ivi​ and the hiring probability xij/(yiqij)x_{ij}/(y_i q_{ij})xij​/(yi​qij​) are 000 when their denominators vanish (the paper's footnote 2).
  • The interview order is a permutation required to be non-increasing in viv_ivi​, with ties in any order.
  • DR is an explicit formula for the probability of each interview set.

The expected reward. RALGptk(I)R_{ALG_{ptk}}(I)RALGptk​​(I) is a finite sum over the interview set, the value vector (independent, law qqq) and the vector of hiring coins (independent given the values). Applicant iii is hired exactly when it is interviewed, its coin succeeds, and fewer than kkk earlier interviewed applicants had successful coins. The reward collects the realised values rVir_{V_i}rVi​​.

Ruled out.

  • Defining the reward as ∑ivi E(1{Ni−1<k}Zi)\sum_i v_i\, \mathbb{E}(\mathbf 1\{N_{i-1} < k\} Z_i)∑i​vi​E(1{Ni−1​<k}Zi​). That is Lemma 3, which would make the goal a statement about its own proof.
  • Comparing with the objective at an arbitrary feasible point instead of an optimal one.

Infrastructure and contributions. The weighted rank function, independent rounding and marginals are separate, reusable definitions. Contributions are welcome on each milestone, especially Proposition EC.1. So is general infrastructure: extreme points of polytopes as basic solutions, and finite product distributions.

Selected references

  • B. Epstein, W. Ma, Selection and Ordering Policies for Hiring Pipelines via Linear Programming, Operations Research, 2024; preprint arXiv:2210.04059v3, 2023. https://arxiv.org/abs/2210.04059
  • Q. Yan, Mechanism design via correlation gap, Proceedings of the 22nd ACM-SIAM Symposium on Discrete Algorithms (SODA), 710–719, 2011. Proceedings volume: https://doi.org/10.1137/1.9781611973082
  • S. Agrawal, Y. Ding, A. Saberi, Y. Ye, Correlation robust stochastic optimization, Proceedings of the 21st ACM-SIAM Symposium on Discrete Algorithms (SODA), 1087–1096, 2010. Proceedings volume: https://doi.org/10.1137/1.9781611973075
  • R. Gandhi, S. Khuller, S. Parthasarathy, A. Srinivasan, Dependent rounding and its applications to approximation algorithms, Journal of the ACM 53(3):324–360, 2006. https://doi.org/10.1145/1147954.1147956
  • M. Purohit, S. Gollapudi, M. Raghavan, Hiring under uncertainty, Proceedings of the 36th International Conference on Machine Learning (PMLR 97), 5181–5189, 2019. https://proceedings.mlr.press/v97/purohit19a.html
13 thms1 active userReviewed
Quantum Information·Captain: mikedeng1

A Grand Unification of Quantum Algorithms: Phase Estimation by QSVT Errs by Less Than 2^{−n}, and Meets the Δ-Region Only at Iteration n − 1, When Δ < 2(cos(3π/16) − 1/√2)Research Paper

Motivation

Phase estimation asks: given access to a unitary UUU and an eigenvector ∣u⟩|u\rangle∣u⟩ with U∣u⟩=e2πiφ∣u⟩U|u\rangle = e^{2\pi i\varphi}|u\rangleU∣u⟩=e2πiφ∣u⟩, determine φ∈[0,1)\varphi \in [0,1)φ∈[0,1). It is the subroutine behind Shor's factoring algorithm, quantum chemistry energy estimation, and amplitude estimation, and is one of the standard sources of quantum speed-up.

Martyn, Rossi, Tan and Chuang, A Grand Unification of Quantum Algorithms (PRX Quantum 2, 040203, 2021), present search, phase estimation and Hamiltonian simulation as instances of one primitive, the quantum singular value transformation (QSVT) of Gilyén, Su, Low and Wiebe (arXiv:1806.01838, STOC 2019). Most of the paper's numbered results restate QSVT theory from earlier work. Its own proved content is Appendix B: the analysis of phase estimation by QSVT (Section V, Algorithm 3), a bit-by-bit binary search in the spirit of Kitaev's iterative phase estimation, where each bit is read by applying a sign function to a singular value. A closely related QSVT phase-estimation algorithm was found independently by Rall (arXiv:2103.09717).

This mission formalizes that analysis: the exact-arithmetic correctness of the bit search (Theorems 6 and 7), and its robustness when the sign function is only approximated (Theorem 8).

Setting

Fix a unitary UUU, an eigenvector ∣u⟩|u\rangle∣u⟩, and the phase 0≤φ<10 \le \varphi < 10≤φ<1. Write 0.φ[j+1:]=0.φj+1φj+2…0.\varphi_{[j+1:]} = 0.\varphi_{j+1}\varphi_{j+2}\ldots0.φ[j+1:]​=0.φj+1​φj+2​… for the fractional part of 2jφ2^j\varphi2jφ.

For j∈Nj \in \mathbb Nj∈N and θ∈R\theta \in \mathbb Rθ∈R, the matrix Aj(θ)=12(I+e−2πiθU2j)A_j(\theta) = \tfrac12(I + e^{-2\pi i\theta}U^{2^j})Aj​(θ)=21​(I+e−2πiθU2j) acts on ∣u⟩|u\rangle∣u⟩ with singular value

σj(θ)=∣cos⁡(π(2jφ−θ))∣=∣cos⁡(π(0.φ[j+1:]−θ))∣.(64–65)\sigma^j(\theta) = \bigl|\cos\bigl(\pi(2^j\varphi - \theta)\bigr)\bigr| = \bigl|\cos\bigl(\pi(0.\varphi_{[j+1:]} - \theta)\bigr)\bigr|. \tag{64–65}σj(θ)=​cos(π(2jφ−θ))​=​cos(π(0.φ[j+1:]​−θ))​.(64–65)

The procedure keeps a binary fraction θ\thetaθ, initially 000, and runs iterations j=n−1,n−2,…,0j = n-1, n-2, \ldots, 0j=n−1,n−2,…,0 for a positive integer nnn. Iteration jjj halves θ\thetaθ, evaluates the sign function Θ(1/2−x)\Theta(1/\sqrt2 - x)Θ(1/2​−x) at x=σj(θ)x = \sigma^j(\theta)x=σj(θ) through QSVT, measures one ancilla bit bjb_jbj​, and sets the first binary digit of θ\thetaθ to bjb_jbj​:

θj=12θj+1+12bj,θn=0.\theta_j = \tfrac12\theta_{j+1} + \tfrac12 b_j, \qquad \theta_n = 0.θj​=21​θj+1​+21​bj​,θn​=0.

An additional j=0j = 0j=0 iteration then sets the units digit b0′b_0'b0′​, and the output is θ=b0′+θ0\theta = b_0' + \theta_0θ=b0′​+θ0​.

The ideal measurement returns b=1b = 1b=1 when σ<1/2\sigma < 1/\sqrt2σ<1/2​ and b=0b = 0b=0 when σ>1/2\sigma > 1/\sqrt2σ>1/2​. In practice the sign function is replaced by a polynomial that is reliable only outside the Δ-region [12−Δ2,12+Δ2]\bigl[\tfrac1{\sqrt2} - \tfrac\Delta2, \tfrac1{\sqrt2} + \tfrac\Delta2\bigr][2​1​−2Δ​,2​1​+2Δ​]; inside it either bit may be returned.

Formalization targets

Goal: Theorem 8 (p. 17)

If

0≤Δ<2(cos⁡3π16−12)≈0.25,0 \le \Delta < 2\Bigl(\cos\frac{3\pi}{16} - \frac1{\sqrt2}\Bigr) \approx 0.25,0≤Δ<2(cos163π​−2​1​)≈0.25,

then in every run of the procedure, the singular value σj\sigma^jσj can fall in the Δ-region only at the first iteration j=n−1j = n-1j=n−1, and the output satisfies

∣θ−φ∣<2−n.|\theta - \varphi| < 2^{-n}.∣θ−φ∣<2−n.

Milestones

  • (64)–(65), p. 15: the singular value and singular vectors of Aj(θ)A_j(\theta)Aj​(θ) on ∣u⟩|u\rangle∣u⟩.
  • Lemma 11 and Theorem 6 (pp. 27, 16): for an nnn-bit φ\varphiφ and the exact sign function, θj=0.φ[j+1:]\theta_j = 0.\varphi_{[j+1:]}θj​=0.φ[j+1:]​, so the loop ends with θ=φ\theta = \varphiθ=φ.
  • Lemma 12 and Theorem 7 (pp. 28, 16): otherwise θj\theta_jθj​ is an (n−j)(n-j)(n−j)-digit rounding of 0.φ[j+1:]0.\varphi_{[j+1:]}0.φ[j+1:]​ up to a carry, with error ≤2j−n−1\le 2^{j-n-1}≤2j−n−1, and the output satisfies ∣θ−φ∣≤2−n−1|\theta - \varphi| \le 2^{-n-1}∣θ−φ∣≤2−n−1.
  • (B14), p. 30: membership of ∣cos⁡(πx)∣|\cos(\pi x)|∣cos(πx)∣ in the Δ-region in terms of two arccos intervals for π∣x∣\pi|x|π∣x∣.
  • (B15), (B16) ⟺ (B21), pp. 30–31: the arccos condition is equivalent to the explicit threshold on Δ\DeltaΔ.
  • Lemma 13, p. 30, and its base step (B17)–(B20), pp. 30–31: the Δ-region can only be met at iteration n−1n-1n−1, and an error there does not propagate.

A companion item states (68): the 2N×2N2N \times 2N2N×2N matrix Wj(θ)W_j(\theta)Wj​(θ) of Figure 10 is unitary and block-encodes Aj(θ)A_j(\theta)Aj​(θ).

Significance

Theorem 8 is what makes phase estimation by QSVT implementable: a sign function cannot be realized exactly by a polynomial, and the theorem shows that a polynomial approximation which fails on a band of width about 0.250.250.25 around 1/21/\sqrt21/2​ costs at most one bit of accuracy, and only at one iteration. Combined with the per-iteration failure probability analysis (71)–(72), it yields the paper's claim that O(nlog⁡(n/δ))O(n\log(n/\delta))O(nlog(n/δ)) queries give an nnn-bit estimate with probability 1−δ1-\delta1−δ.

On the formal side, the paper proves these results in Appendix B by case analysis on binary digits with carries. No machine-checked version of the analysis exists on the platform, and no QSVT-based phase-estimation result has been formalized elsewhere to the curators' knowledge. The mission separates the deterministic correctness of the bit search from the quantum machinery, so the combinatorial core can be checked independently of QSVT itself.

Difficulty

The obvious argument tracks the digits of φ\varphiφ one at a time, and it works for an nnn-bit phase. It fails when φ\varphiφ has more than nnn digits: the sign function rounds rather than truncates, so a bit can be set to 111 when the true digit is 000, carries propagate, and the invariant must be a rounding statement with a carry bit r~j\tilde r_jr~j​ (Lemma 12's nine-case induction). The final bit can carry into the units place, which is why the additional j=0j = 0j=0 iteration exists.

For Theorem 8, the natural first idea, that a bit error makes all later bits unreliable, is false; the content is that after an error at j=n−1j = n-1j=n−1 the distance ∣0.φ[j+1:]−θ∣|0.\varphi_{[j+1:]} - \theta|∣0.φ[j+1:]​−θ∣ stays a fixed amount away from the Δ-region at every later iteration. Turning this into the threshold requires precise bounds on arccos⁡\arccosarccos near 1/21/\sqrt21/2​.

Formalization scope

Everything is stated in Lean 4 with Mathlib, over R\mathbb RR, in the namespace QSVTPhaseEst.BitSearch. The conventions:

  • 0≤φ<10 \le \varphi < 10≤φ<1, n≥1n \ge 1n≥1, Δ≥0\Delta \ge 0Δ≥0 in every item; bits are Bool; 0.φ[j+1:]0.\varphi_{[j+1:]}0.φ[j+1:]​ is Int.fract (2^j * φ).
  • "φ\varphiφ is an nnn-bit number" (n≥mn \ge mn≥m) is φ=k/2n\varphi = k/2^nφ=k/2n for some k∈Nk \in \mathbb Nk∈N; "n<mn < mn<m, including m=∞m = \inftym=∞" is its negation.
  • The outcome rule is the only place the measurement enters: below the Δ-region the bit is 111, above it the bit is 000, inside it (including ties at Δ=0\Delta = 0Δ=0) either bit may occur. Every theorem quantifies over all bit sequences satisfying this rule. The exact sign function of Theorems 6 and 7 is the rule with Δ=0\Delta = 0Δ=0.
  • The additional j=0j = 0j=0 iteration is encoded as Appendix B 1 b (p. 29) analyses it: the general step applied to 0.φ0φ1…=φ/20.\varphi_0\varphi_1\ldots = \varphi/20.φ0​φ1​…=φ/2 with θ\thetaθ halved, singular value ∣cos⁡(π(φ−θ0)/2)∣|\cos(\pi(\varphi - \theta_0)/2)|∣cos(π(φ−θ0​)/2)∣. The literal reading of Algorithm 3, line 9 makes Theorem 7 false on the paper's own example φ=0.11101012\varphi = 0.1110101_2φ=0.11101012​, n=2n = 2n=2.
  • Theorem 8's bound is stated for every run, as Algorithm 3's Output claims; runs with an error at iteration n−1n-1n−1 are the printed case, runs without one are covered by Theorems 6 and 7. Its first part also covers the additional iteration.
  • (B14) assumes Δ≤2−2\Delta \le 2 - \sqrt2Δ≤2−2​ and ∣x∣≤1|x| \le 1∣x∣≤1, which keep the arccos arguments in [−1,1][-1,1][−1,1].

A formalization in which the outcome rule mentions φ\varphiφ, its digits or its rounding, in which σj\sigma^jσj is written through the digits of φ\varphiφ, or in which the output is defined as a rounding of φ\varphiφ, would make the theorems circular; none of these is used.

Not formalized: QSP and QSVT themselves (Theorems 1–4, 9, 10; Theorem 1 is already an open goal on the platform), the polynomial Pϵ,ΔPEP^{\mathrm{PE}}_{\epsilon,\Delta}Pϵ,ΔPE​ of (69), the ϵ\epsilonϵ-error probability analysis (71)–(72), and the runtime. Contributions of reusable lemmas on binary roundings (Int.fract of 2jφ2^j\varphi2jφ, nearest dyadic rounding with carry) and on arccos⁡\arccosarccos near 1/21/\sqrt21/2​ are welcome.

Selected references

  • J. M. Martyn, Z. M. Rossi, A. K. Tan, I. L. Chuang, A Grand Unification of Quantum Algorithms, PRX Quantum 2, 040203, 2021. https://arxiv.org/abs/2105.02859 (v5 is the version formalized)
  • A. Gilyén, Y. Su, G. H. Low, N. Wiebe, Quantum singular value transformation and beyond: exponential improvements for quantum matrix arithmetics, STOC 2019. https://arxiv.org/abs/1806.01838
  • P. Rall, Faster coherent quantum algorithms for phase, energy, and amplitude estimation, Quantum 5, 566, 2021. https://arxiv.org/abs/2103.09717
  • A. Yu. Kitaev, Quantum measurements and the Abelian Stabilizer Problem, 1995. https://arxiv.org/abs/quant-ph/9511026
11 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes III: Bipartite, Unit-Patience Side: Rounding Then Probing by Weight Earns ≥ (1 − 1/e)·Σ w_e p_e y_eResearch Paper

Motivation

Stochastic matching with patience models kidney exchange, online dating and labour platforms: every edge of a graph is present only with some probability, the only way to learn whether it is present is to probe it, and a probed edge that turns out to be present must be added to the matching. Each vertex vvv also has a patience tvt_vtv​, a limit on how many of its edges may be probed. The goal is a probing strategy whose expected matched weight is a large fraction of what the best adaptive strategy obtains. Since the best strategy is hard to compute, algorithms are compared with the value of a linear program (LP (3) below), which upper-bounds every probing strategy (Bansal, Gupta, Li, Mestre, Nagarajan, Rudra, Algorithmica 2012).

Bansal et al. gave a 1/31/31/3-approximation for stochastic bipartite matching. Brubach, Grammel, Ma, MacRury and Srinivasan (Mathematics of Operations Research, 2025; arXiv:2106.06892v3) single out the case in which one side of the bipartition has unit patience, tu=1t_u=1tu​=1 for every u∈V1u\in V_1u∈V1​. This case contains "Problem A" of Hikima et al. (AAAI 2021), whose approximation ratio transfers to their integrated two-stage problem ISPCB; Hikima et al. obtained 1/31/31/3 from the bound of Bansal et al. For the special case in which one side has arbitrary patience and the other unlimited patience, Borodin and MacRury had already obtained the same (1−1/e)(1-1/e)(1−1/e) guarantee through an online problem.

Setting

Let G=(V1∪V2,E)G=(V_1\cup V_2,E)G=(V1​∪V2​,E) be a finite bipartite graph; δ(x)\delta(x)δ(x) denotes the set of edges at a vertex xxx. Each edge eee has a weight we≥0w_e\ge 0we​≥0 and an activation probability pe∈[0,1]p_e\in[0,1]pe​∈[0,1], independently across edges. Every u∈V1u\in V_1u∈V1​ has patience 111; every v∈V2v\in V_2v∈V2​ has a patience tv∈N∪{∞}t_v\in\mathbb N\cup\{\infty\}tv​∈N∪{∞}.

LP (3). A vector (ye)e∈E(y_e)_{e\in E}(ye​)e∈E​ is feasible when 0≤ye≤10\le y_e\le 10≤ye​≤1 and, for every vertex xxx,

∑e∈δ(x)yepe≤1,∑e∈δ(x)ye≤tx.\sum_{e\in\delta(x)}y_ep_e\le 1,\qquad \sum_{e\in\delta(x)}y_e\le t_x .e∈δ(x)∑​ye​pe​≤1,e∈δ(x)∑​ye​≤tx​.

Write ze=yepez_e=y_ep_eze​=ye​pe​ and OPT(v)=∑e∈δ(v)weze\mathsf{OPT}(v)=\sum_{e\in\delta(v)}w_ez_eOPT(v)=∑e∈δ(v)​we​ze​.

The algorithm. A dependent rounding (Gandhi, Khuller, Parthasarathy, Srinivasan, J. ACM 2006) turns yyy into a random set E^={e:Ye=1}\hat E=\{e:Y_e=1\}E^={e:Ye​=1} of rounded edges with Pr⁡[Ye=1]=ye\Pr[Y_e=1]=y_ePr[Ye​=1]=ye​, at most one rounded edge at each u∈V1u\in V_1u∈V1​, at most tvt_vtv​ at each v∈V2v\in V_2v∈V2​, and the negative correlation property (2): for v∈V2v\in V_2v∈V2​, S⊆δ(v)S\subseteq\delta(v)S⊆δ(v) and b∈{0,1}b\in\{0,1\}b∈{0,1},

Pr⁡[⋂e∈S(Ye=b)]≤∏e∈SPr⁡[Ye=b].\Pr\Big[\bigcap_{e\in S}(Y_e=b)\Big]\le\prod_{e\in S}\Pr[Y_e=b].Pr[e∈S⋂​(Ye​=b)]≤e∈S∏​Pr[Ye​=b].

In the rounded graph every v∈V2v\in V_2v∈V2​ is the centre of a star. Each vvv probes its rounded edges in decreasing order of weight and is matched to the first active one; W(v)W(v)W(v) is the weight of that edge (000 if none), and E[ALG]=E[∑v∈V2W(v)]\mathbb E[\mathsf{ALG}]=\mathbb E[\sum_{v\in V_2}W(v)]E[ALG]=E[∑v∈V2​​W(v)].

Formalization targets

Goal: Theorem 2 (p. 18)

For every feasible yyy, every rounding with the properties above and every decreasing-weight probing order,

E[ALG] ≥ (1−1e)∑v∈V2∑e∈δ(v)wepeye.\mathbb E[\mathsf{ALG}]\ \ge\ \Big(1-\frac1e\Big)\sum_{v\in V_2}\sum_{e\in\delta(v)}w_ep_ey_e .E[ALG] ≥ (1−e1​)v∈V2​∑​e∈δ(v)∑​we​pe​ye​.

Milestones

  1. The proof of Lemma 7 (p. 17) expresses W(v)W(v)W(v) as E[∑iwiYiPi∏j<i(1−YjPj)]\mathbb E[\sum_i w_iY_iP_i\prod_{j<i}(1-Y_jP_j)]E[∑i​wi​Yi​Pi​∏j<i​(1−Yj​Pj​)] and bounds E[∏j≤i(1−YjPj)]≤∏j≤i(1−yjpj)\mathbb E[\prod_{j\le i}(1-Y_jP_j)]\le\prod_{j\le i}(1-y_jp_j)E[∏j≤i​(1−Yj​Pj​)]≤∏j≤i​(1−yj​pj​) using (2).
  2. Lemma 7 (p. 16): E[W(v)]≥∑i=1kwizi∏j=1i−1(1−zj)\mathbb E[W(v)]\ge\sum_{i=1}^k w_iz_i\prod_{j=1}^{i-1}(1-z_j)E[W(v)]≥∑i=1k​wi​zi​∏j=1i−1​(1−zj​) for the edges of δ(v)\delta(v)δ(v) labelled by decreasing weight.
  3. Eq. (29) (p. 18): the bound F(i)≥1−e−F∗(i)≥(1−1/e)F∗(i)F(i)\ge1-e^{-F^*(i)}\ge(1-1/e)F^*(i)F(i)≥1−e−F∗(i)≥(1−1/e)F∗(i). The summation-by-parts identity (27) on the same page is included as a supporting lemma.
  4. Lemma 8 (p. 17): ∑iwizi∏j<i(1−zj)≥(1−1/e)∑iwizi\sum_i w_iz_i\prod_{j<i}(1-z_j)\ge(1-1/e)\sum_iw_iz_i∑i​wi​zi​∏j<i​(1−zj​)≥(1−1/e)∑i​wi​zi​ when zi∈[0,1]z_i\in[0,1]zi​∈[0,1], ∑izi≤1\sum_iz_i\le1∑i​zi​≤1 and w1≥⋯≥wk≥0w_1\ge\cdots\ge w_k\ge0w1​≥⋯≥wk​≥0.
  5. Lemma 9 (p. 18): E[W(v)]≥(1−1/e) OPT(v)\mathbb E[W(v)]\ge(1-1/e)\,\mathsf{OPT}(v)E[W(v)]≥(1−1/e)OPT(v) for every v∈V2v\in V_2v∈V2​.

The paper's proofs are in §4, pp. 16–19.

Significance

Combined with the LP upper bound (Lemma 1 of the paper, from Bansal et al.), Theorem 2 is a (1−1/e)(1-1/e)(1−1/e)-approximation for stochastic matching on bipartite graphs with a unit-patience side, improving and generalizing the 1/31/31/3 guarantee of Hikima et al. for Problem A and, through their reduction, for ISPCB. By the paper's account (§1.1, p. 4), the guarantee rests on a new ingredient, a (1−1/e)(1-1/e)(1−1/e)-balanced ordered contention resolution scheme for rank-1 matroids under negative correlation, in which the algorithm chooses the order: the per-star bound of Lemmas 7 and 9 holds for every rounding satisfying (2), not only for independent activations.

The result is proved in the paper; none of it has been machine-checked. This mission formalizes the per-star analysis and the theorem for an abstract rounding described by its properties, which is reusable for any algorithm that probes stars after a negatively correlated rounding.

Difficulty

If the rounded indicators YeY_eYe​ at a vertex were independent, Lemma 7 would be an equality and the remaining work would be the deterministic inequality of Lemma 8. They are not: the rounding is dependent, and Example 1 (p. 19) shows that this dependence can raise the probability that a particular edge is blocked to 1/21/21/2, so that no correlation-agnostic contention resolution scheme is better than 1/21/21/2-balanced. A per-edge guarantee, of the kind a contention resolution scheme that ignores correlation provides, is therefore unavailable: the bound of Theorem 2 holds only for the total weight collected at each vvv, and the negative correlation property (2) is one-sided, so it can be used only in the direction in which it holds.

Formalization scope

  • All randomness is finite. The rounding is a probability vector μ\muμ on subsets of EEE; the activeness pattern P:E→{0,1}P:E\to\{0,1\}P:E→{0,1} is independent with product weights. Every expectation is an explicit finite sum.
  • The rounding of Gandhi et al. is represented by its properties: μ≥0\mu\ge0μ≥0, ∑μ=1\sum\mu=1∑μ=1, the marginals Pr⁡[Ye=1]=ye\Pr[Y_e=1]=y_ePr[Ye​=1]=ye​, at most one rounded edge at each u∈V1u\in V_1u∈V1​, at most tvt_vtv​ at each v∈V2v\in V_2v∈V2​, and (2) on the rounded indicators for every v∈V2v\in V_2v∈V2​, S⊆δ(v)S\subseteq\delta(v)S⊆δ(v), b∈{0,1}b\in\{0,1\}b∈{0,1}. The goal holds for every such μ\muμ, so it covers the paper's rounding; formalizing the rounding procedure itself is a separate project.
  • W(v)W(v)W(v) is defined from the run (the first active edge in vvv's probe list), not by the formula of Lemma 7; the identity between the two is a milestone.
  • Standing assumptions, disclosed: we≥0w_e\ge0we​≥0 (with a negative weight the bound fails), pe∈[0,1]p_e\in[0,1]pe​∈[0,1], patience ∞\infty∞ is allowed on V2V_2V2​, and parallel edges are allowed. The goal is stated for every feasible yyy, a stronger statement than the paper's "optimal" yyy, since the proof never uses optimality. The phrase "yielding a (1−1/e)(1-1/e)(1−1/e)-approximation" is not formalized: it needs Lemma 1 of Bansal et al.
  • Ruled out: defining W(v)W(v)W(v) as ∑iwiYiPi∏j<i(1−YjPj)\sum_iw_iY_iP_i\prod_{j<i}(1-Y_jP_j)∑i​wi​Yi​Pi​∏j<i​(1−Yj​Pj​), as the best active edge regardless of the rounding, or stating the goal for one specific (independent) rounding or "for some rounding" would each be a different, weaker theorem.
  • Useful infrastructure: finite expectations over product measures, a negative-correlation inequality for products, Abel summation (Finset.sum_range_by_parts), and 1−x≤e−x1-x\le e^{-x}1−x≤e−x. Proofs of any milestone, and of the theorem from the milestones, are welcome.

Selected references

  • B. Brubach, N. Grammel, W. Ma, C. MacRury, A. Srinivasan, Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes, Mathematics of Operations Research, 2025. arXiv:2106.06892v3. https://arxiv.org/abs/2106.06892
  • R. Gandhi, S. Khuller, S. Parthasarathy, A. Srinivasan, Dependent rounding and its applications to approximation algorithms, Journal of the ACM 53(3):324–360, 2006. https://doi.org/10.1145/1147954.1147956
  • N. Bansal, A. Gupta, J. Li, J. Mestre, V. Nagarajan, A. Rudra, When LP is the cure for your matching woes: improved bounds for stochastic matchings, Algorithmica 63(4):733–762, 2012. https://doi.org/10.1007/s00453-011-9511-8
  • Y. Hikima, Y. Akagi, H. Kim, M. Kohjima, T. Kurashima, H. Toda, Integrated optimization of bipartite matching and its stochastic behavior: new formulation and approximation algorithm via min-cost flow optimization, The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI 2021) (reference [28] of the paper; no link).
  • A. Borodin, C. MacRury, Online bipartite matching in the probe-commit model, Mathematical Programming, 2025, pp. 1–54 (reference [9] of the paper; no link).
10 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes I: With Patience at Least 2, Attenuated Random-Order Probing Gives Every Edge a(e)·Pr[e Is Free] ≥ β*Research Paper

Motivation

In offline stochastic matching a graph is given in which every edge is present only with some known probability, and the only way to find out is to probe it: a probed edge that turns out to be present must be added to the matching at once. Each vertex may also limit how many of its edges are probed (its patience). The model captures applications in which a proposed match may be refused and an accepted one is binding: organ (kidney) exchange, online dating, advertising, crowdsourcing and ride sharing are the examples the paper lists (pp. 1–2), following Chen, Immorlica, Karlin, Mahdian and Rudra (ICALP 2009) and Bansal, Gupta, Li, Mestre, Nagarajan and Rudra (Algorithmica 2012).

Finding the best probing strategy is computationally hard, so algorithms are compared with a linear-programming relaxation that upper-bounds every strategy (Lemma 1, from Bansal et al.).

Timeline (general graphs with patience, as recorded on p. 2 of the paper).

  • 2012: Bansal et al., a 0.250.250.25-approximation.
  • 2015: Adamczyk, Grandoni and Mukherjee, 0.2690.2690.269.
  • 2018: Baveja, Chavan, Nikiforov, Srinivasan and Xu, 0.310.310.31.
  • 2021–2026: Brubach, Grammel, Ma, MacRury and Srinivasan (arXiv:2106.06892v3; Mathematics of Operations Research, 2025), 0.3820.3820.382 when every patience is at least 222. Their algorithm processes the edges in random order and attenuates each probe with an extra coin flip. Version 3 restricts the result to patience at least 222; earlier versions claimed it for all patience values, and Remark 1 shows why patience 111 fails.
  • Since then Pollner et al. have obtained 0.3950.3950.395 for general graphs (reference [35] of the paper).

This mission formalizes the per-edge bound behind the 0.3820.3820.382 result, Theorem 1 of the paper.

Setting

A finite graph G=(V,E)G = (V, E)G=(V,E) is given. Each edge eee is active independently with probability pe∈[0,1]p_e \in [0,1]pe​∈[0,1], and each vertex vvv has a patience tv∈{1,2,… }∪{∞}t_v \in \{1, 2, \dots\} \cup \{\infty\}tv​∈{1,2,…}∪{∞}, the largest number of probes that may be made to edges incident to vvv. Write δ(v)\delta(v)δ(v) for the edges incident to vvv.

LP (3). A vector (ye)e∈E(y_e)_{e \in E}(ye​)e∈E​ is feasible if

0≤ye≤1,∑e∈δ(v)yepe≤1,∑e∈δ(v)ye≤tv(e∈E, v∈V).0 \le y_e \le 1, \qquad \sum_{e \in \delta(v)} y_e p_e \le 1, \qquad \sum_{e \in \delta(v)} y_e \le t_v \quad (e \in E,\ v \in V).0≤ye​≤1,e∈δ(v)∑​ye​pe​≤1,e∈δ(v)∑​ye​≤tv​(e∈E, v∈V).

Here yey_eye​ is the probability of probing eee.

Attenuation. An attenuation function a~:[0,1]→[0,1]\tilde a : [0,1] \to [0,1]a~:[0,1]→[0,1] assigns to edge eee the probability a(e)=a~(peye)a(e) = \tilde a(p_e y_e)a(e)=a~(pe​ye​). It is effective (Definition 3) if a~(0)=1\tilde a(0) = 1a~(0)=1 and z↦ln⁡(1−xza~(z))z \mapsto \ln(1 - x z \tilde a(z))z↦ln(1−xza~(z)) is convex on [0,1][0,1][0,1] for every x∈(0,1)x \in (0,1)x∈(0,1). The two functions used here are a~exp⁡(z)=e−z/2\tilde a_{\exp}(z) = e^{-z/2}a~exp​(z)=e−z/2 and a~lin(z)=1−z/2\tilde a_{\mathrm{lin}}(z) = 1 - z/2a~lin​(z)=1−z/2 (Definition 4 with α=1/2\alpha = 1/2α=1/2).

Algorithm 1. Draw independent coins Ye∼Bernoulli(ye)Y_e \sim \mathrm{Bernoulli}(y_e)Ye​∼Bernoulli(ye​) and Ae∼Bernoulli(a(e))A_e \sim \mathrm{Bernoulli}(a(e))Ae​∼Bernoulli(a(e)) for every edge, and process the edges in a uniformly random order. When eee is processed it is free if both endpoints are unmatched and have made fewer than their patience in probes. If eee is free and Ye=Ae=1Y_e = A_e = 1Ye​=Ae​=1, probe eee; if it is active (coin Pe∼Bernoulli(pe)P_e \sim \mathrm{Bernoulli}(p_e)Pe​∼Bernoulli(pe​)), match it and both endpoints. Finally

β∗=∫01(e−2x+xe−2x)2 dx≈0.38278.\beta^* = \int_0^1 \bigl(e^{-2x} + x e^{-2x}\bigr)^2\,dx \approx 0.38278.β∗=∫01​(e−2x+xe−2x)2dx≈0.38278.

Formalization targets

Goal: Theorem 1 (p. 9)

If every vertex has patience at least 222, yyy is feasible for LP (3), and a~\tilde aa~ is a~exp⁡\tilde a_{\exp}a~exp​ or a~lin\tilde a_{\mathrm{lin}}a~lin​, then for every edge eee

a(e)⋅Pr⁡[e is free]  ≥  β∗.a(e) \cdot \Pr[e \text{ is free}] \;\ge\; \beta^*.a(e)⋅Pr[e is free]≥β∗.

The probability is over the random order and the coins of Algorithm 1.

Milestones

The milestones are numbered results and displays of the paper, in the order its argument uses them:

  1. a~exp⁡\tilde a_{\exp}a~exp​ and a~lin\tilde a_{\mathrm{lin}}a~lin​ with α=1/2\alpha = 1/2α=1/2 are effective (Definition 4, p. 9).
  2. (7), p. 10: a safe edge (one whose neighbourhood has neither a successful probe nor an exhausted patience before it arrives) is free, so a(e)Pr⁡[e is free]≥a~(peye)Pr⁡[e is safe]a(e)\Pr[e \text{ is free}] \ge \tilde a(p_e y_e)\Pr[e \text{ is safe}]a(e)Pr[e is free]≥a~(pe​ye​)Pr[e is safe].
  3. Lemma 3, p. 11: ∏f∈E1(r)(1−x a(f)yf)≥e−x∑f∈E1(r)yf\prod_{f \in E_1(r)} (1 - x\,a(f) y_f) \ge e^{-x \sum_{f \in E_1(r)} y_f}∏f∈E1​(r)​(1−xa(f)yf​)≥e−x∑f∈E1​(r)​yf​ for an effective attenuation, where E1(r)E_1(r)E1​(r) is the set of edges at rrr other than eee with pf=1p_f = 1pf​=1.
  4. Lemma 4, p. 12 (Baveja et al.): Pr⁡[∑iBi<t]≥Pr⁡[Pois(μ)<t]\Pr[\sum_i B_i < t] \ge \Pr[\mathrm{Pois}(\mu) < t]Pr[∑i​Bi​<t]≥Pr[Pois(μ)<t] for independent Bernoullis with mean sum μ<t−1\mu < t - 1μ<t−1.
  5. Lemma 5, p. 12: the Chernoff bound Pr⁡[∑iBi<(1+ε)μ]≥1−e−ε2μ/(2+ε)\Pr[\sum_i B_i < (1+\varepsilon)\mu] \ge 1 - e^{-\varepsilon^2 \mu/(2+\varepsilon)}Pr[∑i​Bi​<(1+ε)μ]≥1−e−ε2μ/(2+ε).
  6. Proposition 1, p. 14: ∫01λφ≥λ(z∗)∫01φ\int_0^1 \lambda\varphi \ge \lambda(z^*)\int_0^1 \varphi∫01​λφ≥λ(z∗)∫01​φ for λ≥0\lambda \ge 0λ≥0 non-increasing and φ\varphiφ changing sign once, from +++ to −-−, at z∗z^*z∗.
  7. (22), p. 15: a~(ye)∫01(e−x(2−ye)+xe−x(2−ye))2 dx≥β∗\tilde a(y_e)\int_0^1 (e^{-x(2-y_e)} + x e^{-x(2-y_e)})^2\,dx \ge \beta^*a~(ye​)∫01​(e−x(2−ye​)+xe−x(2−ye​))2dx≥β∗ on [0,1][0,1][0,1], with equality at ye=0y_e = 0ye​=0.

Significance

The result. Equation (4) of the paper writes the expected weight of the algorithm's matching as ∑ewepeye a(e)Pr⁡[e is free]\sum_e w_e p_e y_e\, a(e)\Pr[e \text{ is free}]∑e​we​pe​ye​a(e)Pr[e is free]. Theorem 1 therefore gives at least β∗∑ewepeye\beta^* \sum_e w_e p_e y_eβ∗∑e​we​pe​ye​, and with an optimal LP solution and the LP upper bound of Bansal et al. this is a 0.3820.3820.382-approximation for stochastic matching on general graphs with patience at least 222. The bound is per edge, which is the form a random-order contention resolution scheme needs: the same algorithm rounds fractional matchings edge by edge.

Formalizing it. The paper's proof combines a reduction (Lemma 2), the analytic bound of Lemma 3, the tail bounds of Lemmas 4–5, an exchange argument (Lemma 6) resting on a graph construction from another paper, and a case analysis in the patience values that is closed by numerical minimization of explicit integrals over two or three parameters ("we numerically minimize (12)", p. 13; "we numerically verify", p. 15). The margins are thin: the bound 0.38280.38280.3828 in the last case exceeds β∗\beta^*β∗ by about 5⋅10−55 \cdot 10^{-5}5⋅10−5. No part of this argument has a machine-checked proof. A formal proof would certify both the probabilistic reasoning and every numerical step, and would supply a reusable finite model of random-order probing algorithms with patience, of which the platform has none.

Difficulty

The obvious argument bounds Pr⁡[e is free]\Pr[e \text{ is free}]Pr[e is free] by a product over the two endpoints of eee and applies a Poisson approximation to the number of probes at each endpoint. For an endpoint of patience 222 that approximation is only valid for arrival times x<xcx < x_cx<xc​, a threshold that can be 1/21/21/2, and the bound it gives, about 0.3470.3470.347 (display (16)), falls below β∗\beta^*β∗. Closing that case is what requires the exchange argument of Lemma 6. Beyond it, the remaining cases are optimization problems over the LP mass at each endpoint, which the paper settles by computer and a formal proof must settle by rigorous bounds.

Formalization scope

  • The graph is the platform's EdmondsMatching65.Polyhedron.Graph (loopless); the goal adds that the endpoint map is injective, since the paper's edges are pairs {u,v}\{u,v\}{u,v}. Patience is ℕ∞, with ∞\infty∞ allowed; "minimum patience 222" is tv≥2t_v \ge 2tv​≥2 at every vertex.
  • Standing assumptions: pe∈[0,1]p_e \in [0,1]pe​∈[0,1] for every edge; yyy feasible for LP (3) (which includes ye∈[0,1]y_e \in [0,1]ye​∈[0,1]).
  • Every probability is a finite average: over the ∣E∣!|E|!∣E∣! orders of the edges and over the 23∣E∣2^{3|E|}23∣E∣ outcomes of the coins Y,A,PY, A, PY,A,P, each weighted by a product of Bernoulli weights. The paper's continuous arrival times induce exactly this uniform order. Pr⁡[e is free]\Pr[e \text{ is free}]Pr[e is free] is computed from the run of Algorithm 1 (matched vertices and probe counters, step by step), never from the product formulas of p. 11, which would assume the lemmas being proved.
  • The goal is stated for a~exp⁡\tilde a_{\exp}a~exp​ and a~lin\tilde a_{\mathrm{lin}}a~lin​ with α=1/2\alpha = 1/2α=1/2. Theorem 1 cites "Definition 3 where α=1/2\alpha = 1/2α=1/2"; α\alphaα belongs to Definition 4, and an arbitrary effective function would make the statement false. The third function of Definition 4 is not effective (its ln⁡(1−xza~(z))\ln(1 - xz\tilde a(z))ln(1−xza~(z)) is concave near z=0z = 0z=0 for xxx close to 111), so neither the effectiveness milestone nor the goal covers it.
  • Lemma 4 prints e−xμe^{-x\mu}e−xμ in the Poisson sum; the statement uses e−μe^{-\mu}e−μ.
  • A formalization that defines "free" without the patience counters or the matched set, one that bounds Pr⁡[e is safe]\Pr[e \text{ is safe}]Pr[e is safe] or the integral (8) instead of a(e)Pr⁡[e is free]a(e)\Pr[e \text{ is free}]a(e)Pr[e is free], or one stated for "some" attenuation function, is a different theorem and does not count.
  • Not stated: Lemma 2 (a without-loss-of-generality reduction), Lemma 6 (its hypothesis is a graph built in another paper, with property (18) asserted there), the conditional bounds (8)–(17) and (23)–(25), whose objects live inside the proof, and the numerical values of pp. 13–15. Solvers who need them are welcome to state them as their own lemmas. The paper's proofs are in §3.2, pp. 9–15.
  • Reusable beyond this mission: the finite model of Algorithm 1 and its events, Lemma 4 (Bernoulli versus Poisson lower tails), Lemma 5 (a Chernoff bound for independent Bernoullis), and Proposition 1.

Selected references

  • B. Brubach, N. Grammel, W. Ma, C. MacRury, A. Srinivasan, Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes, Mathematics of Operations Research, 2025; arXiv:2106.06892v3 (20 Apr 2026). https://arxiv.org/abs/2106.06892v3
  • N. Bansal, A. Gupta, J. Li, J. Mestre, V. Nagarajan, A. Rudra, When LP is the cure for your matching woes: improved bounds for stochastic matchings, Algorithmica 63(4):733–762, 2012 (reference [7] of the paper).
  • A. Baveja, A. Chavan, A. Nikiforov, A. Srinivasan, P. Xu, Improved bounds in stochastic matching and optimization, Algorithmica 80(11):3225–3252, 2018 (reference [8]; source of Lemma 4).
  • M. Adamczyk, F. Grandoni, J. Mukherjee, Improved approximation algorithms for stochastic matching, ESA 2015, 1–12 (reference [1]).
  • N. Chen, N. Immorlica, A. R. Karlin, M. Mahdian, A. Rudra, Approximating matches made in heaven, ICALP 2009, 266–278 (reference [15]).
10 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes II: With Infinite Patience, Attenuated Random-Order Probing Probes Each Edge w.p. ≥ (1 − e^(−2))y_e/2Research Paper

Motivation

In stochastic matching a platform knows, for every potential pair, the probability that the pair would succeed, but learns whether it does only by trying it, and a successful trial is binding. Kidney exchange, online dating and labour markets are the standard examples: a crossmatch test, a date or an interview is a probe whose outcome is random, and a positive outcome commits both sides. Each participant also tolerates only a limited number of attempts, its patience. The algorithmic question, studied since Chen, Immorlica, Karlin, Mahdian and Rudra (ICALP 2009), is how much of the optimal adaptive strategy's expected weight a simple, non-adaptive rule can secure.

The modern approach solves a linear programming relaxation and rounds its fractional solution online, through a contention resolution scheme: edges are examined one at a time, and an edge is used only when it does not conflict with earlier decisions. Bansal, Gupta, Li, Mestre, Nagarajan and Rudra (Algorithmica 2012) introduced the relaxation (LP (3) below) and showed that it bounds every adaptive probing algorithm. Baveja, Chavan, Nikiforov, Srinivasan and Xu (Algorithmica 2018) analysed processing edges in a uniformly random order. Brubach, Grammel, Ma, MacRury and Srinivasan (Mathematics of Operations Research, 2025; arXiv:2106.06892) add attenuation: an independent coin that sometimes skips an edge on purpose, so that edges likely to block others are probed less often. This mission formalizes their guarantee when patience is unlimited.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite graph. Each edge eee is active independently with known probability pe∈[0,1]p_e\in[0,1]pe​∈[0,1], and each vertex vvv has a patience tv∈N∪{∞}t_v\in\mathbb N\cup\{\infty\}tv​∈N∪{∞}, the maximal number of edges at vvv that may be probed. Write δ(v)\delta(v)δ(v) for the edges incident to vvv. A vector (ye)e∈E(y_e)_{e\in E}(ye​)e∈E​ is feasible for LP (3) when

0≤ye≤1,∑e∈δ(v)yepe≤1,∑e∈δ(v)ye≤tv(e∈E, v∈V);0\le y_e\le 1,\qquad \sum_{e\in\delta(v)}y_ep_e\le 1,\qquad \sum_{e\in\delta(v)}y_e\le t_v\qquad(e\in E,\ v\in V);0≤ye​≤1,e∈δ(v)∑​ye​pe​≤1,e∈δ(v)∑​ye​≤tv​(e∈E, v∈V);

yey_eye​ is read as the probability of probing eee, and ze=yepez_e=y_ep_eze​=ye​pe​ as the probability that eee is matched.

An attenuation function is a map a~:[0,1]→[0,1]\tilde a:[0,1]\to[0,1]a~:[0,1]→[0,1], and the attenuation of an edge is a(e)=a~(peye)a(e)=\tilde a(p_ey_e)a(e)=a~(pe​ye​). The paper's examples (Definition 4) are a~exp⁡(z)=e−αz\tilde a_{\exp}(z)=e^{-\alpha z}a~exp​(z)=e−αz, a~lin(z)=1−αz\tilde a_{\rm lin}(z)=1-\alpha za~lin​(z)=1−αz, and a~(z)=1−z1−e−(1−z)(1−1/e)\tilde a(z)=\frac{1-z}{1-e^{-(1-z)}}(1-1/e)a~(z)=1−e−(1−z)1−z​(1−1/e). A function is effective (Definition 3) when a~(0)=1\tilde a(0)=1a~(0)=1 and z↦ln⁡(1−xza~(z))z\mapsto\ln(1-xz\tilde a(z))z↦ln(1−xza~(z)) is convex on [0,1][0,1][0,1] for every x∈(0,1)x\in(0,1)x∈(0,1).

Algorithm 1 draws independent coins Ye∼Bernoulli(ye)Y_e\sim\mathrm{Bernoulli}(y_e)Ye​∼Bernoulli(ye​) and Ae∼Bernoulli(a(e))A_e\sim\mathrm{Bernoulli}(a(e))Ae​∼Bernoulli(a(e)) and processes the edges in a uniformly random order. When it reaches eee, it probes eee if eee is free (both endpoints unmatched and with remaining patience), Ye=1Y_e=1Ye​=1 and Ae=1A_e=1Ae​=1. A probe uses one unit of patience at both endpoints and reveals the activeness Pe∼Bernoulli(pe)P_e\sim\mathrm{Bernoulli}(p_e)Pe​∼Bernoulli(pe​); if Pe=1P_e=1Pe​=1, both endpoints are matched. The edge e={u,v}e=\{u,v\}e={u,v} is safe when, before eee is processed, each endpoint rrr has received at most tr−1t_r-1tr​−1 probes and no earlier edge f≠ef\neq ef=e at uuu or vvv has AfPfYf=1A_fP_fY_f=1Af​Pf​Yf​=1.

Formalization targets

Goal: Corollary 5 (p. 16)

If every patience is ∞\infty∞, (ye)(y_e)(ye​) is feasible for LP (3), and a~\tilde aa~ is a~exp⁡\tilde a_{\exp}a~exp​ or a~lin\tilde a_{\rm lin}a~lin​ with α=1/2\alpha=1/2α=1/2, then for every edge eee

Pr⁡[Algorithm 1 probes e] ≥ (∫01e−2x dx)ye=12(1−e−2)ye≈0.432 ye.\Pr[\text{Algorithm 1 probes }e]\ \ge\ \Bigl(\int_0^1e^{-2x}\,dx\Bigr)y_e=\tfrac12\bigl(1-e^{-2}\bigr)y_e\approx0.432\,y_e .Pr[Algorithm 1 probes e] ≥ (∫01​e−2xdx)ye​=21​(1−e−2)ye​≈0.432ye​.

Milestones

  1. The exponential and linear functions with α=1/2\alpha=1/2α=1/2 are effective (p. 9).
  2. Equation (4) (p. 9): the expected matched weight is ∑ewepePr⁡[e free]Pr⁡[Ye=1∩Ae=1]=∑ewepeyea(e)Pr⁡[e free]\sum_ew_ep_e\Pr[e\text{ free}]\Pr[Y_e=1\cap A_e=1]=\sum_ew_ep_ey_ea(e)\Pr[e\text{ free}]∑e​we​pe​Pr[e free]Pr[Ye​=1∩Ae​=1]=∑e​we​pe​ye​a(e)Pr[e free].
  3. Equation (7) (p. 10): a(e)Pr⁡[e is free]≥a~(peye)Pr⁡[e is safe]a(e)\Pr[e\text{ is free}]\ge\tilde a(p_ey_e)\Pr[e\text{ is safe}]a(e)Pr[e is free]≥a~(pe​ye​)Pr[e is safe].
  4. Lemma 3 (p. 11): ∏f∈E1(r)(1−xa(f)yf)≥e−x∑f∈E1(r)yf\prod_{f\in E_1(r)}(1-xa(f)y_f)\ge e^{-x\sum_{f\in E_1(r)}y_f}∏f∈E1​(r)​(1−xa(f)yf​)≥e−x∑f∈E1​(r)​yf​ for effective a~\tilde aa~, where E1(r)E_1(r)E1​(r) is the set of edges f≠ef\neq ef=e at rrr with pf=1p_f=1pf​=1.
  5. §3.3 (p. 16): z↦a~(z)∫01e−2x(1−z)dxz\mapsto\tilde a(z)\int_0^1e^{-2x(1-z)}dxz↦a~(z)∫01​e−2x(1−z)dx is minimized on [0,1][0,1][0,1] at z=0z=0z=0.

Companion: Corollary 6 (p. 16)

On a star graph with infinite patience and the third attenuation function, Pr⁡[e is probed]≥(1−1/e) ye\Pr[e\text{ is probed}]\ge(1-1/e)\,y_ePr[e is probed]≥(1−1/e)ye​. It comes with the identity of p. 16 behind it: for the third function, a~(z)∫01e−x(1−z)dx=1−1/e\tilde a(z)\int_0^1e^{-x(1-z)}dx=1-1/ea~(z)∫01​e−x(1−z)dx=1−1/e for all z∈[0,1]z\in[0,1]z∈[0,1]. Both are plain items of the mission, not milestones.

Significance

By (4), Corollary 5 bounds the expected weight of Algorithm 1 by 12(1−e−2)∑ewepeye\frac12(1-e^{-2})\sum_ew_ep_ey_e21​(1−e−2)∑e​we​pe​ye​, and with an optimal yyy and the bound of Bansal et al. this is a 0.4320.4320.432-approximation for stochastic matching without patience constraints. Because the bound holds edge by edge and for every feasible yyy, it also gives a random-order contention resolution scheme for the matching polytope, which is the form reused for other objectives and in online settings. Corollary 6 is the rank-one analogue with the constant 1−1/e1-1/e1−1/e.

None of this is formalized. Stochastic probing, patience, random-order processing and attenuation have no counterpart in Mathlib or on the platform. The mission produces a finite, executable model of a probing algorithm run on random coins and a random order, in which these probabilities are exact finite sums; that model is reusable for the other results of the paper and for related rounding schemes. The paper's results are proved in §3.2 (pp. 9–15) and §3.3 (p. 16); the milestones are the steps used there.

Difficulty

The obvious argument treats the edges at the two endpoints of eee as independent obstacles, each blocking eee with probability proportional to its LP value. That fails because being free is not a product event: whether an earlier edge fff blocks eee depends on whether fff was itself free, which depends on the whole run before fff. A second difficulty is uniformity. The bound must hold for every feasible yyy, and the LP mass at an endpoint can be split among arbitrarily many edges of arbitrary sizes; the quantities involved are not monotone in how that mass is split, and the bound must survive the worst split, including the limit of many tiny edges. The choice of attenuation matters here: the third function of Definition 4 violates the convexity condition of Definition 3, which is why Corollary 6 is not covered by the paper's argument. Finally, the paper reasons with continuous arrival times, while the model has only permutations and finitely many coins.

Formalization scope

  • Model. The graph is the platform's EdmondsMatching65.Polyhedron.Graph (finite, loopless, parallel edges allowed). Probabilities ppp, LP values yyy, weights www and attenuations are real; patience is in ℕ∞, with ⊤=∞\top=\infty⊤=∞. Every probability is a finite average over the ∣E∣!|E|!∣E∣! orders of EEE and over all outcomes of the coins YYY, AAA, PPP, with product weights. The paper's independent uniform arrival times induce exactly this uniform order. The run of Algorithm 1 is computed step by step, with matched vertices and probe counters; free, probed and safe are events of that run.
  • Standing assumptions. 0≤pe≤10\le p_e\le10≤pe​≤1 for every edge (the meaning of "probability of being active"); LP (3) feasibility, which contains 0≤ye≤10\le y_e\le10≤ye​≤1; attenuations with values in [0,1][0,1][0,1] on [0,1][0,1][0,1].
  • Disclosed choices. Corollary 5 is stated for a~exp⁡\tilde a_{\exp}a~exp​ and a~lin\tilde a_{\rm lin}a~lin​ with α=1/2\alpha=1/2α=1/2: the corollary says "the effective attenuation functions from Definition 4", its proof names these two, and the third function fails Definition 3 (g′′(0)<0g''(0)<0g′′(0)<0 for xxx near 1). The effectiveness milestone is stated for these two only. The third function is given its limit 1−1/e1-1/e1−1/e at z=1z=1z=1, where the printed formula is 0/00/00/0. Corollary 6 is a companion item, not a milestone: the paper's argument for it passes through Lemma 3, which does not apply to the third function, so it is supported by numerical checks but its printed proof has a gap.
  • Not stated. The approximation-ratio and "balanced contention resolution scheme" sentences of Corollaries 5 and 6 need a model of all adaptive probing algorithms (Lemma 1 of the paper, from Bansal et al.) and are out of scope; the goals are the displayed probability bounds.
  • Ruled out. Defining Pr⁡[e is free]\Pr[e\text{ is free}]Pr[e is free] or Pr⁡[e is probed]\Pr[e\text{ is probed}]Pr[e is probed] by the product formula of p. 11 instead of from the run, or stating the goal for "some" attenuation function, would make the goal a different and easier theorem; neither is done.
  • Welcome contributions. Proofs of the milestones; a general lemma that an event depending only on the edges before eee is independent of eee's coins; a conditioning-on-arrival-time lemma for uniform permutations; a proof (or a counterexample) for Corollary 6.

Selected references

  • B. Brubach, N. Grammel, W. Ma, C. MacRury, A. Srinivasan, Improved Guarantees for Offline Stochastic Matching via New Ordered Contention Resolution Schemes, Mathematics of Operations Research, 2025; arXiv:2106.06892v3. https://arxiv.org/abs/2106.06892
  • N. Bansal, A. Gupta, J. Li, J. Mestre, V. Nagarajan, A. Rudra, When LP Is the Cure for Your Matching Woes: Improved Bounds for Stochastic Matchings, Algorithmica 63(4):733–762, 2012. https://link.springer.com/journal/453/volumes-and-issues/63-4
  • A. Baveja, A. Chavan, A. Nikiforov, A. Srinivasan, P. Xu, Improved Bounds in Stochastic Matching and Optimization, Algorithmica 80(11):3225–3252, 2018. https://link.springer.com/journal/453/volumes-and-issues/80-11
  • N. Chen, N. Immorlica, A. R. Karlin, M. Mahdian, A. Rudra, Approximating Matches Made in Heaven, ICALP 2009, LNCS 5555. https://doi.org/10.1007/978-3-642-02927-1
8 thms1 active userReviewed
AnalysisOperations Research·Captain: mikedeng1

Online Stochastic Matching: New Algorithms with Better Bounds 2: The Per-Advertiser Inequality Behind the 0.706 Ratio for General Arrival Rates, in the Limit f − s ≤ 1 − ln 2Research Paper

Motivation

Online stochastic matching models display advertising and similar allocation problems in which requests arrive one at a time and must be served immediately. A bipartite graph links a set AAA of advertisers to a set III of impression types; nnn requests arrive, each of a type drawn independently with P(type i)=ri/n\mathbb P(\text{type } i) = r_i/nP(type i)=ri​/n, and each request must be assigned at once and irrevocably to an unmatched interested advertiser, or dropped. Performance is measured by the competitive ratio E[ALG]/E[OPT]\mathbb E[\mathrm{ALG}]/\mathbb E[\mathrm{OPT}]E[ALG]/E[OPT], where OPT is the maximum matching of the realized graph.

Without distributional knowledge the best possible ratio is 1−1/e1 - 1/e1−1/e (Karp, Vazirani and Vazirani, 1990). Knowing the type distribution allows more:

  • Feldman, Mehta, Mirrokni and Muthukrishnan (2009) first beat 1−1/e1 - 1/e1−1/e, with 0.6700.6700.670, when every arrival rate is integral; Bahmani and Kapralov improved this to 0.6990.6990.699.
  • Manshadi, Oveis Gharan and Saberi (2011) obtained 0.7050.7050.705 for integral rates and 0.7020.7020.702 for general arrival rates, using offline statistics drawn by sampling.
  • Jaillet and Lu (2014) introduced Random Lists Algorithms with modified LPs and obtained 1−2e−2≈0.7291 - 2e^{-2} \approx 0.7291−2e−2≈0.729 for integral rates (Theorem 1), 0.7250.7250.725 for vertex weights (Theorem 2) and 0.7060.7060.706 for general rates (Theorem 3).

This mission concerns the analytic core of Theorem 3, the general-rates bound.

Setting

For an advertiser aaa, let f=fa≤1f = f_a \le 1f=fa​≤1 be the LP flow into aaa. Its neighbours a1∈Aa∗a_1 \in A^*_aa1​∈Aa∗​, which include a dummy advertiser ada_dad​ with fad=1f_{a_d} = 1fad​​=1, are indexed by j=1,…,kj = 1, \dots, kj=1,…,k. For each neighbour, xj=ma,a1=ma1,a≥0x_j = m_{a,a_1} = m_{a_1,a} \ge 0xj​=ma,a1​​=ma1​,a​≥0 is the expected number of random lists ⟨a,a1⟩\langle a, a_1\rangle⟨a,a1​⟩, and yj=fa1≤1y_j = f_{a_1} \le 1yj​=fa1​​≤1 is the neighbour's flow, so that xj≤yjx_j \le y_jxj​≤yj​. Write s=∑jxj≤fs = \sum_j x_j \le fs=∑j​xj​≤f and β=max⁡jxj\beta = \max_j x_jβ=maxj​xj​.

Claim 2 of the paper introduces the functions

h(y,x)={yy−x(e−x−e−y),x≠y,y e−y,x=y,g(y,x)=h(y,0)−h(y,x),h(y,x)=\begin{cases}\dfrac{y}{y-x}\bigl(e^{-x}-e^{-y}\bigr), & x\ne y,\\[4pt] y\,e^{-y}, & x=y,\end{cases}\qquad g(y,x)=h(y,0)-h(y,x),h(y,x)=⎩⎨⎧​y−xy​(e−x−e−y),ye−y,​x=y,x=y,​g(y,x)=h(y,0)−h(y,x),

where g(fa1,ma1,a)g(f_{a_1}, m_{a_1,a})g(fa1​​,ma1​,a​) is the probability that aaa is matched through a list headed by a1a_1a1​. The per-advertiser bracket is

B(f;x,y)=1−e−f+1e∑jg(f,xj)−12e(∑jg(yj,xj))2+12e∑jg(f,xj)2,B(f;x,y)=1-e^{-f}+\frac1e\sum_j g(f,x_j)-\frac1{2e}\Bigl(\sum_j g(y_j,x_j)\Bigr)^2+\frac1{2e}\sum_j g(f,x_j)^2,B(f;x,y)=1−e−f+e1​j∑​g(f,xj​)−2e1​(j∑​g(yj​,xj​))2+2e1​j∑​g(f,xj​)2,

and the reduced function of three variables is

R(f,β,s)=1f(1−e−f+1esβg(f,β)−12e(e−1(s−β)+g(1,β))2+12eg(f,β)2).R(f,\beta,s)=\frac1f\Bigl(1-e^{-f}+\frac1e\frac{s}{\beta}g(f,\beta)-\frac1{2e}\bigl(e^{-1}(s-\beta)+g(1,\beta)\bigr)^2+\frac1{2e}g(f,\beta)^2\Bigr).R(f,β,s)=f1​(1−e−f+e1​βs​g(f,β)−2e1​(e−1(s−β)+g(1,β))2+2e1​g(f,β)2).

In Lean these are h, g, bracket f x y and R f β s in RandomListsMatching.GeneralRates.

Formalization targets

Goal: the per-advertiser bound

For 0<f≤10 < f \le 10<f≤1, any k≥0k \ge 0k≥0 and reals with 0≤xj≤yj≤10 \le x_j \le y_j \le 10≤xj​≤yj​≤1, s=∑jxj≤fs = \sum_j x_j \le fs=∑j​xj​≤f and f−s≤1−ln⁡2f - s \le 1 - \ln 2f−s≤1−ln2,

B(f;x,y)f≥0.706.\frac{B(f;x,y)}{f} \ge 0.706 .fB(f;x,y)​≥0.706.

The paper bounds ∑apa/∑afa\sum_a p_a / \sum_a f_a∑a​pa​/∑a​fa​ below by min⁡aB(fa;⋅)/fa\min_a B(f_a; \cdot)/f_amina​B(fa​;⋅)/fa​ (p. 15), so this inequality is the whole of what Theorem 3's numerical constant rests on.

Milestones

  1. Claim 3 (three clauses, p. 15): for y∈[0,1]y \in [0,1]y∈[0,1], h(y,⋅)h(y,\cdot)h(y,⋅) is convex and decreasing on [0,y][0,y][0,y] and g(y,⋅)g(y,\cdot)g(y,⋅) is concave and increasing on [0,y][0,y][0,y]; for x≥0x \ge 0x≥0, g(⋅,x)g(\cdot, x)g(⋅,x) is increasing on [x,∞)[x,\infty)[x,∞).
  2. Inequality (5), analytic part (p. 15): for 0≤x≤y≤10 \le x \le y \le 10≤x≤y≤1, h(y,0)−h(y,x)≤−x ∂2h(y,0)≤e−1xh(y,0)-h(y,x) \le -x\,\partial_2 h(y,0) \le e^{-1}xh(y,0)−h(y,x)≤−x∂2​h(y,0)≤e−1x.
  3. Chord bound (p. 15): ∑jg(f,xj)≥(s/β) g(f,β)\sum_j g(f,x_j) \ge (s/\beta)\, g(f,\beta)∑j​g(f,xj​)≥(s/β)g(f,β).
  4. Cross-sum bound (p. 15): ∑jg(yj,xj)≤e−1(s−β)+g(1,β)\sum_j g(y_j,x_j) \le e^{-1}(s-\beta) + g(1,\beta)∑j​g(yj​,xj​)≤e−1(s−β)+g(1,β).
  5. Reduction (p. 15): B(f;x,y)/f≥R(f,β,s)B(f;x,y)/f \ge R(f,\beta,s)B(f;x,y)/f≥R(f,β,s) when β>0\beta > 0β>0.
  6. Claim 4, corrected (p. 16): R(f,β,s)≥0.706R(f,\beta,s) \ge 0.706R(f,β,s)≥0.706 on 1≥f≥s≥β>01 \ge f \ge s \ge \beta > 01≥f≥s≥β>0, f−s≤1−ln⁡2f - s \le 1 - \ln 2f−s≤1−ln2.

Significance

The result. Theorem 3 gives 0.7060.7060.706 for online stochastic matching with general (non-integral) arrival rates, improving the 0.7020.7020.702 of Manshadi et al. The probabilistic half of its proof reduces matching probabilities to the closed forms hhh and ggg; the paper then states that "in the remaining part of the section, we only use algebraic manipulations and the following properties of functions ggg and hhh". That remaining part, posed here, is an exact real inequality, and it is where the constant 0.7060.7060.706 is decided.

Formalizing it. The paper proves Claim 3 in one line ("can be easily verified by taking first and second order partial derivatives") and Claim 4 by a grid computation over cubes of side 0.0010.0010.001, with no recorded error analysis. A machine-checked proof replaces both. It also settles the regime of the constant: Claim 4 as printed, with the constraint f−s≤(1−ln⁡2)+1/nf - s \le (1 - \ln 2) + 1/nf−s≤(1−ln2)+1/n "for n≥100n \ge 100n≥100", is false, and the bound holds in the limit form stated here. None of these statements has a formal proof anywhere, to the extent of the search made for this mission.

Difficulty

The margin is small. The minimum of RRR over the feasible region is about 0.7060280.7060280.706028, attained near (f,β,s)=(1,0.565,ln⁡2)(f,\beta,s) = (1, 0.565, \ln 2)(f,β,s)=(1,0.565,ln2) on the boundary f−s=1−ln⁡2f - s = 1 - \ln 2f−s=1−ln2; the margin over 0.7060.7060.706 is under 3⋅10−53 \cdot 10^{-5}3⋅10−5. Any argument that loses a constant factor in the estimates of e−xe^{-x}e−x, or replaces ln⁡2\ln 2ln2 by a rational bound that is not tight to five digits, fails. The bound is a three-variable statement with the minimum on a boundary face, so a one-variable monotonicity argument does not settle it.

The second difficulty is the function hhh itself. Its two-case definition is continuous but the quotient form has a removable singularity at x=yx = yx=y, which is exactly the end of the interval [0,y][0, y][0,y] on which Claim 3 asserts convexity and concavity. Derivative computations that are routine away from the diagonal need care there.

The natural first idea for the goal, to apply Claim 4 directly to the bracket, does not type-check: the bracket depends on the whole family (xj,yj)(x_j, y_j)(xj​,yj​), and the reduction to three variables through the chord and cross-sum bounds is a separate step.

Formalization scope

  • All quantities are real numbers. eee is Real.exp 1, ln⁡2\ln 2ln2 is Real.log 2, and 0.7060.7060.706 is the exact rational (0.706 : ℝ).
  • hhh keeps the paper's case split at x=yx = yx=y. The neighbour family is indexed by Fin k, and k=0k = 0k=0 is allowed.
  • "Increasing" and "decreasing" are non-strict (MonotoneOn, AntitoneOn); convexity is ConvexOn ℝ (Set.Icc 0 y). The derivative in (5) is deriv (fun t => h y t) 0, the derivative in the second argument; the page's ∂h/∂y\partial h/\partial y∂h/∂y is a slip.
  • Pinned hypotheses. The goal requires f>0f > 0f>0 (an advertiser with fa=0f_a = 0fa​=0 contributes 0/00/00/0 in the paper and 000 in Lean). Claim 4 and the reduction require β>0\beta > 0β>0, because s/βs/\betas/β is 000 in Lean at β=0\beta = 0β=0 and R(1,0,1)≈0.607R(1,0,1) \approx 0.607R(1,0,1)≈0.607; in the paper β=0\beta = 0β=0 forces s=0s = 0s=0, a case the goal covers directly. The hypotheses xj≤yj≤1x_j \le y_j \le 1xj​≤yj​≤1 are the paper's ma1,a≤sa1≤fa1≤1m_{a_1,a} \le s_{a_1} \le f_{a_1} \le 1ma1​,a​≤sa1​​≤fa1​​≤1.
  • Claim 4 is corrected. As printed it is false: at n=100n = 100n=100, (f,β,s)=(1,0.55886,ln⁡2−0.01)(f,\beta,s) = (1, 0.55886, \ln 2 - 0.01)(f,β,s)=(1,0.55886,ln2−0.01) meets the printed constraints and gives R≈0.70521R \approx 0.70521R≈0.70521. The goal fails at n=100n = 100n=100 as well (about 0.705430.705430.70543). Both are stated in the limit f−s≤1−ln⁡2f - s \le 1 - \ln 2f−s≤1−ln2, the regime in which the paper claims Theorem 3 ("nnn is large enough so that a factor of 1+O(1/n)1 + O(1/n)1+O(1/n) is negligible", p. 6). The constant 0.7060.7060.706 is unchanged.
  • Out of scope. Theorem 3 itself, LP (4), the list construction of §5.3, Claim 2 and the bound on pap_apa​ are not posed. They rest on "≈\approx≈" replacements of binomial sums and on an asymptotic independence whose proof "is omitted in the paper", so they have no exact finite-nnn statement.
  • No trivializing reading. The goal's hypotheses are met, for example, by k=1k = 1k=1, f=1f = 1f=1, x1=0.7x_1 = 0.7x1​=0.7, y1=1y_1 = 1y1​=1, and the conclusion is not vacuous there. Its hypotheses do not exclude the minimizer, and the division by fff is guarded.

A complete development needs the derivative calculus of hhh on [0,y][0,y][0,y], including the diagonal, and certified interval bounds for e−xe^{-x}e−x and ln⁡2\ln 2ln2. The latter is reusable well beyond this mission. Proofs of Claim 3 or Claim 4 alone are welcome contributions.

Selected references

  • P. Jaillet and X. Lu, Online Stochastic Matching: New Algorithms with Better Bounds, Mathematics of Operations Research, 2014; authors' accepted manuscript, rev. June 2013. https://doi.org/10.1287/moor.2013.0621
  • V. H. Manshadi, S. Oveis Gharan and A. Saberi, Online Stochastic Matching: Online Actions Based on Offline Statistics, Mathematics of Operations Research 37(4):559–573, 2012. https://doi.org/10.1287/moor.1120.0551
  • J. Feldman, A. Mehta, V. Mirrokni and S. Muthukrishnan, Online Stochastic Matching: Beating 1 − 1/e, FOCS 2009, pp. 117–126. https://arxiv.org/abs/0905.4100
  • R. M. Karp, U. V. Vazirani and V. V. Vazirani, An Optimal Algorithm for On-line Bipartite Matching, STOC 1990, pp. 352–358. https://doi.org/10.1145/100216.100262
10 thms1 active userReviewed
CombinatoricsOperations ResearchProbability·Captain: mikedeng1

Online Stochastic Matching: New Algorithms with Better Bounds 1: Every Random-Lists Algorithm Has ALG/OPT ≥ E[ALG]/E[OPT] − 2ε/(c+ε) with Probability at Least 1 − 2exp(−2nε²)Research Paper

Motivation

Online bipartite matching with stochastic arrivals models the assignment of display-advertising impressions to advertisers: requests arrive one at a time, each must be assigned irrevocably on arrival or dropped, and the arrival sequence is random rather than adversarial. Since Feldman, Mehta, Mirrokni and Muthukrishnan beat the 1−1/e1 - 1/e1−1/e barrier in the i.i.d. arrival model (FOCS 2009), a line of work has designed algorithms with better guarantees. Jaillet and Lu (Math. Oper. Res. 2014) introduce a whole class of such algorithms, the Random Lists Algorithms, and obtain ratios 0.7290.7290.729, 0.7250.7250.725 and 0.7060.7060.706 for integral arrival rates, vertex weights and general arrival rates.

Two notions of performance coexist in this literature. One compares expectations, E[ALG]/E[OPT]\mathbb E[\mathrm{ALG}]/\mathbb E[\mathrm{OPT}]E[ALG]/E[OPT]; the other asks that ALG/OPT\mathrm{ALG}/\mathrm{OPT}ALG/OPT be large on most realizations, as in Feldman et al. Section 2 of Jaillet and Lu shows that, for every algorithm of their class, the two notions are quantitatively linked by an explicit exponential tail bound. This mission formalizes that section.

Setting

A bipartite graph G={A∪I,E}G = \{A \cup I, E\}G={A∪I,E} has a finite set AAA of advertisers, a set III of impression types, and edges E⊆A×IE \subseteq A \times IE⊆A×I; (a,i)∈E(a, i) \in E(a,i)∈E means advertiser aaa is interested in type iii. A fixed number nnn of requests arrive at periods 1,…,n1, \dots, n1,…,n, and their types are drawn i.i.d. from a known distribution on III. Every advertiser can receive at most one request.

A list for type iii is an ordered sequence of advertisers interested in iii. A Random Lists Algorithm fixes, for each type iii, a distribution Di\mathcal D_iDi​ over lists (constructed from an LP solution; the construction is irrelevant here). When a request of type iii arrives it draws a list from Di\mathcal D_iDi​ and assigns the request to the first advertiser on the list not yet matched, or drops it if every listed advertiser is matched.

Formally, each request carries an outcome xxx in a finite set X\mathcal XX determining its type typ(x)\mathrm{typ}(x)typ(x) and its list lst(x)\mathrm{lst}(x)lst(x); outcomes ω1,…,ωn\omega_1, \dots, \omega_nω1​,…,ωn​ are i.i.d. with law ν\nuν. Starting from W0=∅W_0 = \emptysetW0​=∅, the set WjW_jWj​ of matched advertisers after the jjj-th request is obtained from Wj−1W_{j-1}Wj−1​ by adding the first advertiser of lst(ωj)\mathrm{lst}(\omega_j)lst(ωj​) outside Wj−1W_{j-1}Wj−1​, if any. Then:

  • ALG(ω)=∣Wn∣\mathrm{ALG}(\omega) = |W_n|ALG(ω)=∣Wn​∣, the number of assigned requests;
  • OPT(ω)\mathrm{OPT}(\omega)OPT(ω) is the cardinality of a maximum matching of the realized graph, in which request jjj may go to aaa iff (a,typ(ωj))∈E(a, \mathrm{typ}(\omega_j)) \in E(a,typ(ωj​))∈E;
  • E[ALG]\mathbb E[\mathrm{ALG}]E[ALG], E[OPT]\mathbb E[\mathrm{OPT}]E[OPT] are expectations under ν⊗n\nu^{\otimes n}ν⊗n, and c=E[OPT]/nc = \mathbb E[\mathrm{OPT}]/nc=E[OPT]/n.

Formalization targets

Goal: the concluding display of Section 2 (p. 6)

If every list contains only interested advertisers, then for every n≥1n \ge 1n≥1 and every ϵ>0\epsilon > 0ϵ>0,

P(ALGOPT≥E[ALG]E[OPT]−2ϵc+ϵ)≥1−2exp⁡(−2nϵ2).\mathbb P\left(\frac{\mathrm{ALG}}{\mathrm{OPT}} \ge \frac{\mathbb E[\mathrm{ALG}]}{\mathbb E[\mathrm{OPT}]} - \frac{2\epsilon}{c + \epsilon}\right) \ge 1 - 2\exp(-2n\epsilon^2).P(OPTALG​≥E[OPT]E[ALG]​−c+ϵ2ϵ​)≥1−2exp(−2nϵ2).

It holds for every instance and every law ν\nuν, with no assumption on the size of E[OPT]\mathbb E[\mathrm{OPT}]E[OPT].

Milestones

  1. Claim 1 (p. 5). If two list sequences differ in one position, the cardinalities of the resulting matchings differ by at most one.
  2. Lemma 1 (p. 5). P(ALG−E[ALG]<−nϵ)≤exp⁡(−2nϵ2)\mathbb P(\mathrm{ALG} - \mathbb E[\mathrm{ALG}] < -n\epsilon) \le \exp(-2n\epsilon^2)P(ALG−E[ALG]<−nϵ)≤exp(−2nϵ2).
  3. Lemma 2 (p. 5). P(OPT−E[OPT]>nϵ)≤exp⁡(−2nϵ2)\mathbb P(\mathrm{OPT} - \mathbb E[\mathrm{OPT}] > n\epsilon) \le \exp(-2n\epsilon^2)P(OPT−E[OPT]>nϵ)≤exp(−2nϵ2).

A supporting theorem, not a milestone, records the fact the display uses without stating it: with interested lists, ALG≤OPT\mathrm{ALG} \le \mathrm{OPT}ALG≤OPT on every realization.

Significance

The display shows that the paper's guarantees, proved for the ratio of expectations, transfer to realizations: when E[OPT]=Θ(n)\mathbb E[\mathrm{OPT}] = \Theta(n)E[OPT]=Θ(n), ALG/OPT\mathrm{ALG}/\mathrm{OPT}ALG/OPT is at least E[ALG]/E[OPT]−O(ϵ)\mathbb E[\mathrm{ALG}]/\mathbb E[\mathrm{OPT}] - O(\epsilon)E[ALG]/E[OPT]−O(ϵ) except with probability 2e−2nϵ22e^{-2n\epsilon^2}2e−2nϵ2. It applies uniformly to the whole class of Random Lists Algorithms, whatever the LP and the list distributions, so it covers each of the paper's later algorithms at once.

The result is proved in the paper; nothing about it is open. It has no machine-checked proof. Formalizing it produces a precise model of list-based online matching (the greedy run, the realization-graph optimum, the joint type–list law) that later formalizations of the paper's competitive ratios can build on, and a worked application of the bounded-differences method to a combinatorial online algorithm.

Difficulty

The concluding display is elementary once Lemmas 1 and 2 are available. The two lemmas need McDiarmid's bounded-differences inequality in one-sided form, which Mathlib does not provide, and the bounded-difference properties of ALG and OPT.

Claim 1 is the step where the naive argument fails. Changing one list can change the assignment of every later request, so ALG is not a sum of local contributions, and a single changed list could a priori cascade into many changed assignments; the claim asserts that the cascade never changes the total by more than one. The analogous property for OPT (changing one request's type moves the maximum matching by at most one) is used in Lemma 2's proof but is not stated in the paper.

Formalization scope

  • Arrivals. Outcomes live in a finite type X\mathcal XX with the discrete σ-algebra, and the law of the arrivals is the product measure ν⊗n\nu^{\otimes n}ν⊗n (Measure.pi). Any joint law of type and list is allowed; every Random Lists Algorithm is the case X={(i,l)}\mathcal X = \{(i, l)\}X={(i,l)}, ν(i,l)=pi Di(l)\nu(i, l) = p_i\,\mathcal D_i(l)ν(i,l)=pi​Di​(l). Types and lists are not modelled as independent sequences, which would break ALG≤OPT\mathrm{ALG} \le \mathrm{OPT}ALG≤OPT.
  • Expectations are Bochner integrals of functions on the finite space Xn\mathcal X^nXn, hence honest finite sums.
  • Matchings. OPT is the maximum size of a partial assignment Fin n → Option A that uses only edges and gives each advertiser at most one request; the empty assignment qualifies, so the maximum is over a nonempty set. ALG is ∣Wn∣|W_n|∣Wn​∣ for the greedy recursion.
  • Pinned hypotheses. The goal assumes n≥1n \ge 1n≥1 (the paper's c=E[OPT]/nc = \mathbb E[\mathrm{OPT}]/nc=E[OPT]/n) and that every list only contains interested advertisers (stated in §2, p. 5). Claim 1 and Lemma 1 hold for arbitrary lists and carry neither hypothesis. Lists need not be nonempty or repetition-free.
  • Division by zero. No hypothesis E[OPT]>0\mathbb E[\mathrm{OPT}] > 0E[OPT]>0 or OPT>0\mathrm{OPT} > 0OPT>0 is made. On realizations with OPT=0\mathrm{OPT} = 0OPT=0, and when E[OPT]=0\mathbb E[\mathrm{OPT}] = 0E[OPT]=0, Lean's x/0=0x/0 = 0x/0=0 applies; the statement remains true under it, and adding a positivity hypothesis would weaken the result.
  • Not posed. Theorems 1–3 (the competitive ratios, which hold up to 1+O(1/n)1 + O(1/n)1+O(1/n)) and the LP constructions of the algorithms are out of scope. McDiarmid's inequality is a proof tool, not an item. A one-sided version is posed elsewhere on the platform and not yet proved.

Contributions welcome: a one-sided McDiarmid inequality for Measure.pi (reusable well beyond this mission), the bounded-difference property of maximum bipartite matchings, and Claim 1.

Selected references

  • P. Jaillet and X. Lu, Online Stochastic Matching: New Algorithms with Better Bounds, Mathematics of Operations Research 39(3), 2014; accepted manuscript, rev. June 2013. https://doi.org/10.1287/moor.2013.0621
  • J. Feldman, A. Mehta, V. Mirrokni and S. Muthukrishnan, Online Stochastic Matching: Beating 1 − 1/e, FOCS 2009. https://arxiv.org/abs/0905.4100
  • C. McDiarmid, On the method of bounded differences, Surveys in Combinatorics, London Math. Soc. Lecture Note Series 141, 1989. https://doi.org/10.1017/CBO9781107359949.008
5 thms1 active userReviewed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

Algorithms for Online Matching, Assortment, and Pricing with Tight Weight-Dependent Competitive Ratios II: In the Deterministic Case Multi-price Ranking Is minᵢ F(𝒫ᵢ)-CompetitiveResearch Paper

Motivation

Online matching models a platform that must commit resources to requests as they arrive, without knowing the future. In revenue management the resources are items in limited supply and the requests are customers, and the firm also chooses the price. Ma and Simchi-Levi (arXiv:1905.04770, Oper. Res. 2020, DOI 10.1287/opre.2019.1957) give algorithms whose worst-case guarantee depends on the set of prices each item can be sold at, and show that the guarantee is tight.

Timeline of the deterministic (matching) case:

  • 1990. Karp, Vazirani and Vazirani introduce RANKING for unweighted online bipartite matching: each item gets a random rank, and each arriving customer takes the best-ranked available neighbour. Its competitive ratio is 1−1/e1-1/e1−1/e, which is optimal.
  • 2011. Aggarwal, Goel, Karande and Mehta extend RANKING to vertex-weighted matching, where each item has a single fixed price, with the same ratio 1−1/e1-1/e1−1/e.
  • 2013. Devanur, Jain and Kleinberg give a randomized primal–dual proof of these results with continuous seeds Wi∼U[0,1]W_i\sim U[0,1]Wi​∼U[0,1].
  • 2019. Ma and Simchi-Levi allow each item a set of prices. Their Multi-price Ranking ranks items by a price-dependent value function, and it is min⁡iF(Pi)\min_iF(\mathcal P_i)mini​F(Pi​)-competitive. F(P)F(\mathcal P)F(P) depends only on the ratios of the prices; it equals 1−1/e1-1/e1−1/e for one price and lies in [1−e−1/m,1−1/e][1-e^{-1/m},1-1/e][1−e−1/m,1−1/e] for mmm prices (p. 14).

Setting

A firm sells nnn items, one unit of each. Item iii has a price set Pi={ri(1)<⋯<ri(mi)}\mathcal P_i=\{r_i^{(1)}<\dots<r_i^{(m_i)}\}Pi​={ri(1)​<⋯<ri(mi​)​} with ri(1)>0r_i^{(1)}>0ri(1)​>0, and ri(0):=0r_i^{(0)}:=0ri(0)​:=0. Customers t=1,…,Tt=1,\dots,Tt=1,…,T arrive one at a time. In the deterministic case, customer ttt either would or would not buy item iii at price jjj: pt,i(j)∈{0,1}p^{(j)}_{t,i}\in\{0,1\}pt,i(j)​∈{0,1}. Let jt,ij_{t,i}jt,i​ be the largest jjj with pt,i(j)=1p^{(j)}_{t,i}=1pt,i(j)​=1, or 000 if there is none. Assigning item iii to customer ttt earns ri(jt,i)r_i^{(j_{t,i})}ri(jt,i​)​. An online algorithm sees ptp_{t}pt​ only when customer ttt arrives.

The benchmark is the LP (5): maximize ∑t,i,jpt,i(j)ri(j)xt,i(j)\sum_{t,i,j}p^{(j)}_{t,i}r_i^{(j)}x^{(j)}_{t,i}∑t,i,j​pt,i(j)​ri(j)​xt,i(j)​ subject to ∑t,jpt,i(j)xt,i(j)≤ki\sum_{t,j}p^{(j)}_{t,i}x^{(j)}_{t,i}\le k_i∑t,j​pt,i(j)​xt,i(j)​≤ki​, ∑i,jxt,i(j)≤1\sum_{i,j}x^{(j)}_{t,i}\le1∑i,j​xt,i(j)​≤1 and x≥0x\ge0x≥0, with optimal value OPT\mathrm{OPT}OPT. Its dual (19) minimizes ∑ikiyi+∑tzt\sum_ik_iy_i+\sum_tz_t∑i​ki​yi​+∑t​zt​ subject to pt,i(j)yi+zt≥pt,i(j)ri(j)p^{(j)}_{t,i}y_i+z_t\ge p^{(j)}_{t,i}r_i^{(j)}pt,i(j)​yi​+zt​≥pt,i(j)​ri(j)​ and y,z≥0y,z\ge0y,z≥0. An algorithm is ccc-competitive if E[ALG]≥c⋅OPT\mathbb E[\mathrm{ALG}]\ge c\cdot\mathrm{OPT}E[ALG]≥c⋅OPT for every arrival sequence.

Booking limits. By Proposition 1 there are unique positive α(1),…,α(m)\alpha^{(1)},\dots,\alpha^{(m)}α(1),…,α(m) that sum to 111 and satisfy

1−e−α(1)=1−e−α(j)1−r(j−1)/r(j)(j=2,…,m).1-e^{-\alpha^{(1)}}=\frac{1-e^{-\alpha^{(j)}}}{1-r^{(j-1)}/r^{(j)}}\quad (j=2,\dots,m).1−e−α(1)=1−r(j−1)/r(j)1−e−α(j)​(j=2,…,m).

Set F(P)=1−e−α(1)F(\mathcal P)=1-e^{-\alpha^{(1)}}F(P)=1−e−α(1) and L(j)=α(1)+⋯+α(j)L^{(j)}=\alpha^{(1)}+\dots+\alpha^{(j)}L(j)=α(1)+⋯+α(j). For w∈[0,1]w\in[0,1]w∈[0,1] let ℓ(w)\ell(w)ℓ(w) be the segment containing www. The value function is

ΦP(w)=r(ℓ−1)+(r(ℓ)−r(ℓ−1))e w−L(ℓ−1)−1eα(ℓ)−1,ℓ=ℓ(w).\Phi_{\mathcal P}(w)=r^{(\ell-1)}+\bigl(r^{(\ell)}-r^{(\ell-1)}\bigr)\frac{e^{\,w-L^{(\ell-1)}}-1}{e^{\alpha^{(\ell)}}-1},\qquad \ell=\ell(w).ΦP​(w)=r(ℓ−1)+(r(ℓ)−r(ℓ−1))eα(ℓ)−1ew−L(ℓ−1)−1​,ℓ=ℓ(w).

It increases continuously from 000 to r(m)r^{(m)}r(m) and equals r(j)r^{(j)}r(j) at L(j)L^{(j)}L(j).

Multi-price Ranking (Algorithm 2). Each item draws an independent seed Wi∼U[0,1]W_i\sim U[0,1]Wi​∼U[0,1]. Customer ttt is assigned an available item maximizing ri(jt,i)−ΦPi(Wi)r_i^{(j_{t,i})}-\Phi_{\mathcal P_i}(W_i)ri(jt,i​)​−ΦPi​​(Wi​), provided the maximum is strictly positive. Ties are broken arbitrarily. The analysis uses dual variables: when iii is assigned to ttt, Zt=ri(jt,i)−ΦPi(Wi)Z_t=r_i^{(j_{t,i})}-\Phi_{\mathcal P_i}(W_i)Zt​=ri(jt,i​)​−ΦPi​​(Wi​) and Yi=ΦPi′(Wi)Y_i=\Phi'_{\mathcal P_i}(W_i)Yi​=ΦPi​′​(Wi​); all other dual variables are 000.

Formalization targets

Goal: Theorem 2 (p. 16)

For every setup in the deterministic case with ki=1k_i=1ki​=1, every arrival sequence, every tie-breaking rule and every feasible xxx of (5),

min⁡iF(Pi)⋅∑t,i,jpt,i(j)ri(j)xt,i(j) ≤ EW[ALG].\min_iF(\mathcal P_i)\cdot\sum_{t,i,j}p^{(j)}_{t,i}r_i^{(j)}x^{(j)}_{t,i}\ \le\ \mathbb E_{W}\bigl[\mathrm{ALG}\bigr].imin​F(Pi​)⋅t,i,j∑​pt,i(j)​ri(j)​xt,i(j)​ ≤ EW​[ALG].

Milestones

  1. Weak duality for (5)/(19) (p. 19).
  2. Lemma 2 (p. 22): if item iii is assigned to customer ttt, then (1−e−αi(1))(Yi+Zt)≤ri(jt,i)(1-e^{-\alpha_i^{(1)}})(Y_i+Z_t)\le r_i^{(j_{t,i})}(1−e−αi(1)​)(Yi​+Zt​)≤ri(jt,i​)​.
  3. Dominance claim (App. C, pp. 45–46): let ZcritZ^{\mathrm{crit}}Zcrit be the pseudorevenue at ttt of the run without item iii. If Wi∈[0,Wcrit)W_i\in[0,W^{\mathrm{crit}})Wi​∈[0,Wcrit), then item iii is matched by time ttt in the run with item iii.
  4. Monotonicity claim (App. C, p. 46): Zt≥ZcritZ_t\ge Z^{\mathrm{crit}}Zt​≥Zcrit for every value of WiW_iWi​.
  5. Lemma 3 (p. 22): yi=E[Yi]y_i=\mathbb E[Y_i]yi​=E[Yi​], zt=E[Zt]z_t=\mathbb E[Z_t]zt​=E[Zt​] is feasible for (19).

Significance

The theorem shows that one randomized rule achieves the optimal guarantee for every price set, and that the guarantee depends only on the price ratios. For one price, F=1−1/eF=1-1/eF=1−1/e and the classical vertex-weighted result is recovered. With several prices the benchmark (5) is stronger, because the offline optimum may also choose prices, and the guarantee degrades gracefully: F(P)F(\mathcal P)F(P) lies in [1−e−1/m,1−1/e][1-e^{-1/m},1-1/e][1−e−1/m,1−1/e] and depends only on how far apart the prices are. Theorem 3 of the same paper shows that no online algorithm does better than F(P)F(\mathcal P)F(P) when every item has price set P\mathcal PP, so the ratio is tight.

The results are proved in the paper, in §4 and App. C. As far as the platform's records show, they have not been formalized. A formalization adds three things on top of the paper. It machine-checks a randomized primal–dual argument whose expectations are integrals over [0,1]n[0,1]^n[0,1]n. It makes precise the measure-zero conventions the paper uses: ties in (23), and Φ′\Phi'Φ′ at segment borders. It also gives a Lean model of a ranking algorithm with continuous seeds that sees only the present customer, which could be reused for related online algorithms.

Difficulty

The pointwise part (Lemma 2) is a direct computation from the booking-limit identity (7). The difficulty is Lemma 3. The constraint for a pair (t,i)(t,i)(t,i) needs E[Yi+Zt]≥ri(jt,i)\mathbb E[Y_i+Z_t]\ge r_i^{(j_{t,i})}E[Yi​+Zt​]≥ri(jt,i​)​, but on a single sample path Yi+ZtY_i+Z_tYi​+Zt​ can be far below this: item iii may be taken by an earlier customer, or customer ttt may take another item. The bound only holds after conditioning on the other seeds and comparing two coupled runs, one with item iii and one without. That comparison needs an invariant that holds at every step: the set of items still available in the run with iii contains the set in the run without iii. The invariant fails when ties are broken differently in the two runs, so the measure-zero set of ties must be handled explicitly. The conditional expectation of YiY_iYi​ is then an integral of Φ′\Phi'Φ′, which is discontinuous at the segment borders.

Formalization scope

  • Indexing. Items are Fin n and customers Fin T, both 0-based. Prices are 1-based within an item, with pr r 0 = 0 for r(0)=0r^{(0)}=0r(0)=0. Data at indices outside [1,mi][1,m_i][1,mi​] are never read.
  • Standing assumptions (p. 11), passed as hypotheses: every price set has mi≥1m_i\ge1mi​≥1 and 0<ri(1)<⋯<ri(mi)0<r_i^{(1)}<\dots<r_i^{(m_i)}0<ri(1)​<⋯<ri(mi​)​; the booking limits are positive, sum to 111 and satisfy (7) (IsBookingLimits, unique by Proposition 1); p∈{0,1}p\in\{0,1\}p∈{0,1} on [1,mi][1,m_i][1,mi​]; ki=1k_i=1ki​=1. Weak duality is stated for any p∈[0,1]p\in[0,1]p∈[0,1] and any inventories.
  • Algorithm. The step at customer ttt reads only ptp_tpt​, the seeds and the set of available items. Tie-breaking is any rule returning a maximizer of (23), universally quantified. A run can start from a subset of the items, which gives the run "with item iii removed".
  • Expectations are Lebesgue integrals over the product of nnn uniform laws on [0,1][0,1][0,1]. No integrability hypothesis is added: the integrands are bounded, and measurable outside the null set of ties.
  • Competitive ratio. It is stated multiplied out, for every feasible xxx of (5), and needs n≥1n\ge1n≥1 for the minimum (with no items both sides are 000). This rules out the trivializing readings E[ALG]/OPT\mathbb E[\mathrm{ALG}]/\mathrm{OPT}E[ALG]/OPT with x/0=0x/0=0x/0=0, and an infimum over arrival sequences. The algorithm is fixed as Algorithm 2; it is not "any algorithm with a property".
  • Added or changed hypotheses.
    • Lemma 2 is claimed for every seed vector in [0,1]n[0,1]^n[0,1]n, with Φ′\Phi'Φ′ the right derivative at a border. This implies the paper's "w.p.1".
    • The two claims assume no ties, the paper's "we ignore measure-zero events".
    • Dominance is written as ΦPi(Wi)<ri(j)−Zcrit\Phi_{\mathcal P_i}(W_i)<r_i^{(j)}-Z^{\mathrm{crit}}ΦPi​​(Wi​)<ri(j)​−Zcrit. This is equivalent to Wi<WcritW_i<W^{\mathrm{crit}}Wi​<Wcrit because Φ\PhiΦ is a strictly increasing bijection [0,Li(j)]→[0,ri(j)][0,L_i^{(j)}]\to[0,r_i^{(j)}][0,Li(j)​]→[0,ri(j)​].
  • Infrastructure. A solver needs: monotonicity and continuity of ΦP\Phi_{\mathcal P}ΦP​ and the integral ∫0wΦ′=Φ(w)\int_0^{w}\Phi'=\Phi(w)∫0w​Φ′=Φ(w); measurability of the run in WWW; the fact that ties are null under the product of uniform laws; and conditioning via Fubini on [0,1]n[0,1]^n[0,1]n. These pieces are reusable for other randomized primal–dual analyses. The paper's proofs are in §4 (p. 23) and App. C (pp. 45–46). Proofs of any milestone, and lemmas on ΦP\Phi_{\mathcal P}ΦP​, are welcome.

Selected references

  • W. Ma, D. Simchi-Levi, Algorithms for Online Matching, Assortment, and Pricing with Tight Weight-dependent Competitive Ratios, arXiv:1905.04770v1, 2019; Operations Research 68(6), 2020. https://arxiv.org/abs/1905.04770 · https://doi.org/10.1287/opre.2019.1957
  • R. M. Karp, U. V. Vazirani, V. V. Vazirani, An optimal algorithm for on-line bipartite matching, STOC 1990. https://doi.org/10.1145/100216.100262
  • G. Aggarwal, G. Goel, C. Karande, A. Mehta, Online vertex-weighted bipartite matching and single-bid budgeted allocations, SODA 2011. https://arxiv.org/abs/1007.1271
  • N. R. Devanur, K. Jain, R. D. Kleinberg, Randomized primal-dual analysis of RANKING for online bipartite matching, SODA 2013. https://doi.org/10.1137/1.9781611973105.7
9 thms1 active userReviewed
Operations ResearchProbability·Captain: mikedeng1

Algorithms for Online Matching, Assortment, and Pricing with Tight Weight-Dependent Competitive Ratios III: No Online Algorithm Earns More Than F(𝒫) Times the Expected Offline OptimumResearch Paper

Motivation

A firm sells several products, each in limited supply. Customers arrive one at a time, and each product can be offered at one of a few prices. This is the setting of airline fare classes, hotel rate plans and e-commerce discounting. Because future demand is unknown, the firm must decide online whether to sell a unit now at a low price or keep it for a customer who may pay more later. The competitive ratio measures how much an online policy loses against an omniscient benchmark in the worst case.

Ma and Simchi-Levi (arXiv:1905.04770; Oper. Res. 2020, doi:10.1287/opre.2019.1957) give online algorithms whose competitive ratio depends on the price set 𝒫 of each item through a number F(𝒫), and prove that this dependence is the best possible. This mission formalizes the second half, the impossibility result: no online algorithm can beat F(𝒫).

Timeline of the single-price precursors:

  • Karp, Vazirani and Vazirani (1990) introduced the upper-triangular random-permutation instance and showed that 1 − 1/e is optimal for online bipartite matching.
  • Mehta, Saberi, Vazirani and Vazirani (2007) used a similar construction for AdWords with small bids.
  • Golrezaei, Nazerzadeh and Rusmevichientong (2014) used one for personalized assortment with large inventories.
  • Ma and Simchi-Levi (2019, preprint v1) add phases of customers who pay different prices. With the phase lengths chosen adversarially, the bound becomes F(𝒫).

Setting

A setup has n items. Each item has starting inventory k ∈ ℕ, k ≥ 1, and the same price set 𝒫 = {r⁽¹⁾ < … < r⁽ᵐ⁾}, with r⁽¹⁾ > 0 and r⁽⁰⁾ := 0.

An arrival sequence 𝒜 has T customers. For each customer t, item i and price j it gives a purchase probability p⁽ʲ⁾{t,i}. It is deterministic if every p⁽ʲ⁾{t,i} is 0 or 1.

When customer t arrives, an online algorithm offers at most one in-stock item at one price. It decides using only the setup, the past, and the present customer's probabilities. A deterministic customer buys exactly when p⁽ʲ⁾_{t,i} = 1. A sale earns r⁽ʲ⁾ and uses one unit. ALG(𝒮, 𝒜) is the total revenue. A randomized online algorithm picks a deterministic one at random, ω ↦ alg(ω) with ω ~ μ.

The benchmark OPT(𝒮, 𝒜) is the value of the linear program (5):

max⁡∑t,i,jpt,i(j)r(j)xt,i(j)  s.t. ∑t,jpt,i(j)xt,i(j)≤k,  ∑i,jxt,i(j)≤1,  x≥0.\max \sum_{t,i,j} p^{(j)}_{t,i} r^{(j)} x^{(j)}_{t,i}\ \text{ s.t. } \sum_{t,j} p^{(j)}_{t,i} x^{(j)}_{t,i} \le k,\ \ \sum_{i,j} x^{(j)}_{t,i} \le 1,\ \ x \ge 0.maxt,i,j∑​pt,i(j)​r(j)xt,i(j)​  s.t. t,j∑​pt,i(j)​xt,i(j)​≤k,  i,j∑​xt,i(j)​≤1,  x≥0.

The booking limits α⁽¹⁾, …, α⁽ᵐ⁾ of Proposition 1 are the unique positive numbers summing to 1 with

1−e−α(1)=1−e−α(j)1−r(j−1)/r(j),j=2,…,m.(7)1 - e^{-\alpha^{(1)}} = \frac{1 - e^{-\alpha^{(j)}}}{1 - r^{(j-1)}/r^{(j)}}, \qquad j = 2, \dots, m. \qquad (7)1−e−α(1)=1−r(j−1)/r(j)1−e−α(j)​,j=2,…,m.(7)

The tight ratio is F(𝒫) = 1 − e^{−α⁽¹⁾}. For a single price F(𝒫) = 1 − 1/e. As r⁽ᵐ⁾/r⁽¹⁾ → ∞, F(𝒫) decreases.

Formalization targets

Goal: Theorem 3 (p. 17), in ε-form

For every k ≥ 1, every price set 𝒫 and every ε > 0, there are a setup with all items of inventory k and price set 𝒫 and a finite distribution over deterministic arrival sequences, with 𝔼[OPT] > 0, such that every (measurable) randomized online algorithm satisfies

EA E[ALG(S,A)]≤(1−e−α(1)+ε) EA[OPT(S,A)].\mathbb E_{\mathcal A}\,\mathbb E[\mathrm{ALG}(\mathcal S,\mathcal A)] \le \big(1 - e^{-\alpha^{(1)}} + \varepsilon\big)\,\mathbb E_{\mathcal A}[\mathrm{OPT}(\mathcal S,\mathcal A)].EA​E[ALG(S,A)]≤(1−e−α(1)+ε)EA​[OPT(S,A)].

The statement only asserts that such an instance exists; it does not fix the paper's construction.

Milestones

The instance of §5 has n items and nk customers in n groups of k. The groups are ordered by a uniformly random permutation π: group g wants items π_g, …, π_n. The groups are split into m phases; phase j pays up to r⁽ʲ⁾ and contains a fraction β_j = B_j − B_{j+1} of the groups. The milestones are:

  1. (35): r⁽ʲ⁻¹⁾/r⁽ʲ⁾ ≤ e^{−α⁽ʲ⁾};
  2. Proposition 4: the system B_j r⁽ʲ⁾ e^{−α⁽ʲ⁾} = r⁽¹⁾e^{−α⁽¹⁾} has a unique solution with 0 < B_m < … < B₁ = 1;
  3. (25): on the instance, OPT = Σⱼ (r⁽ʲ⁾ − r⁽ʲ⁻¹⁾)Bⱼnk up to rounding;
  4. Lemma 5: the maximum of the concave program (27) is (28);
  5. (29): (28) at j = 1, τ = 1 equals F(𝒫) times (25);
  6. Lemma 4: the expected revenue of any online algorithm is at most the maximum of (26), up to εnk for large n.

Significance

The theorem shows that the guarantees of the paper's online algorithms cannot be improved. Theorem 2 of the paper (Multi-price Ranking is F(𝒫)-competitive in the deterministic case) and Corollary 1 (Multi-price Balance tends to F(𝒫) as inventories grow) meet this bound, by Yao's minimax principle. So F(𝒫) is the exact competitive ratio for each price set. Without the theorem, the algorithms' ratios would only be lower bounds. The paper also shows (Proposition 2) that F(𝒫) exceeds the ratios of earlier approaches, so the tight value has practical bite.

The result is proved in the paper, with proofs in §5 and Appendix D, but not machine-checked. The formalization adds three things. First, an explicit treatment of rounding, which the paper sets aside as negligible for large n. Second, a corrected Lemma 5, which as printed is false for small τ. Third, a reusable model of online algorithms with deterministic arrivals and their randomized mixtures, and of the random-permutation instance.

Difficulty

The bound must hold for every online algorithm, including adaptive and randomized ones. An algorithm's decision can depend on everything it has seen, and the instance is averaged over n! permutations. So computing the best online algorithm's revenue directly is hopeless. The single-price instances of earlier work do not suffice either. On them all reasonable algorithms perform alike, whereas here the adversary's phase lengths must leave exactly one optimal way to ration inventory across phases. The upper bound on online revenue holds only asymptotically: the paper approximates harmonic sums by logarithms as n → ∞ and ignores the rounding of phase lengths. That is why the goal is in ε-form. Finally, the concave program that evaluates the bound has a closed-form optimum only when the candidate maximizer is nonnegative; Lemma 5 as printed omits this condition.

Formalization scope

Lean conventions:

  • Items and customers are 0-based (Fin n, Fin T); prices are 1-based functions ℕ → ℝ with r⁽⁰⁾ = 0 via price.
  • The booking limits α and the phase sizes B are hypotheses (IsBookingLimits, IsPhaseB), not chosen functions; Propositions 1 and 4 make them unique.
  • OPT is the real supremum of the LP's objective, a true maximum because the feasible set is nonempty and bounded.
  • A deterministic online algorithm is a rule taking the rows of customers 0, …, t to an optional (item, price) offer. It never sees later customers, or T. In the deterministic case this is the paper's information set.
  • A randomized algorithm is alg : Ω → OnlineAlg n on any probability space. Its expected revenue is a Bochner integral, with measurability in ω assumed; without that the integral could be 0 and the bound trivial.
  • The instance's phase borders are ⌊(1 − B_j)n⌋ and customer t is in group ⌊t/k⌋.

Disclosed departures from the page:

  • The goal and Lemma 4 carry an ε, as their proofs require.
  • The goal assumes 𝔼[OPT] > 0, because an empty arrival sequence would otherwise satisfy it trivially.
  • Lemma 5 assumes every candidate λ_ℓ = α⁽ℓ⁾ − (A_j − τ)/(m − j + 1) is nonnegative; the paper's one use (j = 1, τ = 1) satisfies this.
  • (25) is stated with an explicit rounding error of at most k(r⁽ᵐ⁾ − r⁽¹⁾).

The quantifier order is part of the theorem: the instance and distribution are fixed before the algorithm. A statement in which each algorithm gets its own hard instance is weaker and is not this theorem.

Needed infrastructure: finite sums over permutations, measure-theoretic expectation over the algorithm's randomness, harmonic-sum asymptotics, and one-dimensional concave maximization. The definitions of online algorithms and of the random-permutation instance are reusable for other Karp–Vazirani–Vazirani-type lower bounds. Contributions are welcome on any milestone. (35), Proposition 4 and (29) are elementary; (25) needs LP weak duality on the instance; Lemma 4 is the main work.

Selected references

  • W. Ma, D. Simchi-Levi, Algorithms for Online Matching, Assortment, and Pricing with Tight Weight-dependent Competitive Ratios, arXiv:1905.04770v1, 2019; Operations Research 68(6), 2020. https://arxiv.org/abs/1905.04770, https://doi.org/10.1287/opre.2019.1957
  • R. M. Karp, U. V. Vazirani, V. V. Vazirani, An optimal algorithm for on-line bipartite matching, STOC 1990. https://doi.org/10.1145/100216.100262
  • A. Mehta, A. Saberi, U. Vazirani, V. Vazirani, AdWords and generalized online matching, J. ACM 54(5), 2007. https://doi.org/10.1145/1284320.1284321
  • N. Golrezaei, H. Nazerzadeh, P. Rusmevichientong, Real-time optimization of personalized assortments, Management Science 60(6), 2014. https://doi.org/10.1287/mnsc.2014.1939
  • A. C. Yao, Probabilistic computations: Toward a unified measure of complexity, FOCS 1977. https://doi.org/10.1109/SFCS.1977.24
11 thms1 active userReviewed
Linear OptimizationOperations ResearchProbability·Captain: mikedeng1

Algorithms for Online Matching, Assortment, and Pricing with Tight Weight-Dependent Competitive Ratios I: Multi-price Balance Is minᵢ F̃ᵢ-Competitive, F̃ᵢ Bounded via F(𝒫ᵢ), G(𝒫ᵢ)/2 and kᵢResearch Paper

Motivation

Online matching and its revenue-management variants model a firm that allocates limited inventory to customers who arrive one at a time, without knowing who comes next. Classical results in this area assume each item has a single price, or weight. For a single price and large inventories, the BALANCE algorithm of Kalyanasundaram and Pruhs (2000) and its generalizations by Mehta, Saberi, Vazirani and Vazirani (2007), Buchbinder, Jain and Naor (2007) and Golrezaei, Nazerzadeh and Rusmevichientong (2014) achieve the competitive ratio 1−1/e1-1/e1−1/e, which is best possible.

Firms that can also choose a price for each sale face a different problem. Selling an item cheaply now uses inventory that a later customer might have paid more for. Ma and Simchi-Levi (2020) study this setting. Each item can be offered at one of finitely many prices, and the attainable competitive ratio depends on those prices. Their Multi-price Balance algorithm attains, as inventories grow, a ratio that their Theorem 3 shows no online algorithm can beat. This mission formalizes their Theorem 1, the guarantee of Multi-price Balance for finite inventories.

Setting

A firm sells items iii from a finite set. Item iii starts with ki≥1k_i\ge1ki​≥1 units and has a price set Pi\mathcal P_iPi​ of mi≥1m_i\ge1mi​≥1 prices 0<ri(1)<⋯<ri(mi)0<r_i^{(1)}<\dots<r_i^{(m_i)}0<ri(1)​<⋯<ri(mi​)​, with ri(0):=0r_i^{(0)}:=0ri(0)​:=0. Customers t=1,…,Tt=1,\dots,Tt=1,…,T arrive one by one. On arrival of customer ttt the firm learns pt,i(j)∈[0,1]p^{(j)}_{t,i}\in[0,1]pt,i(j)​∈[0,1], the probability that ttt buys item iii at price jjj. It offers at most one item, at one price. The customer accepts with that probability, and a sale earns ri(j)r_i^{(j)}ri(j)​ and uses one unit. An online algorithm decides using only the setup, the past, and the present customer's probabilities.

The benchmark is the linear program (5):

OPT=max⁡∑t,i,jpt,i(j)ri(j)xt,i(j)  s.t.  ∑t,jpt,i(j)xt,i(j)≤ki,  ∑i,jxt,i(j)≤1,  x≥0.\mathrm{OPT}=\max\sum_{t,i,j}p^{(j)}_{t,i}r_i^{(j)}x^{(j)}_{t,i}\ \ \text{s.t.}\ \ \sum_{t,j}p^{(j)}_{t,i}x^{(j)}_{t,i}\le k_i,\ \ \sum_{i,j}x^{(j)}_{t,i}\le1,\ \ x\ge0 .OPT=maxt,i,j∑​pt,i(j)​ri(j)​xt,i(j)​  s.t.  t,j∑​pt,i(j)​xt,i(j)​≤ki​,  i,j∑​xt,i(j)​≤1,  x≥0.

An algorithm is ccc-competitive on a setup if E[ALG]≥c⋅OPT\mathbb E[\mathrm{ALG}]\ge c\cdot\mathrm{OPT}E[ALG]≥c⋅OPT for every arrival sequence (6).

For a price set P\mathcal PP, the booking limits α(1),…,α(m)\alpha^{(1)},\dots,\alpha^{(m)}α(1),…,α(m) are the unique positive numbers summing to 111 with

1−e−α(1)=1−e−α(j)1−r(j−1)/r(j)(j=2,…,m),1-e^{-\alpha^{(1)}}=\frac{1-e^{-\alpha^{(j)}}}{1-r^{(j-1)}/r^{(j)}}\qquad(j=2,\dots,m),1−e−α(1)=1−r(j−1)/r(j)1−e−α(j)​(j=2,…,m),

and the values σ(j)\sigma^{(j)}σ(j) are the unique positive numbers summing to 111 with σ(1)=σ(j)/(1−r(j−1)/r(j))\sigma^{(1)}=\sigma^{(j)}/(1-r^{(j-1)}/r^{(j)})σ(1)=σ(j)/(1−r(j−1)/r(j)) (Proposition 1). Write F(P)=1−e−α(1)F(\mathcal P)=1-e^{-\alpha^{(1)}}F(P)=1−e−α(1) and G(P)=σ(1)G(\mathcal P)=\sigma^{(1)}G(P)=σ(1), and L(j)=α(1)+⋯+α(j)L^{(j)}=\alpha^{(1)}+\dots+\alpha^{(j)}L(j)=α(1)+⋯+α(j).

Multi-price Balance (Algorithm 1) gives each item random segment borders 0=L~i(0)≤⋯≤L~i(mi)=10=\tilde L_i^{(0)}\le\dots\le\tilde L_i^{(m_i)}=10=L~i(0)​≤⋯≤L~i(mi​)​=1 in {0,1/ki,…,1}\{0,1/k_i,\dots,1\}{0,1/ki​,…,1} and a nondecreasing value function Φ~i\tilde\Phi_iΦ~i​ on that grid with Φ~i(0)=0\tilde\Phi_i(0)=0Φ~i​(0)=0. Both are drawn from a randomized procedure, independently across items. With NiN_iNi​ units of item iii sold, customer ttt is offered a pair (i,j)(i,j)(i,j) maximizing

pt,i(j)(Φ~i(L~i(j))−Φ~i(Ni/ki))p^{(j)}_{t,i}\big(\tilde\Phi_i(\tilde L_i^{(j)})-\tilde\Phi_i(N_i/k_i)\big)pt,i(j)​(Φ~i​(L~i(j)​)−Φ~i​(Ni​/ki​))

when this maximum is positive. Two procedures are used. Definition 3 draws one uniform seed WWW and rounds every L(j)kL^{(j)}kL(j)k up or down with it, then sets Φ~\tilde\PhiΦ~ by formula (20). The procedure (45), for k=1k=1k=1, draws configuration ddd with probability σ(d)\sigma^{(d)}σ(d) and sets Φ~(1)=r(d)/σ(1)\tilde\Phi(1)=r^{(d)}/\sigma^{(1)}Φ~(1)=r(d)/σ(1).

Formalization targets

Goal: Theorem 1 (p. 16)

Give each item a mode. A perturbed item uses Definition 3. A split item is replaced by kik_iki​ single-unit copies, each using (45). With

bi=F(Pi)(1+ki)(e1/ki−1) (i),bi=G(Pi)2 (ii, split),bi=1−1/e(1+ki)(1−e−1/ki) (iii, if ∣Pi∣=1),b_i=\frac{F(\mathcal P_i)}{(1+k_i)(e^{1/k_i}-1)}\ \text{(i)},\qquad b_i=\frac{G(\mathcal P_i)}{2}\ \text{(ii, split)},\qquad b_i=\frac{1-1/e}{(1+k_i)(1-e^{-1/k_i})}\ \text{(iii, if }|\mathcal P_i|=1),bi​=(1+ki​)(e1/ki​−1)F(Pi​)​ (i),bi​=2G(Pi​)​ (ii, split),bi​=(1+ki​)(1−e−1/ki​)1−1/e​ (iii, if ∣Pi​∣=1),

Multi-price Balance with those modes satisfies, for every arrival sequence, every tie-breaking rule and every feasible xxx of (5),

(min⁡ibi)∑t,i,jpt,i(j)ri(j)xt,i(j)≤E[ALG].\Big(\min_i b_i\Big)\sum_{t,i,j}p^{(j)}_{t,i}r_i^{(j)}x^{(j)}_{t,i}\le\mathbb E[\mathrm{ALG}].(imin​bi​)t,i,j∑​pt,i(j)​ri(j)​xt,i(j)​≤E[ALG].

Milestones

  1. Weak duality for (5) and its dual (19) (p. 19).
  2. Theorem 4 (p. 19). If every item's procedure satisfies
ki(Φ~i(N+1ki)−Φ~i(Nki))+Φ~i(L~i(j))−Φ~i(Nki)≤ri(j)c  (17),E[Φ~i(L~i(j))]≥ri(j)  (18),k_i\big(\tilde\Phi_i(\tfrac{N+1}{k_i})-\tilde\Phi_i(\tfrac N{k_i})\big)+\tilde\Phi_i(\tilde L_i^{(j)})-\tilde\Phi_i(\tfrac N{k_i})\le\frac{r_i^{(j)}}c\ \ (17),\qquad \mathbb E[\tilde\Phi_i(\tilde L_i^{(j)})]\ge r_i^{(j)}\ \ (18),ki​(Φ~i​(ki​N+1​)−Φ~i​(ki​N​))+Φ~i​(L~i(j)​)−Φ~i​(ki​N​)≤cri(j)​​  (17),E[Φ~i​(L~i(j)​)]≥ri(j)​  (18),

then Algorithm 1 is ccc-competitive. 3. Proposition 3 (p. 21). E[L~(j)]=L(j)\mathbb E[\tilde L^{(j)}]=L^{(j)}E[L~(j)]=L(j), and ∣(L~(j)−L~(j′))−(L(j)−L(j′))∣≤1/k|(\tilde L^{(j)}-\tilde L^{(j')})-(L^{(j)}-L^{(j')})|\le1/k∣(L~(j)−L~(j′))−(L(j)−L(j′))∣≤1/k. 4. (35) (p. 39). r(j−1)/r(j)≤e−α(j)r^{(j-1)}/r^{(j)}\le e^{-\alpha^{(j)}}r(j−1)/r(j)≤e−α(j). 5. Theorem 5 (p. 22). Definition 3 satisfies (17)–(18) with c=F(P)/((1+k)(e1/k−1))c=F(\mathcal P)/((1+k)(e^{1/k}-1))c=F(P)/((1+k)(e1/k−1)), and with c=F(P)/((1+k)(1−e−1/k))c=F(\mathcal P)/((1+k)(1-e^{-1/k}))c=F(P)/((1+k)(1−e−1/k)) when m=1m=1m=1. 6. (45) (p. 44). For k=1k=1k=1, the procedure (45) satisfies (17)–(18) with c=σ(1)/2c=\sigma^{(1)}/2c=σ(1)/2.

Significance

For a single price, bound (iii) improves the dependence on kik_iki​ of the guarantee of Golrezaei et al. (2014). For several prices, bound (i) tends to F(Pi)F(\mathcal P_i)F(Pi​) as ki→∞k_i\to\inftyki​→∞ (Corollary 1). Mission III of this series formalizes Theorem 3, by which no online algorithm beats F(P)F(\mathcal P)F(P), so Theorem 1 makes that ratio tight. Bound (ii) uses a different procedure and gives a guarantee for small inventories that does not rely on perturbing the ideal value function. The paper's Section 6 applies the same framework to the Adwords problem and to assortment problems with multiple prices.

The paper's proofs are in its Appendix B: Theorem 4 by a randomized primal–dual argument, Proposition 3 and Theorem 5 by analysis of the comonotone rounding, (45) by solving a small system, and Theorem 1 by assembling them. None of these results has a machine-checked proof. A complete formalization would yield a reusable, checked primal–dual framework for randomized online allocation: Theorem 4 holds for any family of procedures satisfying (17)–(18).

Difficulty

The primal–dual proof of Theorem 4 sets the dual variables yi=E[Φ~i(NT,i/ki)]y_i=\mathbb E[\tilde\Phi_i(N_{T,i}/k_i)]yi​=E[Φ~i​(NT,i​/ki​)] and zt=E[Zt]z_t=\mathbb E[Z_t]zt​=E[Zt​], where ZtZ_tZt​ is the pseudorevenue. These are expectations over both the initialization and the purchase decisions, and the dual constraint holds only after conditioning on the history and taking expectations. A deterministic value function does not suffice for multiple prices with finite inventory, since the borders L(j)kiL^{(j)}k_iL(j)ki​ are generally not integers. This is why the value functions are random. Rounding each border independently would break the segment-length control. Theorem 5 needs the comonotone bound (22), and an induction over segments with careful bookkeeping of the rounding errors.

Formalization scope

  • Indices. Items form an arbitrary nonempty finite type. Customers are indexed 0,…,T−10,\dots,T-10,…,T−1. Prices are 111-based with r(0)=0r^{(0)}=0r(0)=0. Probabilities pt,i(j)∈[0,1]p^{(j)}_{t,i}\in[0,1]pt,i(j)​∈[0,1], ki≥1k_i\ge1ki​≥1, mi≥1m_i\ge1mi​≥1 and 0<ri(1)<⋯<ri(mi)0<r_i^{(1)}<\dots<r_i^{(m_i)}0<ri(1)​<⋯<ri(mi​)​ are hypotheses.
  • Booking limits. α\alphaα and σ\sigmaσ enter as functions satisfying the defining systems (7) and (8) with positivity and unit sum. By Proposition 1 they are the paper's values.
  • Unit indices. Borders are stored as kL~(j)∈{0,…,k}k\tilde L^{(j)}\in\{0,\dots,k\}kL~(j)∈{0,…,k} and value functions as N↦Φ~(N/k)N\mapsto\tilde\Phi(N/k)N↦Φ~(N/k). In (17) the range of NNN is N<kL~(j)N<k\tilde L^{(j)}N<kL~(j).
  • The algorithm. The offer at customer ttt is computed from that customer's probabilities and the sales counts. The count in (16) is read as min⁡(Ni,ki)\min(N_i,k_i)min(Ni​,ki​), which equals NiN_iNi​ because the algorithm never sells a stocked-out item. Ties are broken by an arbitrary rule returning a maximizer, and every statement holds for every such rule.
  • Expectations. Expected revenue is a finite sum over configurations, weighted by product probabilities, combined with a backward recursion over accept/reject outcomes. Definition 3's configuration probabilities are Lebesgue measures of seed sets.
  • Competitive ratio. The ratio is always stated as c⋅(5a)(x)≤E[ALG]c\cdot(5\mathrm a)(x)\le\mathbb E[\mathrm{ALG}]c⋅(5a)(x)≤E[ALG] for every feasible xxx of the original LP (5). This rules out the trivializations through x/0=0x/0=0x/0=0 when OPT=0\mathrm{OPT}=0OPT=0, through an infimum over arrival sequences, and through a benchmark taken on the split setup instead of the original one.
  • F~i\tilde F_iF~i​ is not used. The printed theorem is phrased through F~i\tilde F_iF~i​, the optimum of the problem (44). The proof never shows that this optimum is attained. Its bound (ii) also comes from splitting the item, not from a procedure feasible for (44). The goal is therefore stated with explicit bounds and modes; choosing the better mode per item gives the printed min⁡imax⁡{… }\min_i\max\{\dots\}mini​max{…}.
  • Not posed. Corollaries 1–2 and the optimality and uniqueness claims about (45).

Weak duality is shared with mission II and (35) with mission III; each mission defines its own copy of the model. Contributions welcome: proofs of the milestones, and of the goal from them.

Selected references

  • W. Ma, D. Simchi-Levi, Algorithms for Online Matching, Assortment, and Pricing with Tight Weight-dependent Competitive Ratios, arXiv:1905.04770v1 (2019); Operations Research 68(6), 2020. https://arxiv.org/abs/1905.04770, https://doi.org/10.1287/opre.2019.1957
  • B. Kalyanasundaram, K. Pruhs, An optimal deterministic algorithm for online b-matching, Theoretical Computer Science 233, 2000. https://doi.org/10.1016/S0304-3975(99)00140-1
  • A. Mehta, A. Saberi, U. Vazirani, V. Vazirani, AdWords and generalized online matching, Journal of the ACM 54(5), 2007. https://doi.org/10.1145/1284320.1284321
  • N. Buchbinder, K. Jain, J. Naor, Online primal-dual algorithms for maximizing ad-auctions revenue, ESA 2007. https://doi.org/10.1007/978-3-540-75520-3_24
  • N. Golrezaei, H. Nazerzadeh, P. Rusmevichientong, Real-time optimization of personalized assortments, Management Science 60(6), 2014. https://doi.org/10.1287/mnsc.2014.1939
11 thms1 active userReviewed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Optimal Approximation for Submodular and Supermodular Optimization with Bounded Curvature I: Swap-Local Optima of the Non-Oblivious Potential Are (1 − c/e)-Approximate for Submodular MaximizationResearch Paper

Motivation

Maximizing a monotone submodular function over the bases of a matroid is the standard model for coverage, facility location, sensor placement and welfare maximization. The best possible approximation factor in the value-oracle model is 1−1/e1 - 1/e1−1/e (Nemhauser–Wolsey 1978; Călinescu–Chekuri–Pál–Vondrák 2011). Many functions met in practice are far from the worst case: they are close to linear. Total curvature measures how close. Conforti and Cornuéjols (1984) showed that the greedy algorithm achieves (1−e−c)/c(1 - e^{-c})/c(1−e−c)/c on uniform matroids and 1/(1+c)1/(1+c)1/(1+c) on general matroids when the curvature is at most ccc; Vondrák (RIMS Kôkyûroku Bessatsu, 2010) obtained (1−e−c)/c(1 - e^{-c})/c(1−e−c)/c for every matroid, for a weaker curvature notion.

Sviridenko, Vondrák and Ward (SODA 2015; journal version Math. Oper. Res. 2017) improve this to 1−c/e1 - c/e1−c/e, show it is optimal, and obtain the matching factor 1+c1−ce−11 + \frac{c}{1-c} e^{-1}1+1−cc​e−1 for minimizing a monotone decreasing supermodular function. One of their two algorithms is a non-oblivious local search, a single-swap search guided not by fff but by an auxiliary potential. This mission formalizes the exact guarantee of that local search. All numbering below is that of the SODA 2015 version (authors' copy dated Oct. 9, 2014).

Setting

Let XXX be a finite set. A set function assigns a real number f(A)f(A)f(A) to every A⊆XA \subseteq XA⊆X. Its marginal value at i∈Xi \in Xi∈X over AAA is fA(i)=f(A+i)−f(A)f_A(i) = f(A + i) - f(A)fA​(i)=f(A+i)−f(A). The function is submodular if f(A)+f(B)≥f(A∩B)+f(A∪B)f(A) + f(B) \ge f(A \cap B) + f(A \cup B)f(A)+f(B)≥f(A∩B)+f(A∪B) for all A,BA, BA,B; supermodular if −f-f−f is submodular; monotone increasing if every fA(i)≥0f_A(i) \ge 0fA​(i)≥0, and monotone decreasing if every fA(i)≤0f_A(i) \le 0fA​(i)≤0.

A monotone increasing fff has total curvature at most ccc if fX−j(j)≥(1−c)f∅(j)f_{X-j}(j) \ge (1-c) f_\emptyset(j)fX−j​(j)≥(1−c)f∅​(j) for every j∈Xj \in Xj∈X: adding jjj last is worth at least a (1−c)(1-c)(1−c) fraction of adding it first. For c=0c = 0c=0 the function is linear up to a constant; c=1c = 1c=1 is no restriction. For a monotone decreasing fff the inequality is reversed: fX−j(j)≤(1−c)f∅(j)f_{X-j}(j) \le (1-c) f_\emptyset(j)fX−j​(j)≤(1−c)f∅​(j).

A matroid M=(X,I)\mathcal M = (X, \mathcal I)M=(X,I) is given by its independent sets; its bases B(M)\mathcal B(\mathcal M)B(M) are the maximal independent sets, and its dual M∗\mathcal M^*M∗ has the complements X∖BX \setminus BX∖B of bases as bases.

For a monotone increasing submodular fff, §6.1 of the paper splits f=g+ℓf = g + \ellf=g+ℓ with a linear part and a remainder,

ℓ(A)=∑j∈AfX−j(j),g(A)=f(A)−ℓ(A).\ell(A) = \sum_{j \in A} f_{X-j}(j), \qquad g(A) = f(A) - \ell(A).ℓ(A)=j∈A∑​fX−j​(j),g(A)=f(A)−ℓ(A).

The local search uses the Filmus–Ward potential of ggg and the potential ψ\psiψ:

h(A)=∑∅≠B⊆Ag(B)∫01epe−1 p∣B∣−1(1−p)∣A∣−∣B∣ dp,ψ(A)=(1−e−1) h(A)+ℓ(A).h(A) = \sum_{\emptyset \ne B \subseteq A} g(B) \int_0^1 \frac{e^p}{e-1}\, p^{|B|-1}(1-p)^{|A|-|B|}\, dp, \qquad \psi(A) = (1 - e^{-1})\, h(A) + \ell(A).h(A)=∅=B⊆A∑​g(B)∫01​e−1ep​p∣B∣−1(1−p)∣A∣−∣B∣dp,ψ(A)=(1−e−1)h(A)+ℓ(A).

A base SSS is a swap-local optimum of ψ\psiψ if ψ(S−a+b)≤ψ(S)\psi(S - a + b) \le \psi(S)ψ(S−a+b)≤ψ(S) for every a∈Sa \in Sa∈S and b∈X∖Sb \in X \setminus Sb∈X∖S with S−a+bS - a + bS−a+b a base.

Formalization targets

Goal: exact core of Theorem 6.1

For f≥0f \ge 0f≥0 monotone increasing and submodular with curvature at most c∈[0,1]c \in [0,1]c∈[0,1], every swap-local optimum SSS of ψ\psiψ satisfies

f(S) ≥ (1−ce) f(O)for every O∈I.f(S) \ \ge\ \Bigl(1 - \frac{c}{e}\Bigr)\, f(O) \qquad \text{for every } O \in \mathcal I.f(S) ≥ (1−ec​)f(O)for every O∈I.

The printed Theorem 6.1 asserts a randomized polynomial-time algorithm losing O(ϵ)O(\epsilon)O(ϵ); the goal is the ϵ=0\epsilon = 0ϵ=0 statement its proof establishes for local optima.

Milestones

  1. Lemma 2.1: ∑j∈AfX−j(j)≥(1−c)f(A)\sum_{j \in A} f_{X-j}(j) \ge (1-c) f(A)∑j∈A​fX−j​(j)≥(1−c)f(A), for f(∅)=0f(\emptyset) = 0f(∅)=0.
  2. Lemma A.1: g=f−ℓg = f - \ellg=f−ℓ is submodular, monotone increasing and nonnegative.
  3. Lemma 5.1 (Brualdi): two bases A,BA, BA,B admit a bijection π:A→B\pi : A \to Bπ:A→B with A−x+π(x)A - x + \pi(x)A−x+π(x) a base for every x∈Ax \in Ax∈A.
  4. Display (5.4) (Filmus–Ward): ee−1g(A)≥g(B)+∑i[h(A)−h(A−ai+bi)]\frac{e}{e-1} g(A) \ge g(B) + \sum_i [h(A) - h(A - a_i + b_i)]e−1e​g(A)≥g(B)+∑i​[h(A)−h(A−ai​+bi​)].
  5. Lemma 5.2: g(A)+ℓ(A)≥(1−e−1)g(B)+ℓ(B)+∑i[ψ(A)−ψ(A−ai+bi)]g(A) + \ell(A) \ge (1 - e^{-1}) g(B) + \ell(B) + \sum_i [\psi(A) - \psi(A - a_i + b_i)]g(A)+ℓ(A)≥(1−e−1)g(B)+ℓ(B)+∑i​[ψ(A)−ψ(A−ai​+bi​)].
  6. §5.1: a swap-local optimum SSS satisfies g(S)+ℓ(S)≥(1−e−1)g(O)+ℓ(O)g(S) + \ell(S) \ge (1 - e^{-1}) g(O) + \ell(O)g(S)+ℓ(S)≥(1−e−1)g(O)+ℓ(O) for every base OOO.

Companion statements

Lemma 2.2, Lemma A.2 and the exact core of Theorem 6.2: for f≥0f \ge 0f≥0 monotone decreasing and supermodular with curvature at most c∈[0,1)c \in [0, 1)c∈[0,1), a swap-local optimum SSS of the corresponding ψ\psiψ in M∗\mathcal M^*M∗ yields a base X∖SX \setminus SX∖S of M\mathcal MM with

f(X∖S) ≤ (1+c1−c e−1)f(O)for every O∈I.f(X \setminus S) \ \le\ \Bigl(1 + \frac{c}{1-c}\, e^{-1}\Bigr) f(O) \qquad \text{for every } O \in \mathcal I.f(X∖S) ≤ (1+1−cc​e−1)f(O)for every O∈I.

Lemmas A.3 and A.4 are the curvature constructions behind the paper's matching lower bounds.

Significance

The factor 1−c/e1 - c/e1−c/e equals 1−1/e1 - 1/e1−1/e at c=1c = 1c=1 and tends to 111 as c→0c \to 0c→0, so it recovers the classical bound and improves it for every curvature below 111; Theorem 7.1 of the paper shows that no algorithm using polynomially many value queries does better. The decomposition f=g+ℓf = g + \ellf=g+ℓ and the joint guarantee g(S)+ℓ(S)≥(1−e−1)g(O)+ℓ(O)g(S) + \ell(S) \ge (1 - e^{-1}) g(O) + \ell(O)g(S)+ℓ(S)≥(1−e−1)g(O)+ℓ(O) are reusable: they give the supermodular-minimization result of Theorem 6.2, and §8 of the paper applies that result to column-subset selection.

The results are proved in the literature; none is machine-checked. The mission produces a formal proof of the exact local-search guarantee, of Brualdi's bijective exchange for Mathlib matroids, and of Filmus and Ward's inequality for their potential hhh, which underlies other non-oblivious local searches for submodular functions.

Difficulty

The reduction from the goal to the §5.1 claim is short. The work is in (5.4): the obvious argument, summing submodularity over the swaps, controls ∑i[g(A)−g(A−ai+bi)]\sum_i [g(A) - g(A - a_i + b_i)]∑i​[g(A)−g(A−ai​+bi​)] and gives only the oblivious factor 1/21/21/2. The potential hhh averages ggg over all subsets of AAA with Beta-type weights, and (5.4) is an identity-level computation with the integrals ∫01eppk−1(1−p)m−k dp\int_0^1 e^p p^{k-1}(1-p)^{m-k}\,dp∫01​eppk−1(1−p)m−kdp. Brualdi's lemma needs a Hall-type argument on the exchange graph; Mathlib has only single-element exchange. Lemma 2.1 also hides a point the paper skips: it is false unless f(∅)=0f(\emptyset) = 0f(∅)=0, so the goal needs a normalisation f↦f−f(∅)f \mapsto f - f(\emptyset)f↦f−f(∅) that leaves marginals, ℓ\ellℓ and the swap-local optima unchanged.

Formalization scope

Subsets are Finset X over [Fintype X] [DecidableEq X] with X : Type; set functions are Finset X → ℝ, and the paper's codomain R≥0\mathbb R_{\ge 0}R≥0​ is a hypothesis ∀ A, 0 ≤ f A. Submodularity is the published definition NonmonotoneSubmod.Shared.Submodular. Total curvature is in the product form above, not the ratio of (1.1), which is undefined when some f∅(j)=0f_\emptyset(j) = 0f∅​(j)=0. Matroids are Mathlib's Matroid X, with M.E = Set.univ wherever fff and M\mathcal MM meet, so that X∖SX \setminus SX∖S is complemented in the right set; the dual is M✶. eee is Real.exp 1. The bijection of Lemma 5.1 is a function π : X → X with Set.BijOn π A B, and sums over i=1,…,ri = 1, \dots, ri=1,…,r are sums over a∈Aa \in Aa∈A with b=π(a)b = \pi(a)b=π(a).

Conventions that differ from the page, each disclosed in the item's Formalization Note:

  • the B=∅B = \emptysetB=∅ term of hhh is excluded (on the page it is g(∅)∫01p−1⋯dpg(\emptyset) \int_0^1 p^{-1} \cdots dpg(∅)∫01​p−1⋯dp, finite only when g(∅)=0g(\emptyset) = 0g(∅)=0);
  • (5.4), Lemma 5.2 and the §5.1 claim assume ggg monotone and nonnegative, the setting of Filmus and Ward and of every use in the paper;
  • Lemma 2.1 adds f(∅)=0f(\emptyset) = 0f(∅)=0, Lemma A.2's nonnegativity adds f(X)=0f(X) = 0f(X)=0, and Lemmas A.3 and A.4 take c>0c > 0c>0; Lemma A.4 is stated as its proof proves it (supermodular, monotone decreasing).

The goal is about every swap-local optimum of ψ\psiψ, not about the existence of a good base: "some base satisfies f(S)≥(1−c/e)f(O)f(S) \ge (1 - c/e) f(O)f(S)≥(1−c/e)f(O)" is trivially true by taking SSS optimal, and is not the theorem.

Welcome contributions: Brualdi's lemma for Mathlib matroids (reusable well beyond this mission), the Beta-integral identities behind hhh, and the normalisation argument. The polynomial-time algorithm, the sampling estimate of ψ\psiψ (§5.2), the continuous greedy of §4 and the lower bounds of §7 are out of scope.

Selected references

  • M. Sviridenko, J. Vondrák, J. Ward, Optimal approximation for submodular and supermodular optimization with bounded curvature, SODA 2015; Math. Oper. Res. 42(4), 2017. https://doi.org/10.1287/moor.2016.0842
  • Y. Filmus, J. Ward, Monotone submodular maximization over a matroid via non-oblivious local search, SIAM J. Comput. 43(2), 2014. https://doi.org/10.1137/110832318
  • M. Conforti, G. Cornuéjols, Submodular set functions, matroids and the greedy algorithm: tight worst-case bounds and some generalizations of the Rado–Edmonds theorem, Discrete Appl. Math. 7(3), 1984. https://doi.org/10.1016/0166-218X(84)90003-9
  • R. A. Brualdi, Comments on bases in dependence structures, Bull. Austral. Math. Soc. 1(2), pp. 161–167, 1969.
  • G. L. Nemhauser, L. A. Wolsey, Best algorithms for approximating the maximum of a submodular set function, Math. Oper. Res. 3(3), 1978. https://doi.org/10.1287/moor.3.3.177
  • G. Călinescu, C. Chekuri, M. Pál, J. Vondrák, Maximizing a monotone submodular function subject to a matroid constraint, SIAM J. Comput. 40(6), 2011. https://doi.org/10.1137/080733991
  • J. Vondrák, Submodularity and curvature: the optimal algorithm, RIMS Kôkyûroku Bessatsu B23, pp. 253–266, 2010.
9 thms1 active userReviewed
CombinatoricsLinear algebraMarkov Chain·Captain: mikedeng1

High Order Random Walks: Beyond Spectral Gap 2: On a Two-Sided λ-Local Spectral Expander, Spec(M⁺_k) ⊆ {1} ∪ ⋃_j [(k+1−j)/(k+2) ± √(k+1)·ε_k/(k+2)] and Eigenvectors Lie Near U^j_kResearch Paper

Motivation

High-dimensional expanders are simplicial complexes whose local structure forces global mixing. Random walks on their kkk-dimensional faces, the high order random walks, are used to analyse sampling algorithms: the bases-exchange walk on the bases of a matroid is such a walk, and its spectral analysis by Anari, Liu, Oveis Gharan and Vinzant (arXiv:1811.01816) settled the Mihail–Vazirani conjecture on counting matroid bases. Agreement tests and PCP constructions use the same walks (Dinur–Kaufman, FOCS 2017).

Most of these applications use only the second eigenvalue of the walk. Kaufman and Oppenheim (arXiv:1707.02799v3) observe that this eigenvalue cannot be very small, because of natural obstructions such as cochains pulled up from lower dimensions, and ask instead for the whole spectrum and the structure of the eigenvectors. For complexes whose links have both small second eigenvalue and bounded-below smallest eigenvalue (two-sided local spectral expanders), they show that the spectrum of the walk on kkk-faces clusters around k+1k+1k+1 explicit values, each cluster corresponding to cochains built from a lower dimension.

Timeline. Garland (1973, doi:10.2307/1970833) introduced the localization method relating global cohomology to spectra of links. Kaufman and Mass (ITCS 2017, arXiv:1604.02947) defined high order random walks and bounded their second eigenvalue. Oppenheim (Discrete Comput. Geom. 2018, arXiv:1709.04431) developed the local spectral expansion framework and its trickle-down theorem. Kaufman and Oppenheim gave the decomposition theorems this mission formalizes; arXiv v3 (2021) corrects an error of the published version. Alev and Lau (arXiv:2001.02827) later improved the one-sided bounds.

Setting

Let XXX be a pure nnn-dimensional finite simplicial complex on a vertex set VVV: a finite family of finite subsets of VVV, closed under subsets, in which every face lies in a face with n+1n+1n+1 vertices. X(k)X(k)X(k) is the set of faces with k+1k+1k+1 vertices, and X(−1)={∅}X(-1)=\{\emptyset\}X(−1)={∅}. A weight is a function m:X→(0,∞)m:X\to(0,\infty)m:X→(0,∞) with m(τ)=∑σ∈X(k+1), τ⊆σm(σ)m(\tau)=\sum_{\sigma\in X(k+1),\,\tau\subseteq\sigma}m(\sigma)m(τ)=∑σ∈X(k+1),τ⊆σ​m(σ) for τ∈X(k)\tau\in X(k)τ∈X(k), k≤n−1k\le n-1k≤n−1.

A kkk-cochain is a function ϕ:X(k)→R\phi:X(k)\to\mathbb Rϕ:X(k)→R; the space Ck(X)C^k(X)Ck(X) carries the inner product ⟨ϕ,ψ⟩=∑σ∈X(k)m(σ)ϕ(σ)ψ(σ)\langle\phi,\psi\rangle=\sum_{\sigma\in X(k)}m(\sigma)\phi(\sigma)\psi(\sigma)⟨ϕ,ψ⟩=∑σ∈X(k)​m(σ)ϕ(σ)ψ(σ). C0k(X)C^k_0(X)C0k​(X) is the subspace of cochains orthogonal to the constants.

  • The signless differential dk:Ck→Ck+1d_k:C^k\to C^{k+1}dk​:Ck→Ck+1 is dkϕ(σ)=∑τ⊂σ, τ∈X(k)ϕ(τ)d_k\phi(\sigma)=\sum_{\tau\subset\sigma,\,\tau\in X(k)}\phi(\tau)dk​ϕ(σ)=∑τ⊂σ,τ∈X(k)​ϕ(τ), and dk∗d_k^*dk∗​ is its adjoint.
  • The upper random walk Mk+M^+_kMk+​ on X(k)X(k)X(k) stays at τ\tauτ with probability 1k+2\frac1{k+2}k+21​ and moves to τ′\tau'τ′ with probability m(τ∪τ′)(k+2)m(τ)\frac{m(\tau\cup\tau')}{(k+2)m(\tau)}(k+2)m(τ)m(τ∪τ′)​ when τ∪τ′∈X(k+1)\tau\cup\tau'\in X(k+1)τ∪τ′∈X(k+1); equivalently dk∗dk=(k+2)Mk+d_k^*d_k=(k+2)M^+_kdk∗​dk​=(k+2)Mk+​.
  • The link of τ\tauτ is Xτ={η: η∩τ=∅, τ∪η∈X}X_\tau=\{\eta:\ \eta\cap\tau=\emptyset,\ \tau\cup\eta\in X\}Xτ​={η: η∩τ=∅, τ∪η∈X} with weight mτ(η)=m(τ∪η)m_\tau(\eta)=m(\tau\cup\eta)mτ​(η)=m(τ∪η). On its vertices, (M′)τ,0+(M')^+_{\tau,0}(M′)τ,0+​ is the non-lazy walk; μτ\mu_\tauμτ​ and ντ\nu_\tauντ​ are its second largest and smallest eigenvalues.
  • XXX is a two-sided λ\lambdaλ-local spectral expander if −λ≤ντ-\lambda\le\nu_\tau−λ≤ντ​ and μτ≤λ\mu_\tau\le\lambdaμτ​≤λ for every face τ\tauτ of dimension −1,…,n−2-1,\dots,n-2−1,…,n−2.

For 0≤k≤n−10\le k\le n-10≤k≤n−1 the paper defines subspaces of C0k(X)C^k_0(X)C0k​(X): V00=C00V^0_0=C^0_0V00​=C00​; for k≥1k\ge1k≥1, Vkj=dk−1⋯dj(C0j)V^j_k=d_{k-1}\cdots d_j(C^j_0)Vkj​=dk−1​⋯dj​(C0j​) for j<kj<kj<k and Vkk=ker⁡dk−1∗V^k_k=\ker d^*_{k-1}Vkk​=kerdk−1∗​; and Uk0=Vk0U^0_k=V^0_kUk0​=Vk0​, Ukj=Vkj∩(Vkj−1)⊥U^j_k=V^j_k\cap(V^{j-1}_k)^\perpUkj​=Vkj​∩(Vkj−1​)⊥ for 0<j<k0<j<k0<j<k, Ukk=VkkU^k_k=V^k_kUkk​=Vkk​. With ε0=λ\varepsilon_0=\lambdaε0​=λ and εk=2k(1+2kk)εk−1+(k+1)λ\varepsilon_k=2k(1+2k\sqrt k)\varepsilon_{k-1}+(k+1)\lambdaεk​=2k(1+2kk​)εk−1​+(k+1)λ, PUP_{U}PU​ denotes the weighted orthogonal projection onto UUU.

Formalization targets

Goal: Theorem 5.9 (p. 22)

If εk≤12(1+2(k+1)k+1)\varepsilon_k\le\frac{1}{2(1+2(k+1)\sqrt{k+1})}εk​≤2(1+2(k+1)k+1​)1​ for 0≤k≤n−20\le k\le n-20≤k≤n−2 and εn−1<12n\varepsilon_{n-1}<\frac1{2\sqrt n}εn−1​<2n​1​, then for 0≤k≤n−10\le k\le n-10≤k≤n−1

Spec⁡(Mk+)⊆{1}∪⋃j=0k[k+1−jk+2−k+1k+2εk, k+1−jk+2+k+1k+2εk],\operatorname{Spec}(M^+_k)\subseteq\{1\}\cup\bigcup_{j=0}^{k}\Big[\tfrac{k+1-j}{k+2}-\tfrac{\sqrt{k+1}}{k+2}\varepsilon_k,\ \tfrac{k+1-j}{k+2}+\tfrac{\sqrt{k+1}}{k+2}\varepsilon_k\Big],Spec(Mk+​)⊆{1}∪j=0⋃k​[k+2k+1−j​−k+2k+1​​εk​, k+2k+1−j​+k+2k+1​​εk​],

and an eigenvector ϕ∈C0k\phi\in C^k_0ϕ∈C0k​ whose eigenvalue lies in the jjj-th interval satisfies ∥ϕ−PUkjϕ∥≤k+1εk1−k+1εk∥ϕ∥\|\phi-P_{U^j_k}\phi\|\le\frac{\sqrt{k+1}\varepsilon_k}{1-\sqrt{k+1}\varepsilon_k}\|\phi\|∥ϕ−PUkj​​ϕ∥≤1−k+1​εk​k+1​εk​​∥ϕ∥.

Milestones

  • the localization identities (Lemma 3.6, Corollary 3.7, Propositions 4.1, 4.2) and the two-sided bound of Lemma 4.3;
  • Lemma 5.1 and the orthogonal decomposition C0k(X)=Ukk⊕⋯⊕Uk0C^k_0(X)=U^k_k\oplus\cdots\oplus U^0_kC0k​(X)=Ukk​⊕⋯⊕Uk0​ (§5.3);
  • Theorem 5.6: ∥dk∗dkPUkjϕ−(k+1−j)PUkjϕ∥≤εk∥PUkjϕ∥\|d^*_kd_kP_{U^j_k}\phi-(k+1-j)P_{U^j_k}\phi\|\le\varepsilon_k\|P_{U^j_k}\phi\|∥dk∗​dk​PUkj​​ϕ−(k+1−j)PUkj​​ϕ∥≤εk​∥PUkj​​ϕ∥;
  • Corollary 5.8: the same for Mk+M^+_kMk+​, with k+1−jk+2\frac{k+1-j}{k+2}k+2k+1−j​ and εkk+2\frac{\varepsilon_k}{k+2}k+2εk​​.

Significance

The result. Theorem 5.9 describes the spectrum of Mk+M^+_kMk+​, not only its second eigenvalue. The eigenvalue k+1−jk+2\frac{k+1-j}{k+2}k+2k+1−j​ is the one carried by cochains pulled up from dimension jjj, so it explains which cochains are shrunk slowly by the walk and which quickly. It is the two-sided counterpart of the paper's one-sided mixing bound (Theorem 5.4, the subject of the first mission in this series). It gives approximate eigenspaces explicitly, which a mixing-time analysis or an agreement-test analysis can use in place of a bound on a single eigenvalue.

Formalizing it. No machine-checked development of simplicial-complex random walks, Garland's method, or local spectral expansion is known to exist; Mathlib has simplicial complexes in a geometric sense but no weighted cochain calculus. The mission produces the cochain calculus of §2–§4 together with the spectral statements of §5.3. The statements are those of the arXiv v3 preprint. They are published results but have not been formalized.

Difficulty

The obvious route would show that the spaces UkjU^j_kUkj​ are exact eigenspaces. That holds for the complete complex but not in general: d∗dd^*dd∗d maps UkjU^j_kUkj​ only approximately into itself, and the error has to be controlled through every lower dimension at once. Theorem 5.6 is an induction on kkk in which the error εk−1\varepsilon_{k-1}εk−1​ of dimension k−1k-1k−1 enters dimension kkk multiplied by norms of dk−1∗dk−1d^*_{k-1}d_{k-1}dk−1∗​dk−1​ and its square root. Controlling these factors on the correct subspaces, rather than on all of Ck−1C^{k-1}Ck−1, is the delicate step: dk−1∗dk−1=(k+1)Mk−1+d^*_{k-1}d_{k-1}=(k+1)M^+_{k-1}dk−1∗​dk−1​=(k+1)Mk−1+​ has norm k+1k+1k+1 on Ck−1(X)C^{k-1}(X)Ck−1(X), attained on the constants, and the bound needed is on the complement of the constants. Passing from Corollary 5.8 to the spectral statement of Theorem 5.9 needs the intervals to be disjoint and the eigenvector to be split along the orthogonal decomposition.

Formalization scope

  • Encoding. Faces are Finset V and XXX is a Finset (Finset V); faces are indexed by their number of vertices (cells X (k + 1) is X(k)X(k)X(k)). Cochains are functions Finset V → ℝ, and every operator vanishes off XXX.
  • Supports. Subspaces, eigenvectors and orthogonal complements consist of functions supported on X(k)X(k)X(k) (Supp X (k + 1)). Without this, a function living off the faces would have norm 000, would be an eigenvector with eigenvalue 000, and would make the spectral statement false; a formalization without supports is ruled out for this reason.
  • Weights and adjoints. The weight is strictly positive on faces. d∗d^*d∗ is defined by its explicit formula, and Lemma 3.6 states that this formula is the adjoint.
  • Expansion. The eigenvalue conditions on links are stated in Rayleigh form on the weighted complement of the constants, ∣⟨(M′)τ,0+g,g⟩∣≤λ∥g∥2|\langle(M')^+_{\tau,0}g,g\rangle|\le\lambda\|g\|^2∣⟨(M′)τ,0+​g,g⟩∣≤λ∥g∥2; this encodes −λ≤ντ-\lambda\le\nu_\tau−λ≤ντ​ and μτ≤λ\mu_\tau\le\lambdaμτ​≤λ and needs no connectivity. Definition 1.2 is followed where Definition 4.4 misprints the two-sided clause.
  • Projections. PUϕP_U\phiPU​ϕ is characterised relationally (IsWProj: u∈Uu\in Uu∈U and ϕ−u⊥U\phi-u\perp Uϕ−u⊥U) instead of by an operator. On these finite-dimensional subspaces it exists and is unique.
  • Indices and constants. εk\varepsilon_kεk​ is eps lam k, with the recursion shifted by one index. kkk is quantified inside each conclusion, and εn−1\varepsilon_{n-1}εn−1​ is written without natural subtraction. The statements follow the printed constants of arXiv v3.

A complete development needs finite-dimensional weighted inner-product spaces of cochains, Garland localization, Courant–Fischer for self-adjoint operators on these spaces, and orthogonal projections onto images of iterated differentials. The cochain calculus and the localization identities are reusable for any weighted simplicial complex, and the first mission of this series needs the same objects. Proofs of the localization identities, of the decomposition, and of any milestone are welcome, as are proofs of the results with weaker hypotheses.

Selected references

  • T. Kaufman, I. Oppenheim, High Order Random Walks: Beyond Spectral Gap, arXiv:1707.02799v3, 2021. https://arxiv.org/abs/1707.02799
  • H. Garland, p-adic curvature and the cohomology of discrete subgroups of p-adic groups, Annals of Mathematics 97, 1973. https://doi.org/10.2307/1970833
  • T. Kaufman, D. Mass, High dimensional random walks and colorful expansion, ITCS 2017. https://arxiv.org/abs/1604.02947
  • I. Oppenheim, Local spectral expansion approach to high dimensional expanders Part I: Descent of spectral gaps, Discrete & Computational Geometry 59, 2018. https://arxiv.org/abs/1709.04431
  • N. Anari, K. Liu, S. Oveis Gharan, C. Vinzant, Log-concave polynomials II: high-dimensional walks and an FPRAS for counting bases of a matroid, STOC 2019. https://arxiv.org/abs/1811.01816
  • V. L. Alev, L. C. Lau, Improved analysis of higher order random walks and applications, STOC 2020. https://arxiv.org/abs/2001.02827
15 thms1 active userReviewed
CombinatoricsLinear algebraMarkov Chain·Captain: mikedeng1

High Order Random Walks: Beyond Spectral Gap 1: On a One-Sided λ-Local Spectral Expander, ‖M⁺_k φ‖ ≤ ((k+1)/(k+2) + (k+1)λ/2)‖φ‖ for Every k-Cochain φ Orthogonal to the ConstantsResearch Paper

Motivation

A high dimensional expander is a simplicial complex whose local structure forces global expansion. The high order random walks on such a complex move from a kkk-face to a kkk-face through a common (k+1)(k+1)(k+1)-face. They were studied for their connection to agreement tests in probabilistically checkable proofs (Dinur–Kaufman 2017; Kaufman–Mass 2017), and they later became a tool for sampling. Anari, Liu, Oveis Gharan and Vinzant (arXiv:1811.01816) used the mixing bound of this mission to prove the Mihail–Vazirani conjecture: the bases-exchange walk of every matroid mixes rapidly.

Timeline:

  • 1973. Garland (Ann. of Math. 97) shows that spectral gaps in the links of a complex control its cohomology. Inner products are localized to links; this is now called Garland's method.
  • 2017. Kaufman and Mass (arXiv:1604.02947) bound the second eigenvalue of the high order walks on complexes with well-expanding links. Dinur and Kaufman obtain the optimal bound under a two-sided spectral gap in the links, as Kaufman–Oppenheim explain.
  • 2018. Oppenheim (Discrete Comput. Geom. 59) shows how spectral gaps descend from top-dimensional links to lower ones ("trickling down").
  • 2017–2021. Kaufman and Oppenheim (arXiv:1707.02799v3) obtain the optimal mixing bound under a one-sided gap only: negative eigenvalues of the links do not matter. This is the target of this mission.

Setting

Let VVV be a type of vertices. A pure nnn-dimensional finite simplicial complex XXX is a finite family of finite subsets of VVV that is closed under subsets, has faces of at most n+1n+1n+1 elements, and has every face contained in a face of exactly n+1n+1n+1 elements. A face with k+1k+1k+1 elements is a kkk-face; X(k)X(k)X(k) is the set of kkk-faces, and X(−1)={∅}X(-1)=\{\emptyset\}X(−1)={∅}.

A weight function is a map mmm from the faces of XXX to (0,∞)(0,\infty)(0,∞) that is balanced: for −1≤k≤n−1-1\le k\le n-1−1≤k≤n−1 and τ∈X(k)\tau\in X(k)τ∈X(k),

m(τ)=∑σ∈X(k+1), τ⊆σm(σ).m(\tau)=\sum_{\sigma\in X(k+1),\ \tau\subseteq\sigma}m(\sigma).m(τ)=σ∈X(k+1), τ⊆σ∑​m(σ).

A kkk-cochain is a function ϕ:X(k)→R\phi:X(k)\to\mathbb Rϕ:X(k)→R. The cochains carry the inner product ⟨ϕ,ψ⟩=∑σ∈X(k)m(σ)ϕ(σ)ψ(σ)\langle\phi,\psi\rangle=\sum_{\sigma\in X(k)}m(\sigma)\phi(\sigma)\psi(\sigma)⟨ϕ,ψ⟩=∑σ∈X(k)​m(σ)ϕ(σ)ψ(σ) and the norm ∥⋅∥\|\cdot\|∥⋅∥. The cochains orthogonal to the constants form C0k(X,R)={ϕ:∑σ∈X(k)m(σ)ϕ(σ)=0}C^k_0(X,\mathbb R)=\{\phi:\sum_{\sigma\in X(k)}m(\sigma)\phi(\sigma)=0\}C0k​(X,R)={ϕ:∑σ∈X(k)​m(σ)ϕ(σ)=0}.

The upper random walk Mk+M^+_kMk+​ acts on kkk-cochains by

Mk+ϕ(τ)=1k+2 ϕ(τ)+∑τ′∈X(k), τ∪τ′∈X(k+1)m(τ∪τ′)(k+2) m(τ) ϕ(τ′).M^+_k\phi(\tau)=\frac{1}{k+2}\,\phi(\tau)+\sum_{\tau'\in X(k),\ \tau\cup\tau'\in X(k+1)}\frac{m(\tau\cup\tau')}{(k+2)\,m(\tau)}\,\phi(\tau').Mk+​ϕ(τ)=k+21​ϕ(τ)+τ′∈X(k), τ∪τ′∈X(k+1)∑​(k+2)m(τ)m(τ∪τ′)​ϕ(τ′).

It stays put with probability 1/(k+2)1/(k+2)1/(k+2), and otherwise moves to a neighbouring kkk-face with probability proportional to the weight of their union.

The link of a face τ\tauτ is Xτ={η∈X:η∩τ=∅, τ∪η∈X}X_\tau=\{\eta\in X:\eta\cap\tau=\emptyset,\ \tau\cup\eta\in X\}Xτ​={η∈X:η∩τ=∅, τ∪η∈X}, weighted by mτ(η)=m(τ∪η)m_\tau(\eta)=m(\tau\cup\eta)mτ​(η)=m(τ∪η). On the vertices of XτX_\tauXτ​, the non-lazy upper walk (M′)τ,0+=2Mτ,0+−I(M')^+_{\tau,0}=2M^+_{\tau,0}-I(M′)τ,0+​=2Mτ,0+​−I is the weighted random walk on the 1-skeleton of the link. Let μτ\mu_\tauμτ​ be its second largest eigenvalue. XXX is a one-sided λ\lambdaλ-local spectral expander if μτ≤λ\mu_\tau\le\lambdaμτ​≤λ for every face τ\tauτ of dimension −1,…,n−2-1,\dots,n-2−1,…,n−2. The empty face is included, and its link is XXX itself.

Formalization targets

Goal: Theorem 5.4 (p. 17)

Let 0≤λ≤10\le\lambda\le10≤λ≤1 and let XXX be a one-sided λ\lambdaλ-local spectral expander. Then for every 0≤k≤n−10\le k\le n-10≤k≤n−1 and every ϕ∈C0k(X,R)\phi\in C^k_0(X,\mathbb R)ϕ∈C0k​(X,R),

∥Mk+ϕ∥≤(k+1k+2+k+12 λ)∥ϕ∥.\|M^+_k\phi\|\le\Big(\frac{k+1}{k+2}+\frac{k+1}{2}\,\lambda\Big)\|\phi\|.∥Mk+​ϕ∥≤(k+2k+1​+2k+1​λ)∥ϕ∥.

Milestones

They follow the paper's proof order:

  • Lemma 3.6 and Corollary 3.7: the adjoint d∗d^*d∗ of the signless differential ddd, and the factorizations d∗d=(k+2)Mk+d^*d=(k+2)M^+_kd∗d=(k+2)Mk+​, dd∗=(k+1)Mk−dd^*=(k+1)M^-_kdd∗=(k+1)Mk−​.
  • Proposition 4.1 (1)–(3), Garland's localization identities, and Proposition 4.2:
∥dϕ∥2=∥d∗ϕ∥2+∥ϕ∥2+∑τ∈X(k−1)⟨(M′)τ,0+(I−Mτ,0−)ϕτ,ϕτ⟩.\|d\phi\|^2=\|d^*\phi\|^2+\|\phi\|^2+\sum_{\tau\in X(k-1)}\langle (M')^+_{\tau,0}(I-M^-_{\tau,0})\phi_\tau,\phi_\tau\rangle .∥dϕ∥2=∥d∗ϕ∥2+∥ϕ∥2+τ∈X(k−1)∑​⟨(M′)τ,0+​(I−Mτ,0−​)ϕτ​,ϕτ​⟩.
  • Lemma 4.3, which bounds the link terms by (k+1)μ∥ϕ∥2(k+1)\mu\|\phi\|^2(k+1)μ∥ϕ∥2.
  • Lemma 5.1.
  • Theorem 5.2 (the Decomposition Theorem).
  • Corollary 5.3, in its general and its one-sided form:
∥dϕ∥2≤∑j=0k(k+1−j+(k+j+2)(k+1−j)2λ)∥ϕj∥2,∥ϕ∥2=∑j=0k∥ϕj∥2.\|d\phi\|^2\le\sum_{j=0}^{k}\Big(k+1-j+\frac{(k+j+2)(k+1-j)}{2}\lambda\Big)\|\phi^j\|^2,\qquad \|\phi\|^2=\sum_{j=0}^k\|\phi^j\|^2.∥dϕ∥2≤j=0∑k​(k+1−j+2(k+j+2)(k+1−j)​λ)∥ϕj∥2,∥ϕ∥2=j=0∑k​∥ϕj∥2.

Significance

The result. The coefficient k+1k+2\frac{k+1}{k+2}k+2k+1​ is the baseline in the paper's mixing bound, and the bound is optimal up to the O(λ)O(\lambda)O(λ) term. It needs a gap on one side only: links may have eigenvalues near −1-1−1. This matters in two places. The links of a matroid's independence complex are only one-sided expanders, so the matroid application needs exactly this case. And the links of Ramanujan complexes are one-sided expanders, so this bound gives optimal mixing on them; the two-sided bound of Dinur–Kaufman does not apply to them.

Formalizing it. The theorem is proved on paper; the Lean statements in this mission are proof targets. Completing the mission would give machine-checked proofs of the mixing bound, Garland's localization identities, and the Decomposition Theorem, built on definitions of weighted simplicial complexes, links, and their random walks. Lemma 4.3 and Corollary 5.3 are stated with a correction: as printed they are false when a link eigenvalue bound is negative (see Formalization scope).

Difficulty

The obvious argument fails. The tempting route bounds the second eigenvalue of Mk+M^+_kMk+​ directly from the link spectra, by induction on kkk. But Mk+M^+_kMk+​ has large eigenvalues near k+1−jk+2\frac{k+1-j}{k+2}k+2k+1−j​ for every jjj, coming from cochains of the form dψd\psidψ with ψ\psiψ of lower degree. A single spectral-gap estimate cannot separate these levels from one another. The paper instead splits ϕ\phiϕ into contributions from every degree j≤kj\le kj≤k; this is the Decomposition Theorem, and each piece is controlled separately. Formally, the main costs are:

  • the double-counting behind Proposition 4.1 (Appendix A, pp. 28–29);
  • a square root of a positive self-adjoint operator on a weighted finite-dimensional space (Theorem 5.2);
  • the bookkeeping of degrees and links.

Formalization scope

Faces are Finset V. XXX is a Finset (Finset V), and X(k)X(k)X(k) is cells X (k + 1): faces are indexed by their number of vertices. Cochains are functions Finset V → ℝ that are read only on the relevant faces. Every operator is zero off XXX. The weight is positive on faces; the paper writes R+\mathbb R^+R+, and mmm appears in denominators. Every goal-level statement carries the standing assumption of §2: XXX is pure nnn-dimensional and mmm is a weight. Orthogonality to the constants is always weighted by mmm (or by mτm_\taumτ​ in a link).

The adjoint d∗d^*d∗ is defined by its explicit formula; that it is the adjoint is Lemma 3.6. The eigenvalue condition μτ≤λ\mu_\tau\le\lambdaμτ​≤λ is stated in Rayleigh form: ⟨(M′)τ,0+g,g⟩≤λ∥g∥2\langle (M')^+_{\tau,0}g,g\rangle\le\lambda\|g\|^2⟨(M′)τ,0+​g,g⟩≤λ∥g∥2 for every ggg on the vertices of XτX_\tauXτ​ that is mτm_\taumτ​-orthogonal to the constants. It is equivalent to the eigenvalue form even for disconnected links. A Rayleigh bound over all ggg, constants included, would be unsatisfiable for λ<1\lambda<1λ<1 and would make the goal vacuous; it is ruled out. The predicate quantifies over every face of dimension −1-1−1 to n−2n-2n−2, including ∅\emptyset∅.

Corrections, all disclosed in the items:

  • Lemma 4.3 is stated with a bound μ≥max⁡(μk,0)\mu\ge\max(\mu_k,0)μ≥max(μk​,0). The printed version with μk<0\mu_k<0μk​<0 fails already for the complete graph on three vertices.
  • Corollary 5.3 accordingly takes μi≥0\mu_i\ge0μi​≥0 and λ≥0\lambda\ge0λ≥0. Its two formal statements retain the page's assumption that every link of dimension at least one is connected, including XXX itself.
  • The proof of Theorem 5.4 ends with (k+1)λ(k+1)\lambda(k+1)λ; the statement's k+12λ\frac{k+1}{2}\lambda2k+1​λ is formalized.

Welcome contributions: proofs of any milestone. Reusable lemmas on finite weighted inner products, on double counting over faces of a Finset (Finset V), and on links are useful beyond this mission; the companion mission on two-sided expanders uses the same objects.

Selected references

  • T. Kaufman, I. Oppenheim, High Order Random Walks: Beyond Spectral Gap, arXiv:1707.02799v3, 2021. https://arxiv.org/abs/1707.02799
  • N. Anari, K. Liu, S. Oveis Gharan, C. Vinzant, Log-concave polynomials II: High-dimensional walks and an FPRAS for counting bases of a matroid, STOC 2019. https://arxiv.org/abs/1811.01816
  • H. Garland, p-adic curvature and the cohomology of discrete subgroups of p-adic groups, Ann. of Math. 97:375–423, 1973. https://doi.org/10.2307/1970781
  • T. Kaufman, D. Mass, High dimensional random walks and colorful expansion, ITCS 2017. https://arxiv.org/abs/1604.02947
  • I. Oppenheim, Local spectral expansion approach to high dimensional expanders Part I: Descent of spectral gaps, Discrete Comput. Geom. 59(2):293–330, 2018. https://arxiv.org/abs/1709.04431
13 thms1 active userReviewed
Formal VerificationTheory of Computation·Captain: mikedeng1

Multiparty Asynchronous Session Types 3: Progress — Every Reduct of a Simple, Well-Linked Typed Program Is ≡ 0 or Reduces FurtherResearch Paper

Motivation

Distributed programs often establish a conversation among several participants, then exchange messages without waiting for each send to be received. A specification of each participant in isolation does not by itself say whether their actions will fit together. Multiparty asynchronous session types address this by describing the intended conversation once as a global type and checking each participant against a projected local type. Honda, Yoshida and Carbone develop this calculus and state a progress result for a restricted class of well-typed programs: if execution has not finished, another reduction is available. The restriction matters because independently initiated sessions can interfere and deadlock even when their communications are individually typed. Honda, Yoshida and Carbone (2016)

Setting

A program is a process before execution: it contains no message queues or restricted session channels, even after structural rearrangement, and it has no free session channels or process variables. A requester on a shared name aaa starts a session with participants numbered 222 through nnn. Each participant receives the same vector s~\widetilde ss of fresh session channels. An asynchronous send appends a message to the appropriate FIFO queue; a receive reads the queue head. Requests, sends, delegations and selections are emitting prefixes. Accepts, receives and branches are receiving prefixes. The reduction relation P⟶QP\longrightarrow QP⟶Q includes these communications, conditionals, guarded declaration unfolding, and closure under parallel composition, restriction and structural congruence ≡\equiv≡. Honda, Yoshida and Carbone (2016), Figs. 1–3 and Def. 2.1

A global type GGG specifies which numbered role sends a value or choice to another role on channel index kkk, followed by the remainder of the conversation. It may also contain parallel components and guarded recursion. A partial projection G↾pG\upharpoonright pG↾p gives role ppp its endpoint type. Global types must be linear: causally ordered actions on a common channel have both input and output dependency chains. A global type is coherent when it is linear and projects to all its participants; the runtime typing Δ\DeltaΔ is coherent when each session family comes from such a global type. Honda, Yoshida and Carbone (2016), Defs. 3.12, 4.1–4.2 and 5.9

The runtime judgement Γ⊢P▹s~Δ\Gamma\vdash P\triangleright_{\widetilde s}\DeltaΓ⊢P▹s​Δ records the types of the process and the queue channels it mentions. Type contexts remember messages already in transit and compose with endpoint types. A process is queue-full when the channels in s~\widetilde ss equal the channels occurring in Δ\DeltaΔ. A prefix is active when it is outside another prefix and outside either branch of a conditional, after permitted declaration unfolding. A process is well-linked when every reachable process has each active shared-name prefix in a redex. A process is simple when it has a typing derivation whose session environments obey the singleton and emptiness restrictions of Definition 5.25, with no delegation input or output rule. Honda, Yoshida and Carbone (2016), pp. 28–37

Formalization targets

The goal is Corollary 5.30. For every simple, well-linked program PPP whose free names have shared sorts, and every reachable process P′P'P′,

P⟶∗P′⟹P′≡0 ∨ ∃P′′  P′⟶P′′.P\longrightarrow^*P'\quad\Longrightarrow\quad P'\equiv 0\ \lor\ \exists P''\;P'\longrightarrow P''.P⟶∗P′⟹P′≡0 ∨ ∃P′′P′⟶P′′.

Here 000 is inaction, and P′≡0P'\equiv 0P′≡0 includes completed sessions whose empty queues disappear by structural congruence. The milestones are the closed-typing preservation clause of Theorem 5.19(3), the linearity and message agreement clauses of Theorem 5.22, and the immediate-step claim of Proposition 5.29(1). Those are statements of the paper and give separate targets before the progress corollary. Honda, Yoshida and Carbone (2016), pp. 34–37

Significance

For the specified class of programs, progress excludes a reachable state that is neither finished nor reducible. It combines static endpoint information with the operational facts about queues and shared-name synchronisation. The communication-safety milestone also states that a value receive is paired with a value message of matching arity, channel reception with a channel vector of matching length, and branching with an offered label. These claims describe behavior of the paper's asynchronous multiparty calculus, rather than a property of a particular implementation. Honda, Yoshida and Carbone (2016), Theorem 5.22 and Corollary 5.30

The paper supplies mathematical proofs, but this mission's statements have no completed machine-checked proofs. Formalizing the result requires a precise account of the calculus, including queue messages, scope, recursive calls, type contexts, projection and the limited form of simplicity. The definitions can support later work on subject reduction and session fidelity in the same model. A contribution may prove any milestone or the goal, or improve the shared definitions while preserving the source's hypotheses and conclusions.

Difficulty

Typing each participant does not immediately give a reduction of their parallel composition. A send can be present while a receive is blocked by an earlier queue message, and a session initiation can be blocked by a shared-name prefix in a different session. Communication safety must relate active prefixes to a unique queue and its actual head message. Progress additionally needs the restrictions on derivations and shared-name links to rule out interference among sessions. The rules for structural congruence and declaration unfolding make the location of a redex depend on more than the outer syntactic constructor. Honda, Yoshida and Carbone (2016), §§5.4–5.5

Formalization scope

Lean uses natural numbers for role identifiers, shared names, channels, labels and process variables. Channel indices are one based, following s[1..m]s[1..m]s[1..m]. A global type, value sort and endpoint type are separate syntax classes; finite branch families are lists with nonempty, distinct labels where a well-formed type is required. Recursion is read equi-recursively by an endpoint bisimulation, and global-type linearity is checked on every finite unfolding. Projection returns an optional endpoint type so undefined projections cannot acquire a default value. The session typings are finite maps represented by association lists, with distinct roles and disjoint channel domains. The judgement's subscript s~\widetilde ss lists queue channels, while the domain of Δ\DeltaΔ lists all sessions under typing.

The formalization uses named process binders and a structural-congruence relation containing alpha conversion. Received-value and call substitution is capture avoiding under explicit freshness conditions. Expression evaluation is fixed to the ordinary Boolean connectives used in the paper's typing rules. Runtime typing includes the queue rules and the partial composition of type contexts. The restricted typing system for simplicity retains runtime queue rules and excludes both delegation directions. The paper prints “[RCV]” in Definition 5.25(2), but its appendix explicitly excludes “[SREC]”; this draft follows the appendix and records that reading in its audit notes. The result quantifies over actual programs and makes simplicity imply typability, so a free, blocked input or an untyped syntax check cannot satisfy the goal. Honda, Yoshida and Carbone (2016), Def. 5.25 and Appendix B.8

Every prefix rule acts on a singleton entry s~:T@p\widetilde s:T@ps:T@p (Notation 4.5); process-variable signatures carry one singleton entry per session vector, as in [VAR]; [SREC] receives the channel names it binds, without substitution (Remark 2.2). Proposition 5.29(1) and Corollary 5.30 are false as printed for open terms: a free name of sort bool used as a conditional guard, or a free process variable, is a stuck simple process. The formal statements therefore add that the free names of the process have shared sorts and, for Proposition 5.29(1), that it has no free process variables (a program has none by definition).

The development needs Mathlib's finite sets, lists and reflexive-transitive closure, plus its own definitions of the process calculus and typing judgements. The Lean declarations in this proposal are draft statements and definitions for review; they are not proofs of the paper's results.

Selected references

  • Kohei Honda, Nobuko Yoshida and Marco Carbone, Multiparty Asynchronous Session Types, Journal of the ACM 63(1), Article 9, 2016. DOI 10.1145/2827695
12 thms1 active userReviewed
Formal VerificationTheory of Computation·Captain: mikedeng1

Multiparty Asynchronous Session Types 1: A Global Type's One-Time Unfolding Is Linear iff Its n-th Unfolding Is Linear, for Every n ≥ 1Research Paper

Motivation

Multiparty communication protocols involve several participants who send messages over shared session channels. An implementation may send a later message before an earlier one has been received, so a written sequence of interactions does not by itself prevent a receiver from taking the wrong message. Honda, Yoshida, and Carbone use global types to specify the whole conversation and a linearity condition to rule out conflicting uses of a channel. Their condition is part of the type system that supports subject reduction and session fidelity in the same paper. Honda, Yoshida, and Carbone, 2016

Global types can contain recursion. Reading their full behaviour as a regular tree may therefore involve infinitely many copies of the same interaction. Proposition 3.13(1) says that checking just one finite unfolding suffices to determine whether every later finite unfolding satisfies the paper's linearity condition. This mission formalizes that proposition and the definitions on which its statement depends. Honda, Yoshida, and Carbone, 2016, §3.5 and Appendix A

Setting

A global type GGG describes actions among roles p,qp,qp,q on channels identified by positive indices kkk. Its constructors are a value communication p→q:k⟨U⟩.G′p\to q:k\langle U\rangle.G'p→q:k⟨U⟩.G′, a labelled branch p→q:k{ℓj:Gj}j∈Jp\to q:k\{\ell_j:G_j\}_{j\in J}p→q:k{ℓj​:Gj​}j∈J​, parallel composition G1∣G2G_1\mid G_2G1​∣G2​, recursion μt.G′\mu t.G'μt.G′, a recursion variable ttt, and termination end\mathrm{end}end. The carried value type UUU may contain shared names whose sorts include another global type, or it may be a located end-point type. The formal syntax represents end-point sends, receives, selections, branches, recursion, variables, and termination because shared global types can occur within the sorts carried by those types. Honda, Yoshida, and Carbone, 2016, Figs. 4 and 6

An action node is an occurrence of a communication or branching action in the tree of a finite unfolding. Each node has a sender, receiver, and channel index. The action order n1≺n2n_1\prec n_2n1​≺n2​ holds when one action lies before another in the same continuation or branch, according to Definition 3.7. Actions in different branches or parallel components have no order solely because they appear next to each other in the syntax. Honda, Yoshida, and Carbone, 2016, pp. 15–16

The paper refines that order into three dependency relations. An II step matches receivers; an IO step connects a receiver to a later sender; and an OO step matches both sender and channel. An input dependency is a chain of IO steps ending in II. An output dependency is a nonempty chain of OO or IO steps. A finite type is linear when every ordered pair of actions on the same channel has both dependencies, including the corresponding condition on the global types carried within its values. The last II step matters because a chain ending at an output has not checked the ordering of the final input. Honda, Yoshida, and Carbone, 2016, Defs. 3.11–3.12

Write G(n)G^{(n)}G(n) for the finite result of unfolding every recursion in GGG nnn times and replacing remaining recursion variables by end\mathrm{end}end. For a single recursion G=μt.HG=\mu t.HG=μt.H, the paper gives G(0)=H[end/t]G^{(0)}=H[\mathrm{end}/t]G(0)=H[end/t] and G(n+1)=H[G(n)/t]G^{(n+1)}=H[G^{(n)}/t]G(n+1)=H[G(n)/t]. Unfolding does not enter carried types. The one-time unfolding is G(1)G^{(1)}G(1). Honda, Yoshida, and Carbone, 2016, p. 20 and Notation A.1

Formalization targets

The milestone is the direction the paper calls the “if-direction”: for a well-formed global type and a positive unfolding index, linearity at that index implies linearity at the first one.

WellFormed⁡(G) ∧ n≥1 ∧ Linear⁡(G(n))⟹Linear⁡(G(1)).\operatorname{WellFormed}(G)\ \land\ n\ge 1\ \land\ \operatorname{Linear}(G^{(n)}) \quad\Longrightarrow\quad \operatorname{Linear}(G^{(1)}).WellFormed(G) ∧ n≥1 ∧ Linear(G(n))⟹Linear(G(1)).

The mission goal is Proposition 3.13(1), the equivalence between the first unfolding and any positive unfolding.

∀G well formed ∀n≥1,Linear⁡(G(1))⟺Linear⁡(G(n)).\forall G\text{ well formed}\,\forall n\ge 1,\qquad \operatorname{Linear}(G^{(1)}) \quad\Longleftrightarrow\quad \operatorname{Linear}(G^{(n)}).∀G well formed∀n≥1,Linear(G(1))⟺Linear(G(n)).

The lower bound n≥1n\ge1n≥1 is essential. The paper explicitly begins its Appendix A induction at n=1n=1n=1 and gives examples that satisfy linearity at the zeroth unfolding but fail after one unfolding. Proposition 3.13(2), the paper's decidability claim, is outside this mission: formalizing computational decidability would require an effective representation and decision procedure rather than a classical Decidable instance. Honda, Yoshida, and Carbone, 2016, p. 20 and Appendix A

Significance

The proposition turns a property stated over arbitrarily deep recursive behaviour into a fixed finite test. It supports the paper's decidability result and supplies the channel-ordering premise used later in coherent global types and runtime typing. Without the stabilization claim, checking a recursive global type by inspecting one finite copy would leave later channel conflicts unresolved. Honda, Yoshida, and Carbone, 2016, Props. 3.13–3.14 and Def. 4.2

The result is already proved in the paper. The formalization work is to give the paper's finite unfolding, action order, dependency chains, and recursive carried-type condition exact Lean meanings, then verify the equivalence against those meanings. The local mission currently contains open theorem statements and compiled definitions; it does not claim a machine-checked proof of Proposition 3.13(1). Those definitions can also be reused when formalizing the paper's coherence and subject-reduction results.

Difficulty

The main obstacle is the interaction between recursion and causality. Unfolding creates further occurrences of actions, while an input dependency requires a chain with a specific final II edge and an output dependency allows only OO or IO edges. The action order also depends on a node's place in a branch, continuation, or parallel component. Merely comparing channel labels across two unfoldings does not establish the required dependencies. The carried-type condition adds another level: unfolding the outer type leaves its carried types intact, but their own linearity must still be checked. Honda, Yoshida, and Carbone, 2016, Defs. 3.7, 3.11–3.12 and Appendix A

Formalization scope

Lean represents roles, labels, type variables, and channel indices by natural numbers, with channel indices interpreted as one-based. Branches are lists; WellFormed G records nonempty branches with distinct labels, closed guarded recursion, positive channel indices, and distinct sender and receiver, also checking carried global types. Both theorem statements assume it to make the paper's standing syntax conventions explicit. The sort grammar includes Boolean and natural-number sorts, shared-name sorts, and coded additional base sorts for the paper's ellipsis. The recursion constructor is named mu and the sort type SType because rec and Sort have special meanings in Lean.

Node names are finite child-index paths. Prec is the transitive closure of the five clauses of Definition 3.7. Every II, IO, or OO step includes this order. Input dependency requires at least one step, resolving the printed n≥0n\ge0n≥0 against the same sentence's mandatory final II step. Carried types are reached through value and end-point type syntax, and nested carriers are included transitively. Linear checks each such carried type at every finite unfolding. The definitions also encode the paper's positive-index and non-reflexive interaction conventions in WellFormed. A linearity predicate that ignores carried types or treats separate parallel components as ordered would change the target theorem. Honda, Yoshida, and Carbone, 2016, pp. 12–13, 16, 19–20

Useful contributions include results about finite unfolding and the action order, preservation of labels at recurring positions, and dependency-chain properties under unfolding. The two folding claims in Appendix A are not listed as milestones here because a faithful folding operation for nested recursion and multiple occurrences has not yet been specified. Their absence is a scope limit on the attack path, not an assumption in the goal.

Selected references

  • Kohei Honda, Nobuko Yoshida, and Marco Carbone, Multiparty Asynchronous Session Types, Journal of the ACM 63(1), Article 9, 2016. DOI: 10.1145/2827695.
4 thms1 active userReviewed
PreviousPage 4 of 10Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me