Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Combinatorics

627 missions · 347 completed

The mathematics of finite and discrete structures — counting the arrangements of a set, deciding when a configuration meeting prescribed constraints can exist, and characterizing the patterns such structures are forced to contain. It encompasses enumerative and extremal combinatorics, graph theory, design theory, and additive combinatorics, with deep ties to algebra, probability, and computer science.

Missions

Open280Completed347All627
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Scheduling of Vehicles from a Central Depot to a Number of Delivery Points: The Savings Procedure Always Ends in a Feasible Truck Allocation Whose Mileage Is the Initial Less the Linked SavingsResearch Paper

Motivation

Delivering goods from one depot to many customers with a fleet of trucks is the vehicle routing problem. Dantzig and Ramser formulated it in 1959 as the "truck dispatching problem" (Management Sci. 6 (1959), doi:10.1287/mnsc.6.1.80). Five years later Clarke and Wright proposed the savings procedure (Oper. Res. 12 (1964), 568–581, doi:10.1287/opre.12.4.568): start with one truck per customer and repeatedly join two routes where joining saves the most distance, as long as the trucks can still carry the loads. On the twelve-customer example of Dantzig and Ramser it reached 290 units against their 294.

The savings procedure became the standard construction heuristic for vehicle routing. It appears in every textbook treatment of the problem, is the initial solution of many metaheuristics, and is the benchmark against which later construction methods are compared. The paper states the procedure and its bookkeeping (the half matrix, the vector QQQ, Table II) but proves nothing about it. That every run of the procedure ends, and ends in a feasible allocation, is left to the reader.

Setting

A depot P0P_0P0​ serves customers P1,…,PMP_1,\dots,P_MP1​,…,PM​. The distance dy,zd_{y,z}dy,z​ between every two points is given, and customer PjP_jPj​ requires a load qjq_jqj​. Trucks come in nnn capacity classes: xix_ixi​ trucks of capacity CiC_iCi​ are available, with C1<⋯<CnC_1<\dots<C_nC1​<⋯<Cn​, and the trucks of the smallest capacity are unlimited, x1=∞x_1=\inftyx1​=∞ (p. 569).

A run is the ordered list of customers Pa1,…,PakP_{a_1},\dots,P_{a_k}Pa1​​,…,Pak​​ served by one truck, which drives P0Pa1⋯PakP0P_0P_{a_1}\cdots P_{a_k}P_0P0​Pa1​​⋯Pak​​P0​. Its load is ∑iqai\sum_i q_{a_i}∑i​qai​​. A state of the procedure is a list of runs; its mileage is the total length of its runs. A list of runs is an allocation if every customer lies on exactly one run, and it is feasible if each run can be given a truck of capacity at least its load without using more trucks of any class than are available.

The saving of the cell (y:z)(y:z)(y:z) is d0,y+d0,z−dy,zd_{0,y}+d_{0,z}-d_{y,z}d0,y​+d0,z​−dy,z​. The half matrix records ty,z=1t_{y,z}=1ty,z​=1 if PyP_yPy​ and PzP_zPz​ are adjacent on a run, and ty,0∈{0,1,2}t_{y,0}\in\{0,1,2\}ty,0​∈{0,1,2} counts how many ends of runs lie at PyP_yPy​. Table II counts, for each capacity level CiC_iCi​, the runs with load above CiC_iCi​ and the trucks with capacity above CiC_iCi​.

The procedure starts with the runs [P1],…,[PM][P_1],\dots,[P_M][P1​],…,[PM​], so ty,0=2t_{y,0}=2ty,0​=2 for every customer. A cell (y:z)(y:z)(y:z) is admissible if (I) ty,0>0t_{y,0}>0ty,0​>0 and tz,0>0t_{z,0}>0tz,0​>0; (II) PyP_yPy​ and PzP_zPz​ are on different runs; (III) after replacing those two runs by one run of load Qy+QzQ_y+Q_zQy​+Qz​, no column of Table II has more runs than trucks. A step links an admissible cell of maximum saving, ties broken arbitrarily, by joining the two runs end to end at PyP_yPy​ and PzP_zPz​. The procedure stops when no cell is admissible.

Formalization targets

Goal: correctness of the procedure

Assume symmetric distances, C1<⋯<CnC_1<\dots<C_nC1​<⋯<Cn​, x1=∞x_1=\inftyx1​=∞, and that the initial one-truck-per-customer allocation passes the Table II test. Then every run of the procedure is finite whatever the tie-breaks; at every reachable state from which a link is possible a step exists; and every final state SSS is a feasible allocation satisfying relation (A), ∑z≠yty,z=2\sum_{z\ne y}t_{y,z}=2∑z=y​ty,z​=2 for every customer, with

mileage(S)=2∑j=1Md0,j−∑1≤y<z≤Mty,z=1(d0,y+d0,z−dy,z).\text{mileage}(S)=2\sum_{j=1}^M d_{0,j}-\sum_{\substack{1\le y<z\le M\\ t_{y,z}=1}}\bigl(d_{0,y}+d_{0,z}-d_{y,z}\bigr).mileage(S)=2j=1∑M​d0,j​−1≤y<z≤Mty,z​=1​∑​(d0,y​+d0,z​−dy,z​).

Milestones

mileage(link(S,y,z))=mileage(S)−(d0,y+d0,z−dy,z)for admissible (y:z),\text{mileage}(\text{link}(S,y,z))=\text{mileage}(S)-(d_{0,y}+d_{0,z}-d_{y,z})\quad\text{for admissible }(y:z),mileage(link(S,y,z))=mileage(S)−(d0,y​+d0,z​−dy,z​)for admissible (y:z),

relation (A) at every reachable state, the permanence of links between customers, and

#{runs with load>Ci}≤∑k>ixk  (i=1,…,n)  ⟺  the runs can be allocated to trucks,\#\{\text{runs with load}>C_i\}\le\sum_{k>i}x_k\ \ (i=1,\dots,n)\iff\text{the runs can be allocated to trucks},#{runs with load>Ci​}≤k>i∑​xk​  (i=1,…,n)⟺the runs can be allocated to trucks,

which together give feasibility of every reachable state. Two further milestones: when Cn≥∑jqjC_n\ge\sum_j q_jCn​≥∑j​qj​ and the distances are a metric, the optimum equals the traveling salesman optimum (p. 569); and on the data of Table I every run of the procedure ends with total distance 290.

Significance

The goal is the specification the paper's procedure meets: it always terminates, never gets stuck, and outputs routes the fleet can actually drive, with the mileage the half-matrix bookkeeping predicts. The equivalence of the Table II test with truck feasibility is the reason the procedure can check capacities by counting columns instead of solving an assignment problem; it is a nested-class instance of Hall's marriage condition and is reusable for any routing or bin-assignment problem with ordered vehicle classes.

None of these statements is formalized anywhere, and the paper does not prove them. The paper makes no claim of optimality ("near-optimal", p. 568, is not quantified), and the mission does not either. A formal model of the procedure as a nondeterministic transition system is a base on which later results about savings heuristics (worst-case ratios, parallel and sequential variants) can be stated.

Difficulty

The obvious argument for termination, "each link removes a run", needs the invariant that every reachable state is a partition of the customers into runs; the procedure manipulates ordered lists and reverses runs, so the invariant must be carried through every step. Feasibility is not preserved by an arbitrary link but only by one that passes condition (III), and turning the column test into an actual assignment of runs to trucks is a matching argument that fails without both x1=∞x_1=\inftyx1​=∞ and the ordering of the capacities. Because ties are broken arbitrarily, every statement must hold for all runs of a nondeterministic procedure, not for one canonical execution. The worked example requires following every tie-break.

Formalization scope

Points are Fin (M+1) with depot 0, and a run's length is SupplyChainTheory.routeCost from the referenced module SupplyChainTheory_vrp. Capacity class i : Fin (n+1) is the paper's Ci+1C_{i+1}Ci+1​; availabilities are in ℕ∞; loads and capacities are real. A state is a list of runs, each an ordered list of customers; the matrix ttt and the vector QQQ are computed from the state. The procedure is a step relation, and every invariant is stated for reachable states. Termination is Acc of the step relation at the initial state.

Choices committed to:

  • distances are arbitrary real, symmetric numbers (the half matrix, p. 573); no nonnegativity or triangle inequality is assumed in the goal, and savings may be negative;
  • every run: ties are free, as the paper suggests choosing randomly;
  • reachable states: invariants are not claimed for arbitrary lists of runs;
  • Table II is read cumulatively: column "Over CiC_iCi​" compares runs with load >Ci>C_i>Ci​ against all trucks of capacity >Ci>C_i>Ci​, as the printed Tables II, IV and VI show;
  • x1=∞x_1=\inftyx1​=∞ and C1<⋯<CnC_1<\dots<C_nC1​<⋯<Cn​ are hypotheses; qj≤Cnq_j\le C_nqj​≤Cn​ is not separately assumed, since it follows from the initial Table II test;
  • the initial one-truck-per-customer allocation is assumed feasible (p. 572);
  • the metric hypotheses enter only the traveling-salesman milestone.

A correctness claim only about final states, without termination and progress, would hold for a procedure with no moves; a step relation with a fixed tie-break would prove less than the paper; invariants for arbitrary states are false; and a mileage identity for an arbitrary partition says nothing about the procedure's output. None of these is the target.

Not formalized: the informal C1≪∑qjC_1\ll\sum q_jC1​≪∑qj​, the shadow-cost reading of p. 571, the decomposition savings (2)–(5) of the general scheme, the load-splitting reduction of pp. 572–573, the Dantzig–Ramser methods, and the empirical comparisons and appendices.

Contributions welcome: proofs of the milestones, in particular the Table II equivalence, which needs a Hall-type argument for nested classes, and a decision procedure for the worked example.

Selected references

  • G. Clarke and J. W. Wright, Scheduling of vehicles from a central depot to a number of delivery points, Operations Research 12(4) (1964), 568–581. https://doi.org/10.1287/opre.12.4.568
  • G. B. Dantzig and J. H. Ramser, The truck dispatching problem, Management Science 6(1) (1959), 80–91. https://doi.org/10.1287/mnsc.6.1.80
  • P. Hall, On representatives of subsets, Journal of the London Mathematical Society 10 (1935), 26–30. https://doi.org/10.1112/jlms/s1-10.37.26
12 thms4 active usersReviewed
🏆Completed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

An Optimal Algorithm for On-line Bipartite Matching 1: RANKING Finds a Matching of Expected Size at Least n(1 − 1/e) − o(n) on Every Graph with a Perfect MatchingResearch Paper

Motivation

Online matching describes allocation when requests must be answered as they arrive. A matching decision uses only the edges revealed so far and cannot be revised when later requests appear. In the bipartite setting studied by Karp, U. Vazirani, and V. Vazirani, the arriving vertices are girls and the possible partners are boys. Even when the full graph has a perfect matching, a fixed greedy priority can leave many girls unmatched. The paper introduced RANKING, which randomly chooses the boys' priority order once and then uses that order for every arrival.

The question is quantitative: how many pairs does RANKING guarantee in expectation against a graph and an arrival order chosen before its random ranking? The paper's target is a fraction approaching 1−1/e1-1/e1−1/e of the nnn pairs in a perfect matching. Its printed Theorem 1 concerns an auxiliary algorithm called EARLY; the RANKING statement follows the intended chain through Lemmas 3 and 5. The original EARLY analysis has a gap for general upper-triangular matrices, so this mission states the RANKING target and the earlier, unaffected lemmas separately. This distinction matters because an assertion about EARLY would be a different formalization target.

Setting

A bipartite graph has a boy side UUU and a girl side VVV, each with nnn vertices. An edge (u,v)(u,v)(u,v) means that boy uuu may be paired with girl vvv. A matching is a collection of edges in which no boy or girl occurs twice. The standing hypothesis for the performance guarantee is that the graph has a perfect matching: some bijection from boys to girls selects an edge for every boy. The graph is otherwise arbitrary.

Girls arrive in a predetermined order. When girl vvv arrives, only her incident edges are revealed. RANKING first chooses a uniformly random permutation π\piπ of the boys. For each arriving girl, it selects the highest-ranked adjacent boy who is still unmatched, if one exists. Write MR(G,π)M_{\mathrm R}(G,\pi)MR​(G,π) for the final matching. The expected size is the finite average over all n!n!n! rankings. The guarantee must hold for every graph and every predetermined arrival order; relabeling girls lets the formal statement fix their order to n,n−1,…,1n,n-1,\ldots,1n,n−1,…,1.

The paper also uses a dual rows-arrive view. Boys arrive in an order and choose among eligible girls, whose priority order is fixed. This is the same greedy rule with the sides exchanged. For its triangular reduction, the columns are numbered 1,…,n1,\ldots,n1,…,n and column nnn has highest priority. An upper-triangular matrix with unit diagonal is a graph with every edge (i,i)(i,i)(i,i) and with an edge (i,j)(i,j)(i,j) only when i≤ji\le ji≤j. On such a graph, the auxiliary algorithm EARLY declines to match row iii if column iii is already covered by EARLY's own matching. For any matching MMM, D(M)D(M)D(M) denotes the indices for which both row iii and column iii are covered.

Formalization targets

RANKING guarantee

For every ε>0\varepsilon>0ε>0, one threshold NNN must work for every size n≥Nn\ge Nn≥N and every graph GGG with a perfect matching:

Eπ∼Unif(Sn)∣MR(G,π)∣≥(1−e−1−ε)n.\mathbb E_{\pi\sim\mathrm{Unif}(S_n)}|M_{\mathrm R}(G,\pi)| \ge (1-e^{-1}-\varepsilon)n.Eπ∼Unif(Sn​)​∣MR​(G,π)∣≥(1−e−1−ε)n.

This is the uniform lower-bound reading of the paper's n(1−1/e)−o(n)n(1-1/e)-o(n)n(1−1/e)−o(n) target. It does not prescribe a finite-nnn additive constant. The mission goal is the RANKING assertion drawn from the paper's Theorem 1 and Lemmas 3 and 5. The six milestones formalize the paper's Lemmas 1–5 and the corollary to Lemma 4, in their source order. They cover the side-exchange identity, arbitrary refusal algorithms, the triangular reduction, the matching-count identity, its expected form, and the pointwise comparison with EARLY.

Significance

The guarantee gives a concrete worst-case floor for a simple randomized allocation rule: as the graph size grows, RANKING matches at least an asymptotic 1−1/e1-1/e1−1/e fraction of the pairs available in a perfect matching, in expectation. The order is selected before the random permutation, matching the paper's performance measure. The lower bound remains meaningful on sparse graphs and does not rely on a density assumption. The original paper also studies the limit on what any randomized online algorithm can guarantee; that upper-bound result is treated in a separate mission.

A formal development here would provide reusable finite definitions for online greedy matching, arbitrary state-dependent refusal, fixed-order duality, and uniform expectation over permutations. The goal is a theorem statement awaiting a machine-checked proof; compiling the draft declarations verifies their Lean syntax and types, not their truth. The local mission separates the valid early structural statements from later statements whose published EARLY argument does not justify them on general upper-triangular graphs.

Difficulty

The random permutation does not make the fate of different vertices independent. Matching one girl removes a boy who might be essential to a later girl, so a per-arrival probability estimate cannot simply be added across all arrivals. The dual and triangular views capture useful structure, but turning that structure into a uniform bound for every graph is the main obstacle. In particular, reasoning about EARLY as if its matched-column set had the same monotonicity as unrestricted RANKING fails on some upper-triangular matrices. A proof of the goal must establish the RANKING guarantee without treating those later EARLY statements as available facts.

Formalization scope

Boys and girls are both Fin n; an adjacency matrix is a relation between them. A published predicate represents a perfect matching as an edge-preserving bijection. The generic greedy run processes arrival times in increasing order and interprets a smaller priority index as higher rank. It makes a new matching decision only from the current matching and the arriving vertex. RANKING's returned edges are consistently ordered as (boy, girl), even though girls arrive. The dual run has rows arriving in an arbitrary permutation and takes column n−1n-1n−1 as highest priority in Lean's zero-based numbering. EARLY's refusal test consults the matching constructed by EARLY itself.

All expectations are finite averages over Equiv.Perm (Fin n), scaled by 1/n!1/n!1/n!. The formal o(n)o(n)o(n) claim is ∀ε>0, ∃N, ∀n≥N, ∀G\forall\varepsilon>0,\ \exists N,\ \forall n\ge N,\ \forall G∀ε>0, ∃N, ∀n≥N, ∀G with a perfect matching, the displayed lower bound. Placing NNN before GGG preserves the worst-case meaning. The perfect-matching condition is essential: the empty graph cannot satisfy a positive linear guarantee. The triangular matrix in Lemma 3 retains every diagonal edge, so a zero matrix cannot witness the reduction. These conventions rule out vacuous versions of the goal and reduction.

The definitions of partial matching, covered vertices, greedy run, RANKING, EARLY, and uniform average are part of the mission. A complete proof may build further finite counting and permutation machinery; such lemmas can be shared beyond this paper. Contributions toward the six milestone statements, the goal, and faithful supporting results are in scope. Lemmas 6–12 and the printed EARLY Theorem 1 are outside this mission because their analysis depends on claims that fail for some matrices allowed by their surrounding assumptions.

Selected references

  • Richard M. Karp, Umesh V. Vazirani, and Vijay V. Vazirani, An Optimal Algorithm for On-line Bipartite Matching, Proceedings of the 22nd Annual ACM Symposium on Theory of Computing, 1990, pp. 352–358. DOI: 10.1145/100216.100262.
10 thms4 active usersReviewed
🏆Completed
ProbabilityStatistics·Captain: mikedeng1

Two Moments Suffice for Poisson Approximations: The Chen-Stein Method 2: A Dependent Bernoulli Process Is Within 2(2b₁+2b₂+b₃) of a Poisson Process in Total VariationResearch Paper

Motivation

Many counting problems in probability, combinatorics and statistics ask for the law of the number of occurrences of rare, weakly dependent events: long head runs in coin tossing, matching segments between two DNA sequences, isolated vertices or small subgraphs in a random graph, clusters of points in a scan statistic. Chen's 1975 adaptation of Stein's method gives an explicit error bound for approximating such a count by a Poisson law. Arratia, Goldstein and Gordon (Ann. Probab. 17 (1989) 9–25) recast it in terms of a neighbourhood of dependence for each event. In this form the error bound needs only the first two moments of the indicators whenever each event is independent of the events outside its neighbourhood. The paper's examples (head runs, DNA sequence matching, birthday-type problems) made this form standard in applied probability.

The paper has two main results. Theorem 1 bounds the distance between the law of the total count and a Poisson law; it is essentially contained in Chen (1975). Theorem 2, which the authors describe as new, is a process version. It compares the joint law of all the indicators, that is, where the events occur, with a Poisson process. Theorem 3, a corollary, compares a dependent family of events with an independent family having the same marginal probabilities. This mission formalizes Theorem 2, the finite-dimensional bound it is derived from, the steps of its proof in §6, and Theorem 3.

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) be a probability space and III an index set. For α∈I\alpha\in Iα∈I let XαX_\alphaXα​ be a Bernoulli random variable, Xα∈{0,1}X_\alpha\in\{0,1\}Xα​∈{0,1}, with

pα=P(Xα=1)>0,λ=∑α∈Ipα∈(0,∞).p_\alpha=P(X_\alpha=1)>0,\qquad \lambda=\sum_{\alpha\in I}p_\alpha\in(0,\infty).pα​=P(Xα​=1)>0,λ=α∈I∑​pα​∈(0,∞).

For each α\alphaα fix a set Bα⊆IB_\alpha\subseteq IBα​⊆I with α∈Bα\alpha\in B_\alphaα∈Bα​, the neighbourhood of dependence of α\alphaα. Put pαβ=E(XαXβ)p_{\alpha\beta}=E(X_\alpha X_\beta)pαβ​=E(Xα​Xβ​) and

b1=∑α∈I∑β∈Bαpαpβ,b2=∑α∈I∑α≠β∈Bαpαβ,b3=∑α∈IE∣E{Xα−pα∣σ(Xβ:β∈I−Bα)}∣.b_1=\sum_{\alpha\in I}\sum_{\beta\in B_\alpha}p_\alpha p_\beta,\qquad b_2=\sum_{\alpha\in I}\sum_{\alpha\neq\beta\in B_\alpha}p_{\alpha\beta},\qquad b_3=\sum_{\alpha\in I}E\bigl|E\{X_\alpha-p_\alpha\mid\sigma(X_\beta:\beta\in I-B_\alpha)\}\bigr|.b1​=α∈I∑​β∈Bα​∑​pα​pβ​,b2​=α∈I∑​α=β∈Bα​∑​pαβ​,b3​=α∈I∑​E​E{Xα​−pα​∣σ(Xβ​:β∈I−Bα​)}​.

Roughly, b1b_1b1​ measures the size of the neighbourhoods, b2b_2b2​ the expected number of neighbours of an occurrence, and b3b_3b3​ the dependence between an event and the events outside its neighbourhood. In many applications XαX_\alphaXα​ is independent of σ(Xβ:β∉Bα)\sigma(X_\beta:\beta\notin B_\alpha)σ(Xβ​:β∈/Bα​), so b3=0b_3=0b3​=0.

The dependent Bernoulli process is X=(Xα)α∈I\mathbf X=(X_\alpha)_{\alpha\in I}X=(Xα​)α∈I​, a random element of Z+I\mathbb Z_+^IZ+I​. The Poisson process on III with intensity p(⋅)p_{(\cdot)}p(⋅)​ is Y=(Yα)α∈I\mathbf Y=(Y_\alpha)_{\alpha\in I}Y=(Yα​)α∈I​ with the YαY_\alphaYα​ mutually independent and YαY_\alphaYα​ Poisson with mean pαp_\alphapα​.

Distances are measured in the paper's total variation norm,

∥L(U)−L(V)∥=sup⁡∥h∥=1∣Eh(U)−Eh(V)∣=2sup⁡A∣P(U∈A)−P(V∈A)∣,\|\mathcal L(U)-\mathcal L(V)\|=\sup_{\|h\|=1}|Eh(U)-Eh(V)|=2\sup_A|P(U\in A)-P(V\in A)|,∥L(U)−L(V)∥=∥h∥=1sup​∣Eh(U)−Eh(V)∣=2Asup​∣P(U∈A)−P(V∈A)∣,

which is twice the usual total variation distance.

Formalization targets

Goal: Theorem 2

∥L(X)−L(Y)∥≤2(2b1+2b2+b3).\|\mathcal L(\mathbf X)-\mathcal L(\mathbf Y)\|\le2(2b_1+2b_2+b_3).∥L(X)−L(Y)∥≤2(2b1​+2b2​+b3​).

The bound has no dependence on λ\lambdaλ and no assumption on III beyond countability (which the setting forces).

Milestones, in attack order

  1. TiSih=hT_iS_ih=hTi​Si​h=h (§6, p. 22). For functions on Z+d\mathbb Z_+^dZ+d​, the coordinatewise Stein operators (Tif)(j)=jif(j)−λif(j+ei)(T_if)(j)=j_if(j)-\lambda_if(j+e_i)(Ti​f)(j)=ji​f(j)−λi​f(j+ei​) and (Sih)(j+ei)=−(λiP(Zi=ji))−1E{h(j1,…,Zi,…,jd)1(Zi≤ji)}(S_ih)(j+e_i)=-(\lambda_iP(Z_i=j_i))^{-1}E\{h(j_1,\dots,Z_i,\dots,j_d)1(Z_i\le j_i)\}(Si​h)(j+ei​)=−(λi​P(Zi​=ji​))−1E{h(j1​,…,Zi​,…,jd​)1(Zi​≤ji​)} satisfy TiSih=hT_iS_ih=hTi​Si​h=h.
  2. Bounds on fi=Si(h−Pih)f_i=S_i(h-P_ih)fi​=Si​(h−Pi​h) (§6, p. 22), where PihP_ihPi​h averages hhh over a Poisson(λi\lambda_iλi​) iii-th coordinate. For ∥h∥≤1\|h\|\le1∥h∥≤1, ∥fi∥<2(1∧1.4λi−1/2)\|f_i\|<2(1\wedge1.4\lambda_i^{-1/2})∥fi​∥<2(1∧1.4λi−1/2​) and ∥Δkfi∥<4(1∧1.4λi−1/2)\|\Delta_kf_i\|<4(1\wedge1.4\lambda_i^{-1/2})∥Δk​fi​∥<4(1∧1.4λi−1/2​).
  3. Display (15) (p. 24). E{(Xα−pα)(f(U+Xβek)−f(U))}≤2∥f∥(pαβ+pαpβ)E\{(X_\alpha-p_\alpha)(f(U+X_\beta e_k)-f(U))\}\le2\|f\|(p_{\alpha\beta}+p_\alpha p_\beta)E{(Xα​−pα​)(f(U+Xβ​ek​)−f(U))}≤2∥f∥(pαβ​+pα​pβ​) for any random UUU.
  4. Displays (13)–(14), the step i=1i=1i=1 (p. 23). With Wj=∑α∈I(j)XαW_j=\sum_{\alpha\in I(j)}X_\alphaWj​=∑α∈I(j)​Xα​ the block sums of a partition and Z1Z_1Z1​ an independent Poisson(λ1\lambda_1λ1​),
∣Eh(W1,…,Wd)−Eh(Z1,W2,…,Wd)∣≤2∥f1∥∑I(1)pα2+2∥f1∥∑I(1)∑α≠β∈Bα(pαβ+pαpβ)+∥f1∥∑I(1)sα.|Eh(W_1,\dots,W_d)-Eh(Z_1,W_2,\dots,W_d)|\le2\|f_1\|\sum_{I(1)}p_\alpha^2+2\|f_1\|\sum_{I(1)}\sum_{\alpha\ne\beta\in B_\alpha}(p_{\alpha\beta}+p_\alpha p_\beta)+\|f_1\|\sum_{I(1)}s_\alpha.∣Eh(W1​,…,Wd​)−Eh(Z1​,W2​,…,Wd​)∣≤2∥f1​∥I(1)∑​pα2​+2∥f1​∥I(1)∑​α=β∈Bα​∑​(pαβ​+pα​pβ​)+∥f1​∥I(1)∑​sα​.
  1. The finite-dimensional bound (Theorem 2, p. 11). For a partition of III into nonempty blocks I(1),…,I(d)I(1),\dots,I(d)I(1),…,I(d) with Wj=∑I(j)XαW_j=\sum_{I(j)}X_\alphaWj​=∑I(j)​Xα​, Zj=∑I(j)YαZ_j=\sum_{I(j)}Y_\alphaZj​=∑I(j)​Yα​ and λj=EWj\lambda_j=EW_jλj​=EWj​:
∥L((W1,…,Wd))−L((Z1,…,Zd))∥≤2(1∧1.4(min⁡iλi)−1/2)(2b1+2b2+b3).\|\mathcal L((W_1,\dots,W_d))-\mathcal L((Z_1,\dots,Z_d))\|\le2\bigl(1\wedge1.4(\min_i\lambda_i)^{-1/2}\bigr)(2b_1+2b_2+b_3).∥L((W1​,…,Wd​))−L((Z1​,…,Zd​))∥≤2(1∧1.4(imin​λi​)−1/2)(2b1​+2b2​+b3​).

Companion results

  • Theorem 3 (p. 12). For an independent Bernoulli process X′\mathbf X'X′ with the same marginals as X\mathbf XX, ∥L(X)−L(X′)∥≤2(2b1+2b2+b3)+4∑pα2\|\mathcal L(\mathbf X)-\mathcal L(\mathbf X')\|\le2(2b_1+2b_2+b_3)+4\sum p_\alpha^2∥L(X)−L(X′)∥≤2(2b1​+2b2​+b3​)+4∑pα2​.
  • The remark after Theorem 3. ∥L(X′)−L(Y)∥≤2∑pα2\|\mathcal L(\mathbf X')-\mathcal L(\mathbf Y)\|\le2\sum p_\alpha^2∥L(X′)−L(Y)∥≤2∑pα2​, so 4∑pα24\sum p_\alpha^24∑pα2​ in Theorem 3 can be replaced by 2∑pα22\sum p_\alpha^22∑pα2​.

Significance

The result. Theorem 2 says that when b1b_1b1​, b2b_2b2​, b3b_3b3​ are small, the set of indices at which the dependent events occur is close in law to a Poisson process with the same intensity. The bound covers every event about the locations, not just the total count. It is in the strong total variation norm and needs only moment information when b3=0b_3=0b3​=0. Theorem 3 turns this into a decoupling statement: a dependent family of rare events is almost indistinguishable from an independent family with the same marginals. The process bound is the form used when the positions of rare events matter, for example in the distribution of the location of the longest match in sequence comparison and in scan statistics.

Formalizing it. The results are proved in the paper; none is machine-checked. A formal development would give a Lean statement and proof of a Chen–Stein bound with explicit constants, for countable index sets and arbitrary dependence. It would also include the coordinatewise Stein operators on Z+d\mathbb Z_+^dZ+d​ and the bounds on their solutions, which are reusable for other multivariate Poisson approximations. A companion mission formalizes Theorem 1, including Lemma 1 (the bounds on the one-variable Stein solution) on which milestone 2 rests.

Difficulty

The total variation distance between two laws on Z+I\mathbb Z_+^IZ+I​ cannot be bounded coordinate by coordinate, because the XαX_\alphaXα​ are dependent. The one-variable Stein equation controls only the law of a single integer-valued statistic. The paper passes through finite-dimensional block sums and replaces the coordinates one at a time. At each replacement the error has to be charged to the terms of b1,b2,b3b_1,b_2,b_3b1​,b2​,b3​ indexed by the current block, so that the total over all blocks reproduces 2b1+2b2+b32b_1+2b_2+b_32b1​+2b2​+b3​ without a factor ddd. Two further points need care. First, the bound ∥Δkf1∥≤2∥f1∥\|\Delta_kf_1\|\le2\|f_1\|∥Δk​f1​∥≤2∥f1​∥ is the only one available for differences in a coordinate other than the one being replaced; this is why the constants are larger than in Theorem 1. Second, the infinite index set requires a limiting argument from finitely many blocks to the full process.

Formalization scope

  • The index set is a countable type. The page says "arbitrary index set", but pα>0p_\alpha>0pα​>0 and ∑pα<∞\sum p_\alpha<\infty∑pα​<∞ force countability; the assumption also makes X\mathbf XX measurable as a map into NI\mathbb N^INI with the product σ-algebra.
  • The XαX_\alphaXα​ are measurable, N\mathbb NN-valued and bounded by 111. pαp_\alphapα​ is P(Xα=1)P(X_\alpha=1)P(Xα​=1). The standing hypotheses pα>0p_\alpha>0pα​>0, ∑pα=λ\sum p_\alpha=\lambda∑pα​=λ and λ>0\lambda>0λ>0 are explicit.
  • b1,b2,b3b_1,b_2,b_3b1​,b2​,b3​ and sαs_\alphasα​ are [0,∞][0,\infty][0,∞]-valued, and every bound is an inequality in [0,∞][0,\infty][0,∞], so a divergent series is never read as 000. The conditional expectation in sαs_\alphasα​ is taken with respect to a σ-algebra generated by measurable maps, hence a genuine sub-σ-algebra.
  • The norm ∥L(U)−L(V)∥\|\mathcal L(U)-\mathcal L(V)\|∥L(U)−L(V)∥ is twice the published definition MarkovChainCLT.tvDist (supremum over measurable sets of ∣μ(A)−ν(A)∣|\mu(A)-\nu(A)|∣μ(A)−ν(A)∣). Dropping the factor 222 would make the goal twice as strong and false in general.
  • Y\mathbf YY (and X′\mathbf X'X′ in Theorem 3) lives on its own probability space. Mutual independence of the YαY_\alphaYα​ and of the Xα′X'_\alphaXα′​ is a hypothesis. Without it the law of the process is not determined by the marginals and the statements are false.
  • Block sums WjW_jWj​ are N\mathbb NN-valued tsums, equal to the true sums almost surely. A partition is a surjection I→{1,…,d}I\to\{1,\dots,d\}I→{1,…,d} (Fin d), so Lean's coordinate 0 is the paper's coordinate 111.
  • (Sih)(j)(S_ih)(j)(Si​h)(j) is set to 000 when ji=0j_i=0ji​=0, as for SSS in §4. The strict inequalities in milestone 2 use the actual sup norms over Z+d\mathbb Z_+^dZ+d​.

Needed infrastructure: product measures and independence on NI\mathbb N^INI, Poisson laws (Mathlib's poissonMeasure), conditional expectation, and a one-variable Stein bound (Lemma 1). Contributions of proofs of any milestone, of the general step iii of §6, and of the one-dimensional Lemma 1 are welcome.

Selected references

  • R. Arratia, L. Goldstein, L. Gordon, Two moments suffice for Poisson approximations: the Chen-Stein method, Ann. Probab. 17(1) (1989) 9–25. https://doi.org/10.1214/aop/1176991491
  • L. H. Y. Chen, Poisson approximation for dependent trials, Ann. Probab. 3(3) (1975) 534–545. https://doi.org/10.1214/aop/1176996359
  • A. D. Barbour, G. K. Eagleson, Poisson approximation for some statistics based on exchangeable trials, Adv. Appl. Probab. 15(3) (1983) 585–600. https://doi.org/10.2307/1426620
  • A. D. Barbour, L. Holst, S. Janson, Poisson Approximation, Oxford University Press, 1992. https://global.oup.com/academic/product/poisson-approximation-9780198522355
8 thms4 active usersReviewed
🏆Completed
ProbabilityStatistics·Captain: mikedeng1

Two Moments Suffice for Poisson Approximations: The Chen-Stein Method 1: Total Variation Bound 2[(b₁+b₂)(1−e^{−λ})/λ + b₃′(1∧1.4λ^{−1/2})] for a Sum of Dependent IndicatorsResearch Paper

Motivation

Counts of rare events often look Poisson even when the events are dependent. For example, a local pattern in a random graph can overlap another copy of the pattern, so the corresponding occurrence indicators are not independent. The useful question is quantitative: how far is the distribution of the total count from a Poisson distribution with the same mean? Arratia, Goldstein and Gordon give a bound in terms of three quantities that can be estimated from neighbourhoods of dependence. Their 1989 paper applies the Chen–Stein method to the count and then to the full point process. This mission concerns the count bound, Theorem 1.

The authors explain that the result is essentially contained in Chen’s earlier work, while their one-variable proof prepares the process result in Theorem 2. The bound remains useful as a precise statement of the dependence conditions under which the Poisson approximation works. The process theorem belongs to the companion mission.

Setting

Let III index Bernoulli indicators XαX_\alphaXα​, each taking values in {0,1}\{0,1\}{0,1} on a probability space with law PPP. Write pα=P(Xα=1)>0p_\alpha=P(X_\alpha=1)>0pα​=P(Xα​=1)>0, and let

W=∑α∈IXα,λ=EW=∑α∈Ipα∈(0,∞).W=\sum_{\alpha\in I}X_\alpha,\qquad \lambda=E W=\sum_{\alpha\in I}p_\alpha\in(0,\infty).W=α∈I∑​Xα​,λ=EW=α∈I∑​pα​∈(0,∞).

For each α\alphaα, choose a dependence neighbourhood Bα⊆IB_\alpha\subseteq IBα​⊆I containing α\alphaα. The neighbourhoods need not be symmetric, and the theorem imposes no independence condition: dependence on indicators outside BαB_\alphaBα​ is measured directly. Define pαβ=E(XαXβ)p_{\alpha\beta}=E(X_\alpha X_\beta)pαβ​=E(Xα​Xβ​) and

b1=∑α∑β∈Bαpαpβ,b2=∑α∑β∈Bαβ≠αpαβ.\begin{aligned} b_1&=\sum_\alpha\sum_{\beta\in B_\alpha}p_\alpha p_\beta,\\ b_2&=\sum_\alpha\sum_{\substack{\beta\in B_\alpha\\\beta\ne\alpha}}p_{\alpha\beta}. \end{aligned}b1​b2​​=α∑​β∈Bα​∑​pα​pβ​,=α∑​β∈Bα​β=α​∑​pαβ​.​

The remaining quantities use conditional expectation. Let Vα=∑β∉BαXβV_\alpha=\sum_{\beta\notin B_\alpha}X_\betaVα​=∑β∈/Bα​​Xβ​, and let Fα\mathcal F_\alphaFα​ be the sigma algebra generated by all XβX_\betaXβ​ outside BαB_\alphaBα​. Put

sα′=E∣E[Xα−pα∣Vα]∣,b3′=∑αsα′,sα=E∣E[Xα−pα∣Fα]∣,b3=∑αsα.\begin{aligned} s'_\alpha&=E\left|E[X_\alpha-p_\alpha\mid V_\alpha]\right|, & b'_3&=\sum_\alpha s'_\alpha,\\ s_\alpha&=E\left|E[X_\alpha-p_\alpha\mid\mathcal F_\alpha]\right|, & b_3&=\sum_\alpha s_\alpha. \end{aligned}sα′​sα​​=E∣E[Xα​−pα​∣Vα​]∣,=E∣E[Xα​−pα​∣Fα​]∣,​b3′​b3​​=α∑​sα′​,=α∑​sα​.​

Conditioning on the count VαV_\alphaVα​ retains less information than conditioning on all far indicators, so sα′≤sαs'_\alpha\le s_\alphasα′​≤sα​. Let ZZZ have the Poisson law with mean λ\lambdaλ. The paper defines ∥L(W)−L(Z)∥\|\mathcal L(W)-\mathcal L(Z)\|∥L(W)−L(Z)∥ as twice the usual supremum over events: 2sup⁡A∣P(W∈A)−P(Z∈A)∣2\sup_A|P(W\in A)-P(Z\in A)|2supA​∣P(W∈A)−P(Z∈A)∣.

Formalization targets

Theorem 1: total variation and the zero-count event

The goal is the complete four-clause statement of Theorem 1, including its strict final inequality:

∥L(W)−L(Z)∥≤2[(b1+b2)1−e−λλ+b3′min⁡{1,1.4λ−1/2}]≤2(b1+b2+b3),∣P(W=0)−e−λ∣≤(b1+b2+b3′)1−e−λλ<min⁡{1,λ−1}(b1+b2+b3).\begin{aligned} \|\mathcal L(W)-\mathcal L(Z)\| &\le 2\left[(b_1+b_2)\frac{1-e^{-\lambda}}{\lambda} +b'_3\min\{1,1.4\lambda^{-1/2}\}\right]\\ &\le 2(b_1+b_2+b_3),\\ |P(W=0)-e^{-\lambda}| &\le (b_1+b_2+b'_3)\frac{1-e^{-\lambda}}{\lambda} <\min\{1,\lambda^{-1}\}(b_1+b_2+b_3). \end{aligned}∥L(W)−L(Z)∥∣P(W=0)−e−λ∣​≤2[(b1​+b2​)λ1−e−λ​+b3′​min{1,1.4λ−1/2}]≤2(b1​+b2​+b3​),≤(b1​+b2​+b3′​)λ1−e−λ​<min{1,λ−1}(b1​+b2​+b3​).​

The intermediate targets are the Stein-operator inverse identity, the bound on a telescoping term, display (11) relating the approximation error to b1,b2,b3′b_1,b_2,b'_3b1​,b2​,b3′​, and the two clauses of Lemma 1. The goal keeps the coefficients and both forms of b3b_3b3​ fixed, as the paper states them.

Significance

The result reduces a distributional approximation question to local sums of probabilities and conditional-dependence errors. When b1b_1b1​, b2b_2b2​ and b3b_3b3​ are small, the entire law of the count is close to its Poisson comparison law, and the probability of no occurrence has its own sharper bound. The latter is useful whenever a model asks whether at least one rare event occurs. The result applies without demanding exact independence outside the chosen neighbourhoods; the residual dependence appears in b3b_3b3​.

The paper proves these results. The formalization task is to give the known estimates machine-checked statements and proofs with the constants and probability conventions exposed. Mathlib supplies the Poisson measure and conditional expectation, while the mission adds the paper-specific neighbourhood sums and Stein operators. The formalized theorem can be reused for count approximations in other dependent-indicator models once those models supply bounds on the three error quantities. No machine-checked proof is claimed here: the theorem items are proposed targets with sorry bodies.

Difficulty

A first approximation based only on EWE WEW misses overlapping event pairs. Bounding pair dependence through b2b_2b2​ alone also misses dependence between one indicator and the aggregate of far indicators. The authors' third term measures that remaining effect by conditional expectation. The proof must control the Stein solution uniformly while preserving its precise constants; replacing that control with a qualitative bound would not recover Theorem 1. In the countably infinite setting, the sums and conditional expectations also require careful handling of convergence and measurability. The proof of Lemma 1 is attributed in the paper to Barbour and Eagleson; it is a substantive target here rather than an assumed bound.

Formalization scope

The Lean index type is countable. Under the paper's assumptions pα>0p_\alpha>0pα​>0 and ∑αpα<∞\sum_\alpha p_\alpha<\infty∑α​pα​<∞, only countably many indices can exist, so this representation retains the stated probabilistic setting. Indicators are measurable natural-number-valued functions with values at most one. The parameter λ\lambdaλ is a positive real equipped with the exact HasSum statement for the probabilities. The Poisson law is Mathlib's poissonMeasure at λ\lambdaλ converted to a nonnegative real parameter.

The sums defining b1,b2,b3,b3′b_1,b_2,b_3,b'_3b1​,b2​,b3​,b3′​ use extended nonnegative reals, so divergence becomes +∞+\infty+∞ rather than the real tsum default zero. The random counts WWW and VαV_\alphaVα​ use natural-number tsum; their divergent-input default can occur only on a null set under the finite-mean hypotheses and therefore does not change their laws. Measurability of these counts follows from countability and measurability of each indicator. The far-field sigma algebra is generated by the measurable indicators, and the formalization checks that it lies below the ambient sigma algebra, avoiding a default-zero conditional expectation. The paper's total variation norm is exactly 2 * MarkovChainCLT.tvDist, with the factor two retained.

The source writes a strict final inequality without discussing infinite error sums. The Lean statement conditions that single strict clause on b1+b2+b3<∞b_1+b_2+b_3<\inftyb1​+b2​+b3​<∞; otherwise both sides can be infinite and strict comparison is false. The other three clauses allow infinite bounds, as the source does. Lemma 1 fixes the Stein inverse at zero exactly as the paper chooses and uses explicit pointwise sup-norm bounds over all nonnegative integers. Display (11) allows ∣h(k)∣≤1|h(k)|\le1∣h(k)∣≤1, a strengthening of the displayed ∥h∥=1\|h\|=1∥h∥=1 case. These choices rule out loss of the norm's factor two, disappearing divergent sums, default-zero mapped measures or conditional expectations, and an unannounced independence assumption.

Selected references

  • Richard Arratia, Larry Goldstein and Louis Gordon, Two moments suffice for Poisson approximations: the Chen-Stein method, Annals of Probability 17(1), 9–25, 1989. DOI 10.1214/aop/1176991491.
8 thms4 active usersReviewed
🏆Completed
Graph TheoryOperations ResearchOptimization·Captain: mikedeng1

Maximal Flow Through a Network I: The Minimal Cut Theorem — the Maximal Flow Value Equals the Minimum Value of a Disconnecting SetResearch Paper

Motivation

The question behind this mission was posed by T. E. Harris to L. R. Ford, Jr. and D. R. Fulkerson at RAND, in the setting of rail transport: given a rail network linking two cities, with a capacity on every link, find the largest steady flow from one city to the other. Ford and Fulkerson's answer, the minimal cut theorem, published in the Canadian Journal of Mathematics in 1956 (DOI 10.4153/CJM-1956-045-5), says that the obvious upper bound, the total capacity of a set of links whose removal separates the two cities, is always achieved by some flow.

The theorem became the starting point of network flow theory, and through it of a large part of combinatorial optimization and operations research: transportation, assignment, scheduling and network reliability problems are routinely reduced to it.

Timeline.

  • 1927: K. Menger proves that the minimum number of vertices separating two vertex sets of a graph equals the maximum number of disjoint paths joining them (Fund. Math. 10), the unit-capacity ancestor of the theorem.
  • 1955: Harris and Ross study the Soviet rail network as a capacity problem in a RAND report; Harris formulates the maximal flow problem (Schrijver's historical account: Math. Program. 91, 2002).
  • 1956: Ford and Fulkerson publish the minimal cut theorem for undirected networks, with a non-constructive proof based on maximal flows (this paper). Independently, Elias, Feinstein and Shannon state and prove the max-flow min-cut theorem for directed networks (IRE Trans. Inf. Theory 2, 1956), and Dantzig and Fulkerson obtain it from linear programming duality.
  • 1956–1962: Ford and Fulkerson's labelling (augmenting path) algorithm, collected in Flows in Networks (Princeton, 1962).
  • 1972: Edmonds and Karp give polynomial bounds for augmenting-path methods (J. ACM 19).

Setting

A network NNN consists of a finite set of vertices VVV, a finite set of arcs EEE, two distinct vertices, the source aaa and the sink bbb, and a positive capacity c(e)>0c(e)>0c(e)>0 on every arc. Each arc eee has two distinct end vertices; arcs are undirected, and several arcs may join the same pair of vertices.

A chain joining uuu and www is a set of distinct arcs that can be arranged as α1(v0v1),α2(v1v2),…,αm(vm−1vm)\alpha_1(v_0v_1),\alpha_2(v_1v_2),\dots,\alpha_m(v_{m-1}v_m)α1​(v0​v1​),α2​(v1​v2​),…,αm​(vm−1​vm​) with v0=uv_0=uv0​=u, vm=wv_m=wvm​=w and the vertices v0,…,vmv_0,\dots,v_mv0​,…,vm​ pairwise distinct; each arc may be traversed in either direction. The null chain (m=0m=0m=0) joins uuu to itself.

A flow fff assigns a number f(C)≥0f(C)\ge 0f(C)≥0 to each chain CCC joining aaa and bbb (and 000 to every other set of arcs) such that the load ℓf(e)=∑C∋ef(C)\ell_f(e)=\sum_{C\ni e}f(C)ℓf​(e)=∑C∋e​f(C) satisfies ℓf(e)≤c(e)\ell_f(e)\le c(e)ℓf​(e)≤c(e) for every arc. Its value is val(f)=∑Cf(C)\mathrm{val}(f)=\sum_C f(C)val(f)=∑C​f(C). An arc is saturated by fff if ℓf(e)=c(e)\ell_f(e)=c(e)ℓf​(e)=c(e). A maximal flow is a flow of largest value.

A set DDD of arcs is a disconnecting set if every chain joining aaa and bbb contains an arc of DDD; its value is v(D)=∑e∈Dc(e)v(D)=\sum_{e\in D}c(e)v(D)=∑e∈D​c(e). A cut is a disconnecting set no proper subset of which is disconnecting.

The proof introduces two further objects: the set SSS of arcs saturated by every maximal flow, and the set L⊆SL\subseteq SL⊆S of left arcs, those arcs of SSS whose left vertex (the end vertex met first by a positive chain flow of a maximal flow, travelling from aaa) can be reached from aaa by a chain with no arc saturated by some maximal flow.

Formalization targets

Goal: Theorem 1 (Minimal cut theorem), p. 400

∃ m∈R:m=max⁡f flowval(f)=min⁡D disconnectingv(D),\exists\, m\in\mathbb R:\quad m=\max_{f\ \text{flow}}\mathrm{val}(f)=\min_{D\ \text{disconnecting}}v(D),∃m∈R:m=f flowmax​val(f)=D disconnectingmin​v(D),

with both the maximum and the minimum attained. The statement mentions only flows and disconnecting sets, not the proof objects SSS and LLL.

Milestones, in the order of the paper's proof

  1. A maximal flow exists, and the set of maximal flows is convex (p. 400).
  2. Lemma 1: SSS is a disconnecting set (p. 400).
  3. Every arc of SSS receives the same orientation from all positive chain flows of all maximal flows: its left vertex is unique (pp. 400–401).
  4. Lemma 2: LLL is a disconnecting set (p. 401).
  5. Lemma 3: no positive chain flow of a maximal flow contains more than one arc of LLL (p. 401).
  6. val(f)≤v(D)\mathrm{val}(f)\le v(D)val(f)≤v(D) for every flow fff and every disconnecting set DDD (p. 402).
  7. LLL is a cut of minimal value, and every maximal flow has value v(L)v(L)v(L) (p. 402).

Two further statements of the paper are included as items without being milestones: the remark that a disconnecting set of minimal value is a cut (p. 400), and the Corollary (p. 402): if a set AAA of arcs meets every cut in exactly one arc, adding kkk to the capacity of each arc of AAA raises the maximal flow value by kkk.

Significance

The minimal cut theorem turns a maximization over flows into a minimization over finite sets of arcs, so an optimal flow comes with a short certificate of optimality. It implies Menger's theorem (unit capacities), and through it König's theorem on bipartite matchings and Hall's marriage theorem. The Corollary is the tool behind the paper's own computing procedure for source–sink planar networks (§2, formalized in a companion mission).

The theorem is classical and proved. What this mission adds is a machine-checked proof of the paper's own formulation: undirected arcs, parallel arcs, flows decomposed along chains (path flows, with no circulations), and the minimum taken over arc sets meeting every chain, together with the proof's intermediate claims. Max-flow min-cut theorems already on the platform (Applied Combinatorics VIII, AppliedComb.Flows.max_flow_min_cut; Introduction to Linear Optimization X, LinearOptimization.max_flow_min_cut) concern directed networks with edge flows obeying conservation and cuts given by vertex sets. They are related results, not this statement, and connecting the two models is itself welcome work.

Difficulty

Weak duality (milestone 6) is immediate; the content is the reverse inequality. The obvious first step, taking a maximal flow and observing that its saturated arcs separate aaa from bbb, does not finish the proof: a positive chain flow may pass through several saturated arcs, so the total capacity of the saturated arcs can exceed the flow value. One has to single out a disconnecting subset that every positive chain flow crosses exactly once, and there is no canonical choice from a single flow. The paper's sets SSS and LLL are defined from all maximal flows at once, and the work consists in showing that these sets are well behaved. The orientation claim in particular needs an exchange argument on two chains that cross at an arc, where the recombined arc sequences may revisit vertices and must be reduced to chains. In a formal development this "a walk contains a chain" step and the averaging of maximal flows over finitely many chains are the main bookkeeping costs.

Formalization scope

  • A network is a structure on a vertex type V and an arc type E, both Fintype with decidable equality, with end-vertex maps tail, head (labels only, no direction), tail e ≠ head e, a source and a sink with source ≠ sink, and capacities cap : E → ℝ with 0 < cap e. These are the paper's standing assumptions; there are no others in §1. In particular, no planarity is assumed and an arc may join aaa and bbb directly.
  • A chain is a Finset E that is the arc set of some arrangement (list of arcs, list of pairwise distinct vertices, each arc joining consecutive vertices in either order).
  • A flow is a function f : Finset E → ℝ, non-negative, zero off the chains joining source and sink, with every arc load at most the capacity. A collection of chain flows that lists a chain twice merges into this form without changing the value or any load.
  • "Maximal" means of maximum value. The goal is stated with IsGreatest and IsLeast on the sets of flow values and of values of disconnecting sets, so no supremum of a real set appears and both extrema must be attained.
  • A trivializing formalization is ruled out: chains must be self-avoiding and must join the source and the sink, the disconnecting condition quantifies over exactly these chains, and the minimum ranges over all disconnecting sets rather than over a family chosen to match a given flow.
  • Needed infrastructure: finite sums over Finset (Finset E), convexity in Finset E → ℝ, compactness of the flow polytope (for existence), and lemmas on lists (extracting a chain from a walk). The walk-to-chain lemma and weak duality are reusable for the companion mission and for any path-flow model.

Selected references

  • L. R. Ford, Jr. and D. R. Fulkerson, Maximal Flow Through a Network, Canadian Journal of Mathematics 8 (1956), 399–404. https://doi.org/10.4153/CJM-1956-045-5
  • P. Elias, A. Feinstein and C. E. Shannon, A note on the maximum flow through a network, IRE Transactions on Information Theory 2 (1956), 117–119. https://doi.org/10.1109/TIT.1956.1056816
  • K. Menger, Zur allgemeinen Kurventheorie, Fundamenta Mathematicae 10 (1927), 96–115. https://doi.org/10.4064/fm-10-1-96-115
  • L. R. Ford, Jr. and D. R. Fulkerson, Flows in Networks, Princeton University Press, 1962.
  • J. Edmonds and R. M. Karp, Theoretical improvements in algorithmic efficiency for network flow problems, Journal of the ACM 19 (1972), 248–264. https://doi.org/10.1145/321694.321699
  • A. Schrijver, On the history of the transportation and maximum flow problems, Mathematical Programming 91 (2002), 437–445. https://doi.org/10.1007/s101070100259
13 thms4 active usersReviewed
🏆Completed
Graph TheoryLinear OptimizationOperations Research+1·Captain: mikedeng1

Maximum Matching and a Polyhedron With 0,1-Vertices: The Vertices of the Matching Polyhedron Are Exactly the Matching VectorsResearch Paper

Motivation

A matching in a graph is a set of edges no two of which share a node. Given a real weight on every edge, the maximum-weight matching problem asks for a matching of largest total weight. It is one of the basic problems of combinatorial optimization: assignment, pairing and scheduling problems reduce to it, and it is the standard example of a combinatorial problem that is solvable in polynomial time although it is not obviously a linear program.

For bipartite graphs the problem is a linear program in disguise: the polytope cut out by nonnegativity and the node-degree inequalities has only 0–1 vertices (the Birkhoff–von Neumann theorem in the square case; Mathlib has it as extremePoints_doublyStochastic). For general graphs this fails already on a triangle, where the vector with every coordinate 1/21/21/2 satisfies all degree inequalities but is not a combination of matchings. Edmonds' 1965 paper (DOI 10.6028/jres.069b.013) adds one family of inequalities, one for each odd set of nodes, and proves that the resulting polyhedron has exactly the matching vectors as its vertices. The companion paper Paths, trees, and flowers gives the cardinality algorithm on which the weighted algorithm of §7 is built.

Timeline:

  • 1931: König and Egerváry prove the min–max theorems for bipartite matching; 1946: Birkhoff shows that the doubly stochastic matrices are the convex hull of the permutation matrices (the bipartite perfect-matching polytope).
  • 1947: Tutte characterizes graphs with a perfect matching.
  • 1965: Edmonds, Paths, trees, and flowers: the blossom algorithm for maximum-cardinality matching.
  • 1965: Edmonds, this paper: Theorem (P) (the matching polyhedron) and Theorem (M) (blossom-shrinking optimality certificates), with a weighted matching algorithm.

Setting

Let GGG be a finite graph with node set VVV and edge set EEE; each edge meets two different nodes, its ends. Real variables xex_exe​ correspond to the edges e∈Ee\in Ee∈E. The polyhedron C⊆REC\subseteq\mathbb R^EC⊆RE is the set of vectors xxx satisfying

  1. xe≥0x_e\ge 0xe​≥0 for every edge eee;
  2. ∑e meets vxe≤1\sum_{e \text{ meets } v} x_e\le 1∑e meets v​xe​≤1 for every node vvv;
  3. ∑e has both ends in Sxe≤r\sum_{e \text{ has both ends in } S} x_e\le r∑e has both ends in S​xe​≤r for every set SSS of 2r+12r+12r+1 nodes, rrr a strictly positive integer.

The matching vectors PPP are the vectors with every component 000 or 111 that satisfy (2); they are the incidence vectors of matchings. For edge weights c∈REc\in\mathbb R^Ec∈RE, the linear form (4) is W(c,x)=∑ecexeW(c,x)=\sum_e c_e x_eW(c,x)=∑e​ce​xe​.

The dual program has a variable yvy_vyv​ for each node and zSz_SzS​ for each odd set SSS (∣S∣=2rS+1|S|=2r_S+1∣S∣=2rS​+1, rS≥1r_S\ge1rS​≥1). Its objective is (5) U(y,z)=∑vyv+∑SrSzSU(y,z)=\sum_v y_v+\sum_S r_S z_SU(y,z)=∑v​yv​+∑S​rS​zS​, subject to (6) y,z≥0y,z\ge0y,z≥0 and (7) yv1+yv2+∑S∋v1,v2zS≥cey_{v_1}+y_{v_2}+\sum_{S\ni v_1,v_2}z_S\ge c_eyv1​​+yv2​​+∑S∋v1​,v2​​zS​≥ce​ for every edge eee with ends v1,v2v_1,v_2v1​,v2​. For a matching MMM, conditions (8)–(10) are the complementary slackness conditions: yv=0y_v=0yv​=0 at nodes not covered by MMM, equality in (7) on MMM, and every odd set with zS>0z_S>0zS​>0 contains exactly rSr_SrS​ edges of MMM.

A blossom sequence {Gi}i=0n\{G_i\}_{i=0}^n{Gi​}i=0n​ (Theorem (M)) starts from G0=GG_0=GG0​=G with matching M0=MM_0=MM0​=M and repeatedly shrinks an odd circuit BiB_iBi​ (a blossom, 2ai+12a_i+12ai​+1 edges of which aia_iai​ are matched) to a single node, carrying node weights w(vi)w(v^i)w(vi) and edge weights w(ei)w(e^i)w(ei) that obey conditions (a)–(k) of p. 127.

In the Lean development these are Graph, IsMatching, incidence, matchingPolyhedron (CCC), matchingVectors (PPP), W, U, DualFeasible ((6)–(7)), CompSlack ((8)–(10)) and BlossomSequence, all in the namespace EdmondsMatching65.Polyhedron.

Formalization targets

Goal: Theorem (P)

ext⁡(C)=P.\operatorname{ext}(C)=P.ext(C)=P.

The vertices (extreme points) of CCC are exactly the matching vectors of GGG. Hence the maximum weight of a matching equals max⁡{W(c,x):x∈C}\max\{W(c,x):x\in C\}max{W(c,x):x∈C} for every ccc.

Milestones

  1. P⊆ext⁡(C)P\subseteq\operatorname{ext}(C)P⊆ext(C) (§2, p. 126).
  2. If for every ccc some 0–1 point of CCC maximizes W(c,⋅)W(c,\cdot)W(c,⋅) over CCC, then ext⁡(C)=P\operatorname{ext}(C)=Pext(C)=P (§2, p. 126).
  3. Weak duality: W(c,x)≤U(y,z)W(c,x)\le U(y,z)W(c,x)≤U(y,z) for x∈Cx\in Cx∈C and ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfying (6)–(7) (§3, p. 126).
  4. If MMM is a matching and ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfies (6)–(10), then W(c,χM)=U(y,z)W(c,\chi^M)=U(y,z)W(c,χM)=U(y,z) (§3, p. 127).
  5. A blossom sequence for MMM yields ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfying (6)–(10) (§5, pp. 127–128).
  6. For every ccc some maximum matching has a blossom sequence (§6, p. 128).
  7. Theorem (M): a matching is maximum if and only if a blossom sequence for it exists (§4, p. 127).
  8. For every ccc there are a matching MMM and ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfying (6)–(10) (§3, p. 127).

Significance

The result. Theorem (P) turns maximum-weight matching in general graphs into a linear program over an explicitly described polyhedron, and Theorem (M) with the §5 translation gives a short certificate of optimality for every maximum matching. Together they established the template of polyhedral combinatorics: describe the convex hull of the combinatorial objects by inequalities, and prove the description through linear programming duality and an algorithm. The matching polytope underlies the analysis of the weighted blossom algorithm, separation over odd-set inequalities (Padberg–Rao), and many later integrality results; Edmonds' own §8 states the extension to degree-constrained subgraphs.

Formalizing it. The theorem has been proved since 1965 and appears in every text on combinatorial optimization; this mission asks for a machine-checked proof of the polytope statement for general finite graphs, including parallel edges, together with the duality certificate and the blossom-sequence characterization. The prove2me platform has a proved form of Edmonds' perfect matching polytope theorem on complete graphs in convex-decomposition form (MetricTSP.pm_polytope_decomposition), a different polytope with a different conclusion; nothing states Theorem (P) or Theorem (M).

Difficulty

The inclusion P⊆ext⁡(C)P\subseteq\operatorname{ext}(C)P⊆ext(C) and weak duality are routine. The difficulty is the reverse inclusion: showing that no fractional point of CCC is a vertex. The bipartite argument (a fractional point has a cycle of fractional edges along which it can be perturbed both ways) breaks on odd cycles: perturbing along an odd circuit violates a degree inequality, and the odd-set inequalities that cut off the half-integral points are exponentially many and overlap. The paper's route needs, for every weight vector, an optimal matching together with a dual solution satisfying (6)–(10), and the existence of that certificate is the substance of the weighted matching algorithm: the blossom sequence of Theorem (M) must be constructed, and the translation (11)–(16) from node and edge weights of the contracted graphs to ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ must be verified through the whole shrinking history.

Formalization scope

  • The graph is a finite node type V, a finite edge type E and an end map ends : E → Sym2 V with no loops. Parallel edges are allowed: the contracted graphs of Theorem (M) have them, and Theorem (P) holds for multigraphs; simple graphs are the case of an injective end map.
  • Vectors are E → ℝ, one coordinate per edge. Vertices are Mathlib's Set.extremePoints ℝ. Odd sets carry an explicit r : ℕ with 1 ≤ r and |S| = 2r + 1; even sets and singletons carry no inequality.
  • Edge weights are arbitrary reals; matchings need not be perfect and may be empty. No connectivity, no parity of |V|.
  • The dual variable z is a function on all node sets of which only odd sets are read.
  • A contracted graph Gᵢ is a partition of V into blocks; an edge of G is an edge of Gᵢ when its ends lie in different blocks. Each Mᵢ must be a matching of Gᵢ, and all of (a)–(k) appear as fields of BlossomSequence; a sequence missing any of them would make milestone 6 trivial or milestone 5 false.
  • A trivializing formalization is ruled out: coordinates indexed by node pairs (Sym2 V → ℝ) leave non-edge coordinates free and give a polyhedron with no extreme points, and the goal is stated as equality of extreme points, not as a convex-hull identity or as the existence of a dual certificate.
  • Needed infrastructure: extreme points of polyhedra as unique maximizers of linear forms, finite LP weak duality over these index sets, and the weighted blossom algorithm (or another proof of milestone 8). The polyhedral lemmas are reusable for other integrality results; contributions on any milestone are welcome.

Selected references

  • J. Edmonds, Maximum Matching and a Polyhedron With 0,1-Vertices, J. Res. Nat. Bur. Standards Sect. B 69B (1965), 125–130. https://doi.org/10.6028/jres.069b.013
  • J. Edmonds, Paths, Trees, and Flowers, Canad. J. Math. 17 (1965), 449–467. https://doi.org/10.4153/CJM-1965-045-4
  • W. T. Tutte, The Factorization of Linear Graphs, J. London Math. Soc. 22 (1947), 107–111. https://doi.org/10.1112/jlms/s1-22.2.107
  • M. W. Padberg, M. R. Rao, Odd Minimum Cut-Sets and b-Matchings, Math. Oper. Res. 7 (1982), 67–80. https://doi.org/10.1287/moor.7.1.67
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer, 2003, Chapter 25.
13 thms4 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Theory of Games and Economic Behavior IX: Solutions for Acyclic RelationsTextbook

Motivation

The solution concept of von Neumann and Morgenstern's Theory of Games and Economic Behavior (1944) is defined from two ingredients: a set of imputations and a domination relation between them. A solution is a set of imputations that is internally stable (no member dominates another) and externally stable (every non-member is dominated by some member). In §65 of the book the authors observe that this definition never uses what imputations and domination actually are. They abstract it to an arbitrary set DDD and an arbitrary relation S\mathcal SS on DDD, and ask which properties of S\mathcal SS guarantee that exactly one solution exists.

The abstract notion is what graph theory now calls a kernel of a directed graph: draw an arc x→yx \to yx→y whenever xSyx\mathcal S yxSy; a solution is a set of vertices that is independent and absorbs every vertex outside it. Kernels appear in combinatorial game theory (the losing positions of a finite impartial game form a kernel of its move graph) and in the theory of preference and choice.

Timeline.

  • 1944 (1st ed.; 3rd ed. 1953, reprinted 2007): von Neumann and Morgenstern define solutions for an arbitrary relation (§65), show that a finite set with an acyclic relation has exactly one solution (65:X), and that acyclicity is necessary for every subset to have a unique solution (65:Z).
  • 1953: M. Richardson, Solutions of irreflexive relations, extends existence (not uniqueness) to finite relations without cycles of odd length.

Setting

Let DDD be an arbitrary set and S\mathcal SS an arbitrary relation on DDD; xSyx\mathcal S yxSy is read "xxx dominates yyy". A solution (in DDD for S\mathcal SS) is a set V⊆DV \subseteq DV⊆D with

(65:1)V={ y∈D:xSy holds for no x∈V }.\text{(65:1)}\qquad V = \{\, y \in D : x\mathcal S y \text{ holds for no } x \in V \,\}.(65:1)V={y∈D:xSy holds for no x∈V}.

For E⊆DE \subseteq DE⊆D, an element xxx is a maximum of EEE if x∈Ex \in Ex∈E and no y∈Ey \in Ey∈E has ySxy\mathcal S xySx; the set of maxima is EmE^mEm.

For m≥1m \ge 1m≥1, condition (Am)(A_m)(Am​) says: never x1Sx0,x2Sx1,…,xmSxm−1x_1\mathcal S x_0, x_2\mathcal S x_1, \dots, x_m\mathcal S x_{m-1}x1​Sx0​,x2​Sx1​,…,xm​Sxm−1​ with x0=xmx_0 = x_mx0​=xm​ and all xi∈Dx_i \in Dxi​∈D. The relation is acyclic if it satisfies every (Am)(A_m)(Am​), m=1,2,…m = 1, 2, \dotsm=1,2,…; in particular never xSxx\mathcal S xxSx. It is strictly acyclic if there is no infinite sequence x0,x1,x2,…x_0, x_1, x_2, \dotsx0​,x1​,x2​,… in DDD with xi+1Sxix_{i+1}\mathcal S x_ixi+1​Sxi​ for every iii. Property (65:K) says that every non-empty E⊆DE \subseteq DE⊆D has Em≠⊖E^m \ne \ominusEm=⊖. A partial ordering (65:B) is a transitive relation for which at most one of x=yx = yx=y, xSyx\mathcal S yxSy, ySxy\mathcal S xySx holds.

For the main theorem the book constructs a candidate solution by induction (65.7.1): A1=DA_1 = DA1​=D; Bi=AimB_i = A_i^mBi​=Aim​; CiC_iCi​ is the set of elements of AiA_iAi​ dominated by some element of BiB_iBi​; Ai+1=Ai−Bi−CiA_{i+1} = A_i - B_i - C_iAi+1​=Ai​−Bi​−Ci​. With i0i_0i0​ the first index for which Ai0=⊖A_{i_0} = \ominusAi0​​=⊖,

(65:2)V0=B1∪⋯∪Bi0−1.\text{(65:2)}\qquad V_0 = B_1 \cup \cdots \cup B_{i_0 - 1}.(65:2)V0​=B1​∪⋯∪Bi0​−1​.

In Lean the elements live in a type α, D V : Set α, and S : α → α → Prop with S x y meaning xSyx\mathcal S yxSy; the predicates are IsSolution D S V, maxima E S, IsAcyclic, IsStrictlyAcyclic, HasMaximaProperty, IsPartialOrdering, ConditionG, and the construction stageA, stageB, stageC, V0.

Formalization targets

Goal: (65:X)

If DDD is finite and S\mathcal SS is acyclic on DDD, then

∃! V: V is a solution in D for S,andV is a solution  ⟺  V=V0.\exists!\, V:\ V \text{ is a solution in } D \text{ for } \mathcal S, \qquad\text{and}\qquad V \text{ is a solution} \iff V = V_0 .∃!V: V is a solution in D for S,andV is a solution⟺V=V0​.

Milestones, in attack order

  1. (65:I) For a partial ordering, a finite DDD satisfies (65:G): every non-maximal yyy is dominated by some maximum.
  2. (65:H) For a partial ordering of an arbitrary DDD: VVV is a solution   ⟺  \iff⟺ (65:G) holds and V=DmV = D^mV=Dm.
  3. (65:O:c) Strict acyclicity implies acyclicity; for finite DDD the two are equivalent.
  4. (65:P) (65:K)   ⟺  \iff⟺ strict acyclicity, for arbitrary DDD.
  5. (65:S) For finite DDD and acyclic S\mathcal SS, some AiA_iAi​ is empty.
  6. (65:V) For finite DDD and acyclic S\mathcal SS, every solution equals V0V_0V0​.
  7. (65:W) For finite DDD and acyclic S\mathcal SS, V0V_0V0​ is a solution.
  8. (65:Z) If every E⊆DE \subseteq DE⊆D has a unique solution in EEE for S\mathcal SS, then S\mathcal SS is acyclic on DDD.

Significance

The result itself. (65:X) is the most general of the book's three existence-and-uniqueness theorems for solutions (complete ordering, partial ordering, acyclic relation; 65.8.1). For games proper it has no direct application: the set of imputations of an essential game has no maxima, so (65:K) fails (65.9.1). Its role is to isolate a sufficient condition for a unique solution. With (65:Z), and applied to every subset of DDD, it characterizes the finite relations for which every subset has exactly one solution: exactly the acyclic ones (65.8.2). In graph language it is the statement that a finite directed acyclic graph has exactly one kernel. In combinatorial game theory this is the partition of the positions of a finite impartial game into P- and N-positions. The complete- and partial-ordering results (65:E)–(65:I) are the special cases the book treats first.

Formalizing it. The results are classical and fully proved in the book; to the best of our knowledge none of them is on the Prove2Me platform, and Mathlib has well-foundedness (WellFounded, RelEmbedding of ℕ) but no kernel or von Neumann–Morgenstern solution notion for an abstract relation. The mission produces machine-checked proofs of the book's §65 chain: the equivalence of (65:K) with strict acyclicity for arbitrary sets, the finite equivalence of acyclicity and strict acyclicity, the explicit construction of V0V_0V0​, and the characterization of 65.8.2.

Difficulty

Most of the individual steps are short. The work is in making the book's finite induction precise. The sets AiA_iAi​ are defined recursively and V0V_0V0​ refers to the first empty stage i0i_0i0​. The uniqueness proof (65:V) is a minimal-counterexample argument over the stage index, which moves between "smallest kkk with y∉Aky \notin A_ky∈/Ak​" and the disjoint decomposition (65:U) of DDD into the BiB_iBi​ and CiC_iCi​. A tempting shortcut, taking an arbitrary well-founded rank function instead of the book's construction, proves existence and uniqueness but not that the solution is the V0V_0V0​ of (65:2), which is part of the goal. For (65:P) and (65:O:c) the difficulty is the passage between finite cycles and infinite chains. Going from a chain in a finite set to a repetition needs a pigeonhole argument, and going from a set without maxima to a chain needs dependent choice.

Formalization scope

  • Representation. An ambient type α; D, E, V are Set α; the relation is S : α → α → Prop and is only ever consulted on elements of the set under consideration, so it is the book's relation on DDD (or its restriction to EEE). Finite and infinite sequences are functions ℕ → α.
  • Solutions. IsSolution D S V is the set equation (65:1) literally; it forces V⊆DV \subseteq DV⊆D. Uniqueness in the goal is ∃! over all V : Set α, not over a subtype; there is no degenerate reading in which the solution is fixed by construction.
  • Acyclicity. IsAcyclic D S requires (Am)(A_m)(Am​) for every m≥1m \ge 1m≥1, all cycle elements in DDD. The case m=0m = 0m=0 is excluded, as in the book (it would be unsatisfiable). This is equivalent to the absence of a Relation.TransGen loop inside DDD, but the book's form is stated.
  • Construction. Stages are indexed from 000: stageA D S k is the book's Ak+1A_{k+1}Ak+1​. V0 D S is the union of all BiB_iBi​, which equals B1∪⋯∪Bi0−1B_1 \cup \cdots \cup B_{i_0 - 1}B1​∪⋯∪Bi0​−1​ because every later BiB_iBi​ is empty.
  • Standing hypotheses instantiated. (65:S), (65:V), (65:W) and the goal (65:X) carry the hypotheses of 65.7.1, "DDD finite and S\mathcal SS acyclic" (for finite DDD equivalently strictly acyclic, i.e. (65:K)), as D.Finite and IsAcyclic D S. (65:H) and (65:I) carry the partial-ordering hypothesis (65:B:a), (65:B:b) of 65.5.1, and (65:I) also finiteness of DDD. (65:O:c), (65:P) and (65:Z) are for arbitrary DDD and S\mathcal SS, as 65.6.2 and 65.8.2 state. The empty DDD is allowed everywhere; there the unique solution is ⊖\ominus⊖.
  • Not stated. The infinite case of (65:X) and of (65:Y), which the book leaves open (65.7.1, 65.8.3, question (65:9)); the complete-ordering results (65:E), (65:F), which silently assume D≠⊖D \neq \ominusD=⊖; the counting statement (65:8).
  • Needed infrastructure. Finite-set induction and pigeonhole on Set.Finite, dependent choice for (65:P). The definitions are reusable for any later work on kernels of digraphs and on abstract stable sets. Proofs of any milestone, and alternative proofs of the goal, are welcome.

Selected references

  • J. von Neumann and O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary edition, Princeton University Press, 2007 (reprint of the 3rd ed., 1953), §65, pp. 587–602. https://doi.org/10.1515/9781400829460
  • M. Richardson, Solutions of irreflexive relations, Annals of Mathematics 58 (1953), 573–590. https://doi.org/10.2307/1969755
13 thms4 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Theory of Games and Economic Behavior VII: Simple Games, Weighted Majorities and the Main Simple SolutionTextbook

Motivation

Many collective decisions are taken by coalitions that either carry the vote or do not: committees, legislatures, shareholder meetings, councils with weighted votes. In such a situation the only aim of a participant is to be part of a coalition that wins, and nothing is left to bargain about except the division of the prize inside the winning coalition. Chapter X of von Neumann and Morgenstern's Theory of Games and Economic Behavior (1944; 3rd ed. 1953) isolates exactly this class of zero-sum nnn-person games, the simple games, and studies their numerical description by weighted majorities and their finite main simple solutions.

The chapter is the origin of a large later literature: simple games and weighted voting games are the standard model of voting bodies in political science and social choice (for instance the Shapley–Shubik power index, 1954). The characterization of which simple games admit homogeneous weights, and the solutions they carry, starts here.

Setting

A zero-sum nnn-person game with players I={1,…,n}I = \{1, \dots, n\}I={1,…,n} is represented by its characteristic function vvv, a real function on the subsets of III with v(⊖)=0v(\ominus) = 0v(⊖)=0, v(−S)=−v(S)v(-S) = -v(S)v(−S)=−v(S) (−S-S−S the complement) and v(S∪T)≧v(S)+v(T)v(S \cup T) \geqq v(S) + v(T)v(S∪T)≧v(S)+v(T) for disjoint S,TS, TS,T. An imputation is a vector α⃗\vec\alphaα with αi≧v((i))\alpha_i \geqq v((i))αi​≧v((i)) and ∑iαi=0\sum_i \alpha_i = 0∑i​αi​=0; α⃗\vec\alphaα dominates β⃗\vec\betaβ​ if some nonempty SSS has ∑i∈Sαi≦v(S)\sum_{i\in S}\alpha_i \leqq v(S)∑i∈S​αi​≦v(S) and αi>βi\alpha_i > \beta_iαi​>βi​ for i∈Si \in Si∈S; a solution is a set VVV of imputations none of which dominates another and which dominates every imputation outside it (30.1.1). The game is inessential when its reduced form vanishes identically, essential otherwise.

A coalition SSS is flat if v(S)=∑k∈Sv((k))v(S) = \sum_{k\in S} v((k))v(S)=∑k∈S​v((k)). The losing coalitions LΓL_\GammaLΓ​ are the flat sets, and the winning coalitions WΓW_\GammaWΓ​ are the sets whose complement is flat. The game is simple if it is essential and every coalition is winning or losing. WmW^mWm denotes the minimal winning coalitions, those of which no proper subset wins.

Weights w1,…,wnw_1, \dots, w_nw1​,…,wn​ define the winning system W={S:∑i∈Swi>12∑iwi}W = \{S : \sum_{i\in S} w_i > \tfrac12 \sum_i w_i\}W={S:∑i∈S​wi​>21​∑i​wi​}, and under the conditions (50:B) (non-negative weights, no player with half the total weight, no ties) this is the weighted majority game [w1,…,wn][w_1,\dots,w_n][w1​,…,wn​]. The weights are homogeneous if the advantage aS=∑i∈Swi−∑i∈−Swia_S = \sum_{i\in S} w_i - \sum_{i\in -S} w_iaS​=∑i∈S​wi​−∑i∈−S​wi​ is the same for all SSS in WmW^mWm.

In §50 the game is taken in reduced form with γ=1\gamma = 1γ=1, so v((i))=−1v((i)) = -1v((i))=−1. For numbers xi≧0x_i \geqq 0xi​≧0 and a coalition SSS let α⃗S\vec\alpha^SαS give −1-1−1 to the players outside SSS and −1+xi-1 + x_i−1+xi​ to player iii in SSS. When the xix_ixi​ satisfy ∑i∈Sxi=n\sum_{i \in S} x_i = n∑i∈S​xi​=n for every S∈WmS \in W^mS∈Wm, the set VVV of all α⃗S\vec\alpha^SαS, S∈WmS \in W^mS∈Wm, is a main simple solution.

Formalization targets

Goal: (50:K), p. 444

Every homogeneous weighted majority game possesses a main simple solution,\text{Every homogeneous weighted majority game possesses a main simple solution,}Every homogeneous weighted majority game possesses a main simple solution,

namely the set of α⃗S\vec\alpha^SαS, S∈WmS \in W^mS∈Wm, with xi=nbwix_i = \frac{n}{b} w_ixi​=bn​wi​, b=12(∑iwi+a)b = \frac12(\sum_i w_i + a)b=21​(∑i​wi​+a), aaa the common advantage. Conversely, if xi≧0x_i \geqq 0xi​≧0 solve ∑i∈Sxi=n\sum_{i\in S} x_i = n∑i∈S​xi​=n on WmW^mWm, then wi=xiw_i = x_iwi​=xi​ are homogeneous weights for the game if and only if

∑i=1nxi<2n.\sum_{i=1}^n x_i < 2n .i=1∑n​xi​<2n.

Milestones

  1. (49:C) LΓL_\GammaLΓ​ contains the empty set and all one-element sets.
  2. (49:A) WΓ,LΓW_\Gamma, L_\GammaWΓ​,LΓ​ are mapped onto each other by complementation, WΓW_\GammaWΓ​ is closed under supersets, and LΓL_\GammaLΓ​ is closed under subsets.
  3. (49:B) WΓ∩LΓ=⊖W_\Gamma \cap L_\Gamma = \ominusWΓ​∩LΓ​=⊖ if and only if the game is essential. If the game is inessential, every set is both winning and losing.
  4. (49:F) The pairs W,LW, LW,L of simple games are exactly those satisfying (48:A:a)–(48:A:d) and (49:C).
  5. (50:A) The essential three-person game is simple: it is the direct majority game.
  6. (50:B) Non-negative weights define a winning system with (49:W*) if and only if (50:B:a), (50:B:b) hold.
  7. (50:D) aS>0a_S > 0aS​>0 on WWW, aS<0a_S < 0aS​<0 on LLL, and aS=0a_S = 0aS​=0 never occurs.
  8. (50:G) An imputation β⃗\vec\betaβ​ is undominated by V={α⃗S:S∈U}V = \{\vec\alpha^S : S \in U\}V={αS:S∈U} if and only if R(β⃗)∈U+R(\vec\beta) \in U^+R(β​)∈U+.
  9. (50:J) The exact criterion (50:8*), (50:9*) for VVV to be a solution.

Significance

The result links two descriptions of a simple game. One is numerical: a vector of weights, normalized by homogeneity. The other is game-theoretic: a finite solution in which each minimal winning coalition forms and divides a fixed total among its members. When the weights are homogeneous they are, up to scale, the shares in the main simple solution. When a main simple solution exists, its shares are homogeneous weights exactly under the inequality (50:20). The criterion (50:J) behind it is the chapter's general tool for deciding which systems of "profitable" minimal winning coalitions yield a finite solution. It is used again in the enumeration of simple games in §§51–55.

All of the results are proved in the book. As far as a search of the Prove2Me library shows (queries on simple game, weighted majority, winning coalition and stable set, 2026-09-28), none of them has been machine-checked. The only stable-set statements on the platform concern feasible payoff vectors of convex games, which is a different domain. The mission therefore asks for a formal proof of the known results, including the case analysis of §50.5–50.6, and in doing so it produces a reusable Lean theory of simple games and their winning systems.

Difficulty

The characterizations of §49 are set-theoretic, but they depend on superadditivity to show that subsets of flat sets are flat, and on the strategic-equivalence description of essentiality. The substantial part is (50:J). Deciding whether VVV is a solution means classifying every imputation β⃗\vec\betaβ​ by the set R(β⃗)R(\vec\beta)R(β​) where it meets the shares −1+xi-1 + x_i−1+xi​.

The natural first attempt is to check only the minimal winning coalitions. It fails, because domination can be exercised through any winning coalition. The book's argument has to exclude sets of U+U^+U+ with ∑i∈Txi<n\sum_{i\in T} x_i < n∑i∈T​xi​<n by producing infinitely many undominated imputations against a finite VVV. It also has to handle indifferent players with xi=0x_i = 0xi​=0, whose presence makes R(β⃗)R(\vec\beta)R(β​) larger than the coalition that generated β⃗\vec\betaβ​. For the converse half of the goal, the obstacle is the strict inequality a>0a > 0a>0: the equations (50:17) are linear and say nothing about it.

Formalization scope

Players are Fin n (the book's player iii is index i−1i - 1i−1), coalitions are Finset (Fin n), and characteristic functions are Finset (Fin n) → ℝ. Imputations are vectors Fin n → ℝ, and systems of coalitions are Set (Finset (Fin n)). A game is identified with its characteristic function (by 26.1 every vvv satisfying (25:3:a)–(25:3:c) arises from a game). The theory is the "old" one of 30.1.1 (49.1.1), with no excess. The definitions of imputation, domination and solution are the same as in mission V of this series and are restated here, because a draft cannot import another draft.

The standing hypotheses, stated in each theorem where the book has them in force:

  • (25:3:a)–(25:3:c) on vvv in every theorem;
  • simplicity (essential + (49:1:b)) in (50:G), (50:J), (50:K);
  • the reduced form with γ=1\gamma = 1γ=1, as v((i))=−1v((i)) = -1v((i))=−1 for all iii (50.4.1), in (50:G), (50:J), (50:K);
  • U⊆WmU \subseteq W^mU⊆Wm, (50:7) xi≧0x_i \geqq 0xi​≧0 and (50:8) ∑i∈Sxi=n\sum_{i\in S} x_i = n∑i∈S​xi​=n for S∈US \in US∈U (50.5.1) in (50:G), (50:J);
  • (50:B) on the weights in (50:D) and in the first half of (50:K);
  • non-negative weights in (50:B). The book states (50:B) for arbitrary real weights, but its "only if" direction is false without wi≧0w_i \geqq 0wi​≧0: [10,10,10,−110][10, 10, 10, -\tfrac1{10}][10,10,10,−101​] is a counterexample. The corrected statement is recorded in the item.

The numbers xix_ixi​ are given for every player. Players in no minimal winning coalition, for whom the book defines no xix_ixi​, do not affect any α⃗S\vec\alpha^SαS. In the converse of (50:K) the derived weights are wi=xiw_i = x_iwi​=xi​ for every player.

The goal is not the bare solvability of (50:17). A statement that only asserted "xxx exists with (50:7), (50:17)" would reduce to linear algebra. The goal asserts that the set of α⃗S\vec\alpha^SαS is a solution in the sense of 30.1.1, with domination requiring a nonempty effective set, and it adds the converse equivalence with (50:20). The set VVV is built from WmW^mWm only, never from all of WWW.

Welcome contributions: proofs of the §49 milestones, which form a small reusable library on winning and losing systems; a proof of (50:G) and (50:J); and lemmas connecting WΓW_\GammaWΓ​ of a simple reduced game with the explicit formula (49:2), v(S)=n−∣S∣v(S) = n - |S|v(S)=n−∣S∣ on WWW and −∣S∣-|S|−∣S∣ on LLL.

Selected references

  • J. von Neumann, O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary ed., Princeton University Press, 2007 (reprint of the 3rd ed., 1953), Chapter X, §§48–50, pp. 420–444. https://doi.org/10.1515/9781400829460
  • L. S. Shapley, M. Shubik, "A method for evaluating the distribution of power in a committee system", American Political Science Review 48 (1954) 787–792. https://doi.org/10.2307/1951053
13 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

An Efficient Approximation Scheme for the One-Dimensional Bin-Packing Problem II: Geometric Grouping with Residual LP RoundingResearch Paper

Motivation

One-dimensional bin packing asks for the fewest unit-capacity bins that hold a given list of items with sizes in (0,1)(0,1)(0,1). Deciding whether two bins suffice is NP-hard (it contains the partition problem), so no polynomial-time algorithm guarantees a ratio below 3/23/23/2 unless P = NP. The natural question is therefore asymptotic: how small can the additive error A(I)−OPT(I)A(I) - OPT(I)A(I)−OPT(I) be made, as a function of the optimum OPT(I)OPT(I)OPT(I)?

  • 1974: D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey and R. L. Graham analysed First Fit and First Fit Decreasing, with asymptotic ratios 17/1017/1017/10 and 11/911/911/9 (SIAM J. Comput. 3(4)).
  • 1981: W. Fernandez de la Vega and G. S. Lueker gave an asymptotic approximation scheme: for every ε>0\varepsilon > 0ε>0, (1+ε) OPT(I)+1(1+\varepsilon)\,OPT(I) + 1(1+ε)OPT(I)+1 bins in linear time (Combinatorica 1).
  • 1982: N. Karmarkar and R. M. Karp replaced the multiplicative error by an additive one: OPT(I)+O(log⁡2OPT(I))OPT(I) + O(\log^2 OPT(I))OPT(I)+O(log2OPT(I)) bins in polynomial time (Proc. 23rd FOCS). This mission formalizes that bound.
  • 2017: R. Hoberg and T. Rothvoss improved the additive error to O(log⁡OPT)O(\log OPT)O(logOPT) (SODA 2017). Whether OPT(I)+O(1)OPT(I) + O(1)OPT(I)+O(1) is achievable remains open.

Its main device, geometric grouping followed by rounding a linear program over bin configurations, recurs in later additive results and in cutting-stock problems.

Setting

An instance III is a finite multiset of piece sizes in the open interval (0,1)(0,1)(0,1). Write n(I)n(I)n(I) for the number of pieces, m(I)m(I)m(I) for the number of distinct sizes, SIZE(I)SIZE(I)SIZE(I) for the total size and a(I)a(I)a(I) for the smallest size. A packing is a multiset of bins whose union is III and in each of which the sizes sum to at most 111; its cost is the number of bins, and OPT(I)OPT(I)OPT(I) is the least cost.

A configuration is a nonempty multiset of sizes occurring in III that fits in one bin. The fractional bin-packing problem is the linear program

(I)min⁡ 1⋅xs.t.x≥0,Ax≥b,(I)\qquad \min\ \mathbf 1\cdot x\quad\text{s.t.}\quad x \ge 0,\quad Ax \ge b,(I)min 1⋅xs.t.x≥0,Ax≥b,

with one variable xjx_jxj​ per configuration, where AtjA_{tj}Atj​ counts the pieces of size ttt in configuration jjj and btb_tbt​ the pieces of size ttt in III. Its value is LIN(I)LIN(I)LIN(I). A basic feasible solution is an extreme point of the feasible region.

Geometric grouping with parameter kkk sorts the pieces in non-increasing order and cuts them into consecutive groups G1,G2,…,GqG_1, G_2, \dots, G_qG1​,G2​,…,Gq​, each the shortest run of pieces of total size at least kkk. Within each group GiG_iGi​ (i≥2i \ge 2i≥2) only as many of the largest pieces as Gi−1G_{i-1}Gi−1​ has are kept; they are rounded up to the largest size in GiG_iGi​, giving Gi′G_i'Gi′​. The rounded pieces form JJJ, and G1G_1G1​ together with the unrounded leftovers ΔGi\Delta G_iΔGi​ form J′J'J′.

ALGORITHM 2 with a positive integer kkk and a positive real ggg:

  1. Eliminate all pieces of size ≤g\le g≤g.
  2. While SIZE>1+11−1/kln⁡1gSIZE > 1 + \frac{1}{1-1/k}\ln\frac1gSIZE>1+1−1/k1​lng1​: group the current instance into J,J′J, J'J,J′; pack J′J'J′ in at most 2k[2+ln⁡1g]2k[2 + \ln\frac1g]2k[2+lng1​] bins; obtain a basic feasible solution xxx of the LP of JJJ with cost at most LIN(J)+1LIN(J)+1LIN(J)+1; open ⌊xj⌋\lfloor x_j\rfloor⌊xj​⌋ bins of each configuration jjj, fill them with pieces, and delete the pieces so packed.
  3. Pack the remaining pieces in at most 2+21−1/kln⁡1g2 + \frac{2}{1-1/k}\ln\frac1g2+1−1/k2​lng1​ bins.
  4. Reinsert the eliminated pieces, using a new bin only when necessary.

Its cost on III is written A(I)A(I)A(I).

Formalization targets

Goal: Theorem 4 with explicit constants

For every instance III with SIZE(I)≥2SIZE(I) \ge 2SIZE(I)≥2, every packing that ALGORITHM 2 with k=2k=2k=2 and g=1/SIZE(I)g = 1/SIZE(I)g=1/SIZE(I) can output is a packing of III with

A(I)≤OPT(I)+(1+log⁡2OPT(I))(9+4ln⁡OPT(I))+2+4ln⁡OPT(I).A(I) \le OPT(I) + \bigl(1 + \log_2 OPT(I)\bigr)\bigl(9 + 4\ln OPT(I)\bigr) + 2 + 4\ln OPT(I).A(I)≤OPT(I)+(1+log2​OPT(I))(9+4lnOPT(I))+2+4lnOPT(I).

This is the paper's A(I)≤OPT(I)+O(log⁡2OPT(I))A(I) \le OPT(I) + O(\log^2 OPT(I))A(I)≤OPT(I)+O(log2OPT(I)), with the constants that its proof yields.

The general bound for ALGORITHM 2

For integers k≥2k \ge 2k≥2, 0<g≤120 < g \le \tfrac120<g≤21​ and SIZE(I)≥1SIZE(I) \ge 1SIZE(I)≥1:

A(I)≤max⁡{(1+2g) OPT(I)+1, OPT(I)+[1+ln⁡SIZE(I)ln⁡k][1+4k+2kln⁡1g]+2+21−1kln⁡1g}.A(I) \le \max\Bigl\{(1+2g)\,OPT(I) + 1,\ OPT(I) + \Bigl[1 + \frac{\ln SIZE(I)}{\ln k}\Bigr]\Bigl[1 + 4k + 2k\ln\frac1g\Bigr] + 2 + \frac{2}{1-\frac1k}\ln\frac1g\Bigr\}.A(I)≤max{(1+2g)OPT(I)+1, OPT(I)+[1+lnklnSIZE(I)​][1+4k+2klng1​]+2+1−k1​2​lng1​}.

Milestones

In attack order: Lemmas 1–3; Theorem 2 (items 1–3, the bound on J′J'J′, item 4 corrected); the per-iteration shrinking of SIZESIZESIZE; the bound on the number ttt of iterations; the telescoping of LINLINLIN; the bin count after Step 3; the general bound.

Significance

The bound gives a polynomial-time algorithm whose additive error is polylogarithmic in the optimum, hence a fully polynomial asymptotic approximation scheme (O(log⁡2OPT)=o(OPT)O(\log^2 OPT) = o(OPT)O(log2OPT)=o(OPT)). Varying kkk and ggg trades running time for error, as the paper notes after Theorem 4. The scheme of solving the rounded LP, keeping its integer part and re-grouping the residual is reused by later additive results, including the O(log⁡OPT)O(\log OPT)O(logOPT) bound of Hoberg and Rothvoss.

The result has been proved since 1982. No machine-checked proof of it, or of any bin-packing approximation guarantee of this kind, is known to exist in Lean or Mathlib. The mission produces a formal version whose hypotheses and constants are explicit. It also corrects two printed statements whose published forms are false: Theorem 2, item 4, and the chain of inequalities in the analysis that relies on it. The corrections are disclosed in the statements.

Difficulty

Rounding a single LP solution does not suffice. A basic solution of the configuration LP has at most mmm fractional variables, and after rounding down, the leftover pieces form an instance of size at most m(J)m(J)m(J). With linear grouping that leftover is of order 1/ε21/\varepsilon^21/ε2 and costs a constant factor. The difficulty is making the residual shrink geometrically. Geometric grouping must produce an instance JJJ with m(J)≤SIZE/k+O(ln⁡(1/g))m(J) \le SIZE/k + O(\ln(1/g))m(J)≤SIZE/k+O(ln(1/g)) distinct sizes while discarding only O(kln⁡(1/g))O(k\ln(1/g))O(kln(1/g)) in J′J'J′. The residual must then be re-grouped and re-solved. Each step must be accounted for simultaneously in SIZESIZESIZE, LINLINLIN and OPTOPTOPT, with an additive loss per iteration; the harmonic-sum estimate behind SIZE(J′)SIZE(J')SIZE(J′) and the telescoping of LINLINLIN across iterations carry most of the weight.

Formalization scope

  • Model. An instance is a Multiset ℝ with sizes in the open interval (0,1)(0,1)(0,1); real sizes generalize the paper's rationals, and the interval is open because a group of size at least kkk must contain more than kkk pieces. Packings are Multiset (Multiset ℝ). OPTOPTOPT and LINLINLIN are infima over nonempty sets. LP solutions are finitely supported functions on configurations; "basic" means extreme point.
  • Subroutine contract. The Fractional Bin-Packing procedure is modelled only by its stated output: any basic feasible solution of cost at most LIN(J)+1LIN(J)+1LIN(J)+1. The ellipsoid method of §6 is not modelled.
  • Runs. ALGORITHM 2 is a relation Alg2Run k g I P, witnessed by a trace. Every bound holds for every run: every admissible subroutine output, every packing at Steps 2 and 3 within the prescribed counts, every choice of pieces for the principal bins (which must fill every available slot), and every order of the Step 4 insertion. A separate well-definedness item states that a run exists, so the bounds are not vacuous.
  • Explicit constants. O(log⁡2OPT(I))O(\log^2 OPT(I))O(log2OPT(I)) in Theorem 4 is replaced by (1+log⁡2OPT)(9+4ln⁡OPT)+2+4ln⁡OPT(1+\log_2 OPT)(9 + 4\ln OPT) + 2 + 4\ln OPT(1+log2​OPT)(9+4lnOPT)+2+4lnOPT. The asymptotic threshold is made explicit as SIZE(I)≥2SIZE(I) \ge 2SIZE(I)≥2. ln⁡\lnln is Real.log and log⁡2\log_2log2​ is Real.logb 2.
  • Corrected statements. The last group of geometric grouping may fall short of kkk, which the paper ignores. For it, ΔGq\Delta G_qΔGq​ consists of the max⁡(0,lq−lq−1)\max(0, l_q - l_{q-1})max(0,lq​−lq−1​) smallest pieces. Theorem 2, item 4 is stated as m(J)≤SIZE(J)/k+ln⁡(1/a(I))+1m(J) \le SIZE(J)/k + \ln(1/a(I)) + 1m(J)≤SIZE(J)/k+ln(1/a(I))+1; the printed version without +1+1+1 fails for I={0.95,0.95,0.95,0.9}I = \{0.95, 0.95, 0.95, 0.9\}I={0.95,0.95,0.95,0.9}, k=2k = 2k=2. Theorem 2 is stated for integers k≥2k \ge 2k≥2, which its proof needs. The iteration bound is stated for t≥1t \ge 1t≥1 and for the instance after Step 1.
  • Out of scope. Running times, polynomiality, the function T(m,n)T(m,n)T(m,n), the number of subroutine calls, §6, ALGORITHM 3 and Theorem 5.
  • Ruling out trivial versions. "There exists a packing with at most OPT(I)+…OPT(I) + \dotsOPT(I)+… bins" is trivially true and is not the goal. The goal bounds every output of the algorithm, and the existence item shows that outputs exist.

Contributions welcome: milestone proofs; a harmonic-sum bound ∑j=ab1/j≤ln⁡ba−1\sum_{j=a}^{b} 1/j \le \ln\frac{b}{a-1}∑j=ab​1/j≤lna−1b​; extreme-point facts for {x≥0:Ax≥b}\{x \ge 0 : Ax \ge b\}{x≥0:Ax≥b} (at most as many nonzero coordinates as rows; an optimal extreme point exists), reusable beyond bin packing; monotonicity of LINLINLIN and OPTOPTOPT under the piecewise order.

Selected references

  • N. Karmarkar, R. M. Karp, An Efficient Approximation Scheme for the One-Dimensional Bin-Packing Problem, Proc. 23rd Annual Symposium on Foundations of Computer Science (SFCS 1982), IEEE, pp. 312–320, 1982. https://doi.org/10.1109/SFCS.1982.61
  • W. Fernandez de la Vega, G. S. Lueker, Bin packing can be solved within 1 + ε in linear time, Combinatorica 1(4), 349–355, 1981. https://doi.org/10.1007/BF02579456
  • D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey, R. L. Graham, Worst-case performance bounds for simple one-dimensional packing algorithms, SIAM J. Comput. 3(4), 299–325, 1974. https://doi.org/10.1137/0203025
  • R. Hoberg, T. Rothvoss, A Logarithmic Additive Integrality Gap for Bin Packing, Proc. 28th ACM-SIAM SODA, 2616–2625, 2017. https://doi.org/10.1137/1.9781611974782.172
21 thms4 active usersReviewed
🏆Completed
Operations ResearchOptimizationProbability·Captain: mikedeng1

The Distributionally Robust Chance-Constrained Vehicle Routing Problem I: With a Subadditive Demand Estimator the Two-Index Vehicle Flow Formulation Is ExactResearch Paper

Motivation

The capacitated vehicle routing problem (CVRP) asks for delivery routes of minimum cost. Each route starts and ends at a depot, every customer is visited exactly once, and the demand served on a route does not exceed the vehicle capacity. The problem is central in logistics and one of the most studied problems in combinatorial optimization. Its standard exact methods are branch-and-cut algorithms built on the two-index vehicle flow formulation, a 0/1 program over arcs whose capacity constraints are the rounded capacity inequalities (RCIs); see Laporte, Nobert and Desrochers (1985) and Semet, Toth and Vigo (2014).

In practice customer demands are uncertain. A chance-constrained CVRP requires each route to respect its capacity with probability at least 1−ϵ1-\epsilon1−ϵ under a known distribution. That distribution is rarely known. Most solution methods also need independent demands. Ghosal and Wiesemann (Oper. Res. 68(3), 2020) study the distributionally robust chance-constrained CVRP. There the chance constraint must hold for every distribution in an ambiguity set P\mathcal PP of plausible distributions. The ambiguity set may contain dependent distributions and uncountably many of them, so it is not clear a priori that the problem can be solved by the usual branch-and-cut machinery. This mission formalizes the paper's answer to that question: its Theorem 1 and the counterexample that precedes it.

Setting

The graph is complete and directed. Its nodes are V={0,…,n}V=\{0,\dots,n\}V={0,…,n} and its arcs are A={(i,j)∈V×V:i≠j}A=\{(i,j)\in V\times V:i\neq j\}A={(i,j)∈V×V:i=j}. Node 000 is the depot and VC={1,…,n}V_C=\{1,\dots,n\}VC​={1,…,n} are the customers. There are mmm vehicles, indexed by K={1,…,m}K=\{1,\dots,m\}K={1,…,m}, each of capacity Q>0Q>0Q>0. Traversing the arc (i,j)(i,j)(i,j) costs c(i,j)≥0c(i,j)\ge 0c(i,j)≥0; costs may be asymmetric.

A route Rk=(Rk,1,…,Rk,nk)\mathbf R_k=(R_{k,1},\dots,R_{k,n_k})Rk​=(Rk,1​,…,Rk,nk​​) is an ordered list of customers, with Rk,0=Rk,nk+1=0R_{k,0}=R_{k,n_k+1}=0Rk,0​=Rk,nk​+1​=0. A route set R=(R1,…,Rm)∈P(VC,m)\mathbf R=(\mathbf R_1,\dots,\mathbf R_m)\in\mathfrak P(V_C,m)R=(R1​,…,Rm​)∈P(VC​,m) partitions VCV_CVC​ into mmm nonempty ordered routes. Its cost is c(R)=∑k∑l=0nkc(Rk,l,Rk,l+1)c(\mathbf R)=\sum_{k}\sum_{l=0}^{n_k}c(R_{k,l},R_{k,l+1})c(R)=∑k​∑l=0nk​​c(Rk,l​,Rk,l+1​).

The demand vector q~∈Rn\tilde{\boldsymbol q}\in\mathbb R^nq~​∈Rn is random. The ambiguity set P\mathcal PP is a set of probability distributions of q~\tilde{\boldsymbol q}q~​ and ϵ∈(0,1)\epsilon\in(0,1)ϵ∈(0,1) is the risk level. The problem RVRP(P\mathcal PP) minimizes c(R)c(\mathbf R)c(R) over route sets such that

P[∑i∈Rkq~i≤Q]≥1−ϵ∀ P∈P, ∀ k∈K.\mathbb P\Big[\textstyle\sum_{i\in\mathbf R_k}\tilde q_i\le Q\Big]\ge 1-\epsilon\qquad\forall\,\mathbb P\in\mathcal P,\ \forall\,k\in K .P[∑i∈Rk​​q~​i​≤Q]≥1−ϵ∀P∈P, ∀k∈K.

With Q-VaR1−ϵ[X~]=inf⁡{x:Q[X~≤x]≥1−ϵ}\mathbb Q\text{-VaR}_{1-\epsilon}[\tilde X]=\inf\{x:\mathbb Q[\tilde X\le x]\ge1-\epsilon\}Q-VaR1−ϵ​[X~]=inf{x:Q[X~≤x]≥1−ϵ}, the demand estimator of the paper's Eq. (2) is

dP(S)=max⁡{⌈1Qsup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]⌉,1}(S≠∅),dP(∅)=0.d_{\mathcal P}(S)=\max\left\{\left\lceil\frac1Q\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}\Big[\sum_{i\in S}\tilde q_i\Big]\right\rceil,1\right\}\quad(S\neq\emptyset),\qquad d_{\mathcal P}(\emptyset)=0 .dP​(S)=max{⌈Q1​P∈Psup​P-VaR1−ϵ​[i∈S∑​q~​i​]⌉,1}(S=∅),dP​(∅)=0.

The problem 2VF(P\mathcal PP) minimizes ∑(i,j)∈Ac(i,j)xij\sum_{(i,j)\in A}c(i,j)x_{ij}∑(i,j)∈A​c(i,j)xij​ over x∈{0,1}Ax\in\{0,1\}^Ax∈{0,1}A with in- and out-degree 111 at every customer and mmm at the depot, and with the RCIs

∑i∈V∖S∑j∈Sxij≥dP(S)∀ S⊆VC, S≠∅.\sum_{i\in V\setminus S}\sum_{j\in S}x_{ij}\ge d_{\mathcal P}(S)\qquad\forall\,S\subseteq V_C,\ S\neq\emptyset .i∈V∖S∑​j∈S∑​xij​≥dP​(S)∀S⊆VC​, S=∅.

A route set induces the arc vector with xij=1x_{ij}=1xij​=1 exactly when (i,j)=(Rk,l,Rk,l+1)(i,j)=(R_{k,l},R_{k,l+1})(i,j)=(Rk,l​,Rk,l+1​) for some k,lk,lk,l (the paper's Eq. (3)). The estimator satisfies the subadditivity condition (S) if dP(S∪T)≤dP(S)+dP(T)d_{\mathcal P}(S\cup T)\le d_{\mathcal P}(S)+d_{\mathcal P}(T)dP​(S∪T)≤dP​(S)+dP​(T) for all S,T⊆VCS,T\subseteq V_CS,T⊆VC​.

Formalization targets

Goal: Theorem 1

Assume q~≥0\tilde{\boldsymbol q}\ge\mathbf 0q~​≥0 P\mathbb PP-a.s. for all P∈P\mathbb P\in\mathcal PP∈P, and assume dPd_{\mathcal P}dP​ is real valued and satisfies (S). Then:

(i)  R feasible in RVRP(P) ⟹ x(R) feasible in 2VF(P),  c(x(R))=c(R);(ii)  x feasible in 2VF(P) ⟹ x=x(R) for an RVRP(P)-feasible R, unique up to reordering routes, c(x)=c(R).\begin{aligned} &\text{(i)}\ \ \mathbf R \text{ feasible in RVRP}(\mathcal P)\ \Longrightarrow\ x(\mathbf R)\text{ feasible in 2VF}(\mathcal P),\ \ c(x(\mathbf R))=c(\mathbf R);\\ &\text{(ii)}\ \ x\text{ feasible in 2VF}(\mathcal P)\ \Longrightarrow\ x=x(\mathbf R)\text{ for an RVRP}(\mathcal P)\text{-feasible }\mathbf R,\text{ unique up to reordering routes},\ c(x)=c(\mathbf R). \end{aligned}​(i)  R feasible in RVRP(P) ⟹ x(R) feasible in 2VF(P),  c(x(R))=c(R);(ii)  x feasible in 2VF(P) ⟹ x=x(R) for an RVRP(P)-feasible R, unique up to reordering routes, c(x)=c(R).​

Milestones

  1. The chance constraint Q[X~≤τ]≥1−ϵ\mathbb Q[\tilde X\le\tau]\ge1-\epsilonQ[X~≤τ]≥1−ϵ is equivalent to Q-VaR1−ϵ[X~]≤τ\mathbb Q\text{-VaR}_{1-\epsilon}[\tilde X]\le\tauQ-VaR1−ϵ​[X~]≤τ (p. 720).
  2. Eq. (1): a route satisfies its robust chance constraint if and only if the worst-case VaR of its cumulative demand is at most QQQ.
  3. Example 1: an instance with two customers where a route set is RVRP(P\mathcal PP)-feasible, yet its induced flow violates the RCI for S={1,2}S=\{1,2\}S={1,2}, since dP({1,2})≥3d_{\mathcal P}(\{1,2\})\ge3dP​({1,2})≥3.
  4. Example 1 (continued): on that instance dPd_{\mathcal P}dP​ violates (S).
  5. Theorem 1 (i) and 6. Theorem 1 (ii), stated separately.

Significance

Theorem 1 separates the modeling question from the algorithmic one. Whenever the ambiguity set yields a subadditive estimator, the distributionally robust CVRP is solved exactly by a two-index flow branch-and-cut. The only change from the deterministic case is the right-hand side dP(S)d_{\mathcal P}(S)dP​(S) of the RCIs, however many distributions P\mathcal PP contains. The companion missions of this series show that (S) holds for every moment ambiguity set (Theorem 2 of the paper) and compute dPd_{\mathcal P}dP​ for several classes of such sets. Example 1 shows that the hypothesis cannot be dropped: ambiguity sets that pin down each customer's marginal distribution break the equivalence.

The paper's proofs are in its online supplement; no machine-checked version of these statements exists. Formalizing them produces a checked reduction between a stochastic routing model and an integer program. It also produces reusable definitions of route sets, induced arc flows and RCIs over directed graphs with a depot.

Difficulty

Direction (ii) is a graph decomposition. A 0/1 vector with the prescribed degrees splits into mmm depot cycles plus possibly depot-free subtours. The RCIs, through the max⁡{⋅,1}\max\{\cdot,1\}max{⋅,1} in dPd_{\mathcal P}dP​, must exclude the subtours, and the RCI on the customers of a single route must enforce that route's chance constraint. Uniqueness up to reordering requires that directed routes are recovered from arcs.

Direction (i) is where (S) enters. The naive argument bounds the number of vehicles entering SSS by dP(S)d_{\mathcal P}(S)dP​(S) directly from the chance constraints. It fails because the chance constraints control each route separately, while dP(S)d_{\mathcal P}(S)dP​(S) looks at the joint worst case of the demands in SSS; Example 1 is exactly this failure. A set SSS is typically visited by several routes, each covering only part of it. Relating the per-route guarantees to the joint quantity dP(S)d_{\mathcal P}(S)dP​(S) needs both hypotheses of the theorem: nonnegative demands and (S).

Formalization scope

Customers are Fin n (0-based; the paper's customer iii is i - 1). Nodes are Fin (n+1) with the depot 0 and customer i at i.succ, and vehicles are Fin m. A route set is R : Fin m → List (Fin n): every route is nonempty and the concatenated routes are a permutation of all customers. Arc vectors are ℕ-valued functions on ordered node pairs, with values in {0,1}\{0,1\}{0,1} and the non-arcs (i,i)(i,i)(i,i) fixed to 000.

Distributions are measures on Fin n → ℝ, and the ambiguity set is a set of probability measures. Chance constraints are written ENNReal.ofReal (1 - ε) ≤ P {q | …}. Value-at-risk is the published MultistageStochastic.valueAtRisk at level 1 - ε. The worst-case VaR is a real sSup and dPd_{\mathcal P}dP​ is integer valued.

Two conventions implicit on the page are explicit hypotheses:

  • Q>0Q>0Q>0, because (2) divides by QQQ;
  • boundedness of the VaR values for every customer set, which encodes the paper's declaration dP:2VC→R+d_{\mathcal P}:2^{V_C}\to\mathbb R_+dP​:2VC​→R+​.

A real sSup of an unbounded set is 000 in Lean. Without the boundedness hypothesis every such estimator would silently equal 111 and (ii) would fail. For an empty ambiguity set the Lean estimator equals 111 on nonempty sets, as the paper's does.

The RCIs range over all nonempty customer sets with the depot on the outside. The estimator keeps the ceiling and the max⁡{⋅,1}\max\{\cdot,1\}max{⋅,1}. 2VF feasibility mentions neither routes nor chance constraints. RVRP feasibility does not mention dPd_{\mathcal P}dP​. A formalization in which either side refers to the other, or in which dPd_{\mathcal P}dP​ drops the max⁡{⋅,1}\max\{\cdot,1\}max{⋅,1}, is not this theorem.

Useful contributions include lemmas on the decomposition of degree-constrained 0/1 arc vectors into depot cycles, monotonicity of VaR under almost-sure ordering, and the CDF right-continuity behind milestone 1.

Related platform work: SupplyChainTheory_vrp formalizes a different, symmetric, unit-demand VRP and is not reused.

Selected references

  • S. Ghosal, W. Wiesemann, The Distributionally Robust Chance-Constrained Vehicle Routing Problem, Operations Research 68(3):716–732, 2020. https://doi.org/10.1287/opre.2019.1924
  • G. Laporte, Y. Nobert, M. Desrochers, Optimal routing under capacity and distance restrictions, Operations Research 33(5):1050–1073, 1985. https://doi.org/10.1287/opre.33.5.1050
  • F. Semet, P. Toth, D. Vigo, Classical exact algorithms for the capacitated vehicle routing problem, in P. Toth, D. Vigo (eds.), Vehicle Routing: Problems, Methods, and Applications, 2nd ed., SIAM, 2014, 37–57. https://doi.org/10.1137/1.9781611973594.ch2
  • J. Lysgaard, A. N. Letchford, R. W. Eglese, A new branch-and-cut algorithm for the capacitated vehicle routing problem, Mathematical Programming 100(2):423–445, 2004. https://doi.org/10.1007/s10107-003-0481-8
12 thms4 active usersReviewed
🏆Completed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXII: Convex Extensibility of M-Convex FunctionsTextbook

Motivation

A discrete function defined only on the integer lattice cannot, by itself, be minimized by the tools of continuous optimization — gradients and convexity in the classical sense simply do not apply. Murota's theory of M-convex functions closes this gap by showing that the exchange axiom alone, a purely combinatorial condition, is enough to guarantee that a discrete function behaves exactly like a convex one: its minimizers form a well-structured (M-convex) set, it can be extended to a genuine convex function on real space without gaining any new local minima, and its behavior under a change of price vector (in the economic interpretation where the function is a cost and its argument a bundle of goods) satisfies the same gross substitutes law economists have studied since Kelso and Crawford's matching-market models. This mission develops the second half of that connection: from local optimality (established in the companion mission) to the full structural picture — minimizer sets, price-substitution laws, and the extension of M-convex functions to genuine convex functions in real variables.

Companion mission 06-mconvex-functions-i (Discrete Convex Analysis V) and sibling mission 22-ch06b-mconvexfunctions (Discrete Convex Analysis XXI) cover this chapter's optimality theory (the M-optimality criterion, the exchange axiom as sequential improvement) and its algebraic toolkit (domain operations, worked examples). This mission builds the vocabulary those results also need (redeclared here, since sibling drafts cannot yet import one another) and proves the results on minimizer structure, gross substitutability, and convex extension that this chapter's remaining sections develop: the M-convexity of minimizer sets, the gross substitutes and stepwise gross substitutes properties and their characterizing role, a minimizer-cut theorem with scaling, integral convexity of M♮-convex functions, and — this mission's goal — the theorem characterizing M-convexity entirely through the polyhedral structure of a function's convex extension.

Setting

Fix a finite ground set VVV. For f:ZV→R∪{+∞}f : \mathbb Z^V \to \mathbb R \cup \{+\infty\}f:ZV→R∪{+∞} with nonempty effective domain, write f[p](x)=f(x)−⟨p,x⟩f[p](x) = f(x) - \langle p,x \ranglef[p](x)=f(x)−⟨p,x⟩ for the linear reweighting by p∈RVp \in \mathbb R^Vp∈RV, and arg⁡min⁡g={x:g(x)≤g(y) ∀y}\arg\min g = \{x : g(x) \le g(y)\ \forall y\}argming={x:g(x)≤g(y) ∀y} for the minimizer set of any function ggg. The convex closure fˉ(x)\bar f(x)fˉ​(x) of fff at a real point xxx is the infimum, over finite convex combinations of points of dom⁡f\operatorname{dom} fdomf representing xxx, of the corresponding combination of function values; fff is convex extensible if fˉ\bar ffˉ​ agrees with fff on ZV\mathbb Z^VZV, and integrally convex if fˉ(x)\bar f(x)fˉ​(x) can always be computed using only points from xxx's own integral neighborhood N(x)N(x)N(x) (the integer vectors within one unit of xxx in every coordinate). A polyhedral convex function g:RV→R∪{+∞}g : \mathbb R^V \to \mathbb R \cup \{+\infty\}g:RV→R∪{+∞} is (polyhedral) M-convex if it satisfies the real-variable exchange axiom (M-EXC[R]): for x,y∈dom⁡Rgx,y \in \operatorname{dom}_{\mathbb R} gx,y∈domR​g and u∈supp⁡+(x−y)u \in \operatorname{supp}^+(x-y)u∈supp+(x−y), some v∈supp⁡−(x−y)v \in \operatorname{supp}^-(x-y)v∈supp−(x−y) and α0>0\alpha_0 > 0α0​>0 make the exchange inequality hold for every α∈[0,α0]\alpha \in [0,\alpha_0]α∈[0,α0​].

Formalization targets

Goal: convex extensibility characterizes M-convexity

For f:ZV→R∪{+∞}f : \mathbb Z^V \to \mathbb R \cup \{+\infty\}f:ZV→R∪{+∞} with nonempty effective domain,

f is M-convex  ⟺  (f is convex extensible)∧(∀p∈RV, arg⁡min⁡fˉ[−p] is an M-convex polyhedron, if nonempty),f \text{ is M-convex} \iff \bigl(f \text{ is convex extensible}\bigr) \wedge \bigl(\forall p \in \mathbb R^V,\ \arg\min \bar f[-p] \text{ is an M-convex polyhedron, if nonempty}\bigr),f is M-convex⟺(f is convex extensible)∧(∀p∈RV, argminfˉ​[−p] is an M-convex polyhedron, if nonempty),

with the M♮-analogue using M♮-convex polyhedra (Theorem 6.43). This is the weakest stable form: it characterizes M-convexity purely by properties of the (unique) convex closure, without reference to any specific algorithm for computing it or any bound on the polyhedron's complexity.

Supporting structural targets

Ten further results build the toolkit this goal draws on and the picture it completes: the M-convexity of minimizer sets (Proposition 6.29), the gross substitutes and stepwise gross substitutes properties and the theorems showing they characterize M-convexity and M♮-convexity among convex-extensible functions (Propositions 6.32-6.33, 6.35, Theorems 6.34, 6.36), a minimizer-cut theorem with scaling used algorithmically in Chapter 10 (Theorem 6.39), integral convexity of M♮-convex functions (Theorem 6.42), a shared-coefficient convex-combination theorem for pairs of M♮-convex functions used in Chapter 8's separation theorem (Theorem 6.44), and the polyhedral-M-convexity of an M-convex function's convex extension together with the correspondence between polyhedral M♮-convexity and the real exchange axiom (Theorems 6.45, 6.47).

Significance

Theorem 6.43 is what makes the whole edifice of M-convex function theory a genuine extension of M-convex set theory (chapters 4-5) rather than a separate parallel development: it says that knowing a function's convex extension is polyhedral, with every price-weighted minimizer set an M-convex polyhedron, is not merely a consequence of M-convexity but an exact characterization of it. This is the theorem that lets later results (the discrete conjugacy theorem of Chapter 8, the separation theorems for M♮-convex functions) move freely between the discrete and continuous pictures. The gross substitutes property (Propositions 6.32-6.36) is independently significant outside this book: it is the exact condition, discovered independently in mathematical economics (Kelso-Crawford, Gul-Stacchetti), under which competitive equilibria with indivisible goods are guaranteed to exist — Murota's theorem that gross substitutability characterizes M-convexity (among convex-extensible functions) is what unifies the economic and combinatorial literatures on this question, taken up again in Chapter 11.

None of these results are open — they are Murota's systematic account of a theory with roots in matroid theory, submodular optimization, and mathematical economics. What this mission contributes is a faithful, machine-checked formal statement of each, extending the shared Lean vocabulary (MExchangeAxiom, ConvexClosureVal, ArgMinOn) the Discrete Convex Analysis series builds on; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The forward direction of Theorem 6.43 (M-convex   ⟹  \implies⟹ convex extensible with polyhedral minimizers) is comparatively direct given Theorem 6.42 and Proposition 6.29. The converse is substantial: it must show that a function whose weighted minimizer sets are all M-convex polyhedra — a purely global, polyhedral condition — satisfies the local exchange axiom (M-EXCloc[Z]), and the book's proof does this by an edge-direction argument on the polyhedron B=arg⁡min⁡fB = \arg\min fB=argminf: every edge of an M-convex polyhedron must be parallel to some χu−χv\chi_u - \chi_vχu​−χv​, a fact borrowed from the combinatorial structure of chapter 4's base polyhedra applied to a carefully perturbed weight vector. No shortcut through convex analysis alone succeeds, because ordinary polyhedral theory says nothing about which combinatorial directions a polyhedron's edges must follow — that content comes entirely from the M-convexity of the minimizer sets, not from convexity of the closure by itself.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; functions are (V→ℤ)→WithTop ℝ (integer domain) or (V→ℝ)→WithTop ℝ (real domain, for the polyhedral theorems). The convex closure is built directly from finite convex-combination representations rather than an abstract closure operator, and integral convexity compares it against the same construction restricted to each point's integral neighborhood (Fintype.piFinset of per-coordinate Finset.Icc). Real M-convex/M♮-convex polyhedra are defined as convex hulls of M-convex/M♮-convex integer sets, reusing chapters 4-5's own characterization. The real-variable exchange axioms (Theorems 6.45, 6.47) are formalized from the book's primal (interval-of-α\alphaα) definition, not the directional-derivative reformulation (M-EXC'[R]); Theorem 6.47's own three-way equivalence is correspondingly stated with only its first two legs (see Difficulty and MODERATION_NOTES.md/HARD.md — this is a documented scope choice, not a trivializing omission, since the six results using the primal axiom already exercise the chapter's real- variable machinery in full). No numeric constants are hard-coded anywhere in this mission beyond the book's own literal coefficients in Theorem 6.39's cut bound ((n-1)(α-1)). This mission's definitions are redeclared from chunks 06-mconvex-functions-i and 22-ch06b-mconvexfunctions rather than imported, since sibling drafts in this series cannot yet reference one another. Contributions completing any of the twelve sorrys are welcome; the goal's converse direction and Theorem 6.44's shared-coefficient construction carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • A. S. Kelso Jr. and V. P. Crawford, "Job matching, coalition formation, and gross substitutes," Econometrica, 50 (1982), pp. 1483-1504.
  • F. Gul and E. Stacchetti, "Walrasian equilibrium with gross substitutes," Journal of Economic Theory, 87 (1999), pp. 95-124.
47 thms4 active usersReviewed
🏆Completed
Discrete GeometryOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis I: Valuated MatroidsTextbook

Motivation

Matroids abstract the combinatorial content of linear independence: which sets of columns of a matrix are independent, which are maximal (bases), and how bases relate to each other. This abstraction, isolated independently by Whitney (1935) and van der Waerden's school, turned out to be exactly the right level of generality for a large family of greedy and augmenting-path algorithms — a base of a matroid can always be reached from another by a sequence of single-element swaps, and this exchange property is what makes local search on bases correct and efficient.

A natural question, raised in the 1980s once matroid-based combinatorial optimization was mature, is what happens when bases are not merely present or absent but carry real-valued weights that must interact well with the exchange structure. Dress and Wenzel answered this with the notion of a valuated matroid: a real-valued function on the bases of a matroid satisfying a weighted strengthening of the exchange axiom. Their motivation was explicitly algorithmic — valuated matroids are exactly the structures for which a greedy algorithm computes an optimal basis under linear objectives, and more generally under the family of "tilted" objectives obtained by adding an arbitrary linear functional. Independently, valuated matroids arise from the classical Grassmann–Plücker relation applied to matrices over a field with a valuation (hence the name), connecting them to tropical geometry.

This mission formalizes the two theorems of Murota's Discrete Convex Analysis (2003, §2.4) that make this story precise: the classical correspondence between a matroid's base family and its rank function (Theorem 2.29), and the characterization of valuations by a perturbation-robustness property (Theorem 2.32). Theorem 2.32 is also historically the entry point of the book's central theme — it is the special case, for the two-valued lattice {0,1}V\{0,1\}^V{0,1}V, of the general local-exchange criterion for M-convex functions that occupies chapters 6 and 7.

Setting

Let VVV be a finite set (the ground set). A matroid on VVV is a pair (V,B)(V, \mathcal B)(V,B) where B\mathcal BB, the base family, is a nonempty family of subsets of VVV satisfying the simultaneous exchange axiom (B): for every J,J′∈BJ, J' \in \mathcal BJ,J′∈B and every i∈J∖J′i \in J \setminus J'i∈J∖J′, there exists j∈J′∖Jj \in J' \setminus Jj∈J′∖J such that both

J−i+j:=(J∖{i})∪{j}∈BandJ′+i−j:=(J′∖{j})∪{i}∈B.J - i + j := (J \setminus \{i\}) \cup \{j\} \in \mathcal B \quad\text{and}\quad J' + i - j := (J' \setminus \{j\}) \cup \{i\} \in \mathcal B.J−i+j:=(J∖{i})∪{j}∈BandJ′+i−j:=(J′∖{j})∪{i}∈B.

Equivalently (Theorem 2.29 below), a matroid can be described by its rank function ρ:2V→Z\rho : 2^V \to \mathbb Zρ:2V→Z, a set function satisfying:

  • (R1) 0≤ρ(X)≤∣X∣0 \le \rho(X) \le |X|0≤ρ(X)≤∣X∣ for every X⊆VX \subseteq VX⊆V;
  • (R2) monotonicity: X⊆Y  ⟹  ρ(X)≤ρ(Y)X \subseteq Y \implies \rho(X) \le \rho(Y)X⊆Y⟹ρ(X)≤ρ(Y);
  • (R3) submodularity: ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y)\rho(X) + \rho(Y) \ge \rho(X \cup Y) + \rho(X \cap Y)ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y).

A valuation of a base family B\mathcal BB is a function ω:B→R\omega : \mathcal B \to \mathbb Rω:B→R satisfying the axiom (VM): for every J,J′∈BJ, J' \in \mathcal BJ,J′∈B and i∈J∖J′i \in J \setminus J'i∈J∖J′, there is j∈J′∖Jj \in J' \setminus Jj∈J′∖J with J−i+j,J′+i−j∈BJ - i + j, J' + i - j \in \mathcal BJ−i+j,J′+i−j∈B and

ω(J)+ω(J′)≤ω(J−i+j)+ω(J′+i−j).\omega(J) + \omega(J') \le \omega(J - i + j) + \omega(J' + i - j).ω(J)+ω(J′)≤ω(J−i+j)+ω(J′+i−j).

The pair (V,ω)(V, \omega)(V,ω) is then a valuated matroid. For p:V→Rp : V \to \mathbb Rp:V→R, the perturbation of ω\omegaω by ppp is

ω[−p](J)=ω(J)−∑j∈Jp(j).\omega[-p](J) = \omega(J) - \sum_{j \in J} p(j).ω[−p](J)=ω(J)−j∈J∑​p(j).

Formalization targets

Goal: Theorem 2.32 (the valuated matroid characterization)

ω is a valuation of B  ⟺  ∀ p:V→R, {J∈B:ω[−p](J′)≤ω[−p](J) ∀J′∈B} is a nonempty family satisfying (B).\omega \text{ is a valuation of } \mathcal B \iff \forall\, p : V \to \mathbb R,\ \{J \in \mathcal B : \omega[-p](J') \le \omega[-p](J)\ \forall J' \in \mathcal B\} \text{ is a nonempty family satisfying (B)}.ω is a valuation of B⟺∀p:V→R, {J∈B:ω[−p](J′)≤ω[−p](J) ∀J′∈B} is a nonempty family satisfying (B).

The right-hand side says: for every linear perturbation ppp, the set of ω[−p]\omega[-p]ω[−p]-maximal bases is again the base family of a matroid. The universal quantifier over ppp is not optional — a version of this statement quantified over a single fixed ppp is either vacuous or false, and does not capture what makes valuated matroids useful.

Milestone: Theorem 2.29 (the base-family / rank-function correspondence)

The maps

ρ(X)=max⁡{∣X∩J∣:J∈B},B={J⊆V:ρ(J)=∣J∣=ρ(V)}\rho(X) = \max\{|X \cap J| : J \in \mathcal B\}, \qquad \mathcal B = \{J \subseteq V : \rho(J) = |J| = \rho(V)\}ρ(X)=max{∣X∩J∣:J∈B},B={J⊆V:ρ(J)=∣J∣=ρ(V)}

are mutually inverse bijections between nonempty families satisfying (B) and set functions satisfying (R1)-(R3). This is weaker groundwork than the goal, stated first because it fixes the exact axiomatic vocabulary — (B) and (R) — that Theorem 2.32 is built on.

Significance

The result itself. Theorem 2.32 is the reason valuated matroids are the right object for weighted combinatorial optimization on matroids: it says a function on bases behaves correctly under every linear re-weighting of the ground set exactly when it satisfies the local exchange inequality (VM). This is what guarantees, for instance, that a greedy algorithm which is correct for the unweighted matroid extends correctly to families of tilted objectives, and it is the germ of the general local-optimality criterion for M-convex functions (chapters 6–7), which underlies most of the algorithmic content of the rest of the book. Theorem 2.29 is the classical result — due jointly to the development of matroid theory from the 1930s onward — that the base-exchange and rank-submodularity axiomatizations of a matroid carry the same information; it is the finite, unweighted precursor of Theorem 2.32.

Formalizing it. Neither theorem has a machine-checked proof on the platform prior to this mission (see Formalization scope for the prior-art check). Theorem 2.29's own proof is elementary but has two independent halves (each map preserves its target axiom class, and the two maps compose to the identity in both directions) that must all be established; Theorem 2.32's proof, as given in the source, defers entirely to a later, more general chapter-6 theorem, so a solver working only from this mission must either reconstruct a direct combinatorial argument for this special case or await chunk 06 (DiscreteConvex.MConvexFunctions, a separate mission) and specialize its main theorem.

Difficulty

The obvious approach to Theorem 2.32 — fix an optimal basis JJJ for ω[−p]\omega[-p]ω[−p] and try to show the exchange condition on maximizers directly from (VM) — proves one direction (VM implies the maximizer property) in a few lines, since perturbing does not change which exchange moves are available. The converse is the substantial direction: from "the maximizer set is always a matroid, for every ppp," one must recover the single global inequality (VM) that must hold for all pairs J,J′∈BJ, J' \in \mathcal BJ,J′∈B, not just optimal ones. The standard argument constructs, for a given non-optimal pair, a perturbation ppp under which that specific pair becomes simultaneously optimal, and this construction is exactly the step the book skips by citing chapter 6's general theorem. A formalization attempting to bypass this by only checking the maximizer property for a finite or generic sample of perturbations would trivialize the statement to something false or vacuous — a pitfall the goal's explicit ∀ p is designed to prevent.

Formalization scope

The ground set VVV is a Fintype with DecidableEq; 2V2^V2V is represented as Finset (Finset V), and V→RV \to \mathbb RV→R as a plain function type. The rank function is Z\mathbb ZZ-valued (matching the book's own convention for matroid rank, as opposed to the R\mathbb RR-valued conventions used from chapter 6 onward for general M-convex functions); RankOfFamily is implemented with Finset.sup over N\mathbb NN rather than a partial max', so that it is a total function — its junk value at the empty family is never invoked, since every hypothesis in this mission supplies nonemptiness explicitly, matching the book's own phrasing.

A trivializing formalization of the goal is one that quantifies over a single fixed ppp, or allows B\mathcal BB to be empty; both are explicitly excluded by keeping B.Nonempty\mathcal B.\text{Nonempty}B.Nonempty a hypothesis and ppp universally quantified inside the theorem statement itself.

Checked against Mathlib (commit 0df444a360eaa60ab8c11dca51a86af692955474): Mathlib's Matroid structure is axiomatized via the single-element (asymmetric) exchange property, classically but not definitionally equivalent to Murota's simultaneous axiom (B) used throughout this book, and Mathlib provides no constructor recovering a base family or a Matroid from a bare rank function satisfying (R1)-(R3). Theorem 2.29 is therefore genuine, reusable infrastructure, not a restatement of existing Mathlib API. No reference item was found on the platform for either theorem (GET /theorems?q=matroid, q=valuated matroid return only unrelated tropical-geometry and k-server results). Contributions to a shared DiscreteConvex.Combinatorial definitions layer (the exchange and rank axioms) are welcome from later chunks of this series that build on matroid or base-polyhedron structure.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • H. Whitney, "On the abstract properties of linear dependence," American Journal of Mathematics, 57(3), 1935, pp. 509–533.
  • A. W. M. Dress, W. Wenzel, "Valuated matroids," Advances in Mathematics, 93(2), 1992, pp. 214–250.
  • R. A. Brualdi, "Comments on bases in dependence structures," Bulletin of the Australian Mathematical Society, 1(2), 1969, pp. 161–167.
13 thms4 active usersReviewed
🏆Completed
Theoretical Computer Science·Captain: mikedeng1

Three Partition Refinement Algorithms 2: Refining by the Smaller HalfResearch Paper

Motivation

Many equivalence problems on finite structures reduce to computing the coarsest partition of a finite set that is compatible with a relation. Deciding whether two states of a finite labelled transition system are bisimilar, testing congruence of finite-state processes in Milner's calculus of communicating systems (CCS), and minimizing a deterministic finite automaton are all instances. Kanellakis and Smolka studied the relational version in connection with CCS equivalence and gave an O(mn)O(mn)O(mn)-time algorithm, conjecturing that O(mlog⁡n)O(m \log n)O(mlogn) was possible. Paige and Tarjan's 1987 paper answers that conjecture with an algorithm that has since become the standard method for bisimulation minimization in model checkers and process-algebra tools.

Timeline:

  • 1971 — Hopcroft gives an O(nlog⁡n)O(n \log n)O(nlogn) algorithm for minimizing deterministic finite automata, i.e. for the coarsest partition stable with respect to one or more functions, using the rule "process the smaller half".
  • 1983/1990 — Kanellakis and Smolka give an O(mn)O(mn)O(mn)-time, O(m+n)O(m + n)O(m+n)-space algorithm for the relational problem, and O(c2nlog⁡n)O(c^2 n \log n)O(c2nlogn) when every element has at most ccc successors; they conjecture an O(mlog⁡n)O(m \log n)O(mlogn) algorithm.
  • 1987 — Paige and Tarjan combine Hopcroft's smaller-half strategy with refinement by unions of blocks and obtain O(mlog⁡n)O(m \log n)O(mlogn) time and O(m+n)O(m + n)O(m+n) space for the relational problem.

Setting

Let UUU be a finite set with n=∣U∣n = |U|n=∣U∣ elements and let E⊆U×UE \subseteq U \times UE⊆U×U be a binary relation on UUU; write xEyxEyxEy for (x,y)∈E(x, y) \in E(x,y)∈E and m=∣E∣m = |E|m=∣E∣. For S⊆US \subseteq US⊆U the preimage of SSS is

E−1(S)={x∈U∣∃y∈S, xEy}.E^{-1}(S) = \{x \in U \mid \exists y \in S,\ xEy\}.E−1(S)={x∈U∣∃y∈S, xEy}.

A partition of UUU is a family of nonempty, pairwise disjoint subsets of UUU, its blocks, whose union is UUU. A partition RRR is a refinement of a partition PPP if every block of RRR lies inside a block of PPP.

A set B⊆UB \subseteq UB⊆U is stable with respect to S⊆US \subseteq US⊆U if B⊆E−1(S)B \subseteq E^{-1}(S)B⊆E−1(S) or B∩E−1(S)=∅B \cap E^{-1}(S) = \emptysetB∩E−1(S)=∅: either every element of BBB has an EEE-successor in SSS, or none does. A partition is stable with respect to SSS if all its blocks are, and a partition is stable if it is stable with respect to each of its own blocks.

Given EEE and an initial partition PPP, the coarsest stable refinement of PPP is a stable partition QQQ refining PPP such that every stable partition refining PPP is a refinement of QQQ. The relational coarsest partition problem asks for it.

The algorithms refine by the operation split(S,Q)\mathrm{split}(S, Q)split(S,Q), which replaces each block BBB of QQQ that meets both E−1(S)E^{-1}(S)E−1(S) and its complement by the two blocks B∩E−1(S)B \cap E^{-1}(S)B∩E−1(S) and B−E−1(S)B - E^{-1}(S)B−E−1(S). The set SSS is a splitter of QQQ if split(S,Q)≠Q\mathrm{split}(S, Q) \neq Qsplit(S,Q)=Q.

  • The naïve algorithm starts from Q=PQ = PQ=P and, while possible, picks a splitter SSS of QQQ that is a union of blocks of QQQ and replaces QQQ by split(S,Q)\mathrm{split}(S, Q)split(S,Q).
  • The improved algorithm also maintains a partition XXX, initially {U}\{U\}{U}, of which QQQ is a refinement. While Q≠XQ \neq XQ=X, it picks a block S∈XS \in XS∈X that is not a block of QQQ and a block B∈QB \in QB∈Q with B⊆SB \subseteq SB⊆S and ∣B∣≤∣S∣/2|B| \le |S|/2∣B∣≤∣S∣/2, replaces SSS in XXX by BBB and S−BS - BS−B, and replaces QQQ by split(S−B,split(B,Q))\mathrm{split}(S - B, \mathrm{split}(B, Q))split(S−B,split(B,Q)).

The improved algorithm is analysed under the standing assumption ∣E({x})∣≥1|E(\{x\})| \ge 1∣E({x})∣≥1 for all x∈Ux \in Ux∈U: every element has at least one successor. (The paper reduces the general case to this one by a preprocessing step.)

Formalization targets

Goal: the improved algorithm

For every run (Q0,X0)=(P,{U}),…,(QK,XK)(Q_0, X_0) = (P, \{U\}), \dots, (Q_K, X_K)(Q0​,X0​)=(P,{U}),…,(QK​,XK​) of the improved algorithm with refining blocks B0,…,BK−1B_0, \dots, B_{K-1}B0​,…,BK−1​:

  1. at every stage QjQ_jQj​ and XjX_jXj​ are partitions, QjQ_jQj​ refines XjX_jXj​, and QjQ_jQj​ is stable with respect to every block of XjX_jXj​;
  2. if QK=XKQ_K = X_KQK​=XK​, then QKQ_KQK​ is the coarsest stable refinement of PPP;
  3. if QK≠XKQ_K \neq X_KQK​=XK​, another step applies;
  4. K≤n−1K \le n - 1K≤n−1;
  5. every x∈Ux \in Ux∈U satisfies
#{ j<K∣x∈Bj }≤log⁡2n+1.\#\{\, j < K \mid x \in B_j \,\} \le \log_2 n + 1.#{j<K∣x∈Bj​}≤log2​n+1.

Items 1–4 are the correctness of the improved algorithm, which the paper deduces from that of the naïve one. Item 5 is the counting fact on which the O(mlog⁡n)O(m \log n)O(mlogn) bound rests.

Milestones

  • §3, p. 978: SSS is a splitter of QQQ if and only if QQQ is unstable with respect to SSS.
  • Properties (1)–(3), p. 978: stability is inherited under refinement and under union; split\mathrm{split}split is monotone in its second argument.
  • §3, p. 979: a stable partition is stable with respect to every union of its blocks.
  • Lemma 2, p. 979: every stable refinement of PPP refines each partition produced by the naïve algorithm.
  • Theorem 2, p. 979: the naïve algorithm stops after at most n−1n - 1n−1 steps at the unique coarsest stable refinement.
  • Property (4), p. 978: split\mathrm{split}split is commutative, and split(S,split(Q,P))\mathrm{split}(S, \mathrm{split}(Q, P))split(S,split(Q,P)) is the coarsest refinement of PPP stable with respect to both SSS and QQQ.
  • Lemma 3, p. 980: the three-way split of a block DDD into D11D_{11}D11​, D12D_{12}D12​ and D2D_2D2​, including D12=D1∩(E−1(B)−E−1(S−B))D_{12} = D_1 \cap (E^{-1}(B) - E^{-1}(S - B))D12​=D1​∩(E−1(B)−E−1(S−B)).

Significance

The coarsest stable refinement of the partition of states by their labels is the bisimilarity relation of a finite transition system, so the goal certifies, for any sequence of choices, the correctness of the refinement loop at the core of bisimulation minimization. The halving count is the combinatorial half of the O(mlog⁡n)O(m \log n)O(mlogn) bound: once the implementation charges O(∣B∣+∑y∈B∣E−1({y})∣)O(|B| + \sum_{y \in B} |E^{-1}(\{y\})|)O(∣B∣+∑y∈B​∣E−1({y})∣) per refining block BBB, the count bounds the total work.

The results are proved in the paper, some by one-line arguments and the elementary properties (1)–(4) not at all ("stated without proof"). No machine-checked proof of the Paige–Tarjan algorithm's correctness or of its halving count is known to be available in Lean or Mathlib. The mission produces a checked account of the invariant, the final correctness and the counting argument for every run, not only for a particular implementation.

Difficulty

The correctness of the improved algorithm is not a special case of the naïve one read off directly. An improved step refines by BBB and by S−BS - BS−B, and S−BS - BS−B is a union of blocks of QQQ only because QQQ refines XXX. The invariant that QQQ is stable with respect to every block of XXX is what makes Q=XQ = XQ=X a stopping condition, and it holds initially only under the standing assumption. The naive idea of reusing Hopcroft's argument fails: for relations, stability with respect to SSS and BBB does not imply stability with respect to S−BS - BS−B, which is why both refinements are performed. For the halving count, the refining blocks that contain a fixed element must be shown to be nested across steps, which requires tracking how blocks of XXX are replaced.

Formalization scope

  • UUU is a Fintype with decidable equality, EEE a decidable relation U → U → Prop. Partitions are Finset (Finset U) with an explicit predicate IsPartition (nonempty, pairwise disjoint blocks covering UUU); blocks are required to be nonempty, which the paper leaves implicit.
  • "Coarsest" means: every stable partition refining PPP refines it. The paper's "every other stable partition" is read this way, since a stable partition that does not refine PPP need not refine the answer.
  • Algorithms are step relations; a run is a finite sequence of states indexed by Fin (K + 1), with the choices Sj,BjS_j, B_jSj​,Bj​ recorded. Every statement holds for every run, so no choice rule is fixed.
  • Added hypotheses: UUU nonempty (so {U}\{U\}{U} is a partition and "at most n−1n - 1n−1 steps" is meaningful); the standing assumption ∀x ∃y, xEy\forall x\, \exists y,\ xEy∀x∃y, xEy for the goal only. Lemma 2 is stated for every stable refinement of PPP, which is what its proof gives and what Theorem 2 uses; it implies the printed form.
  • Explicit forms: ∣B∣≤∣S∣/2|B| \le |S|/2∣B∣≤∣S∣/2 is 2 * B.card ≤ S.card, K≤n−1K \le n - 1K≤n−1 is K + 1 ≤ n, log⁡2\log_2log2​ is Real.logb 2 of nnn cast to R\mathbb{R}R. The termination bound for the improved algorithm is not printed in the paper and is derived as in the proof of Theorem 2. Running times (O(mn)O(mn)O(mn), O(mlog⁡n)O(m \log n)O(mlogn)) and the data structures of the implementation are out of scope.
  • A trivializing reading is ruled out: the goal quantifies over all runs from (P,{U})(P, \{U\})(P,{U}) with every side condition of the step (in particular S∉QS \notin QS∈/Q and the half-size condition), and the conclusion is a full correctness statement, not the existence of some stable partition; the discrete partition is stable but is not the answer in general.
  • Reusable beyond this mission: preimage, stability, split\mathrm{split}split and its algebra (properties (1)–(4)), which apply to Hopcroft's algorithm and to bisimulation minimization in general. Contributions proving the elementary properties first, then Lemma 2 and Theorem 2, are the natural attack order.

Selected references

  • R. Paige, R. E. Tarjan, Three Partition Refinement Algorithms, SIAM Journal on Computing 16(6):973–989, 1987. https://doi.org/10.1137/0216062
  • P. C. Kanellakis, S. A. Smolka, CCS expressions, finite state processes, and three problems of equivalence, Information and Computation 86(1):43–68, 1990. https://doi.org/10.1016/0890-5401(90)90025-D
  • J. E. Hopcroft, An n log n algorithm for minimizing states in a finite automaton, in Theory of Machines and Computations, Academic Press, 1971, pp. 189–196. https://doi.org/10.1016/B978-0-12-417750-5.50022-1
  • A. V. Aho, J. E. Hopcroft, J. D. Ullman, The Design and Analysis of Computer Algorithms, Addison-Wesley, 1974.
12 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming XV: Dominants of Polytopes and Upper SeparationTextbook

Motivation

Many real-world disjunctive models are not unions of polyhedra in a single shared space, but unions of polyhedra in different spaces linked by a logical implication: some action affecting one set of entities has consequences for another. Balas's treatment of such models (§17 of the book, following [17]) reduces to understanding a single auxiliary object attached to each polytope in isolation: its dominant, the set of points that dominate (coordinatewise) some feasible point. Dominants and their duals, blockers, have a long history in combinatorial optimization — blocking-pair theory for covering and packing polyhedra traces to Fulkerson (D. R. Fulkerson, Blocking and anti-blocking pairs of polyhedra, Mathematical Programming 1 (1971), 168–194, https://doi.org/10.1007/BF01584085) — but this chapter develops a self-contained, constructive theory tailored to polytopes inside the unit cube, culminating in an exact, facet-complete description of the dominant for an arbitrary such polytope.

Setting

For a polyhedron P⊆R+nP \subseteq \mathbb{R}^n_+P⊆R+n​, the dominant is P+:=P+R+n={y≥0:y≥x for some x∈P}P^+ := P + \mathbb{R}^n_+ = \{y \ge 0 : y \ge x \text{ for some } x \in P\}P+:=P+R+n​={y≥0:y≥x for some x∈P}, and the blocker is P∗:={π∈R+n:πx≥1 for all x∈P}P^* := \{\pi \in \mathbb{R}^n_+ : \pi x \ge 1 \text{ for all } x \in P\}P∗:={π∈R+n​:πx≥1 for all x∈P} — the covering inequalities valid for PPP. (The blocker is not the reverse polar of 02b-polarity: restricting to the nonnegative orthant is essential and changes the object.) For x∗∈R+nx^* \in \mathbb{R}^n_+x∗∈R+n​, the upper-separation value is αP(x∗):=min⁡{πx∗:π∈P∗}\alpha_P(x^*) := \min\{\pi x^* : \pi \in P^*\}αP​(x∗):=min{πx∗:π∈P∗}; a violated covering inequality for x∗x^*x∗ exists exactly when αP(x∗)<1\alpha_P(x^*) < 1αP​(x∗)<1. A polytope P⊆[0,1]nP \subseteq [0,1]^nP⊆[0,1]n is upper monotone (with respect to [0,1]n[0,1]^n[0,1]n) if P=P+∩[0,1]nP = P^+ \cap [0,1]^nP=P+∩[0,1]n — the natural "closure" condition under which the theory of this chapter applies cleanly.

For S⊆N:={1,…,n}S \subseteq N := \{1,\dots,n\}S⊆N:={1,…,n}, write a(S):=∑j∈Saja(S) := \sum_{j\in S} a_ja(S):=∑j∈S​aj​. Given P⊆RnP \subseteq \mathbb{R}^nP⊆Rn and a coordinate subset SSS, the projection PSP^SPS keeps only the SSS-coordinates, letting the rest range freely. ISI^SIS is the set of valid inequalities πx≥1\pi x \ge 1πx≥1 of PSP^SPS with πj>0\pi_j > 0πj​>0 exactly on SSS, tight at ∣S∣|S|∣S∣ linearly independent points of PSP^SPS.

Formalization targets

Proposition 13.1. For an upper monotone P=⋂iPiP = \bigcap_i P_iP=⋂i​Pi​ (each PiP_iPi​ a single inequality in [0,1]n[0,1]^n[0,1]n), P+=⋂iPi+P^+ = \bigcap_i P_i^+P+=⋂i​Pi+​.

Theorem 13.3. For P={x∈[0,1]n:ax≥1}P = \{x \in [0,1]^n : ax \ge 1\}P={x∈[0,1]n:ax≥1} (a≥0a \ge 0a≥0) upper monotone,

P+={x≥0:∑j∈Sajxj1−a(N∖S)≥1 for every S⊆N with 1−a(N∖S)>0}.P^+ = \Big\{x \ge 0 : \sum_{j\in S} \frac{a_j x_j}{1-a(N\setminus S)} \ge 1 \text{ for every } S\subseteq N \text{ with } 1-a(N\setminus S)>0\Big\}.P+={x≥0:j∈S∑​1−a(N∖S)aj​xj​​≥1 for every S⊆N with 1−a(N∖S)>0}.

Theorem 13.5. For the same PPP and any x∗≥0x^* \ge 0x∗≥0, with xq∗x^*_qxq∗​ the greatest coordinate value xj∗x^*_jxj∗​ satisfying a(N∖S(xj∗))<1a(N\setminus S(x^*_j))<1a(N∖S(xj∗​))<1 and xj∗≤g(xj∗)x^*_j \le g(x^*_j)xj∗​≤g(xj∗​): S(αP)=S(xq∗)S(\alpha_P) = S(x^*_q)S(αP​)=S(xq∗​) and αP=g(xq∗)\alpha_P = g(x^*_q)αP​=g(xq∗​), an explicit, computable value.

Theorem 13.7 (goal). For an arbitrary polytope P⊆[0,1]nP \subseteq [0,1]^nP⊆[0,1]n (not necessarily upper monotone):

P+={x≥0:πx≥1 for every S⊆N and π∈IS},P^+ = \{x \ge 0 : \pi x \ge 1 \text{ for every } S \subseteq N \text{ and } \pi \in I^S\},P+={x≥0:πx≥1 for every S⊆N and π∈IS},

and every one of these inequalities is facet-defining for P+P^+P+.

Corollary 13.8. Every facet-defining inequality of P+P^+P+ has at most dim⁡(P)+1\dim(P)+1dim(P)+1 nonzero coefficients.

The targets move from the intersection-distributivity fact (13.1) through an explicit, exponentially-large but fully closed-form facet system for the single-inequality case (13.3) and its constructive, polynomial evaluation recipe (13.5) to the fully general facet characterization (13.7, requiring no monotonicity assumption at all) and its immediate corollary on facet sparsity (13.8).

Significance

Theorem 13.7 is a rare case in polyhedral combinatorics of a complete and exact facet description obtained for the dominant of an arbitrary polytope, not merely a valid relaxation or an algorithmic separation oracle — every facet is accounted for, and every listed inequality is genuinely a facet, not merely valid. Corollary 13.8's support bound is the mechanism that makes Theorem 13.10 (not part of this mission) tractable: it lets the facets of a dominant built from a disjunction of polytopes in different spaces be characterized purely in terms of each factor's own low-dimensional facets, avoiding an exponential blowup in the combined space.

Both directions are proved in the source (Balas's own treatment, following the joint framework of [17]) but have no counterpart on this platform: nothing existing treats dominants, blockers, or upper monotonicity. This mission produces the first Lean statements of all five targets.

Difficulty

The obvious shortcut for Theorem 13.7 is to state only the validity half of the claim (every inequality from ISI^SIS is valid for P+P^+P+) and treat "facet-defining" as a decoration — after all, Proposition 13.1's polar-style validity argument generalizes easily. But the theorem's actual force is the converse: not merely that these inequalities suffice to describe P+P^+P+, but that none of them is redundant, and no other facet exists. The book's own converse proof needs a genuine perturbation argument (splitting a facet candidate with fewer than ∣S∣|S|∣S∣ independent tight points into two distinct valid inequalities averaging back to it, contradicting facetness) — this is where the real content lives, and a formalization that only captures the forward direction would understate the theorem substantially.

For Theorem 13.5, the difficulty is that S(α)S(\alpha)S(α) and g(α)g(\alpha)g(α) are themselves defined in terms of α\alphaα, so "the largest xj∗x^*_jxj∗​ satisfying [a condition stated in terms of S(xj∗)S(x^*_j)S(xj∗​) and g(xj∗)g(x^*_j)g(xj∗​)]" is a genuinely self-referential extremal characterization, not a closed-form formula one could simply plug into — hence its faithful statement (via IsGreatest over an explicit, self-referential candidate set) rather than an unwound algebraic expression.

Formalization scope

The ambient space is Fin n → ℝ throughout, matching the series default. Dominant/Blocker are given their own names (not reusing, even informally, 02b-polarity's polar/reverse-polar vocabulary), per BRIEF.md's explicit warning that the nonnegativity restriction makes these different objects. PolyDim/IsFacet are restated from 02b-polarity/11a-intersection-cuts (affine dimension via Module.finrank of vectorSpan, faces via IsExtreme), since Chapter 2 already pins these down precisely for this series and Chapter 13's own facet claims use the same notion. IsUpperMonotone is stated exactly as Definition 4 (P = P⁺ ∩ [0,1]ⁿ), not paraphrased as coordinatewise monotonicity, per BRIEF.md's explicit warning that these are different conditions.

IsInIS (membership in ISI^SIS) uses LinearIndependent ℝ directly for the "|S| linearly independent points" hypothesis, matching the book's own wording; since every such point satisfies πx=1\pi x=1πx=1, a linear dependence among them is automatically an affine dependence (the coefficients of any nontrivial linear relation among them must sum to zero), so this is not a weakening of the more familiar "affinely independent" reading a reader might otherwise expect. A trivializing formalization to rule out explicitly: describing Theorem 13.7's P+P^+P+ using only the validity half of the claim (dropping "each of these inequalities is facet-defining for P+P^+P+") — this mission states both conjuncts, since the facet-exactness is the theorem's genuine content beyond a Farkas-style validity certificate.

This mission depends on no other chunk's Lean definitions; it restates the affine-dimension/facet vocabulary of 02b-polarity/11a-intersection-cuts only informally, per the series convention. Corollary 13.6 (an O(n)O(n)O(n)-time algorithmic claim for computing αP\alpha_PαP​) is out-of-cone per BRIEF.md: it is fully quantified, not a veto-V3 case, but is a computational-complexity statement outside this mission's polyhedral-characterization scope.

Selected references

  • D. R. Fulkerson, Blocking and anti-blocking pairs of polyhedra, Mathematical Programming 1 (1971), 168–194. https://doi.org/10.1007/BF01584085
  • E. Balas and R. G. Jeroslow, Strengthening cuts for mixed integer programs (for the broader monotonization-of-polyhedra context cited by this chapter's introduction), European Journal of Operational Research 4 (1980), 224–234. https://doi.org/10.1016/0377-2217(80)90106-X
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 13, §13.1–13.2. https://doi.org/10.1007/978-3-030-00148-3
8 thms4 active users
🏆Completed
Graph TheoryLinear OptimizationOperations Research·Captain: mikedeng1

Cones of Matrices and Set-Functions and 0–1 Optimization II: One Round of N on the Stable Set Polytope Gives Exactly the Odd Hole ConstraintsResearch Paper

Motivation

The stable set problem (vertex packing) asks for a largest set of pairwise non-adjacent nodes of a graph. It is NP-hard, and its polyhedral study, the description of the stable set polytope STAB(G)\mathrm{STAB}(G)STAB(G) by linear inequalities, is one of the most studied topics of polyhedral combinatorics. Classes of valid inequalities (clique, odd hole, odd antihole, wheel constraints) and the graph classes they describe exactly (perfect, ttt-perfect, hhh-perfect graphs) organize much of that literature; see Grötschel, Lovász and Schrijver, Geometric Algorithms and Combinatorial Optimization (Springer, 1988).

Lovász and Schrijver (SIAM J. Optim. 1(2), 1991) introduced a general lift-and-project procedure for 0–1 programs: lift a relaxation KKK into a space of matrices, impose linear conditions that every 0–1 point satisfies, and project back. One round of their operator NNN gives a tighter relaxation N(K)N(K)N(K) that still contains every 0–1 point of KKK; nnn rounds give the 0–1 hull. The procedure is an ancestor of the Sherali–Adams and Lasserre hierarchies, and the stable set problem is its first test case. This mission formalizes the paper's exact description of what one round of NNN does to the fractional stable set polytope: it adds precisely the odd hole constraints.

Setting

Let G=(V,E)G = (V, E)G=(V,E) be a finite graph with no isolated nodes, n=∣V∣n = |V|n=∣V∣. Vectors of RV∪{0}\mathbb{R}^{V \cup \{0\}}RV∪{0} have a distinguished coordinate x0x_0x0​; RV\mathbb{R}^VRV sits inside as the hyperplane H0={x0=1}H_0 = \{x_0 = 1\}H0​={x0​=1}, via x↦(1,x)x \mapsto (1, x)x↦(1,x).

  • FRAC(G)⊆RV\mathrm{FRAC}(G) \subseteq \mathbb{R}^VFRAC(G)⊆RV is the solution set of the nonnegativity constraints xi≥0x_i \ge 0xi​≥0 (i∈Vi \in Vi∈V) and the edge constraints xi+xj≤1x_i + x_j \le 1xi​+xj​≤1 (ij∈Eij \in Eij∈E).
  • FR(G)⊆RV∪{0}\mathrm{FR}(G) \subseteq \mathbb{R}^{V\cup\{0\}}FR(G)⊆RV∪{0} is the cone given by xi≥0x_i \ge 0xi​≥0 and xi+xj≤x0x_i + x_j \le x_0xi​+xj​≤x0​; it is the cone spanned by the vectors (1,x)(1, x)(1,x) with x∈FRAC(G)x \in \mathrm{FRAC}(G)x∈FRAC(G).
  • QQQ is the cone spanned by the 0–1 vectors with x0=1x_0 = 1x0​=1. For a convex cone KKK, its polar cone is K∗={u:uTx≥0 ∀x∈K}K^* = \{u : u^{\mathsf T}x \ge 0 \ \forall x \in K\}K∗={u:uTx≥0 ∀x∈K}.
  • M(K)=M(K,Q)M(K) = M(K, Q)M(K)=M(K,Q) is the set of (n+1)×(n+1)(n+1)\times(n+1)(n+1)×(n+1) matrices Y=(yij)Y = (y_{ij})Y=(yij​) that are symmetric, satisfy yii=y0iy_{ii} = y_{0i}yii​=y0i​ for i∈Vi \in Vi∈V, and satisfy uTYv≥0u^{\mathsf T} Y v \ge 0uTYv≥0 for all u∈K∗u \in K^*u∈K∗, v∈Q∗v \in Q^*v∈Q∗.
  • N(K)={Ye0:Y∈M(K)}N(K) = \{Y e_0 : Y \in M(K)\}N(K)={Ye0​:Y∈M(K)}, and N(G)={x∈RV:(1,x)∈N(FR(G))}N(G) = \{x \in \mathbb{R}^V : (1, x) \in N(\mathrm{FR}(G))\}N(G)={x∈RV:(1,x)∈N(FR(G))}.
  • A set C⊆VC \subseteq VC⊆V is an odd hole if it induces a chordless cycle of odd length ∣C∣≥3|C| \ge 3∣C∣≥3 (triangles included). Its odd hole constraint is ∑i∈Cxi≤12(∣C∣−1)\sum_{i \in C} x_i \le \frac12(|C| - 1)∑i∈C​xi​≤21​(∣C∣−1).

Formalization targets

Goal: Theorem 2.3 (p. 178)

For every finite graph GGG without isolated nodes,

N(G)={x∈RV:xi≥0 (i∈V),  xi+xj≤1 (ij∈E),  ∑i∈Cxi≤12(∣C∣−1) (C an odd hole)}.N(G) = \Big\{x \in \mathbb{R}^V : x_i \ge 0\ (i \in V),\ \ x_i + x_j \le 1\ (ij \in E),\ \ \sum_{i \in C} x_i \le \tfrac12(|C|-1)\ (C \text{ an odd hole})\Big\}.N(G)={x∈RV:xi​≥0 (i∈V),  xi​+xj​≤1 (ij∈E),  i∈C∑​xi​≤21​(∣C∣−1) (C an odd hole)}.

Milestones, in the order the proof uses them

  1. Lemma 1.3 (p. 171): for a convex cone K⊆QK \subseteq QK⊆Q and i∈Vi \in Vi∈V, N(K)⊆(K∩Hi)+(K∩Gi)N(K) \subseteq (K \cap H_i) + (K \cap G_i)N(K)⊆(K∩Hi​)+(K∩Gi​), with Hi={xi=0}H_i = \{x_i = 0\}Hi​={xi​=0}, Gi={xi=x0}G_i = \{x_i = x_0\}Gi​={xi​=x0​}.
  2. Lemma 2.2 (p. 178): if both the deletion and the contraction of some node vvv give inequalities valid for KKK, then aTx≤ba^{\mathsf T}x \le baTx≤b is valid for N(K)N(K)N(K).
  3. Part (1) of the proof of Theorem 2.3 (p. 178): for an odd hole CCC and i∈Ci \in Ci∈C, the deletion and contraction of iii in the odd hole constraint are valid for FRAC(G)\mathrm{FRAC}(G)FRAC(G).
  4. Observation of Section 2.b (p. 177): every Y∈M(FR(G))Y \in M(\mathrm{FR}(G))Y∈M(FR(G)) has yij=0y_{ij} = 0yij​=0 for ij∈Eij \in Eij∈E.
  5. Part (2) of the proof of Theorem 2.3 (p. 178): x∈N(G)x \in N(G)x∈N(G) if and only if some nonnegative symmetric YYY with y00=1y_{00} = 1y00​=1, yi0=yii=xiy_{i0} = y_{ii} = x_iyi0​=yii​=xi​ satisfies xi+xj+xk−1≤yik+yjk≤xkx_i + x_j + x_k - 1 \le y_{ik} + y_{jk} \le x_kxi​+xj​+xk​−1≤yik​+yjk​≤xk​ for all i,j,ki, j, ki,j,k with ij∈Eij \in Eij∈E.
  6. Lemma 2.4 (p. 178): a system a(ij)≤yi+yj≤b(ij)a(ij) \le y_i + y_j \le b(ij)a(ij)≤yi​+yj​≤b(ij), y≥0y \ge 0y≥0, y∣U=0y|_U = 0y∣U​=0 on a graph is infeasible if and only if a walk with a negative alternating sum of one of four types exists.

Significance

Theorem 2.3 gives a complete description of one round of NNN on the stable set problem: the only new constraints are the odd hole constraints. Consequences:

  • For ttt-perfect graphs (those for which nonnegativity, edge and odd hole constraints describe STAB(G)\mathrm{STAB}(G)STAB(G)), N(G)=STAB(G)N(G) = \mathrm{STAB}(G)N(G)=STAB(G).
  • It is the base case for the paper's bounds on the NNN-index of stable set inequalities (Theorem 2.13), and it contrasts with the semidefinite operator N+N_+N+​, which after one round already satisfies clique, odd antihole and wheel constraints.
  • Lemma 2.4 is a combinatorial feasibility criterion for systems with two variables per inequality, useful beyond this paper.

The result has been proved since 1991. At the time of drafting, Prove2Me holds no formalization of it or of any part of the Lovász–Schrijver construction, and Mathlib has none. The mission produces a formal account of the NNN operator on the stable set polytope and a formal proof of the walk criterion for two-variable systems.

Difficulty

The inclusion of N(G)N(G)N(G) in the odd hole system is a short argument once Lemma 1.3 is available. The reverse inclusion is the substance: given xxx satisfying all odd hole constraints, one must exhibit a lifted matrix YYY. A direct appeal to Farkas' lemma yields a certificate with no visible relation to odd cycles; the difficulty is to show that every obstruction to solvability of the matrix system forces a violated odd hole constraint, which is what Lemma 2.4 and the analysis of its four walk types accomplish. Case (d) of that analysis needs the odd hole constraints; the other cases need only the edge constraints. Lemma 2.4 itself is called folklore on the page and is stated without proof there.

A further point: Lemma 2.4 is stated for lower bounds 0≤a0 \le a0≤a, while the lower bounds that arise from the matrix system, xi+xj+xk−1x_i + x_j + x_k - 1xi​+xj​+xk​−1, can be negative.

Formalization scope

  • Coordinates of RV∪{0}\mathbb{R}^{V\cup\{0\}}RV∪{0} are indexed by Option V, with none the coordinate x0x_0x0​. Graphs are Mathlib SimpleGraphs on a finite type VVV with decidable adjacency. Every statement about a graph carries the paper's standing assumption that GGG has no isolated nodes (∀ v, ∃ w, G.Adj v w).
  • MMM is defined by condition (iii), never by its rewritings. Lemma 1.3 and Lemma 2.2 take the cone KKK closed, a hypothesis the paper leaves tacit (its cones are polyhedral); for a non-closed KKK Lemma 1.3 is false. FR(G)\mathrm{FR}(G)FR(G) is polyhedral, so the goal needs no such hypothesis.
  • FR(G)\mathrm{FR}(G)FR(G) is defined by its constraints; this agrees with the cone over FRAC(G)\mathrm{FRAC}(G)FRAC(G) because GGG has no isolated nodes.
  • Lemma 2.2 is stated in cone form: KKK is any closed convex cone inside FR(G)\mathrm{FR}(G)FR(G), and validity is read on the slice x0=1x_0 = 1x0​=1. The paper's extra hypothesis STAB(G)⊆K\mathrm{STAB}(G) \subseteq KSTAB(G)⊆K is dropped, which strengthens the lemma.
  • Deletion and contraction of a node are coefficient vectors on the same graph (coefficients set to 000), not inequalities on the subgraphs G−vG - vG−v and G−Γ(v)−vG - \Gamma(v) - vG−Γ(v)−v.
  • Odd holes are chordless odd cycles including triangles; triangles are needed, as 121\tfrac12\mathbf 121​1 satisfies all other constraints on a triangle.
  • The matrix system of part (2) is stated as an equivalence; the page uses one direction.
  • Lemma 2.4 uses edge values on unordered pairs and strict inequalities, exactly as printed.

A trivializing formalization is ruled out: the goal is the set equality for every graph without isolated nodes, not the existence of a lifted matrix and not a single graph.

Not formalized here: the semidefinite operator N+N_+N+​, the operator N^\hat NN^, algorithmic statements (Theorems 1.6, 2.1, Corollary 2.5), and the set-function results of Section 3.

Reusable beyond this mission: the matrix cone layer (QQQ, MMM, NNN), the stable-set cones, and the two-variable feasibility criterion of Lemma 2.4. Contributions of any of the milestones, and of general facts about polar cones of polyhedral cones in this setting, are welcome.

Selected references

  • L. Lovász and A. Schrijver, Cones of matrices and set-functions and 0–1 optimization, SIAM Journal on Optimization 1(2) (1991) 166–190. https://doi.org/10.1137/0801013
  • M. Grötschel, L. Lovász and A. Schrijver, Geometric Algorithms and Combinatorial Optimization, Springer, 1988. https://doi.org/10.1007/978-3-642-97881-4
  • H. D. Sherali and W. P. Adams, A hierarchy of relaxations between the continuous and convex hull representations for zero-one programming problems, SIAM Journal on Discrete Mathematics 3(3) (1990) 411–430. https://doi.org/10.1137/0403036
13 thms4 active usersReviewed
🏆Completed
Graph TheoryOperations ResearchOptimization+1·Captain: mikedeng1

An Analysis of Several Heuristics for the Traveling Salesman Problem I: Nearest Neighbor Tours Can Be Far from OptimalResearch Paper

Motivation

The traveling salesman problem with the triangle inequality asks for a shortest closed tour through nnn points whose distances form a metric. It is NP-hard, so in practice tours are built by fast construction heuristics, and the natural question is how far such a tour can be from optimal in the worst case. Rosenkrantz, Stearns and Lewis (SIAM J. Comput. 6(3), 1977) gave the first systematic worst-case analysis of the standard heuristics. Their results are reproduced in textbooks on approximation algorithms and combinatorial optimization, and they are the reference point against which later guarantees (Christofides' 3/23/23/2 algorithm, the double-tree 222-approximation) are compared.

The simplest heuristic studied is the nearest neighbor algorithm (Bellmore and Nemhauser, 1968; the "next best method" of Gavett, 1965): from the current node, always move to the closest node not yet visited, and return to the start at the end. The paper shows that this greedy rule is never worse than logarithmic (Theorem 1) and that the logarithm cannot be removed (Theorem 2). This mission is about Theorem 2, the lower bound.

Setting

A traveling salesman graph on nnn nodes is a complete graph with a distance d(a,b)∈Rd(a,b)\in\mathbb Rd(a,b)∈R that is symmetric, d(a,b)=d(b,a)d(a,b)=d(b,a)d(a,b)=d(b,a), nonnegative, d(a,b)≥0d(a,b)\ge 0d(a,b)≥0, and satisfies the triangle inequality d(a,c)≤d(a,b)+d(b,c)d(a,c)\le d(a,b)+d(b,c)d(a,c)≤d(a,b)+d(b,c). A tour lists the nodes in a visiting order τ(0),…,τ(n−1)\tau(0),\dots,\tau(n-1)τ(0),…,τ(n−1) and returns to τ(0)\tau(0)τ(0); its length is the sum of the nnn distances along it. OPTIMAL is the least length of a tour.

The nearest neighbor algorithm starts at an arbitrary node τ(0)\tau(0)τ(0); having reached τ(k)\tau(k)τ(k), it moves to a node τ(k+1)\tau(k+1)τ(k+1) that minimizes d(τ(k),⋅)d(\tau(k),\cdot)d(τ(k),⋅) over the nodes not yet visited, breaking ties arbitrarily; after the last node it returns to τ(0)\tau(0)τ(0). The length of the resulting tour is written NEARNEIBER. Because the start node and the ties are free, one instance has in general several nearest-neighbor tours. A lower bound needs only one of them; an upper bound must hold for all.

The instances of the proof are built from a recursive family of weighted graphs. With li=16(4⋅2i−(−1)i+3)l_i=\frac16(4\cdot 2^i-(-1)^i+3)li​=61​(4⋅2i−(−1)i+3) (so l1,l2,l3,l4=2,3,6,11l_1,l_2,l_3,l_4=2,3,6,11l1​,l2​,l3​,l4​=2,3,6,11), the graph F1F_1F1​ is a triangle with unit weights, and Fi+1F_{i+1}Fi+1​ consists of two copies of FiF_iFi​ joined through one new node by two edges of length 111 and two edges of length lil_ili​. Each FiF_iFi​ has 2i+1−12^{i+1}-12i+1−1 nodes and a path PiP_iPi​ from its start node to its middle node through every node, of length LiL_iLi​ with L1=2L_1=2L1​=2, Li+1=2Li+2liL_{i+1}=2L_i+2l_iLi+1​=2Li​+2li​. The graph GiG_iGi​ adds two closing edges to FiF_iFi​, and Gˉi\bar G_iGˉi​ is the complete graph on the same nodes whose distance is the shortest-path distance of GiG_iGi​.

Formalization targets

Goal: Theorem 2 (p. 566)

For each m>3m>3m>3 there is a traveling salesman graph with n=2m−1n=2^m-1n=2m−1 nodes and a nearest-neighbor tour on it such that

NEARNEIBEROPTIMAL>13lg⁡(n+1)+49.\frac{\mathrm{NEARNEIBER}}{\mathrm{OPTIMAL}}>\frac13\lg(n+1)+\frac49 .OPTIMALNEARNEIBER​>31​lg(n+1)+94​.

The statement is existential in both the instance and the run of the algorithm, exactly as in the paper.

Milestones, in the order the proof uses them

  1. (2.12): the difference equation Li+1=2Li+2liL_{i+1}=2L_i+2l_iLi+1​=2Li​+2li​, L1=2L_1=2L1​=2, has the solution Li=19(6 i 2i+8⋅2i+(−1)i−9)L_i=\frac19(6\,i\,2^i+8\cdot2^i+(-1)^i-9)Li​=91​(6i2i+8⋅2i+(−1)i−9).
  2. Gˉi\bar G_iGˉi​ is a traveling salesman graph: the shortest-path distance of GiG_iGi​ is symmetric, nonnegative and satisfies the triangle inequality.
  3. (2.13)–(2.17): the shortest-path distances in Fi+1F_{i+1}Fi+1​ between the seven named nodes A,…,GA,\dots,GA,…,G of Fig. 1, e.g. AG‾=li+2−2\overline{AG}=l_{i+2}-2AG=li+2​−2.
  4. Property a): every edge of GiG_iGi​ is a shortest path between its endpoints.
  5. Property b): the nearest neighbor algorithm started at the start node of Gˉi\bar G_iGˉi​ can follow PiP_iPi​ and return along the edge of length li−1l_i-1li​−1.
  6. The optimal tour: OPTIMAL(Gˉi)=2i+1−1\mathrm{OPTIMAL}(\bar G_i)=2^{i+1}-1OPTIMAL(Gˉi​)=2i+1−1.
  7. The exact ratio: the tour along PiP_iPi​ has length Li+li−1L_i+l_i-1Li​+li​−1, so its ratio is (Li+li−1)/n(L_i+l_i-1)/n(Li​+li​−1)/n.
  8. The inequality: (Li+li−1)/n>13lg⁡(n+1)+49(L_i+l_i-1)/n>\frac13\lg(n+1)+\frac49(Li​+li​−1)/n>31​lg(n+1)+94​ for i≥3i\ge3i≥3.

The instance for mmm is Gˉm−1\bar G_{m-1}Gˉm−1​.

Significance

Theorem 1 of the same paper shows NEARNEIBER/OPTIMAL≤12⌈lg⁡n⌉+12\mathrm{NEARNEIBER}/\mathrm{OPTIMAL}\le\frac12\lceil\lg n\rceil+\frac12NEARNEIBER/OPTIMAL≤21​⌈lgn⌉+21​ for every nearest-neighbor tour on every traveling salesman graph. Theorem 2 shows that this bound has the right order: no constant-factor guarantee holds for the nearest neighbor rule, and the gap between the two constants (13\frac1331​ against 12\frac1221​) is all that remains. This separates the nearest neighbor rule from the insertion rules analysed later in the same paper, of which nearest and cheapest insertion are within a factor 222 of optimal. It is the standard example of a natural greedy heuristic whose approximation ratio grows with nnn.

The upper bound, Theorem 1, is already on Prove2Me with a machine-checked proof (SupplyChainTheory.nearest_neighbor_bound); its statement notes that the lower-bound instances are not formalized there. This mission supplies them: an explicit recursive family of metric instances, the shortest-path computations that certify it, and the arithmetic of its ratio. The result is proved in the paper; to our knowledge it has not been formalized in any proof assistant. The construction (a recursively defined weighted graph with a closed-form shortest-path table) is also a reusable pattern for other worst-case lower bounds of greedy heuristics.

Difficulty

The arithmetic ((2.12) and the final inequality) is routine. The content is in properties a) and b). A shortest-path distance is an infimum over all walks, and property a) asks that no detour through the recursive structure is shorter than the direct edge, at every level of the recursion. The paper handles this by an induction on (2.13)–(2.17) that tracks only seven nodes per level, and argues that distances inside a copy of FiF_iFi​ are not shortened by embedding it into Fi+1F_{i+1}Fi+1​. Property b) then needs that at each step of PiP_iPi​ the chosen node is at least as close as every unvisited node, including nodes in the other copy and nodes reached through the start or right nodes; ties occur, and the claim is only that some resolution of them follows PiP_iPi​. Checking small cases by computer does not give either property for all iii.

Formalization scope

Nodes of an instance are Fin n, a tour is a permutation of Fin n, the tour length is the sum over consecutive pairs including the closing edge, and OPTIMAL is a minimum over the finite set of permutations. The model is the paper's: symmetric, nonnegative distances with the triangle inequality. The distance structure also carries d(a,a)=0d(a,a)=0d(a,a)=0, a normalization not in the paper; the diagonal never enters a tour length. A nearest-neighbor tour is a permutation in which each step goes to a node at least as close as every unvisited node, from an arbitrary start with arbitrary ties.

Ratios are multiplied out: the goal is (13log⁡2(n+1)+49)⋅OPTIMAL<NEARNEIBER(\frac13\log_2(n+1)+\frac49)\cdot\mathrm{OPTIMAL}<\mathrm{NEARNEIBER}(31​log2​(n+1)+94​)⋅OPTIMAL<NEARNEIBER together with OPTIMAL>0\mathrm{OPTIMAL}>0OPTIMAL>0, the paper's standing assumption (1.1). lg⁡(n+1)\lg(n+1)lg(n+1) is Real.logb 2 of n+1n+1n+1, as printed. Because of the strict inequality and the conjunct OPTIMAL>0\mathrm{OPTIMAL}>0OPTIMAL>0, the all-zero distance does not satisfy the goal, so the statement cannot be met by a degenerate instance.

In the construction the nodes of FiF_iFi​, GiG_iGi​, Gˉi\bar G_iGˉi​ are numbered 0,…,2i+1−20,\dots,2^{i+1}-20,…,2i+1−2 from left to right (start node 000, middle node 2i−12^i-12i−1, right node 2i+1−22^{i+1}-22i+1−2); in Fi+1F_{i+1}Fi+1​ the left copy comes first, then the new node, then the right copy. Graphs are edge lists with real weights and lil_ili​ is defined in R\mathbb RR exactly as in (2.11). The shortest-path distance is the infimum of walk weights over an inductive walk predicate; it would be 000 for two nodes with no connecting walk, a case that does not arise because every GiG_iGi​ and FiF_iFi​ is connected. LiL_iLi​ is defined by its difference equation; its identification with the length of the tour along PiP_iPi​ is milestone 7. All construction statements assume i≥1i\ge1i≥1.

A complete development needs a small library for shortest-path distances of finite weighted edge lists (symmetry, triangle inequality, attainment, behaviour under relabelling and under gluing two graphs at a few nodes); this part is reusable beyond the mission. Contributions welcome: proofs of any milestone, and such general shortest-path lemmas as separate theorems. Theorem 1 is not part of this mission.

Selected references

  • D. J. Rosenkrantz, R. E. Stearns, P. M. Lewis II, An Analysis of Several Heuristics for the Traveling Salesman Problem, SIAM J. Comput. 6(3):563–581, 1977. https://doi.org/10.1137/0206041
  • M. Bellmore, G. L. Nemhauser, The Traveling Salesman Problem: A Survey, Operations Research 16(3):538–558, 1968. https://doi.org/10.1287/opre.16.3.538
  • J. W. Gavett, Three Heuristic Rules for Sequencing Jobs to a Single Production Facility, Management Science 11(8):B166–B176, 1965. https://doi.org/10.1287/mnsc.11.8.B166
  • N. Christofides, Worst-Case Analysis of a New Heuristic for the Travelling Salesman Problem, Report 388, Graduate School of Industrial Administration, Carnegie Mellon University, 1976.
12 thms4 active usersReviewed
🏆Completed
Operations ResearchOptimizationTheoretical Computer Science·Captain: mikedeng1

Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms 4: First-Fit Decreasing Uses at Most 71/60 L* + 5 Bins When No Item Exceeds 1/2Research Paper

Motivation

Bin packing asks how to place a list of items with sizes in (0,1](0,1](0,1] into as few unit-capacity bins as possible. It models the cutting of stock material, the packing of files onto tracks of a disc and the assignment of jobs to machines with a common deadline. Deciding the optimum is NP-hard, so in practice simple rules are used, and the question is how far they can stray from the optimum in the worst case.

Johnson, Demers, Ullman, Garey and Graham (SIAM J. Comput. 3(4), 1974) gave the first sharp worst-case bounds for the four classical rules. For First-Fit Decreasing (FFD), the rule that sorts the items into nonincreasing order and then places each into the first bin with room, they announced the bound FFD(L)≤119L∗+4FFD(L)\le\frac{11}{9}L^*+4FFD(L)≤911​L∗+4, whose full proof in Johnson's thesis exceeds 75 pages. To show the method, Section 4 of the paper proves a simpler bound in detail: when no item exceeds 1/21/21/2, FFD uses at most 7160L∗+5\frac{71}{60}L^*+56071​L∗+5 bins. That result is the subject of this mission.

Timeline:

  • 1973: D. S. Johnson's MIT thesis, Near-optimal bin packing algorithms, contains the complete proofs of the 11/911/911/9 and 71/6071/6071/60 bounds.
  • 1974: Johnson, Demers, Ullman, Garey and Graham publish the 71/6071/6071/60 bound for lists in (0,1/2](0,1/2](0,1/2] (Theorem 4.1) with a proof that is complete except for parts of two lemmas, and show by example that 71/6071/6071/60 cannot be lowered.
  • 1985: B. S. Baker gives a shorter proof of the 11/911/911/9 bound for FFD (J. Algorithms 6, 1985).
  • 2007: G. Dósa determines the tight additive constant 6/96/96/9 in the 11/911/911/9 bound (ESCAPE 2007, LNCS 4614).

Setting

A list is a finite sequence L=(a1,…,an)L=(a_1,\dots,a_n)L=(a1​,…,an​) of real numbers in (0,1](0,1](0,1]; values may repeat. A bin has capacity 111; its level is the sum of the numbers in it. The optimum L∗L^*L∗ is the least number of bins into which the elements of LLL can be placed with no bin level exceeding 111.

First-Fit places a1,a2,…a_1,a_2,\dotsa1​,a2​,… in order into bins B1,B2,…B_1,B_2,\dotsB1​,B2​,…, each initially at level 000: aia_iai​ goes into the bin of least index whose level β\betaβ satisfies β≤1−ai\beta\le 1-a_iβ≤1−ai​. First-Fit Decreasing first arranges LLL into nonincreasing order and then runs First-Fit. FFD(L)FFD(L)FFD(L) is the number of bins it uses.

The proof uses a weight WWW on finite sets of elements. For an integer k≥1k\ge1k≥1, xxx is a kkk-piece if x∈(1k+1,1k]x\in(\frac1{k+1},\frac1k]x∈(k+11​,k1​], and a kkk-bin is a bin whose largest element is a kkk-piece. Set w1(x)=⌊1/x⌋−1w_1(x)=\lfloor 1/x\rfloor^{-1}w1​(x)=⌊1/x⌋−1. A pair (x,y)(x,y)(x,y) obeys relation kkk if xxx is a kkk-piece and kx+y≤1kx+y\le1kx+y≤1; then w2(x,y)=w1(x)+k−1kw1(y)w_2(x,y)=w_1(x)+\frac{k-1}{k}w_1(y)w2​(x,y)=w1​(x)+kk−1​w1​(y), and otherwise w2(x,y)=w1(x)+w1(y)w_2(x,y)=w_1(x)+w_1(y)w2​(x,y)=w1​(x)+w1​(y). For a partition π\piπ of XXX into one- and two-element sets, with each pair ordered (earlier, later) in the nonincreasing order,

w12(π)=∑{x}∈πw1(x)+∑(x,y)∈πw2(x,y),W(X)=min⁡πw12(π).w_{12}(\pi)=\sum_{\{x\}\in\pi}w_1(x)+\sum_{(x,y)\in\pi}w_2(x,y),\qquad W(X)=\min_\pi w_{12}(\pi).w12​(π)={x}∈π∑​w1​(x)+(x,y)∈π∑​w2​(x,y),W(X)=πmin​w12​(π).

BASIC is the set of elements of LLL that are kkk-pieces lying in a kkk-bin of the FFD packing of LLL, for some kkk; SURPLUS is the rest of LLL.

Formalization targets

Goal: Theorem 4.1

for every list L⊆(0,12]:FFD(L)≤7160L∗+5.\text{for every list } L\subseteq(0,\tfrac12]:\qquad FFD(L)\le\frac{71}{60}L^*+5 .for every list L⊆(0,21​]:FFD(L)≤6071​L∗+5.

The constants are those printed in the paper. The multiplicative constant 71/6071/6071/60 is best possible.

Milestones

  1. Lemma 3.3 (FFD part): if FFD(L)>rL∗+dFFD(L)>rL^*+dFFD(L)>rL∗+d with r,d≥1r,d\ge1r,d≥1, the list L′L'L′ of the elements of LLL exceeding (r−1)/r(r-1)/r(r−1)/r also has FFD(L′)>rL′∗+dFFD(L')>rL'^*+dFFD(L′)>rL′∗+d.
  2. Claim 4.2.1: for N≥4N\ge4N≥4 and L⊆(1N,12]L\subseteq(\frac1N,\frac12]L⊆(N1​,21​], ∑x∈BASICw1(x)≥FFD(L)−∑j=2N−1j−1j\sum_{x\in\mathrm{BASIC}}w_1(x)\ge FFD(L)-\sum_{j=2}^{N-1}\frac{j-1}{j}∑x∈BASIC​w1​(x)≥FFD(L)−∑j=2N−1​jj−1​.
  3. Claim 4.2.2: for N≥4N\ge4N≥4, L⊆(1N,12]L\subseteq(\frac1N,\frac12]L⊆(N1​,21​] and every partition π\piπ of LLL into one- and two-element sets, w12(π)≥w1(BASIC)−∑j=3N−11jw_{12}(\pi)\ge w_1(\mathrm{BASIC})-\sum_{j=3}^{N-1}\frac1jw12​(π)≥w1​(BASIC)−∑j=3N−1​j1​.
  4. Lemma 4.2: for N≥4N\ge4N≥4 and L⊆(1N,12]L\subseteq(\frac1N,\frac12]L⊆(N1​,21​], W(L)≥FFD(L)−N+2W(L)\ge FFD(L)-N+2W(L)≥FFD(L)−N+2.
  5. Subadditivity: W(X1∪⋯∪Xk)≤∑iW(Xi)W(X_1\cup\dots\cup X_k)\le\sum_i W(X_i)W(X1​∪⋯∪Xk​)≤∑i​W(Xi​).
  6. Lemma 4.3: if X⊆(17,12]X\subseteq(\frac17,\frac12]X⊆(71​,21​] and ∑x∈Xx≤1\sum_{x\in X}x\le1∑x∈X​x≤1, then W(X)≤7160W(X)\le\frac{71}{60}W(X)≤6071​.

A companion item states the Remark after Theorem 4.1: for every N≥1N\ge1N≥1 there is a list with all elements below 1/31/31/3, L∗=60NL^*=60NL∗=60N and FFD(L)=71NFFD(L)=71NFFD(L)=71N.

Significance

Theorem 4.1 shows the weighting-function method in its simplest nontrivial form: a weight whose total is within a constant of the algorithm's bin count, and which no feasible bin can exceed by more than the target ratio. The same method, with more elaborate weights, gives the 11/911/911/9 bound for FFD, and it is the model for later worst-case analyses of packing heuristics. The Remark shows that 71/6071/6071/60 is exact for items in (0,1/2](0,1/2](0,1/2], and the Corollary on p. 322 extends the analysis to the asymptotic ratio RFFDαR^\alpha_{FFD}RFFDα​ when items are bounded by α∈(8/29,1/2]\alpha\in(8/29,1/2]α∈(8/29,1/2].

The source proof is partial. The billing argument behind Claim 4.2.2 is given only when two auxiliary conditions (G1) and (G2) hold ("The more intricate argument here omitted", p. 321), and Lemma 4.3 is checked in four of about seventy-four cases ("leaving the remaining 70-odd, more or less routine, cases to the ambitious reader", p. 321). Complete details are in Johnson's thesis. The theorem itself is established. A formalization therefore gives the first complete, checked proof in a single place. The finite case analysis of Lemma 4.3 is well suited to machine checking. No machine-checked proof of any FFD bound is known to exist.

Difficulty

The obvious weight w1w_1w1​ alone fails. Claim 4.2.1 shows that w1(BASIC)w_1(\mathrm{BASIC})w1​(BASIC) covers the FFD bins, but many sets XXX of elements with sum at most 111 have w1(X)>71/60w_1(X)>71/60w1​(X)>71/60, for example two 222-pieces, a 555-piece and a 666-piece. The pair discounts of w2w_2w2​ repair Lemma 4.3, but they must then be paid for in Lemma 4.2, for every partition. That is Claim 4.2.2: a charge from each discounted pair to distinct SURPLUS elements that are no larger. The charge is straightforward only when no member of a pair obeying relation kkk lies in a bin of type k′<kk'<kk′<k. In general a pair's larger element may already have been charged by a smaller relation, and the paper omits the argument that handles this. Lemma 4.3 is elementary but has many cases, each determined by the piece types in XXX and the relations they obey.

Formalization scope

A list is L : List ℝ with IsList L (0<a≤10<a\le10<a≤1 for each element) in every statement. L∗L^*L∗ is optBins L, the least bbb such that some map from positions to Fin b has every bin sum at most 111. The First-Fit run keeps the nonempty bins as a List (List ℝ), and opens a new bin at the end exactly when no existing bin fits, which is the paper's "least jjj". The fit test is β+a≤1\beta+a\le1β+a≤1. FFD is First-Fit on sortDesc L, the mergeSort into nonincreasing order; ties do not affect the bin count. Indices are 000-based.

W(X)W(X)W(X) sorts XXX into nonincreasing order and minimises w12w_{12}w12​ over the involutions of its positions: fixed points are singletons, and a pair i<σ(i)i<\sigma(i)i<σ(i) is oriented (larger, smaller). The minimum is over a finite nonempty set, so it is attained. BASIC is a set of positions of sortDesc L, and each position's bin is its bin in the final FFD packing. In w2w_2w2​, k=⌊1/x⌋k=\lfloor1/x\rfloork=⌊1/x⌋ is the piece type of the first element. Sums ∑j=2N−1\sum_{j=2}^{N-1}∑j=2N−1​ are over Finset.Icc 2 (N - 1) with N≥4N\ge4N≥4.

The goal's range is (0,1/2](0,1/2](0,1/2]. The restriction to (1/7,1/2](1/7,1/2](1/7,1/2] belongs only to the proof, through Lemma 3.3. Stating the goal for (1/7,1/2](1/7,1/2](1/7,1/2], weakening 71/6071/6071/60 or 555, or making WWW an unattained infimum would each change the theorem. Only the FFD half of Lemma 3.3 is stated. Claim 4.2.1 is stated with Lemma 4.2's standing hypothesis N≥4N\ge4N≥4. The Remark's printed range 0<ε≤5/870<\varepsilon\le5/870<ε≤5/87 is a misprint: its FFD packing needs ε<1/174\varepsilon<1/174ε<1/174, and the companion item states only the existence claim.

Infrastructure needed: a usable API for the First-Fit run (the invariants of the fold, bin levels, the order of bins), a lemma that FFD bins receive items in nonincreasing order, and a decision procedure for Lemma 4.3's case analysis over piece types. The model file and the weight file are reusable for the 11/911/911/9 bound (mission 3 of this series) and for the bounded-α\alphaα corollaries. Contributions of proofs of Lemma 4.3 by computer-checked case enumeration, and of the missing general case of Claim 4.2.2, are especially welcome.

Selected references

  • D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey, R. L. Graham, Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms, SIAM J. Comput. 3(4):299–325, 1974. https://doi.org/10.1137/0203025
  • D. S. Johnson, Near-Optimal Bin Packing Algorithms, Ph.D. thesis, Massachusetts Institute of Technology, 1973 (reference [8] of the paper).
  • B. S. Baker, A new proof for the first-fit decreasing bin-packing algorithm, J. Algorithms 6, 1985.
  • G. Dósa, The tight bound of first fit decreasing bin-packing algorithm is FFD(I) ≤ 11/9 OPT(I) + 6/9, ESCAPE 2007, Lecture Notes in Computer Science 4614, 2007.
9 thms4 active usersReviewed
🏆Completed
Operations ResearchOptimizationTheoretical Computer Science·Captain: mikedeng1

Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms 2: First-Fit and Best-Fit with Bounded Item SizesResearch Paper

Motivation

Bin packing asks for the fewest unit-capacity bins that hold a given list of item sizes. It models cutting stock, memory allocation, file placement and the loading of trucks, and it is NP-hard, so in practice lists are packed by simple rules that look at one item at a time. The two most widely used rules are First-Fit and Best-Fit, and the question that Johnson, Demers, Ullman, Garey and Graham answered in 1974 is how far from optimal they can be in the worst case.

Their headline answer is that both rules use at most about 1710\tfrac{17}{10}1017​ times the optimal number of bins, and that 1710\tfrac{17}{10}1017​ is asymptotically attained. The lists that force this ratio use items larger than 12\tfrac1221​. When all items are known to be small, which is typical of memory and storage applications, the guarantee is much better, and this mission is about that refinement: the paper's Theorem 2.3 and its corollary, which determine the asymptotic worst-case ratio of First-Fit and Best-Fit exactly as a function of the largest allowed item size α≤12\alpha\le\tfrac12α≤21​.

Timeline. Ullman (1971) introduced the worst-case analysis of First-Fit with a 1710L∗+3\tfrac{17}{10}L^*+31017​L∗+3 bound. Garey, Graham and Ullman (1972) and Johnson's thesis (MIT, 1973) extended it to Best-Fit and to the decreasing variants. The 1974 SIAM paper collects these results; Theorem 2.3 there is the parametric bound for items of size at most α\alphaα. The additive constants in the unrestricted 1710\tfrac{17}{10}1017​ bound were sharpened over the following four decades, culminating in Dósa and Sgall's proof (2013) that FF(L)≤⌊1710L∗⌋FF(L)\le\lfloor\tfrac{17}{10}L^*\rfloorFF(L)≤⌊1017​L∗⌋.

Setting

A list is a finite sequence L=(a1,…,an)L=(a_1,\dots,a_n)L=(a1​,…,an​) of real numbers in (0,1](0,1](0,1]. Its optimum L∗L^*L∗ is the least number of bins into which the elements of LLL can be placed so that no bin contains numbers whose sum exceeds 111. The level of a bin is the sum of the numbers in it. For a real α>0\alpha>0α>0, write L⊆(0,α]L\subseteq(0,\alpha]L⊆(0,α] when every element of LLL is at most α\alphaα.

First-Fit (FFFFFF) considers bins B1,B2,…B_1,B_2,\dotsB1​,B2​,…, all initially empty, and places a1,a2,…,ana_1,a_2,\dots,a_na1​,a2​,…,an​ in that order: aia_iai​ goes into the bin BjB_jBj​ of least index whose level β\betaβ satisfies β≤1−ai\beta\le 1-a_iβ≤1−ai​. Best-Fit (BFBFBF) is the same except that, among the bins with β≤1−ai\beta\le 1-a_iβ≤1−ai​, it chooses one of largest level β\betaβ (least index among ties). FF(L)FF(L)FF(L) and BF(L)BF(L)BF(L) denote the numbers of nonempty bins at the end.

The restricted worst-case ratios are

RFFα(k)=max⁡{FF(L)L∗:L⊆(0,α], L∗=k},RBFα(k)=max⁡{BF(L)L∗:L⊆(0,α], L∗=k}.R^\alpha_{FF}(k)=\max\Big\{\frac{FF(L)}{L^*}: L\subseteq(0,\alpha],\ L^*=k\Big\},\qquad R^\alpha_{BF}(k)=\max\Big\{\frac{BF(L)}{L^*}: L\subseteq(0,\alpha],\ L^*=k\Big\}.RFFα​(k)=max{L∗FF(L)​:L⊆(0,α], L∗=k},RBFα​(k)=max{L∗BF(L)​:L⊆(0,α], L∗=k}.

Throughout, 0<α≤120<\alpha\le\tfrac120<α≤21​ and m=⌊α−1⌋m=\lfloor\alpha^{-1}\rfloorm=⌊α−1⌋, an integer with m≥2m\ge 2m≥2 and 1m+1<α≤1m\tfrac1{m+1}<\alpha\le\tfrac1mm+11​<α≤m1​.

Formalization targets

Goal: the asymptotic ratio (Corollary of Theorem 2.3, p. 308)

lim⁡k→∞RFFα(k)=lim⁡k→∞RBFα(k)=1+1⌊α−1⌋.\lim_{k\to\infty}R^\alpha_{FF}(k)=\lim_{k\to\infty}R^\alpha_{BF}(k)=1+\frac{1}{\lfloor\alpha^{-1}\rfloor}.k→∞lim​RFFα​(k)=k→∞lim​RBFα​(k)=1+⌊α−1⌋1​.

The goal is stated as a limit, which is the stable form of the result: it is unaffected by any improvement of the additive constants below.

Theorem 2.3(i): the lower bound (p. 307)

For each k≥1k\ge1k≥1 there is a list L⊆(0,α]L\subseteq(0,\alpha]L⊆(0,α] with L∗=kL^*=kL∗=k and FF(L)≥m+1mL∗−1mFF(L)\ge\frac{m+1}{m}L^*-\frac1mFF(L)≥mm+1​L∗−m1​; likewise for BFBFBF.

Two steps of the First-Fit upper bound (p. 308)

If no element of LLL exceeds 1m\frac1mm1​, then in the First-Fit packing every bin except possibly the last contains at least mmm elements, and all but at most two bins have level at least mm+1\frac{m}{m+1}m+1m​.

Theorem 2.3(ii): the upper bounds (p. 307)

For every list L⊆(0,α]L\subseteq(0,\alpha]L⊆(0,α],

FF(L)≤m+1mL∗+2,BF(L)≤m+1mL∗+2.FF(L)\le\frac{m+1}{m}L^*+2,\qquad BF(L)\le\frac{m+1}{m}L^*+2.FF(L)≤mm+1​L∗+2,BF(L)≤mm+1​L∗+2.

Significance

The theorem gives an exact, parametric description of how the worst case of the two greedy rules improves as items shrink: the asymptotic ratio is 32\tfrac3223​ when items are at most 12\tfrac1221​, 43\tfrac4334​ when at most 13\tfrac1331​, and tends to 111 as the maximum item size tends to 000. Combined with the 1710\tfrac{17}{10}1017​ bound for unrestricted lists, it shows that the bad behaviour of First-Fit is caused entirely by items larger than 12\tfrac1221​. Such parametric bounds are the standard way bin-packing heuristics are compared in the literature on online and semi-online packing, and the construction in part (i) is a reusable template for lower-bound lists.

The paper proves the First-Fit upper bound and the lower bound (the verification of the lower-bound construction is left to the reader). The Best-Fit upper bound is stated but not proved: the paper says only that "a similar, but slightly more complicated, argument can be used". A formal proof of the goal therefore requires supplying that argument. None of these results is known to have a machine-checked proof; Mathlib contains no bin-packing development.

Difficulty

For First-Fit the upper bound is a counting argument, but it rests on a property of the run, not of the final packing: an item that went into a later bin did not fit into an earlier bin at the moment it was placed. Turning that into a statement about the final levels requires an invariant maintained through the whole sequence of placements.

The Best-Fit upper bound is harder because that property fails: Best-Fit may put a small item into a fuller, later bin while an earlier, lighter bin still has room, so a light early bin and a light later bin can coexist longer than under First-Fit. The paper gives no argument for this case.

The lower bound requires computing the exact behaviour of both algorithms on a specific interleaved list with item sizes perturbed by powers of mmm, and computing L∗L^*L∗ exactly for that list, which needs a matching lower bound on the optimum.

Formalization scope

A list is L : List ℝ with the hypothesis IsList L (every element in (0,1](0,1](0,1]); L⊆(0,α]L\subseteq(0,\alpha]L⊆(0,α] is the additional hypothesis ∀ a ∈ L, a ≤ α. L∗L^*L∗ is optBins L, a sInf in ℕ over numbers of bins admitting a feasible assignment; the hypothesis IsList makes the set nonempty. The runs ffPack L and bfPack L are folds over the list that keep the nonempty bins in the order they were opened, each with its contents; an item that fits nowhere opens a new bin at the end, which is the paper's "least jjj" over infinitely many empty bins. Comparisons are exact (classical decidability on ℝ), and FF(L)FF(L)FF(L), BF(L)BF(L)BF(L) are the lengths of the final bin lists. mmm is Nat.floor α⁻¹, cast before any division.

The ratios RFFα(k)R^\alpha_{FF}(k)RFFα​(k), RBFα(k)R^\alpha_{BF}(k)RBFα​(k) are suprema taken in ℝ≥0∞: an unbounded family would give +∞+\infty+∞, never a default value, and at k=0k=0k=0 the only admissible list is empty and the value is 000. The goal is a Tendsto … atTop (𝓝 (1 + (⌊α⁻¹⌋₊)⁻¹)) statement in ℝ≥0∞. A real-valued sSup would have returned 000 on an unbounded family and made a false bound look provable; that encoding is ruled out. The upper bounds keep the additive constant 222 and the lower bound the subtractive 1m\frac1mm1​ exactly as printed.

The two proof steps are stated under the proof's own hypothesis "no element exceeding 1/m1/m1/m", which is weaker than L⊆(0,α]L\subseteq(0,\alpha]L⊆(0,α].

A complete development needs invariants of the First-Fit and Best-Fit folds, a lower bound L∗≥∑iaiL^*\ge\sum_i a_iL∗≥∑i​ai​, and exact evaluation of both runs on the construction of part (i). Lemmas about the fold encoding of First-Fit and Best-Fit and about L∗L^*L∗ are reusable in the companion missions on the 1710\tfrac{17}{10}1017​, 119\tfrac{11}{9}911​ and 7160\tfrac{71}{60}6071​ bounds of the same paper. Contributions on the Best-Fit upper bound are especially welcome, since the source gives no proof.

Selected references

  • D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey, R. L. Graham, Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms, SIAM Journal on Computing 3(4):299–325, 1974. https://doi.org/10.1137/0203025
  • J. D. Ullman, The Performance of a Memory Allocation Algorithm, Technical Report 100, Princeton University, 1971.
  • M. R. Garey, R. L. Graham, J. D. Ullman, Worst-Case Analysis of Memory Allocation Algorithms, Proc. 4th ACM Symposium on Theory of Computing, 143–150, 1972. https://doi.org/10.1145/800152.804907
  • D. S. Johnson, Near-Optimal Bin Packing Algorithms, PhD thesis, Massachusetts Institute of Technology, 1973. http://hdl.handle.net/1721.1/57819
  • G. Dósa, J. Sgall, First Fit Bin Packing: A Tight Analysis, Proc. 30th STACS, LIPIcs 20:538–549, 2013. https://doi.org/10.4230/LIPIcs.STACS.2013.538
7 thms4 active usersReviewed
🏆Completed
Operations ResearchOptimizationTheoretical Computer Science·Captain: mikedeng1

Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms 1: First-Fit and Best-Fit Have Asymptotic Worst-Case Ratio 17/10Research Paper

Motivation

Bin packing asks for the fewest unit-capacity bins that hold a given list of item sizes. It is one of the first problems studied through the worst-case analysis of approximation algorithms, and it models storage allocation, paging and file placement on tracks, as well as cutting-stock problems in operations research. Deciding the optimum exactly is NP-hard, so the practical question is how badly simple rules can do. The two simplest on-line rules, First-Fit and Best-Fit, are still the baseline against which every later bin-packing heuristic is measured.

Timeline:

  • 1972. Garey, Graham and Ullman announce that First-Fit uses at most about 1.71.71.7 times the optimal number of bins (Proc. 4th ACM STOC, 1972); Johnson's thesis (MIT, 1973) develops the analysis.
  • 1974. Johnson, Demers, Ullman, Garey and Graham prove FF(L)≤1.7L∗+2FF(L)\le 1.7L^*+2FF(L)≤1.7L∗+2 and BF(L)≤1.7L∗+2BF(L)\le 1.7L^*+2BF(L)≤1.7L∗+2 for every list, and give lists with FF(L)=BF(L)>1.7L∗−8FF(L)=BF(L)>1.7L^*-8FF(L)=BF(L)>1.7L∗−8 for every optimum L∗=kL^*=kL∗=k, so the asymptotic worst-case ratio of both rules is exactly 1710\tfrac{17}{10}1017​ (SIAM J. Comput. 3(4)). This paper is the source of the mission.
  • 1976–2014. The additive constant is lowered: Garey, Graham, Johnson and Yao (1976) show FF(L)≤⌈1.7L∗⌉FF(L)\le\lceil 1.7L^*\rceilFF(L)≤⌈1.7L∗⌉, and Dósa and Sgall prove the tight bound FF(L)≤⌊1.7L∗⌋FF(L)\le\lfloor 1.7L^*\rfloorFF(L)≤⌊1.7L∗⌋ (STACS 2013) and the same bound for Best-Fit (ICALP 2014).

Setting

A list is a finite sequence L=(a1,a2,…,an)L=(a_1,a_2,\dots,a_n)L=(a1​,a2​,…,an​) of real numbers in (0,1](0,1](0,1]; values may repeat. A bin has capacity 111, and its level is the sum of the numbers in it. The optimum L∗L^*L∗ is the minimum number of bins into which the elements of LLL can be placed so that no bin contains numbers whose sum exceeds 111.

Both rules place a1,…,ana_1,\dots,a_na1​,…,an​ in this order into bins B1,B2,…B_1,B_2,\dotsB1​,B2​,…, each initially at level 000, and never move an element once placed.

  1. First-Fit (FF) places aia_iai​ into the bin BjB_jBj​ of least index whose level β\betaβ satisfies β≤1−ai\beta\le 1-a_iβ≤1−ai​.
  2. Best-Fit (BF) places aia_iai​ into a bin whose level β\betaβ satisfies β≤1−ai\beta\le 1-a_iβ≤1−ai​ and is as large as possible, taking the least index among ties.

FF(L)FF(L)FF(L) and BF(L)BF(L)BF(L) are the numbers of nonempty bins at the end. The worst-case ratio at optimum kkk is

RFF(k)=sup⁡{FF(L)L∗:L∗=k},RBF(k)=sup⁡{BF(L)L∗:L∗=k}.R_{FF}(k)=\sup\Bigl\{\frac{FF(L)}{L^*}:L^*=k\Bigr\},\qquad R_{BF}(k)=\sup\Bigl\{\frac{BF(L)}{L^*}:L^*=k\Bigr\}.RFF​(k)=sup{L∗FF(L)​:L∗=k},RBF​(k)=sup{L∗BF(L)​:L∗=k}.

The analysis also uses a weighting function W:[0,1]→[0,1]W:[0,1]\to[0,1]W:[0,1]→[0,1], piecewise linear with W(α)=65αW(\alpha)=\tfrac65\alphaW(α)=56​α on [0,16][0,\tfrac16][0,61​], 95α−110\tfrac95\alpha-\tfrac1{10}59​α−101​ on (16,13](\tfrac16,\tfrac13](61​,31​], 65α+110\tfrac65\alpha+\tfrac1{10}56​α+101​ on (13,12](\tfrac13,\tfrac12](31​,21​] and 111 on (12,1](\tfrac12,1](21​,1], and the coarseness of a bin of a completed packing: the largest 1−level⁡(B′)1-\operatorname{level}(B')1−level(B′) over the bins B′B'B′ of smaller index, and 000 for the first bin.

Formalization targets

Goal: the asymptotic ratio (Corollary of Section 2, p. 306)

lim⁡k→∞RFF(k)=1.7andlim⁡k→∞RBF(k)=1.7.\lim_{k\to\infty}R_{FF}(k)=1.7\qquad\text{and}\qquad\lim_{k\to\infty}R_{BF}(k)=1.7.k→∞lim​RFF​(k)=1.7andk→∞lim​RBF​(k)=1.7.

The goal fixes only the asymptotic ratio and leaves the additive constants free, so it is the statement that survives the later improvements of the constants.

Milestones, in the order the proof uses them

  • Claim 2.2.1 (p. 304): a bin with total size at most 111 has ∑iW(bi)≤1710\sum_i W(b_i)\le\tfrac{17}{10}∑i​W(bi​)≤1017​.
  • Claim 2.2.2 (p. 305): in an FF or BF packing, every element placed into a bin before the bin was more than half full exceeds the bin's coarseness.
  • Claim 2.2.3 (p. 305): a bin of coarseness α<12\alpha<\tfrac12α<21​ whose level exceeds 1−α1-\alpha1−α has weight at least 111.
  • Claim 2.2.4 (p. 306): a bin of coarseness α<12\alpha<\tfrac12α<21​ with weight 1−β1-\beta1−β, β>0\beta>0β>0, either holds a single element at most 12\tfrac1221​ or has level at most 1−α−59β1-\alpha-\tfrac59\beta1−α−95​β.
  • Theorem 2.2 (p. 304): FF(L)≤1.7L∗+2FF(L)\le 1.7L^*+2FF(L)≤1.7L∗+2 and BF(L)≤1.7L∗+2BF(L)\le 1.7L^*+2BF(L)≤1.7L∗+2 for every list.
  • Theorem 2.1 (p. 301): for every k≥1k\ge1k≥1 there is a list with L∗=kL^*=kL∗=k and FF(L)=BF(L)>1.7L∗−8FF(L)=BF(L)>1.7L^*-8FF(L)=BF(L)>1.7L∗−8.

A companion item, not a milestone, records the explicit list of Fig. 3 (p. 307) with L∗=10L^*=10L∗=10 and FF(L)=BF(L)=17FF(L)=BF(L)=17FF(L)=BF(L)=17.

Significance

The result fixes the worst-case behaviour of the two simplest bin-packing heuristics: neither ever uses more than about 70%70\%70% more bins than an optimal packing, and both can be forced to. The weighting-function technique introduced for this bound became the standard method for analysing bin-packing heuristics, including First-Fit Decreasing, Harmonic-type algorithms and on-line lower bounds, and the constant 1710\tfrac{17}{10}1017​ is the reference point for later on-line algorithms.

The theorem is proved, and its constants have since been sharpened. No machine-checked proof of any of these results is known. This mission produces a Lean model of on-line bin packing (the optimum, the First-Fit and Best-Fit runs with their placement history, and the worst-case ratio) that the other missions of this paper and later bin-packing formalizations can reuse. It also produces formal proofs of the weighting-function bounds, of the 1.7L∗+21.7L^*+21.7L∗+2 upper bound and of the lower-bound construction.

Difficulty

The first idea, charging each bin its level, gives only FF(L)≤2L∗+1FF(L)\le 2L^*+1FF(L)≤2L∗+1: at most one bin is at most half full. The ratio 1710\tfrac{17}{10}1017​ comes from bins that are more than half full but far from full, and a bound on the total size of the elements cannot see them. No property of the final packing alone suffices: the bins that are far from full can only be controlled through the order in which the rule opened and filled them, so the argument depends on the dynamics of the run. On the lower-bound side, the natural periodic list (sizes near 16,13,12\tfrac16,\tfrac13,\tfrac1261​,31​,21​, p. 301) gives only the ratio 53\tfrac5335​; reaching 1710\tfrac{17}{10}1017​ needs a list on which both rules waste space in every medium bin, for every kkk, while L∗L^*L∗ is still known exactly.

Formalization scope

A list is L : List ℝ with the hypothesis IsList L (every element in (0,1](0,1](0,1]), and every statement assumes it. L∗L^*L∗ is optBins L, the least b : ℕ for which some assignment Fin L.length → Fin b has every bin sum at most 111. A run is a fold over the list that keeps only the nonempty bins, in index order, each with its contents in placement order. A new bin is opened at the end exactly when no nonempty bin fits, which is the paper's "least jjj" over infinitely many initially empty bins, since elements are positive. The fit test is the non-strict β+ai≤1\beta+a_i\le1β+ai​≤1, and Best-Fit breaks ties by least index. The placement history (the bin chosen for each element and that bin's level just before) is read off the run on the prefix of the list. Indices are 000-based. Coarseness is computed in the completed packing. WWW is a function ℝ → ℝ and is only ever applied to elements of (0,1](0,1](0,1]. RFF(k)R_{FF}(k)RFF​(k) and RBF(k)R_{BF}(k)RBF​(k) are suprema in the extended nonnegative reals [0,∞][0,\infty][0,∞], and the limit is taken there.

A real-valued supremum would be 000 on an empty or unbounded family, and the limit statement would then say nothing about the algorithms. The extended-real supremum rules this trivialization out. Every claim is stated for the concrete First-Fit run and the concrete Best-Fit run, not for an abstract rule with the properties used in the proof.

Claim 2.2.4 is printed with alternative (i) "m=1m=1m=1 and b1<12b_1<\tfrac12b1​<21​", which is false: First-Fit on (0.6,0.5)(0.6,0.5)(0.6,0.5) gives a counterexample. The mission states it with b1≤12b_1\le\tfrac12b1​≤21​, which is what the paper's proof establishes and what the main proof uses. The milestone text keeps the printed version.

The model definitions are reusable for any on-line bin-packing rule, since the run is parameterized by the choice rule. Contributions welcome: proofs of the milestones, general lemmas about the runs (levels stay at most 111, at most one bin is at most half full, the history determines the final packing), and the computation of L∗L^*L∗ for the explicit lists of Theorem 2.1 and Fig. 3.

Selected references

  • D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey, R. L. Graham, Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms, SIAM Journal on Computing 3(4):299–325, 1974. https://doi.org/10.1137/0203025
  • M. R. Garey, R. L. Graham, J. D. Ullman, Worst-case analysis of memory allocation algorithms, Proc. 4th ACM STOC, 1972.
  • D. S. Johnson, Near-Optimal Bin Packing Algorithms, PhD thesis, MIT, 1973.
  • M. R. Garey, R. L. Graham, D. S. Johnson, A. C. Yao, Resource constrained scheduling as generalized bin packing, J. Combinatorial Theory Ser. A 21, 1976.
  • G. Dósa, J. Sgall, First Fit bin packing: A tight analysis, STACS 2013, LIPIcs 20:538–549. https://doi.org/10.4230/LIPIcs.STACS.2013.538
  • G. Dósa, J. Sgall, Optimal analysis of Best Fit bin packing, ICALP 2014, LNCS 8572.
9 thms4 active usersReviewed
🏆Completed
Operations ResearchOptimizationProbability+1·Captain: mikedeng1

Approximation Techniques for Average Completion Time Scheduling I: Best-α on One Machine with Release DatesResearch Paper

Motivation

Minimizing the average completion time of jobs that arrive over time is one of the basic objectives of machine scheduling: it measures how long, on average, a job waits in the system. On a single machine with release dates and no preemption (written 1∣rj∣∑Cj1|r_j|\sum C_j1∣rj​∣∑Cj​), the problem is strongly NP-hard, so research has focused on approximation algorithms whose guarantees are stated against every feasible schedule.

The standard route runs through the preemptive relaxation. When jobs may be interrupted and resumed, the shortest-remaining-processing-time rule (SRPT) produces an optimal schedule, and its value is a lower bound for every nonpreemptive schedule. The question is how to turn that preemptive schedule into a nonpreemptive one without losing too much.

Timeline:

  • 1995, Phillips, Stein and Wein (WADS 1995, pp. 86–97): order the jobs by their SRPT completion times and schedule them nonpreemptively in that order. This gives a 2-approximation. Later 2-approximations are by Hoogeveen and Vestjens (IPCO 1996), Stougie (1995), and Goemans (SODA 1997). Hoogeveen and Vestjens also showed that deterministic on-line algorithms cannot beat 2.
  • 2001, Chekuri, Motwani, Natarajan and Stein (SIAM J. Comput. 31(1)): order by α\alphaα-points instead of completion times, choose α\alphaα at random, and take the best α\alphaα off-line. This gives the e/(e−1)≈1.58e/(e-1)\approx1.58e/(e−1)≈1.58 bound for Best-α\alphaα that is the goal of this mission, and an optimal randomized on-line algorithm.
  • 1999, Afrati et al. (FOCS 1999): a polynomial-time approximation scheme for 1∣rj∣∑wjCj1|r_j|\sum w_jC_j1∣rj​∣∑wj​Cj​. This settled the approximability of the problem, but the resulting algorithms are far from simple.

Setting

An instance has nnn jobs J0,…,Jn−1J_0,\dots,J_{n-1}J0​,…,Jn−1​. Job JjJ_jJj​ has a processing time pj>0p_j>0pj​>0, a release date rj≥0r_j\ge0rj​≥0, and, where the objective is weighted, a weight wj>0w_j>0wj​>0. There is one machine.

A nonpreemptive schedule assigns each job a start time Sj≥rjS_j\ge r_jSj​≥rj​ such that the intervals [Sj,Sj+pj)[S_j,S_j+p_j)[Sj​,Sj​+pj​) are pairwise disjoint. Its completion times are Cj=Sj+pjC_j=S_j+p_jCj​=Sj​+pj​.

A preemptive schedule PPP specifies, for each time ttt, which job runs at ttt, if any. Job JjJ_jJj​ runs only at times t≥max⁡(0,rj)t\ge\max(0,r_j)t≥max(0,rj​), receives exactly pjp_jpj​ units of processing in total, and finishes by some finite time. Its completion time CjPC^P_jCjP​ is the first time by which all of JjJ_jJj​ has been processed. For α∈(0,1]\alpha\in(0,1]α∈(0,1], its α\alphaα-point CjP(α)C^P_j(\alpha)CjP​(α) is the first time by which αpj\alpha p_jαpj​ units have been processed.

For a job JiJ_iJi​, TiT_iTi​ denotes the idle time of PPP before CiPC^P_iCiP​. xijx_{ij}xij​ denotes the fraction of JjJ_jJj​ processed before CiPC^P_iCiP​. The paper writes SiP(β)S^P_i(\beta)SiP​(β) for the set of jobs with xij=βx_{ij}=\betaxij​=β, and also for their total processing time.

One-machine list scheduling in a given order runs the jobs nonpreemptively in that order. Each job starts at the later of its release date and the completion of the previous job in the list. An α\alphaα-schedule is list scheduling in nondecreasing order of the α\alphaα-points CjP(α)C^P_j(\alpha)CjP​(α). CjαC^\alpha_jCjα​ denotes the completion times of an α\alphaα-schedule.

Random-α\alphaα draws α\alphaα from a distribution on (0,1](0,1](0,1] and outputs the α\alphaα-schedule. Best-α\alphaα outputs the α\alphaα-schedule of smallest total completion time min⁡α∑jCjα\min_\alpha\sum_j C^\alpha_jminα​∑j​Cjα​.

Formalization targets

Goal: Corollary 2.7

Let PPP be optimal among preemptive schedules for ∑jCj\sum_j C_j∑j​Cj​. Then there is α∈(0,1]\alpha\in(0,1]α∈(0,1] such that every α\alphaα-schedule derived from PPP satisfies

∑jCjα  ≤  ee−1∑jCjfor every feasible nonpreemptive schedule (Cj)j.\sum_j C^\alpha_j\;\le\;\frac{e}{e-1}\sum_j C_j\qquad\text{for every feasible nonpreemptive schedule } (C_j)_j .j∑​Cjα​≤e−1e​j∑​Cj​for every feasible nonpreemptive schedule (Cj​)j​.

Since Best-α\alphaα returns a schedule no worse than this α\alphaα-schedule, Best-α\alphaα is an e/(e−1)e/(e-1)e/(e−1)-approximation.

Milestones

  1. The calculus behind the constant. For f(α)=eα/(e−1)f(\alpha)=e^\alpha/(e-1)f(α)=eα/(e−1) and every β∈(0,1]\beta\in(0,1]β∈(0,1],
∫0β1+α−ββf(α) dα=1e−1.\int_0^\beta\frac{1+\alpha-\beta}{\beta}f(\alpha)\,d\alpha=\frac1{e-1}.∫0β​β1+α−β​f(α)dα=e−11​.
  1. Lemma 2.2: CiP=Ti+∑0<β≤1βSiP(β)C^P_i=T_i+\sum_{0<\beta\le1}\beta S^P_i(\beta)CiP​=Ti​+∑0<β≤1​βSiP​(β).
  2. Lemma 2.3: Ciα≤Ti+(1+α)∑β≥αSiP(β)+∑β<αβSiP(β)C^\alpha_i\le T_i+(1+\alpha)\sum_{\beta\ge\alpha}S^P_i(\beta)+\sum_{\beta<\alpha}\beta S^P_i(\beta)Ciα​≤Ti​+(1+α)∑β≥α​SiP​(β)+∑β<α​βSiP​(β).
  3. Lemma 2.5: if α\alphaα has density fff on (0,1](0,1](0,1], then E[Ciα]≤(1+δ)CiPE[C^\alpha_i]\le(1+\delta)C^P_iE[Ciα​]≤(1+δ)CiP​ with δ=max⁡0<β≤1∫0β1+α−ββf(α) dα\delta=\max_{0<\beta\le1}\int_0^\beta\frac{1+\alpha-\beta}{\beta}f(\alpha)\,d\alphaδ=max0<β≤1​∫0β​β1+α−β​f(α)dα.
  4. Theorem 2.6, for the weighted objective with PPP optimal among preemptive schedules: the expected approximation ratio of Random-α\alphaα is at most 222 for uniform α\alphaα, at most 1.81.81.8 for α=1\alpha=1α=1 w.p. 3/53/53/5 and α=1/2\alpha=1/2α=1/2 w.p. 2/52/52/5, and at most e/(e−1)e/(e-1)e/(e−1) for the density eα/(e−1)e^\alpha/(e-1)eα/(e−1).

Companion statements, not milestones:

  • the upper bound of Theorem 2.1, ∑jCjα≤(1+1/α)∑jCjP\sum_jC^\alpha_j\le(1+1/\alpha)\sum_jC^P_j∑j​Cjα​≤(1+1/α)∑j​CjP​;
  • the existence of an optimal preemptive schedule.

Significance

The e/(e−1)e/(e-1)e/(e−1) bound shows that conversion from the preemptive relaxation can beat the factor 2 of the natural ordering. It does so by exploiting that no single instance is bad for many values of α\alphaα at once. The α\alphaα-point technique was also used with LP relaxations, for example by Goemans (SODA 1997) and by Schulz and Skutella. The randomized version is an optimal randomized on-line algorithm for 1∣rj∣∑Cj1|r_j|\sum C_j1∣rj​∣∑Cj​. Lemma 2.3 is a statement about any preemptive schedule, so it applies wherever a good preemptive or fractional schedule is available.

All results of the mission are proved in the paper, except that the proof of Theorem 2.6, part 2 is omitted there. No machine-checked proof of them is known. A complete development would give a verified model of preemptive one-machine schedules, α\alphaα-points and list scheduling, together with the averaging argument over α\alphaα. These are reusable for the later results of the same paper and for the α\alphaα-point literature.

Difficulty

The obvious argument bounds each job's α\alphaα-schedule completion time directly against its preemptive completion time. That argument loses a factor 1+1/α1+1/\alpha1+1/α (Theorem 2.1), which is at least 2 for every fixed α\alphaα. The improvement needs Lemma 2.3. There the charge to each job depends on how much of it was done by CiPC^P_iCiP​ relative to α\alphaα, and the idle time TiT_iTi​ is not inflated at all. Proving Lemma 2.3 requires reasoning about a preemptive schedule as a measure on time, and about how moving pieces of jobs changes completion times. A proof that treats the preemptive schedule as a finite list of pieces must first show that nothing is lost by this discretization.

The averaging step needs the expectation over α\alphaα to be an honest integral. The map α↦Ciα\alpha\mapsto C^\alpha_iα↦Ciα​ must be shown integrable, which requires a fixed rule for ties between equal α\alphaα-points.

Formalization scope

  • Model. Jobs are Fin n, time is real, pj>0p_j>0pj​>0 and rj≥0r_j\ge0rj​≥0. The paper admits pj=0p_j=0pj​=0 only in its tightness instances.
    • A preemptive schedule is a function σ:R→\sigma:\mathbb R\toσ:R→ Option (Fin n) (none = idle). Each job's run set is measurable, lies in [max⁡(0,rj),∞)[\max(0,r_j),\infty)[max(0,rj​),∞), is bounded above, and has Lebesgue measure pjp_jpj​.
    • Completion times and α\alphaα-points are infima of nonempty sets that are bounded below.
    • TiT_iTi​ is the measure of the idle set in [0,CiP)[0,C^P_i)[0,CiP​).
    • The paper's sums over β\betaβ are sums over jobs, weighted by the fraction xijx_{ij}xij​.
  • List scheduling is strict: jobs never overtake the list order, and the machine is free from time 000.
    • Lemma 2.3, Theorem 2.1, Theorem 2.6.2 and the goal hold for every tie-break among equal α\alphaα-points.
    • The expectations (Lemma 2.5, Theorem 2.6.1 and 2.6.3) use the tie-break by job index. They assert integrability as part of the conclusion.
  • Optimality. "Approximation ratio ccc" is stated as an inequality against every feasible nonpreemptive schedule, never against an infimum.
    • The optimality of PPP among preemptive schedules is the paper's standing assumption for its upper bounds (p. 151). It appears as a hypothesis of Theorem 2.6 and of the goal.
    • The lemmas hold for arbitrary PPP and do not carry it.
    • An existence statement shows the hypothesis can be met.
  • Lemma 2.5's δ\deltaδ is replaced by any upper bound of the integrals over β∈(0,1]\beta\in(0,1]β∈(0,1]. This is equivalent, and it avoids assuming that the maximum is attained.
  • Not stated:
    • the running time O(n2)O(n^2)O(n2) of Best-α\alphaα and the optimality of SRPT;
    • the tightness parts of Theorem 2.1 and Corollary 2.4, and the lower bounds of Theorem 2.9, which use zero-length jobs;
    • the on-line Theorem 2.8, which needs a model of on-line algorithms.
  • Trivializing formalization ruled out. Dropping the optimality of PPP from the goal would turn it into a statement about arbitrary preemptive schedules, which is Lemma 2.5, not Corollary 2.7. Comparing against ∑jCjP\sum_jC^P_j∑j​CjP​ instead of every nonpreemptive schedule would likewise remove the content of the corollary.

Contributions are welcome at every level. The calculus milestone and Lemma 2.2 are good first targets.

Selected references

  • C. Chekuri, R. Motwani, B. Natarajan, C. Stein, Approximation Techniques for Average Completion Time Scheduling, SIAM J. Comput. 31(1):146–166, 2001. https://doi.org/10.1137/S0097539797327180
  • C. Phillips, C. Stein, J. Wein, Scheduling jobs that arrive over time, Proc. 4th Workshop on Algorithms and Data Structures (WADS), 1995, pp. 86–97 (reference [25] of the paper; no link verified).
  • J. A. Hoogeveen, A. P. A. Vestjens, Optimal on-line algorithms for single-machine scheduling, Proc. 5th IPCO, 1996, pp. 404–414 (reference [21]; no link verified).
  • M. X. Goemans, Improved approximation algorithms for scheduling with release dates, Proc. 8th ACM-SIAM SODA, 1997, pp. 591–598 (reference [12]; no link verified).
  • F. Afrati et al., Approximation schemes for minimizing average weighted completion time with release dates, Proc. 40th FOCS, 1999 (reference [2]; no link verified).
9 thms4 active usersReviewed
🏆Completed
Operations ResearchOptimizationTheoretical Computer Science·Captain: mikedeng1

Local Search Heuristics for k-Median and Facility Location Problems III: Add-Drop-Swap Local Search for Uncapacitated Facility Location Has Locality Gap 3Research Paper

Motivation

The uncapacitated facility location (UFL) problem is one of the basic models of location theory and operations research: a firm chooses which warehouses, plants or servers to open, paying a fixed cost for each open site and a service cost for every client according to its distance to the nearest open site. It is also a standard test case for approximation algorithms.

Local search is the simplest of these and the one most used in practice: start from any set of open facilities and repeatedly add, drop or exchange one facility while this lowers the cost. The question is how bad a solution can be when no such move helps. Arya, Garg, Khandekar, Meyerson, Munagala and Pandit (SIAM J. Comput. 33(3), 2004) answered it for UFL with an exact constant.

Timeline. Korupolu, Plaxton and Rajaraman (SODA 1998, J. Algorithms 2000) analysed local search with add, drop and swap moves and proved a locality gap of at most 5; their analysis contains the service cost bound restated here as Lemma 4.1. Charikar and Guha (FOCS 1999) proved a locality gap of 3 for a different local search, in which one facility is added and any number are dropped. Arya et al. (STOC 2001; journal version 2004) proved that the add/drop/swap neighbourhood itself has locality gap at most 3, and gave an instance showing that 3 cannot be improved (§4.3).

Setting

A metric instance consists of a finite set CCC of clients, a finite set FFF of facilities, and a distance ddd on C∪FC \cup FC∪F that is nonnegative, symmetric and satisfies the triangle inequality. The cost of serving client jjj by facility iii is cji=d(j,i)c_{ji} = d(j,i)cji​=d(j,i); the distance cii′c_{ii'}cii′​ between two facilities is also available. Each facility i∈Fi \in Fi∈F has an opening cost fi≥0f_i \ge 0fi​≥0.

A solution is a nonempty set S⊆FS \subseteq FS⊆F of open facilities. Every client is served by its nearest open facility, so

costf(S)=∑i∈Sfi,costs(S)=∑j∈Cmin⁡i∈Scji,cost(S)=costf(S)+costs(S).\mathrm{cost}_f(S) = \sum_{i \in S} f_i, \qquad \mathrm{cost}_s(S) = \sum_{j \in C} \min_{i \in S} c_{ji}, \qquad \mathrm{cost}(S) = \mathrm{cost}_f(S) + \mathrm{cost}_s(S).costf​(S)=i∈S∑​fi​,costs​(S)=j∈C∑​i∈Smin​cji​,cost(S)=costf​(S)+costs​(S).

The neighbourhood of SSS is the set of solutions reachable by adding one facility, dropping one facility, or swapping one open facility for another:

B(S)={S+{s′}}∪{S−{s}∣s∈S}∪{S−{s}+{s′}∣s∈S}.\mathcal B(S) = \{S + \{s'\}\} \cup \{S - \{s\} \mid s \in S\} \cup \{S - \{s\} + \{s'\} \mid s \in S\}.B(S)={S+{s′}}∪{S−{s}∣s∈S}∪{S−{s}+{s′}∣s∈S}.

SSS is locally optimum if cost(S)≤cost(S′)\mathrm{cost}(S) \le \mathrm{cost}(S')cost(S)≤cost(S′) for every S′∈B(S)S' \in \mathcal B(S)S′∈B(S). The locality gap is the supremum, over all instances, of the ratio between the cost of a worst local optimum and the cost of a global optimum.

The proofs use the following notation, which appears in the milestones but not in the goal. Fix a second solution OOO and nearest-facility assignments σS:C→S\sigma_S : C \to SσS​:C→S, σO:C→O\sigma_O : C \to OσO​:C→O; write Sj=cjσS(j)S_j = c_{j\sigma_S(j)}Sj​=cjσS​(j)​, Oj=cjσO(j)O_j = c_{j\sigma_O(j)}Oj​=cjσO​(j)​, NS(s)=σS−1(s)N_S(s) = \sigma_S^{-1}(s)NS​(s)=σS−1​(s), NO(o)=σO−1(o)N_O(o) = \sigma_O^{-1}(o)NO​(o)=σO−1​(o) and Nso=NO(o)∩NS(s)N^o_s = N_O(o) \cap N_S(s)Nso​=NO​(o)∩NS​(s). A facility s∈Ss \in Ss∈S captures o∈Oo \in Oo∈O if ∣Nso∣>12∣NO(o)∣|N^o_s| > \tfrac12 |N_O(o)|∣Nso​∣>21​∣NO​(o)∣; sss is good if it captures no facility of OOO and bad otherwise. The proof of the facility cost bound uses a permutation π\piπ of the clients that maps each NO(o)N_O(o)NO​(o) onto itself, moves every client of a non-capturing block NsoN^o_sNso​ out of that block (Property 3.1), and fixes every client of a capturing block that it would map into the same block.

Formalization targets

Goal: Theorem 4.3

cost(S)≤3⋅cost(O)for every locally optimum S and every solution O.\mathrm{cost}(S) \le 3 \cdot \mathrm{cost}(O) \quad \text{for every locally optimum } S \text{ and every solution } O.cost(S)≤3⋅cost(O)for every locally optimum S and every solution O.

This is the locality gap bound of Theorem 4.3 (p. 557) in its strongest printed form: OOO is any solution, not only an optimal one.

Milestones

  1. Lemma 4.1 (service cost), p. 554: costs(S)≤costf(O)+costs(O)\mathrm{cost}_s(S) \le \mathrm{cost}_f(O) + \mathrm{cost}_s(O)costs​(S)≤costf​(O)+costs​(O).
  2. The refined mapping π\piπ of the proof of Lemma 4.2, p. 555: such a permutation exists for any two assignments.
  3. Inequality (5), p. 555: the drop move for a good facility sss,
−fs+∑j∈NS(s), π(j)≠j(Oj+Oπ(j)+Sπ(j)−Sj)+2∑j∈NS(s), π(j)=jOj≥0.-f_s + \sum_{j \in N_S(s),\ \pi(j) \neq j} (O_j + O_{\pi(j)} + S_{\pi(j)} - S_j) + 2 \sum_{j \in N_S(s),\ \pi(j) = j} O_j \ge 0.−fs​+j∈NS​(s), π(j)=j∑​(Oj​+Oπ(j)​+Sπ(j)​−Sj​)+2j∈NS​(s), π(j)=j∑​Oj​≥0.
  1. Inequality (6), pp. 555–556: the swap of a bad facility sss with the facility ooo it captures that is nearest to it.
  2. Inequality (8), p. 556: for a bad facility sss capturing the set P⊆OP \subseteq OP⊆O, the analogue of (5) with ∑o′∈Pfo′−fs\sum_{o' \in P} f_{o'} - f_s∑o′∈P​fo′​−fs​ in place of −fs-f_s−fs​.
  3. Lemma 4.2 (facility cost), p. 555: costf(S)≤costf(O)+2⋅costs(O)\mathrm{cost}_f(S) \le \mathrm{cost}_f(O) + 2 \cdot \mathrm{cost}_s(O)costf​(S)≤costf​(O)+2⋅costs​(O).

A companion item, not a milestone, states the bound in the proof of Theorem 4.4 with α=2\alpha = \sqrt2α=2​: a local optimum of the instance with facility costs 2fi\sqrt2 f_i2​fi​ costs at most (1+2) cost(O)(1+\sqrt2)\,\mathrm{cost}(O)(1+2​)cost(O) in the original instance.

Significance

The result. Theorem 4.3 shows that the simplest local search for metric UFL is within a factor 3 of optimal at every local optimum, with no LP and no rounding, and the tight example of §4.3 shows the analysis cannot be improved for this neighbourhood. Because Lemmas 4.1 and 4.2 hold against every solution OOO, scaling the facility costs before running local search trades the two bounds against each other and gives the 1+2+ϵ1 + \sqrt2 + \epsilon1+2​+ϵ guarantee of Theorem 4.4. The same capture-and-reassign technique is used for k-median (§3) and capacitated facility location (§5).

Formalizing it. The theorem is proved on paper; no machine-checked proof of it or of any locality gap bound for facility location is known to this mission. A formal development would check the reassignment arguments, which are stated case by case in the paper, and would produce reusable Lean infrastructure for metric facility location instances, nearest-facility costs and neighbourhood-based local optimality.

Difficulty

The service cost bound is routine; the facility cost bound is where the work lies. The natural first idea, closing a facility s∈Ss \in Ss∈S and sending each of its clients to the facility of SSS nearest to that client's optimal facility, fails when sss serves most of the clients of some o∈Oo \in Oo∈O: the nearest facility of SSS to ooo may be sss itself, so the client has nowhere to go. The proof separates good facilities, which can be dropped, from bad ones, which must be swapped with a captured facility, and pays for the clients that cannot be moved through the distance between sss and its nearest captured facility. The combinatorial core is the construction of a permutation within each NO(o)N_O(o)NO​(o) that avoids every non-capturing block and has fixed points only where they are unavoidable.

Formalization scope

Clients and facilities are finite types Cl and Fa. The distance is a real-valued function on Cl ⊕ Fa that is nonnegative, symmetric and satisfies the triangle inequality; d(x,x)=0d(x,x) = 0d(x,x)=0 is not assumed, since the paper neither states nor uses it. Opening costs are a function f : Fa → ℝ with 0 ≤ f i, and demands are unit, as in the paper.

Solutions are nonempty Finsets. The service cost is ∑jmin⁡i∈Scji\sum_j \min_{i \in S} c_{ji}∑j​mini∈S​cji​ (Finset.inf') and is defined only for nonempty sets, so no junk value for ∅\emptyset∅ enters. Accordingly the drop move is considered only when a facility remains open; with at least one client, ∅\emptyset∅ cannot serve anyone and is not a solution. Local optimality is required for all moves of B(S)\mathcal B(S)B(S): every added facility, every dropped facility and every swap, not only the moves used in the proof. The goal is stated as the multiplied-out inequality cost(S)≤3 cost(O)\mathrm{cost}(S) \le 3\,\mathrm{cost}(O)cost(S)≤3cost(O) for every nonempty OOO, never as a ratio, since cost(O)\mathrm{cost}(O)cost(O) may be 000.

In the milestones, the nearest-facility assignments σS\sigma_SσS​, σO\sigma_OσO​ are arbitrary among the nearest ones (ties broken arbitrarily), and the family of bijections π:NO(o)→NO(o)\pi : N_O(o) \to N_O(o)π:NO​(o)→NO​(o) is a single permutation of the clients with σO∘π=σO\sigma_O \circ \pi = \sigma_OσO​∘π=σO​. Inequality (5) assumes at least one client, which the paper assumes implicitly: with no clients and S={s}S = \{s\}S={s} it would read −fs≥0-f_s \ge 0−fs​≥0. The goal and Lemma 4.2 need no such assumption.

A statement that assumes local optimality only for the moves the proof uses, that fixes OOO to be a global optimum defined by hypotheses, or that allows the empty set a zero service cost would be a different theorem; none of these is used.

Needed infrastructure: sums over nearest-facility assignments and their fibers NO(o)N_O(o)NO​(o), the permutation π\piπ, and bookkeeping of the three kinds of moves. The instance, cost and local optimality definitions are reusable for other local search analyses of metric location problems. Proofs of any milestone are welcome, as are alternative proofs of the goal.

Selected references

  • V. Arya, N. Garg, R. Khandekar, A. Meyerson, K. Munagala, V. Pandit, Local Search Heuristics for k-Median and Facility Location Problems, SIAM J. Comput. 33(3):544–562, 2004. https://doi.org/10.1137/S0097539702416402
  • M. R. Korupolu, C. G. Plaxton, R. Rajaraman, Analysis of a Local Search Heuristic for Facility Location Problems, J. Algorithms 37(1):146–188, 2000. https://doi.org/10.1006/jagm.2000.1100
  • M. Charikar, S. Guha, Improved Combinatorial Algorithms for the Facility Location and k-Median Problems, FOCS 1999, 378–388. https://doi.org/10.1109/SFFCS.1999.814609
10 thms4 active usersReviewed
🏆Completed
Machine LearningOptimization·Captain: naimengye

Understanding Machine Learning XV: Neural NetworksTextbook

Motivation

A feedforward neural network is a directed acyclic graph of neurons, each computing a fixed scalar activation of a weighted sum of its inputs; fixing the graph and the activation and letting the weights vary gives a hypothesis class. Chapter 20 of Shalev-Shwartz and Ben-David, Understanding Machine Learning: From Theory to Algorithms (doi:10.1017/CBO9781107298019), studies these classes through the book's three lenses. Approximation: every Boolean function is implemented by a network of depth 2 (Claim 20.1), but only at exponential size (Theorem 20.2), while a sign neuron implements conjunctions and disjunctions (Lemma 20.4), the bridge to Boolean circuits and hence to everything computable in bounded time. Estimation: the VC dimension of the class of sign networks over a graph with ∣E∣|E|∣E∣ edges is O(∣E∣log⁡∣E∣)O(|E|\log|E|)O(∣E∣log∣E∣) (Theorem 20.6), so the sample complexity is governed by the number of weights. Optimization: training is NP-hard even for tiny networks, and the practical answer is SGD with the gradient computed by backpropagation, whose correctness the chapter derives from the chain rule.

Setting

A layered graph has layers V0,…,VTV_0, \dots, V_TV0​,…,VT​, every edge joining Vt−1V_{t-1}Vt−1​ to VtV_tVt​; V0V_0V0​ holds the nnn inputs and a constant neuron outputting 111. With weights w:E→Rw : E \to \mathbb{R}w:E→R and an activation σ\sigmaσ, the outputs are computed layer by layer, at+1,i=∑j:(vt,j,vt+1,i)∈Ewt,i,j ot,ja_{t+1,i} = \sum_{j : (v_{t,j}, v_{t+1,i}) \in E} w_{t,i,j}\,o_{t,j}at+1,i​=∑j:(vt,j​,vt+1,i​)∈E​wt,i,j​ot,j​ and ot+1,i=σ(at+1,i)o_{t+1,i} = \sigma(a_{t+1,i})ot+1,i​=σ(at+1,i​). The class HV,E,σ={hV,E,σ,w:w:E→R}H_{V,E,\sigma} = \{h_{V,E,\sigma,w} : w : E \to \mathbb{R}\}HV,E,σ​={hV,E,σ,w​:w:E→R} (20.1); for binary classification the output layer is a single neuron and σ\sigmaσ is the sign function, so HV,E,sign⁡H_{V,E,\operatorname{sign}}HV,E,sign​ is a set of {±1}\{\pm1\}{±1}-valued predictors on Rn\mathbb{R}^nRn. The size of the network is ∣V∣|V|∣V∣, its depth TTT. The growth function τH(m)=max⁡∣C∣≤m∣HC∣\tau_H(m) = \max_{|C| \le m}|H_C|τH​(m)=max∣C∣≤m​∣HC​∣ extends to classes with any finite codomain (p. 275), and the proof of Theorem 20.6 uses two of its properties, stated as Exercises 3 and 4: the growth function of a product class is at most the product of the growth functions, and likewise for a composition class. For backpropagation the activation is any differentiable σ\sigmaσ and the loss is 12∥oT−y∥2\frac12\|o_T - y\|^221​∥oT​−y∥2; the backward pass sets δT=oT−y\delta_T = o_T - yδT​=oT​−y and δt=δt+1diag⁡(σ′(at+1))Wt\delta_t = \delta_{t+1}\operatorname{diag}(\sigma'(a_{t+1}))W_tδt​=δt+1​diag(σ′(at+1​))Wt​.

Formalization targets

Goal: Theorem 20.6

The VC dimension of HV,E,sign⁡H_{V,E,\operatorname{sign}}HV,E,sign​ is O(∣E∣log⁡∣E∣)O(|E|\log|E|)O(∣E∣log∣E∣). Explicitly, for a layered graph of depth at least 111 with a single output neuron,

VCdim⁡(HV,E,sign⁡)≤2∣E∣log⁡2(16∣E∣),\operatorname{VCdim}(H_{V,E,\operatorname{sign}}) \le 2|E|\log_2(16|E|),VCdim(HV,E,sign​)≤2∣E∣log2​(16∣E∣),

stated as: every m≤VCdim⁡m \le \operatorname{VCdim}m≤VCdim satisfies this bound (so the VC dimension is finite).

Milestones

Claim 20.1 (the depth-2 graph with ∣V1∣=2n+1|V_1| = 2^n + 1∣V1​∣=2n+1 whose sign class contains every function {±1}n→{±1}\{\pm1\}^n \to \{\pm1\}{±1}n→{±1}); Theorem 20.2 (every sign network implementing all functions {0,1}n→{0,1}\{0,1\}^n \to \{0,1\}{0,1}n→{0,1} has 2n/3≤2∣V∣2^{n/3} \le 2|V|2n/3≤2∣V∣); Lemma 20.4 (conjunction and disjunction as sign neurons); Exercise 4 (growth function of a composition); the correctness of backpropagation (§20.6: the partial derivative for the edge (vt,j,vt+1,i)(v_{t,j}, v_{t+1,i})(vt,j​,vt+1,i​) is δt+1,iσ′(at+1,i)ot,j\delta_{t+1,i}\sigma'(a_{t+1,i})o_{t,j}δt+1,i​σ′(at+1,i​)ot,j​). Further items: Exercise 3 (growth function of a product) and the intermediate bound τH(m)≤(em)∣E∣\tau_H(m) \le (em)^{|E|}τH​(m)≤(em)∣E∣ of the proof of Theorem 20.6.

Significance

Theorem 20.6 is the reason networks are learnable at all in the book's sense: by the fundamental theorem, a class with finite VC dimension is agnostic PAC learnable with sample complexity linear in that dimension, and here the dimension is essentially the number of tunable parameters. The proof technique, due to Kakade and Tewari's lecture notes, is a composition-and-product argument on growth functions that applies to any layered class of threshold units and is reusable well beyond this chapter. Theorem 20.2 is the matching negative fact on expressive power, and it is a corollary of the same bound: a class that shatters 2n2^n2n points needs Ω(2n)\Omega(2^n)Ω(2n) edges. Backpropagation's correctness is the one theorem about training the chapter can offer, given the hardness results, and it is the algorithm every practitioner runs.

Difficulty

Claim 20.1 and Lemma 20.4 are explicit constructions: the neuron gi(x)=sign⁡(⟨x,ui⟩−n+1)g_i(x) = \operatorname{sign}(\langle x, u_i\rangle - n + 1)gi​(x)=sign(⟨x,ui​⟩−n+1) detects x=uix = u_ix=ui​ because ⟨x,ui⟩≤n−2\langle x, u_i\rangle \le n - 2⟨x,ui​⟩≤n−2 otherwise, and the output neuron takes the disjunction; formally one must build the weight function and evaluate the forward pass on the 2n2^n2n inputs. Exercises 3 and 4 are counting: a restricted product is determined by its two restricted factors, and a restricted composition f2∘f1f_2 \circ f_1f2​∘f1​ on CCC is determined by f1∣Cf_1|_Cf1​∣C​ and f2∣f1(C)f_2|_{f_1(C)}f2​∣f1​(C)​, with ∣f1(C)∣≤∣C∣|f_1(C)| \le |C|∣f1​(C)∣≤∣C∣. Theorem 20.6 then needs: the class of one neuron is the class of homogenous halfspaces on its dt,id_{t,i}dt,i​ incoming coordinates, of VC dimension at most dt,id_{t,i}dt,i​ (Mission VI), Sauer's lemma in the form τ(m)≤(em)d\tau(m) \le (em)^{d}τ(m)≤(em)d for every m≥1m \ge 1m≥1 (Mission IV; for m≤dm \le dm≤d use 2m≤(em)m2^m \le (em)^m2m≤(em)m), the layer class as a product and the network as a composition of layer classes, and finally the arithmetic 2m≤(em)∣E∣⇒m≤2∣E∣log⁡2(16∣E∣)2^m \le (em)^{|E|} \Rightarrow m \le 2|E|\log_2(16|E|)2m≤(em)∣E∣⇒m≤2∣E∣log2​(16∣E∣), which replaces the book's appeal to Lemma A.2 (for m≥8∣E∣m \ge 8|E|m≥8∣E∣ one has ln⁡m≤mln⁡22∣E∣\ln m \le \frac{m\ln 2}{2|E|}lnm≤2∣E∣mln2​). Theorem 20.2 follows from the goal with ∣E∣≤∣V∣2|E| \le |V|^2∣E∣≤∣V∣2. Backpropagation is a chain-rule computation in a single real variable: the loss as a function of one weight is a composition of finitely many differentiable maps, and the derivative unwinds to the backward recursion; the formal effort is in the induction along layers with the natural-number indexing of the model.

Formalization scope

Layers and neurons are indexed by natural numbers: a LayeredGraph records the depth, the layer widths and, for each t<Tt < Tt<T, the finite set of edges (vt,j,vt+1,i)(v_{t,j}, v_{t+1,i})(vt,j​,vt+1,i​) as pairs (i,j)(i, j)(i,j) within the layer widths. Weights are functions on all index triples, and only those on edges are used, so the class is the image of all weight functions, as in (20.1). The forward computation netOutput is a recursion on the layer index; netInput is at+1,ia_{t+1,i}at+1,i​. The sign activation returns ±1\pm1±1 with sign⁡(0)=−1\operatorname{sign}(0) = -1sign(0)=−1, the book's convention elsewhere, and a neuron with no incoming edges outputs σ(0)\sigma(0)σ(0) (p. 270). The binary class signNetClass n G is Bool-valued, true iff the output neuron's input is positive, and is stated for graphs of depth at least 111 (for depth 000 the edges out of the input layer would be used but not counted in ∣E∣|E|∣E∣). Growth functions with finite codomain are growthY, an sSup over restriction sizes, well defined because the codomains are finite; the Bool case is Mission IV's growth, and VC dimension and shattering are Mission IV's. Theorem 20.6 and Theorem 20.2 are given with explicit constants derived from the proof, since O(⋅)O(\cdot)O(⋅) statements have no formal content; the drafter verified max⁡{m:2m≤(em)∣E∣}≤2∣E∣log⁡2(16∣E∣)\max\{m : 2^m \le (em)^{|E|}\} \le 2|E|\log_2(16|E|)max{m:2m≤(em)∣E∣}≤2∣E∣log2​(16∣E∣) numerically for ∣E∣|E|∣E∣ up to 300030003000 and at 104,…,10710^4, \dots, 10^7104,…,107, and 2n≤2∣V∣2log⁡2(16∣V∣2)≤8∣V∣32^n \le 2|V|^2\log_2(16|V|^2) \le 8|V|^32n≤2∣V∣2log2​(16∣V∣2)≤8∣V∣3. Backpropagation is stated for an arbitrary layered graph (phantom edges have weight 000, p. 279), any differentiable activation, and one edge at a time as a HasDerivAt of the loss in that weight; δt\delta_tδt​ is defined by recursion on T−tT - tT−t. The book's layer indices in (20.3) are shifted by one in the statement.

Not stated: Theorem 20.3 (Turing machines), Theorem 20.5 and Exercise 1 (sigmoid approximation, which needs a convention for outputs in [−1,1][-1,1][−1,1] that the chapter leaves open), Theorem 20.7 and Exercise 6 (NP-hardness), Exercise 5 (the Ω(∣E∣2)\Omega(|E|^2)Ω(∣E∣2) sigmoid lower bound, which assumes an exact threshold), the sigmoid half of Theorem 20.2, and the SGD pseudocode of §20.6, which is a heuristic without a stated guarantee.

Selected references

  • S. Shalev-Shwartz, S. Ben-David, Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press, 2014, Chapter 20. doi:10.1017/CBO9781107298019
  • M. Anthony, P. L. Bartlett, Neural Network Learning: Theoretical Foundations, Cambridge University Press, 1999. doi:10.1017/CBO9780511624216
  • D. E. Rumelhart, G. E. Hinton, R. J. Williams, Learning representations by back-propagating errors, Nature 323, 1986. doi:10.1038/323533a0
  • I. Parberry, Circuit Complexity and Neural Networks, MIT Press, 1994.
  • E. B. Baum, D. Haussler, What size net gives valid generalization?, Neural Computation 1(1), 1989. doi:10.1162/neco.1989.1.1.151
8 thms4 active usersReviewed
🏆Completed
Machine LearningProbabilityStatistics·Captain: naimengye

An Introduction to Computational Learning Theory III: The Vapnik-Chervonenkis Dimension, ε-Nets and Sample ComplexityTextbook

Motivation

Chapter 3 of Kearns and Vazirani, An Introduction to Computational Learning Theory (MIT Press, 1994, doi:10.7551/mitpress/3897.001.0001), asks how many random examples suffice to learn a concept from an infinite class. The cardinality bound of Occam's Razor is useless there, yet the rectangle game of Chapter 1 shows that some infinite classes are learnable from a finite sample. The answer is the Vapnik–Chervonenkis dimension: the size of the largest set on which the class realizes every labeling. Sauer's lemma says that a class of VC dimension ddd realizes only Φd(m)=∑i≤d(mi)≤(em/d)d\Phi_d(m) = \sum_{i \le d}\binom{m}{i} \le (em/d)^dΦd​(m)=∑i≤d​(im​)≤(em/d)d labelings on any mmm points, polynomially many rather than 2m2^m2m, and the ε-net theorem of Blumer, Ehrenfeucht, Haussler and Warmuth turns this into a sample bound: a consistent hypothesis from a class of VC dimension ddd is probably approximately correct once mmm is of order (1/ϵ)(log⁡(1/δ)+dlog⁡(1/ϵ))(1/\epsilon)(\log(1/\delta) + d\log(1/\epsilon))(1/ϵ)(log(1/δ)+dlog(1/ϵ)). A matching lower bound shows that Ω(d/ϵ)\Omega(d/\epsilon)Ω(d/ϵ) examples are necessary. The chapter thus gives a single combinatorial parameter that characterizes, up to a logarithmic factor, the sample complexity of learning any class in the distribution-free model.

Setting

For a class CCC of concepts X→{0,1}X \to \{0,1\}X→{0,1} and a finite S⊆XS \subseteq XS⊆X, ΠC(S)\Pi_C(S)ΠC​(S) is the set of dichotomies of SSS realized by CCC; SSS is shattered if all 2∣S∣2^{|S|}2∣S∣ are realized; VCD(C)\mathrm{VCD}(C)VCD(C) is the supremum of the sizes of shattered sets, possibly ∞\infty∞; ΠC(m)\Pi_C(m)ΠC​(m) is the largest ∣ΠC(S)∣|\Pi_C(S)|∣ΠC​(S)∣ over ∣S∣=m|S| = m∣S∣=m; and Φd(m)\Phi_d(m)Φd​(m) is defined by Φd(m)=Φd(m−1)+Φd−1(m−1)\Phi_d(m) = \Phi_d(m-1) + \Phi_{d-1}(m-1)Φd​(m)=Φd​(m−1)+Φd−1​(m−1), Φd(0)=Φ0(m)=1\Phi_d(0) = \Phi_0(m) = 1Φd​(0)=Φ0​(m)=1. For a target ccc the error regions are c Δ hc \,\Delta\, hcΔh for hhh in the hypothesis class, and a set of points is an ε-net if it meets every error region of weight at least ϵ\epsilonϵ under the target distribution DDD. Samples, their product law, consistency and the error of a hypothesis are those of Mission I.

Formalization targets

Goal: Theorems 3.3 and 3.4

Let HHH be a class of VC dimension at most ddd, well-behaved for the target ccc (the double-sample event of the proof is null-measurable), and m≥8/ϵm \ge 8/\epsilonm≥8/ϵ. The points of a random sample of mmm examples of a target ccc fail to be an ε-net for the error regions {c Δ h:h∈H}\{c \,\Delta\, h : h \in H\}{cΔh:h∈H} with probability at most

2 Φd(2m) 2−ϵm/2,2\,\Phi_d(2m)\,2^{-\epsilon m/2},2Φd​(2m)2−ϵm/2,

so any algorithm that outputs a hypothesis in HHH consistent with its sample has error greater than ϵ\epsilonϵ with at most that probability; with m≥(4/ϵ)log⁡2(2/δ)m \ge (4/\epsilon)\log_2(2/\delta)m≥(4/ϵ)log2​(2/δ) and m≥(8d/ϵ)log⁡2(13/ϵ)m \ge (8d/\epsilon)\log_2(13/\epsilon)m≥(8d/ϵ)log2​(13/ϵ) the probability is at most δ\deltaδ; and, if HHH is nonempty, every class contained in HHH for whose targets HHH is well-behaved is PAC learnable using HHH.

Milestones

Lemma 3.1 (Sauer's lemma, ΠC(m)≤Φd(m)\Pi_C(m) \le \Phi_d(m)ΠC​(m)≤Φd​(m)); Lemma 3.2 (Φd(m)=∑i≤d(mi)\Phi_d(m) = \sum_{i \le d}\binom{m}{i}Φd​(m)=∑i≤d​(im​)); the polynomial bound Φd(m)≤(em/d)d\Phi_d(m) \le (em/d)^dΦd​(m)≤(em/d)d of p. 57; Theorem 3.5 (the Ω(d/ϵ)\Omega(d/\epsilon)Ω(d/ϵ) lower bound, in the two explicit forms of its proof).

Significance

Theorem 3.3 is the fundamental theorem of PAC learning: it replaces log⁡∣H∣\log|H|log∣H∣ in Occam's Razor by the VC dimension and thereby covers rectangles, halfspaces, polygons, neural networks with a fixed architecture, and every class whose dichotomies grow polynomially. Its proof, the double sample and random partition argument, is the origin of symmetrization in empirical process theory. Sauer's lemma is a cornerstone of extremal combinatorics with independent proofs by Sauer, Shelah and Vapnik–Chervonenkis, and the lower bound of Theorem 3.5 shows that the upper bound is tight to within log⁡(1/ϵ)\log(1/\epsilon)log(1/ϵ), so the VC dimension genuinely characterizes sample complexity. None of these is machine-checked. Formalizing them puts on the platform the VC dimension, the growth function and the ε-net theorem with explicit constants, stated on the same sample law as the rest of this series, and the first information-theoretic lower bound for learning.

Difficulty

Sauer's lemma is a double induction on ddd and mmm through the auxiliary class C′C'C′ of dichotomies whose two extensions to a distinguished point are both realized, which needs care with the identification of dichotomies of SSS and of S∖{x}S \setminus \{x\}S∖{x}. The ε-net theorem needs: the reduction Pr⁡[A]≤2Pr⁡[B]\Pr[A] \le 2\Pr[B]Pr[A]≤2Pr[B] from a failed ε-net on the first half to a region hit at least ϵm/2\epsilon m/2ϵm/2 times by the second half, which is a Chebyshev bound on a binomial variable and is where m≥8/ϵm \ge 8/\epsilonm≥8/ϵ enters; the exchangeability of the 2m2m2m draws with a random partition into two halves; the counting bound (mℓ)/(2mℓ)≤2−ℓ\binom{m}{\ell}/\binom{2m}{\ell} \le 2^{-\ell}(ℓm​)/(ℓ2m​)≤2−ℓ; and Sauer's lemma applied to the error regions, whose growth function equals that of HHH. The explicit constants require the numerical inequality 2(2em/d)d2−ϵm/2≤δ2(2em/d)^d 2^{-\epsilon m/2} \le \delta2(2em/d)d2−ϵm/2≤δ under the two stated conditions. The lower bound is a probabilistic argument with a random target: conditional on the sample, the labels of unseen points are fair coins, so the number of errors on them is binomial and exceeds half its range with probability at least 1/21/21/2; the refined bound scales this construction to a region of weight 16ϵ16\epsilon16ϵ and uses Markov's inequality to bound the number of draws landing in it. Measurability of the failure sets is avoided by stating outer-measure bounds, except for the double-sample event, which the proof integrates: it is assumed null-measurable (the well-behavedness of Blumer et al., without which the theorem is false for a class of VC dimension 111 on ω1\omega_1ω1​). For the lower bound it is avoided by working over a finitely supported distribution on a space with measurable singletons.

Formalization scope

The VC dimension is a supremum in N∪{∞}\mathbb{N} \cup \{\infty\}N∪{∞}, the growth function a supremum in N\mathbb{N}N (bounded by 2m2^m2m), and Φd\Phi_dΦd​ the book's recurrence, with its closed form and polynomial bound stated as separate theorems. The goal is stated for a hypothesis class HHH (Theorem 3.4), Theorem 3.3 being the case C=HC = HC=H; it carries the exact bound of the proof, the explicit constants of Blumer et al. in place of the book's c0c_0c0​, the requirement m≥8/ϵm \ge 8/\epsilonm≥8/ϵ of the proof's Chebyshev step, measurability of the hypotheses and the target, well-behavedness of HHH for the target, and 0<ϵ,δ<10 < \epsilon, \delta < 10<ϵ,δ<1. PAC learnability of the subclasses of HHH needs HHH nonempty, since no algorithm outputs hypotheses in the empty class. The lower bound is stated for every deterministic learning function, on an instance space with measurable singletons, for a class shattering some set of d≥1d \ge 1d≥1 points, with the explicit constants derived in the proof sketch (m≤d/2m \le d/2m≤d/2: error ≥1/8\ge 1/8≥1/8 with probability ≥1/2\ge 1/2≥1/2; ϵ≤1/16\epsilon \le 1/16ϵ≤1/16 and m≤(d−1)/(64ϵ)m \le (d-1)/(64\epsilon)m≤(d−1)/(64ϵ): error >ϵ> \epsilon>ϵ with probability ≥1/4\ge 1/4≥1/4). Running time is not modelled. The composition bound for layered networks (Theorems 3.6 and 3.7) is not stated.

Trivializing readings are excluded: the ε-net event ranges over every hypothesis of HHH, the failure bounds are uniform over all consistent learners, and the lower bound holds for every learning function. Welcome contributions: Sauer's lemma, the closed form and the (em/d)d(em/d)^d(em/d)d bound, the random-partition counting lemma, and the binomial median inequality used in the lower bound.

Selected references

  • M. J. Kearns, U. V. Vazirani, An Introduction to Computational Learning Theory, MIT Press, 1994, Chapter 3. doi:10.7551/mitpress/3897.001.0001
  • A. Blumer, A. Ehrenfeucht, D. Haussler, M. K. Warmuth, Learnability and the Vapnik–Chervonenkis dimension, Journal of the ACM 36(4), 1989. doi:10.1145/76359.76371
  • V. N. Vapnik, A. Ya. Chervonenkis, On the uniform convergence of relative frequencies of events to their probabilities, Theory of Probability and its Applications 16(2), 1971. doi:10.1137/1116025
  • N. Sauer, On the density of families of sets, Journal of Combinatorial Theory, Series A 13(1), 1972. doi:10.1016/0097-3165(72)90019-2
  • A. Ehrenfeucht, D. Haussler, M. Kearns, L. Valiant, A general lower bound on the number of examples needed for learning, Information and Computation 82(3), 1989. doi:10.1016/0890-5401(89)90002-3
8 thms4 active usersReviewed
🏆Completed
Captain: Yuxuan Xu

Magic Squares V: The Counting Function of Semi-Magic Squares of Every OrderResearch Paper

Motivation

The magic-square programme already on this platform works at fixed small orders: MacMahon's enumeration of the 3×33\times33×3 squares, both the magic count M3(3e)=2e2+2e+1M_{3}(3e)=2e^{2}+2e+1M3​(3e)=2e2+2e+1 and the semi-magic count H3(t)=3(t+34)+(t+22)H_{3}(t)=3\binom{t+3}{4}+\binom{t+2}{2}H3​(t)=3(4t+3​)+(2t+2​); the classification of the normal 3×33\times33×3 squares; and the counts of the panmagic and symmetric order-three classes. Each of those is a statement about a single order. This mission changes the axis: it asks what the counting function does when the order itself is allowed to vary.

Timeline.

  • 1915 — MacMahon determines H3H_{3}H3​ and M3M_{3}M3​ explicitly [MacMahon 1960].
  • 1966 — Anand, Dumir and Gupta conjecture that Hn(t)H_{n}(t)Hn​(t), as a function of the line sum ttt, is a polynomial of degree (n−1)2(n-1)^{2}(n−1)2 for every order nnn [Anand-Dumir-Gupta 1966].
  • 1973 — the conjecture is proved independently by Ehrhart, from linear Diophantine systems [Ehrhart 1973], and by Stanley, from linear homogeneous Diophantine equations and the magic labelings of graphs [Stanley 1973].
  • 1980 — Spencer gives an elementary proof [Spencer 1980].
  • 2002–2003 — Beck and Pixton compute the Ehrhart polynomial of the Birkhoff polytope at order four [Beck-Pixton 2002]; Beck, Cohen, Cuomo and Gribelyuk extend the structural picture to the magic, symmetric and pan-diagonal counts, which are quasi-polynomials rather than polynomials [BCCG 2003].

That split is the point of the mission, so it is worth naming before anything is proved. A quasi-polynomial of degree ddd and period mmm agrees with a degree-ddd polynomial on each residue class modulo mmm, the polynomials differing between classes; a polynomial is the case m=1m=1m=1. For the magic squares the values do depend on ttt modulo a period — at order three M3(t)M_{3}(t)M3​(t) vanishes unless 3∣t3\mid t3∣t — and the same is true of every other class. For HnH_{n}Hn​ it never happens.

Setting

An n×nn\times nn×n semi-magic square of line sum ttt is an n×nn\times nn×n array of nonnegative integers in which every row and every column sums to ttt. Entries may repeat, and no condition is placed on the diagonals. Write Hn(t)H_{n}(t)Hn​(t) for the number of such arrays.

In Lean the array is a Square n ℕ, that is, a Matrix (Fin n) (Fin n) ℕ; the condition is IsSemiMagic M t, which asks every rowSum and every colSum to equal t; and the counting function is semiMagicCount n t, the cardinality of the finset of all arrays over Fin (t + 1) satisfying IsSemiMagic. Restricting the entries to Fin (t + 1) loses nothing, since an entry of a square of line sum ttt is at most ttt.

Dividing by ttt turns such an array into a doubly stochastic matrix, a nonnegative real matrix whose every row and column sums to 111. So Hn(t)H_{n}(t)Hn​(t) is equally the number of lattice points in the ttt-fold dilation of the Birkhoff polytope BnB_{n}Bn​. Two geometric facts about BnB_{n}Bn​ are what the mission is about. Its dimension is (n−1)2(n-1)^{2}(n−1)2: the n2n^{2}n2 entries satisfy 2n2n2n line equations, exactly one of which is dependent. Its vertices are the n!n!n! permutation matrices, by the Birkhoff–von Neumann theorem, hence integral. The mission states that both facts are visible in the arithmetic of HnH_{n}Hn​.

Formalization targets

Goal — the counting function is a polynomial

∃ p∈Q[X]:deg⁡p=(n−1)2,p(t)=Hn(t)  for all t∈N,\exists\, p\in\mathbb{Q}[X]:\quad \deg p=(n-1)^{2},\qquad p(t)=H_{n}(t)\ \text{ for all }t\in\mathbb{N},∃p∈Q[X]:degp=(n−1)2,p(t)=Hn​(t)  for all t∈N, p(−n−t)=(−1)n−1p(t)  for all t∈Z,p(−1)=p(−2)=⋯=p(−n+1)=0.p(-n-t)=(-1)^{n-1}p(t)\ \text{ for all }t\in\mathbb{Z},\qquad p(-1)=p(-2)=\cdots=p(-n+1)=0 .p(−n−t)=(−1)n−1p(t)  for all t∈Z,p(−1)=p(−2)=⋯=p(−n+1)=0.

This is Theorem 1 of [BCCG 2003], stated there for n≥1n\ge 1n≥1. It is the shape of the truth, not a closed form, so no later improvement of the explicit formulas can invalidate it. The three parts are not independent: the degree is the dimension of BnB_{n}Bn​, and the two identities are the reciprocity law for lattice-point counting, applied to BnB_{n}Bn​.

The intermediate rungs

The goal is far from the easy cases, and the mission is laid out so that each rung is an independently provable statement.

  • Order one. H1(t)=1H_{1}(t)=1H1​(t)=1: a 1×11\times11×1 array of line sum ttt is just [t][t][t].
  • Orders two and three. Already proved on the platform, as MagicSquares.semi_magic_count_two (H2(t)=t+1H_{2}(t)=t+1H2​(t)=t+1) and MagicSquares.semi_magic_count_three (MacMahon's H3(t)=3(t+34)+(t+22)H_{3}(t)=3\binom{t+3}{4}+\binom{t+2}{2}H3​(t)=3(4t+3​)+(2t+2​)). Included as references, not as targets.
  • Order four, with the denominators cleared so that it is an identity between natural numbers:
11340⋅H4(t)=11t9+198t8+1596t7+7560t6+23289t5+48762t4+70234t3+68220t2+40950t+11340.11340\cdot H_{4}(t)=11t^{9}+198t^{8}+1596t^{7}+7560t^{6}+23289t^{5}+48762t^{4}+70234t^{3}+68220t^{2}+40950t+11340 .11340⋅H4​(t)=11t9+198t8+1596t7+7560t6+23289t5+48762t4+70234t3+68220t2+40950t+11340.

Its leading coefficient is 1111340=vol⁡(B4)\tfrac{11}{11340}=\operatorname{vol}(B_{4})1134011​=vol(B4​) and its normalised volume is 352352352.

  • Existence and degree, uniformly in nnn. The polynomial exists, with degree exactly (n−1)2(n-1)^{2}(n−1)2.
  • The reciprocity identity and the vanishing list, for that polynomial.

Significance

The result itself. The theorem makes the semi-magic squares countable in closed form at every order, and it is why the semi-magic count can be tabulated as a polynomial while the magic, symmetric and pandiagonal counts cannot: a polynomial is determined by finitely many values, a quasi-polynomial is not without knowing its period. The reciprocity identities are the same statement seen from the interior of BnB_{n}Bn​, which is why they are what pins an explicit polynomial down once its degree is known. The order-four polynomial above was verified against direct enumeration on seventeen values of ttt; that verification is evidence, not proof, and is recorded because the general statement is what has to be proved.

Formalizing it. The theorem has been known since 1973 and has had an elementary proof since 1980; what does not exist anywhere is a machine-checked proof. Mathlib contains no Ehrhart theory, no quasi-polynomial machinery and no rational-generating-function toolbox — the string "Ehrhart" does not occur in it — so a formalization must construct its own lattice-point-counting argument for this family of polytopes, or find an elementary route that avoids polytopes altogether. Either outcome is reusable: the same absence blocks the quasi-polynomial counts MnM_{n}Mn​, SnS_{n}Sn​ and PnP_{n}Pn​ of BCCG's Theorem 2, which the earlier missions approach only at order three.

Difficulty

The first idea anyone has is to interpolate: compute Hn(t)H_{n}(t)Hn​(t) for enough values of ttt and fit a polynomial. That works, and it is how the order-four rung was produced, but it cannot prove the general statement: the degree is what is being asserted, so the number of values needed is not known in advance, and with nnn itself a variable no finite computation settles it. Interpolation is legitimate as a target at order four; it must not be mistaken for a route to the goal.

The second idea is to import the geometry as a black box: a rational polytope dilated by ttt has a counting function that is a quasi-polynomial of degree equal to its dimension, with period dividing the least common multiple of the vertex denominators. That is Ehrhart's theorem, and it is the textbook route. It is not available here, and reconstructing it in general is a larger project than this mission; the statements the mission asks for are the ones that survive without it.

The part of the goal with no counting interpretation at all is the second line. HnH_{n}Hn​ is defined on N\mathbb{N}N; the assertion that a polynomial agreeing with it there vanishes at −1,…,−(n−1)-1,\dots,-(n-1)−1,…,−(n−1) and satisfies p(−n−t)=(−1)n−1p(t)p(-n-t)=(-1)^{n-1}p(t)p(−n−t)=(−1)n−1p(t) is a statement about the interior of the polytope, and it cannot be read off from the combinatorial definition. A solver who proves only the polynomiality and the degree has not finished the goal.

Formalization scope

The formalization commits to the following conventions.

  • The counting function is semiMagicCount n t, the Finset.card of the arrays over Square n (Fin (t+1)) satisfying IsSemiMagic. Entries are natural numbers, not integers or reals.
  • The polynomial is over ℚ and is quantified existentially. Negative arguments are handled by casting the integer into ℚ and evaluating there; Polynomial.eval₂ is unusable for the reciprocity, since it would need a ring homomorphism Q→Z\mathbb{Q}\to\mathbb{Z}Q→Z, which does not exist.
  • The degree is encoded as p.natDegree = (n - 1) ^ 2, with natural-number subtraction, which makes the n=1n=1n=1 case harmless rather than degenerate.
  • The hypothesis 1 ≤ n is carried explicitly although the statement is meaningful at n=0n=0n=0; it matches the source.
  • A trivializing formalization to avoid: replacing ∀ t by a finite range of values, or replacing semiMagicCount by a smooth surrogate, would make the statement easy and empty. The universal quantifier over ttt and the exact value of natDegree are what give the goal its content.

Reusable beyond this mission: any development of lattice-point counting in the Birkhoff polytope, of dilations of rational polytopes, or of quasi-polynomials. The vocabulary of the programme (MagicSquares, MagicSquaresPandiagonal, MagicSquaresMostPerfect, MagicSquaresTransforms, MagicSquaresNormal3) is shared with the earlier missions and is included as reference items rather than redefined.

Selected references

  • P. A. MacMahon, Combinatory Analysis, Chelsea, New York, 1960.
  • H. Anand, V. C. Dumir and H. Gupta, A combinatorial distribution problem, Duke Math. J. 33 (1966) 757--769.
  • E. Ehrhart, Sur les carrés magiques, C. R. Acad. Sci. Paris Sér. A-B 277 (1973) A651--A654.
  • R. P. Stanley, Linear homogeneous Diophantine equations and magic labelings of graphs, Duke Math. J. 40 (1973) 607--632.
  • J. Spencer, Counting magic squares, Amer. Math. Monthly 87 (1980) 397--399.
  • M. Beck and D. Pixton, The Ehrhart polynomial of the Birkhoff polytope, arXiv:math.CO/0202267 — https://arxiv.org/abs/math/CO/0202267
  • M. Beck, M. Cohen, J. Cuomo and P. Gribelyuk, The number of "magic" squares, cubes and hypercubes, Amer. Math. Monthly 110 (2003) 707--717 — https://arxiv.org/abs/math/0201013
  • G. M. Ziegler, Lectures on Polytopes, Springer-Verlag, New York, 1995.
31 thms4 active usersReviewed
🏆Completed
Number Theory·Captain: aarontcao

Shao's three units theorem: density 5/8 forces a three-fold additive basisResearch Paper

Let mmm be an odd squarefree positive integer and let AAA be a set of units modulo mmm with ∣A∣>58φ(m)|A| > \frac{5}{8}\varphi(m)∣A∣>85​φ(m). Then A+A+A=Z/mZA + A + A = \mathbb{Z}/m\mathbb{Z}A+A+A=Z/mZ: every residue class, unit or not, is a sum of three elements of AAA.

This is Corollary 1.5 of Xuancheng Shao, A density version of the Vinogradov three primes theorem, Duke Math. J. 163 (2014) 489-512, arXiv:1206.6139v2. It is the local input to Shao's density version of the three primes theorem, and it is a clean finite statement in its own right.

The constant is sharp and the inequality is strict

At m=15m = 15m=15 the set {2,8,11,13,14}\{2, 8, 11, 13, 14\}{2,8,11,13,14} has five elements, so 5φ(15)=8⋅55\varphi(15) = 8 \cdot 55φ(15)=8⋅5 exactly, and 111 is not a sum of three of its elements. The hypothesis therefore fails by nothing at all and the conclusion already fails. If <<< is weakened to ≤\le≤, the statement is false.

Where the proof comes from

The corollary cannot be proved by induction on sets. Passing from mmm to a prime factor ppp splits AAA into fibers of different densities, and a set is the wrong object to carry through that split. The induction has to run on functions f:Z/mZ→[0,1]f : \mathbb{Z}/m\mathbb{Z} \to [0,1]f:Z/mZ→[0,1], and the corollary is the case f=1Af = 1_Af=1A​ of a weighted statement, Proposition 1.4. That is the one step from which the rest follows.

The weighted statement then splits at the primes 3 and 5. For mmm coprime to 30 the induction runs on the prime factors, using Cauchy-Davenport-Chowla for three sets modulo a prime, and it produces the stronger bilinear conclusion f(a)f(b)+f(b)f(c)+f(c)f(a)>58(f(a)+f(b)+f(c))f(a)f(b) + f(b)f(c) + f(c)f(a) > \frac{5}{8}(f(a) + f(b) + f(c))f(a)f(b)+f(b)f(c)+f(c)f(a)>85​(f(a)+f(b)+f(c)). The modulus 15 is handled separately by a linear program over the eight units. Two averaging inequalities, one symmetric and one asymmetric, are what turn a density above 5/85/85/8 into a single good triple in both halves.

What the milestones are

The nine milestones follow Shao's own numbering: the two averaging inequalities of Section 2 (Lemmas 2.1 and 2.2), the finite check at m=15m = 15m=15 (Lemma 2.3), the three-set Cauchy-Davenport-Chowla bound, the divisor reduction that lets the proof assume 15∣m15 \mid m15∣m, the induction away from 3 and 5 (Proposition 3.1), the modulus-15 case (Proposition 3.2), the weighted local result (Proposition 1.4), and the counting bridge that the units modulo mmm number φ(m)\varphi(m)φ(m).

Notes on the formalization

Every item is stated in Mathlib primitives alone, so the mission needs no definition items: IsUnit, Nat.totient, Odd, Squarefree, Finset, and Antitone. The set of units modulo mmm is written Finset.univ.filter (fun x => IsUnit x) at each use rather than through a defined abbreviation, so a reader auditing a statement has to trust only Mathlib. That is also why open scoped Classical appears in the preamble.

The density hypothesis is written 5 * Nat.totient m < 8 * A.card, which is ∣A∣>58φ(m)|A| > \frac{5}{8}\varphi(m)∣A∣>85​φ(m) cleared of division so the whole statement stays in N\mathbb{N}N with no rounding.

10 thms4 active usersReviewed
PreviousPage 2 of 14Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me