Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Combinatorics

627 missions · 347 completed

The mathematics of finite and discrete structures — counting the arrangements of a set, deciding when a configuration meeting prescribed constraints can exist, and characterizing the patterns such structures are forced to contain. It encompasses enumerative and extremal combinatorics, graph theory, design theory, and additive combinatorics, with deep ties to algebra, probability, and computer science.

Missions

Open280Completed347All627
Linear Optimization·Captain: Shuze Chen

The Polynomial Hirsch ConjectureOpen Problem

Motivation

The simplex method walks along edges of a polytope from vertex to vertex. Whether any pivot rule could ever make that walk short in the worst case is governed by a prior, purely geometric question: how far apart, in the edge graph, can two vertices of a polytope be? Warren Hirsch conjectured in 1957 that the diameter of a ddd-dimensional polytope with nnn facets is at most n−dn - dn−d. Half a century of upper bounds stalled at quasi-polynomial, and Santos disproved the conjecture itself in 2012 — but only by a constant factor. The surviving question, the subject of the Polymath 3 project, is the polynomial Hirsch conjecture: is the diameter bounded by a polynomial in nnn and ddd?

Timeline

  • 1957. Hirsch states the conjecture diam≤n−d\mathrm{diam} \le n - ddiam≤n−d in a letter to Dantzig, who publishes it in Linear Programming and Extensions (1963).
  • 1964–1966. Klee determines the exact maximum diameter of 333-polytopes with nnn facets, ⌊2n/3⌋−1\lfloor 2n/3\rfloor - 1⌊2n/3⌋−1 — the Hirsch bound holds up to dimension three.
  • 1967. Klee and Walkup (Acta Math.) refute the unbounded-polyhedron version, prove the bounded conjecture for n−d≤5n - d \le 5n−d≤5, and reduce the general case to the ddd-step conjecture (n=2dn = 2dn=2d).
  • 1970. Larman (Proc. LMS) proves diam≤n 2d−3\mathrm{diam} \le n\,2^{d-3}diam≤n2d−3 — linear in the number of facets for each fixed dimension, still the best bound of that shape.
  • 1989. Naddef (Math. Programming) proves 0/10/10/1-polytopes satisfy the Hirsch bound, with diameter at most ddd.
  • 1992. Kalai and Kleitman (Bull. AMS) prove diam≤nlog⁡2d+2\mathrm{diam} \le n^{\log_2 d + 2}diam≤nlog2​d+2 in under a page — the quasi-polynomial barrier every later bound refines. The same year brings subexponential pivot rules (Kalai; Matoušek–Sharir–Welzl), the algorithmic counterpart.
  • 2010. Eisenbrand, Hähnle, Razborov, and Rothvoß (Math. OR) show the known upper-bound arguments survive in a purely combinatorial abstraction — which admits almost-quadratic lower bounds, so a polynomial bound must use real geometry. Kalai launches Polymath 3 on the polynomial version.
  • 2010–2012. Santos (Annals of Math.) disproves the Hirsch conjecture: a 434343-dimensional polytope with 868686 facets and diameter at least 444444, via spindles of large width.
  • 2014–2019. Todd (SIAM J. Discrete Math.) sharpens Kalai–Kleitman to (n−d)log⁡2d(n-d)^{\log_2 d}(n−d)log2​d; Sukegawa refines further. Matschke, Santos, and Weibel (Proc. LMS 2015) shrink the counterexample to dimension 202020 with 404040 facets and diameter 212121. All known violations remain constant-factor; all known bounds remain quasi-polynomial.

Setting

Work in Rd\mathbb{R}^dRd. An H-polytope is a set cut out by finitely many linear inequalities: given vectors a1,…,an∈Rda_1, \dots, a_n \in \mathbb{R}^da1​,…,an​∈Rd and reals b1,…,bnb_1, \dots, b_nb1​,…,bn​, it is

P  =  { x∈Rd∣⟨ai,x⟩≤bi for i=1,…,n },P \;=\; \{\, x \in \mathbb{R}^d \mid \langle a_i, x\rangle \le b_i \text{ for } i = 1, \dots, n \,\},P={x∈Rd∣⟨ai​,x⟩≤bi​ for i=1,…,n},

where ⟨ai,x⟩=∑j=1daijxj\langle a_i, x\rangle = \sum_{j=1}^d a_{ij} x_j⟨ai​,x⟩=∑j=1d​aij​xj​ is the standard inner (dot) product — so each condition ⟨ai,x⟩≤bi\langle a_i, x\rangle \le b_i⟨ai​,x⟩≤bi​ is one linear inequality, with normal vector aia_iai​ and offset bib_ibi​. Throughout, PPP is assumed nonempty and bounded. The parameter nnn counts the inequalities in the given description; since every polytope with fff facets admits a description by exactly fff inequalities, bounds stated in terms of nnn over all descriptions are equivalent to bounds in terms of facet counts.

A vertex of PPP is an extreme point. Two vertices u≠vu \ne vu=v are adjacent when the segment [u,v][u, v][u,v] is an extreme subset of PPP; for a polytope the convex extreme subsets are exactly the faces, so this says precisely that [u,v][u,v][u,v] is a one-dimensional face — an edge. The combinatorial diameter of PPP is the diameter of the graph of vertices and edges. Throughout, "diameter at most BBB" is expressed as: every two vertices are joined by a walk of BBB steps, each step staying put or crossing an edge — a form that is monotone in BBB and asserts connectivity of the graph (Balinski's theorem) as part of the claim.

Formalization targets

Goal — the polynomial Hirsch conjecture

∃ c,k∈N: every nonempty bounded P={x∈Rd∣⟨ai,x⟩≤bi, i≤n} has diameter≤c (n+d)k.\exists\, c, k \in \mathbb{N}:\ \text{every nonempty bounded } P = \{x \in \mathbb{R}^d \mid \langle a_i, x \rangle \le b_i,\ i \le n\} \text{ has diameter} \le c\,(n + d)^k.∃c,k∈N: every nonempty bounded P={x∈Rd∣⟨ai​,x⟩≤bi​, i≤n} has diameter≤c(n+d)k.

Every polynomial in nnn and ddd is dominated by some c(n+d)kc(n+d)^kc(n+d)k and conversely, so this is exactly polynomiality, with no committed degree — the form that survives any future sharpening of constants or exponents.

Milestones — the known ladder

Six classical results over the same definitions: the Hirsch bound n−dn - dn−d in dimension d≤3d \le 3d≤3 (Klee; Klee–Walkup); Larman's bound n⋅2d−3n \cdot 2^{d-3}n⋅2d−3; Naddef's bound ddd for 0/10/10/1-polytopes; the Kalai–Kleitman bound nlog⁡2d+2n^{\log_2 d + 2}nlog2​d+2; Todd's bound (n−d)log⁡2d(n-d)^{\log_2 d}(n−d)log2​d for full-dimensional PPP with n≥d≥3n \ge d \ge 3n≥d≥3; and — in the other direction — the Santos counterexample: a nonempty bounded H-polytope whose diameter exceeds n−dn - dn−d.

Significance

A polynomial diameter bound is necessary for any pivot rule of the simplex method to run in polynomial time in the worst case: if vertices can be super-polynomially far apart, no edge-following algorithm can connect them quickly. A refutation would close off one of the main hoped-for routes to a strongly polynomial linear programming algorithm (Smale's ninth problem). The conjecture is also the test question of polyhedral graph theory: the Kalai–Kleitman argument uses so little about polytopes that it holds for far more general set systems, and Eisenbrand, Hähnle, Razborov, and Rothvoß (Math. OR 2010) showed such abstractions admit almost-quadratic lower bounds — so a proof of the conjecture must use geometry the abstract setting lacks, and a disproof must beat the abstraction barrier's constructions with actual polytopes.

None of these results has been formalized in any proof assistant; Mathlib has extreme points and faces of convex sets, but no polytope combinatorics — no vertex-edge graph, no diameter, no facet counting. This mission builds that layer: an H-polytope model, adjacency via faces, and walk-based diameter bounds, against which both the upper-bound ladder and the Santos disproof can be machine-checked. The Kalai–Kleitman proof is one page from first principles and is the natural summit; the Santos construction is a concrete finite object whose verification is a different, computational kind of challenge.

Difficulty

The naive approach — walk toward the target vertex by always improving some linear objective — is exactly the simplex method, and proving any polynomial bound on such walks is open for every known pivot rule; monotone variants of the diameter question have exponential lower bounds. The obvious inductive strategy (bound the diameter by recursing on facets) is precisely what Kalai–Kleitman optimizes, and it provably cannot go below quasi-polynomial without using metric or topological properties of actual polytopes, by the abstraction lower bound above. On the other side, making diameters large is blocked by the wedge/spindle calculus only producing constant-factor violations. The problem sits in a genuine gap: no technique on either side is known to reach polynomial.

Formalization scope

The Lean model commits to: ambient space EuclideanSpace ℝ (Fin d); the polytope as Hpoly a b = {x | ∀ i, ⟪a i, x⟫ ≤ b i} for a : Fin n → EuclideanSpace ℝ (Fin d), b : Fin n → ℝ, with nonemptiness and Bornology.IsBounded as explicit hypotheses (boundedness is essential: Klee–Walkup's unbounded counterexample would otherwise trivialize the Santos milestone); vertices as Set.extremePoints ℝ; adjacency as u ≠ v ∧ IsExtreme ℝ P (segment ℝ u v); and diameter bounds as the walk predicate DiamLE, whose stationary steps make it monotone in the bound. Real-exponent bounds enter through Real.logb and the natural floor. In larman_bound and the two Hirsch-form bounds the subtraction is natural-number (truncated) subtraction, which only weakens nothing: the stated forms are true as written for all n,dn, dn,d in scope. The dimension parameter ddd is the ambient dimension; lower-dimensional polytopes are included, and every milestone is stated so as to remain true for them, with todd_bound requiring full-dimensionality ((interior P).Nonempty) as in its source.

Welcome contributions: any milestone in any order (dimension_three_bound for d≤1d \le 1d≤1 cases and structural lemmas about Adj and DiamLE are natural entry points, and kalai_kleitman_bound is the summit); reusable infrastructure — polytopes have finitely many extreme points, faces of H-polytopes, Balinski connectivity — published as platform theorems; and, as a separate expedition, the explicit Santos or Matschke–Santos–Weibel polytope. Statements about unbounded polyhedra, the simplex method itself, and subexponential pivot rules are left to future missions.

Selected references

  • V. Klee, D. Walkup, The d-step conjecture for polyhedra of dimension d < 6, Acta Math. 117 (1967). doi:10.1007/BF02392971
  • D. Larman, Paths on polytopes, Proc. London Math. Soc. 20 (1970). doi:10.1112/plms/s3-20.2.249
  • D. Naddef, The Hirsch conjecture is true for (0,1)-polytopes, Math. Programming 45 (1989). doi:10.1007/BF01589418
  • G. Kalai, D. Kleitman, A quasi-polynomial bound for the diameter of graphs of polyhedra, Bull. AMS 26 (1992). arXiv:math/9204233
  • F. Santos, A counterexample to the Hirsch conjecture, Annals of Mathematics 176 (2012). arXiv:1006.2814
  • M. Todd, An improved Kalai–Kleitman bound for the diameter of a polyhedron, SIAM J. Discrete Math. 28 (2014). arXiv:1402.3579
  • B. Matschke, F. Santos, C. Weibel, The width of five-dimensional prismatoids, Proc. London Math. Soc. 110 (2015). arXiv:1202.4701
  • F. Eisenbrand, N. Hähnle, A. Razborov, T. Rothvoß, Diameter of polyhedra: limits of abstraction, Math. Oper. Res. 35 (2010). doi:10.1287/moor.1100.0470
  • F. Santos, Recent progress on the combinatorial diameter of polytopes and simplicial complexes, TOP 21 (2013) (survey). arXiv:1307.5900
81 thms5 active usersReviewed
🏆Completed
Complexity Theory·Captain: marwahaha

Block Sensitivity vs. Sensitivity: Reach 2.05Open Problem

Establish a separation exponent of at least 2.052.052.05 between block sensitivity and sensitivity of total Boolean functions.

The target is an infinite family fk:{0,1}nk→{0,1}f_k:\{0,1\}^{n_k}\to\{0,1\}fk​:{0,1}nk​→{0,1} such that

s(fk)→∞,bs(fk)≥s(fk)2.05−o(1)as k→∞.s(f_k)\to\infty,\qquad bs(f_k)\ge s(f_k)^{2.05-o(1)}\quad\text{as }k\to\infty.s(fk​)→∞,bs(fk​)≥s(fk​)2.05−o(1)as k→∞.

Here o(1)o(1)o(1) tends to zero with kkk. Sensitivity is the maximum number of individual coordinate flips that change the output at a common input; block sensitivity allows pairwise disjoint nonempty sets of coordinates instead. Both maxima range over all inputs.

The Lean goal uses the campaign’s shared definition: for every ε>0\varepsilon>0ε>0 and every integer S≥2S\ge2S≥2, there must be a total Boolean function fff with s(f)≥Ss(f)\ge Ss(f)≥S and bs(f)≥s(f)2.05−εbs(f)\ge s(f)^{2.05-\varepsilon}bs(f)≥s(f)2.05−ε. The decimal 2.052.052.05 means exactly 41/2041/2041/20.

One sufficient route is a finite function fff, an input xxx, and integers A,B>1A,B>1A,B>1 satisfying

s(f)≤A,bs(f,x)≥B,A2.05≤B.s(f)\le A,\qquad bs(f,x)\ge B,\qquad A^{2.05}\le B.s(f)≤A,bs(f,x)≥B,A2.05≤B.

The proved theorem SensitivityCampaign.finite_certificate then gives the asymptotic conclusion. Direct family constructions are equally welcome.

The starting milestone is the campaign’s proved exponent 2.02052.02052.0205. The target 2.052.052.05 is a challenge to prove, not an established campaign record. Further background and construction parameters appear in the campaign proposal.

6 thms4 active usersReviewed
🏆Completed
Complexity Theory·Captain: marwahaha

Block Sensitivity vs. Sensitivity: Reach 2.007Open Problem

Establish the separation exponent α≥2.007\alpha\ge2.007α≥2.007 for total Boolean functions, improving on the depth-20 specialization of OpenAI's construction.

Precisely, for every ε>0\varepsilon>0ε>0 and every integer S≥2S\ge2S≥2, construct a function fff with s(f)≥Ss(f)\ge Ss(f)≥S and bs(f)≥s(f)2.007−εbs(f)\ge s(f)^{2.007-\varepsilon}bs(f)≥s(f)2.007−ε.

A finite certificate is sufficient: supply a function and an input xxx with s(f)≤As(f)\le As(f)≤A, bs(f,x)≥Bbs(f,x)\ge Bbs(f,x)≥B, A,B>1A,B>1A,B>1, and A2.007≤BA^{2.007}\le BA2.007≤B, then apply the shared certificate theorem. Sharper estimates, improved parameters, and different constructions are all eligible; direct family proofs are also welcome.

This is an open research target. The preceding benchmarks are 222 classically and approximately 2.0064708282.0064708282.006470828 from the depth-20 seed. Numerical searches guide discovery but do not replace certified bounds. Intermediate improvements are welcome as separate campaign entries.

38 thms4 active usersReviewed
🏆Completed
Complexity Theory·Captain: marwahaha

Block Sensitivity vs. Sensitivity: Depth-20 ImprovementResearch Paper

Certify α≥2.006470828\alpha\ge2.006470828α≥2.006470828 by specializing OpenAI's general seed theorem to d=20d=20d=20 and M=921M=9^{21}M=921.

The construction gives

s(f)≤A=44M21,bs(f,0)≥B=M2(2M2+1)20.s(f)\le A=44M^{21},\qquad bs(f,0)\ge B=M^2(2M^2+1)^{20}.s(f)≤A=44M21,bs(f,0)≥B=M2(2M2+1)20.

Here bs(f,0)bs(f,0)bs(f,0) is block sensitivity at the all-zero input. The ratio log⁡B/log⁡A\log B/\log AlogB/logA is approximately 2.006470828227379…2.006470828227379\ldots2.006470828227379…. Prove the exact inequality A2.006470828≤BA^{2.006470828}\le BA2.006470828≤B, then reuse the foundation's finite-certificate theorem.

The goal uses the campaign's shared definitions and requires arbitrarily large sensitivity. This is a stronger specialization of the existing construction, not a claim of a new construction or global parameter optimality.

39 thms4 active usersReviewed
Algorithmic Game TheoryEconomicsOperations Research+1·Captain: mikedeng1

Endogenous Risk Exposure and Systemic Instability II: Banks Take More Risk in the Least Equilibrium of a Complete Network than of a Ring NetworkResearch Paper

Motivation

Banks lend to one another, and the shape of the resulting network decides how a loss at one bank reaches the others. A long line of work, starting with Allen and Gale (2000) and continued by Acemoglu, Ozdaglar and Tahbaz-Salehi (2015), compares the ring network, where each bank is owed money by one neighbour, with the complete network, where every bank holds an equal share of every other bank's debt. That literature studies contagion after shocks hit and finds that the complete network spreads losses thinly and can absorb small shocks better.

Shu's paper (Management Science, doi:10.1287/mnsc.2022.01519) asks the ex-ante question: when banks choose how much risk to take, knowing the network they sit in, which network makes them take more? A successful bank subsidizes its failed counterparties through the clearing of interbank debt, and anticipating that subsidy pushes it toward riskier projects. Proposition 4 of the paper says that this effect is stronger in the complete network. This mission formalizes that proposition and the computation behind it.

Setting

There are N≥2N\ge2N≥2 banks. In a regular network with share matrix Θ=[θij]\Theta=[\theta_{ij}]Θ=[θij​], bank jjj owes bank iii the face value θijdˉ\theta_{ij}\bar dθij​dˉ, every bank has total interbank liability dˉ>0\bar d>0dˉ>0, and every bank also owes a senior deposit v>0v>0v>0. The two networks of Definition 3 are

ΘR: θij=1 iff j≡i−1(modN),ΘC=1N−1(1N,N−IN).\Theta^R:\ \theta_{ij}=1 \text{ iff } j\equiv i-1 \pmod N,\qquad \Theta^C=\tfrac{1}{N-1}\big(\mathbb 1_{N,N}-I_N\big).ΘR: θij​=1 iff j≡i−1(modN),ΘC=N−11​(1N,N​−IN​).

Each bank iii chooses a project ZiZ_iZi​ in a common interval [Z‾,Z‾][\underline Z,\overline Z][Z​,Z]. The project pays ZiZ_iZi​ with probability P(Zi)P(Z_i)P(Zi​) and 000 otherwise, independently across banks. Assumption 1 requires P(Z)∈(0,1)P(Z)\in(0,1)P(Z)∈(0,1), PPP decreasing, and P(Z) ZP(Z)\,ZP(Z)Z concave. The standing assumption Z‾≥v+dˉ\underline Z\ge v+\bar dZ​≥v+dˉ says a successful bank never defaults.

After the state ω∈{s,f}N\omega\in\{s,f\}^Nω∈{s,f}N is realized, interbank payments clear. A payment equilibrium is a vector ddd with

di={min⁡[∑jθijdj+ei−v, dˉ]}+,d_i=\Big\{\min\Big[\textstyle\sum_j\theta_{ij}d_j+e_i-v,\ \bar d\Big]\Big\}^+,di​={min[∑j​θij​dj​+ei​−v, dˉ]}+,

where ei=Zie_i=Z_iei​=Zi​ if bank iii succeeds and 000 if it fails. Bank iii's profit is (∑jθijdj∗+ei−v−di∗)+\big(\sum_j\theta_{ij}d^*_j+e_i-v-d^*_i\big)^+(∑j​θij​dj∗​+ei​−v−di∗​)+. A risk-taking equilibrium is a profile Z∗Z^*Z∗ in which each Zi∗Z^*_iZi∗​ maximizes bank iii's expected profit given Z−i∗Z^*_{-i}Z−i∗​. Equilibria need not be unique, and the paper selects the least one.

The key quantity is the network risk-taking distortion

Di(Z−i)=∑ω−i(dˉ−∑jθijdj∗(ωi=s))Pr⁡(ω−i),\mathcal D_i(Z_{-i})=\sum_{\omega_{-i}}\Big(\bar d-\sum_j\theta_{ij}d^*_j(\omega^{i=s})\Big)\Pr(\omega_{-i}),Di​(Z−i​)=ω−i​∑​(dˉ−j∑​θij​dj∗​(ωi=s))Pr(ω−i​),

which is bank iii's expected net interbank payment to the other banks when its own project succeeds. In a regular network, expected profit equals P(Zi)(Zi−v)−P(Zi) Di(Z−i)P(Z_i)(Z_i-v)-P(Z_i)\,\mathcal D_i(Z_{-i})P(Zi​)(Zi​−v)−P(Zi​)Di​(Z−i​), so Di\mathcal D_iDi​ acts like extra debt that the bank repays only when it succeeds. Superscripts CCC and RRR mark the complete and ring networks.

Formalization targets

Goal: Proposition 4

With ZCZ^CZC the least equilibrium of the complete network and ZRZ^RZR the least equilibrium of the ring,

ZiR≤ZiCfor every bank i.Z^R_i\le Z^C_i\qquad\text{for every bank } i.ZiR​≤ZiC​for every bank i.

Milestones

  1. Clearing in the complete network (IA p. 15): a failed bank pays (dˉ−N−1Sv)+\big(\bar d-\frac{N-1}{S}v\big)^+(dˉ−SN−1​v)+, where SSS is the number of successful banks.
  2. (I.13): with qqq the common success probability of the other banks and Pr⁡(m)=(N−1m)(1−q)mqN−1−m\Pr(m)=\binom{N-1}{m}(1-q)^mq^{N-1-m}Pr(m)=(mN−1​)(1−q)mqN−1−m,
DiC=∑m=1N−1min⁡(mvN−m,mdˉN−1)Pr⁡(m).\mathcal D^C_i=\sum_{m=1}^{N-1}\min\Big(\frac{mv}{N-m},\frac{m\bar d}{N-1}\Big)\Pr(m).DiC​=m=1∑N−1​min(N−mmv​,N−1mdˉ​)Pr(m).
  1. (I.14): in the ring, a failed bank pays (dˉ−Kiv)+(\bar d-K_iv)^+(dˉ−Ki​v)+, where KiK_iKi​ counts the consecutive failed banks upstream of iii, starting with iii itself.
  2. (I.15): the conditional distribution, given mmm failures, of what a successful bank receives in the ring.
  3. Closed form of DiR\mathcal D^R_iDiR​ (IA p. 16, also p. 14).
  4. Lemma I.A (ii): ∑l=rn(lr)(n−l)=(n+1r+1)n−rr+2\sum_{l=r}^n\binom lr(n-l)=\binom{n+1}{r+1}\frac{n-r}{r+2}∑l=rn​(rl​)(n−l)=(r+1n+1​)r+2n−r​. Part (i), the classical hockey-stick identity, is already published and proved on the platform and is included by reference.
  5. Lemma I.B: ∑iAi+≥(∑iAi−B)++B\sum_i A_i^+\ge(\sum_iA_i-B)^++B∑i​Ai+​≥(∑i​Ai​−B)++B whenever B<max⁡iAiB<\max_iA_iB<maxi​Ai​.
  6. DiR≤DiC\mathcal D^R_i\le\mathcal D^C_iDiR​≤DiC​ when all other banks choose the same project.

Significance

The result. Proposition 4 reverses the conventional reading of the complete network as the safer structure. The co-insurance that makes it resilient after a shock is the same cross-subsidy that weakens incentives before the shock. Two networks with the same face-value liabilities dˉ+v\bar d+vdˉ+v therefore induce different equilibrium risk-taking. Liabilities alone are not a sufficient statistic for risk incentives, and the network topology matters in its own right. The same comparison is the template for the paper's later results on the number of banks and on central clearing.

Formalizing it. The proposition is proved in the paper, not open, and none of it is machine-checked yet. A formal proof must establish the two clearing vectors, the counting identity behind (I.15), and the two closed forms of the distortion. The printed argument also leaves a step to be supplied: its final appeal to "the monotone selection theorem" needs the distortion comparison at every profile of the other banks. It is proved only when they all choose the same project, and it is false in general. The goal is nevertheless stated for least equilibria exactly as in the paper, and its formal proof has to bridge that gap. The milestones are true as stated.

Difficulty

The distortion of the ring is not a function of the number of failures alone. What a successful bank receives depends on the length of the run of failed banks immediately upstream of it, so the closed form needs an exact count of the binary strings with a given number of failures and a given initial run length. The comparison of the two distortions is not termwise either: the positive part sits inside a sum on the ring side and outside it on the complete side.

The obvious final step is to say that the distortion is larger in the complete network, and that a larger distortion raises the optimal risk exposure. That step does not go through as stated. The equilibrium comparison needs control of the best-response maps at every profile, while the distortion comparison holds only on the diagonal, where all other banks choose the same project. Some further structure of the two games is needed to restrict attention to that diagonal.

Formalization scope

Banks are Fin N with N≥2N\ge2N≥2, and states are Fin N → Bool with true meaning success. The paper's general model is specialized to a regular network given by (Θ,dˉ,v)(\Theta,\bar d,v)(Θ,dˉ,v), which covers both networks of Definition 3. Every expectation is a finite sum over the 2N2^N2N states, so no measure theory is involved. The payment equilibrium d∗d^*d∗ is the greatest solution of the clearing system, because the paper asserts only generic uniqueness. Every bank's project lies in [Z‾,Z‾][\underline Z,\overline Z][Z​,Z], and Z‾≥v+dˉ\underline Z\ge v+\bar dZ​≥v+dˉ is a hypothesis of every statement.

The distortion milestones (2, 5 and 8) are stated at the constant profile in which every bank chooses the same zzz, which is how the page's single P(Z−i)P(Z_{-i})P(Z−i​) reads. At m=N−1m=N-1m=N−1, where every other bank fails, the printed ring binomial has lower index −1-1−1, and the weight is fixed explicitly to 111 at l=N−1l=N-1l=N−1. Proposition 4 is stated for least equilibria and weak inequality. It adds one hypothesis the page does not state, continuity of PPP on [Z‾,Z‾][\underline Z,\overline Z][Z​,Z], so that best responses and least equilibria exist. Without it the IsLeast hypotheses could be unsatisfiable and the goal vacuous.

Trivializing encodings are ruled out: d∗d^*d∗ is an actual solution of the clearing system, not a junk supremum, and the run length KiK_iKi​ is only used in states where some bank succeeds.

A complete development needs Knaster–Tarski on the box [0,dˉ]N[0,\bar d]^N[0,dˉ]N, the clearing computations for the two networks, binomial identities, and a monotone comparative statics argument for the equilibria. Published Topkis results on supermodular games (existence of least equilibria, and monotonicity of least fixed points in a parameter) are included by reference as tools. The clearing and counting lemmas are reusable for the paper's other results on ring and complete networks. Proofs of any milestone, and of the goal, are welcome.

Not posed here: Proposition 1 (strategic complementarity in any network, a separate mission), Proposition 2 (existence), and the later comparative statics in the number of banks, central clearing and bailouts.

Selected references

  • C. Shu, Endogenous Risk Exposure and Systemic Instability, Management Science (accepted manuscript, 17 Sep 2024). https://doi.org/10.1287/mnsc.2022.01519
  • F. Allen and D. Gale, Financial Contagion, Journal of Political Economy 108(1), 2000. https://doi.org/10.1086/262109
  • D. Acemoglu, A. Ozdaglar and A. Tahbaz-Salehi, Systemic Risk and Stability in Financial Networks, American Economic Review 105(2), 2015. https://doi.org/10.1257/aer.20130456
  • L. Eisenberg and T. H. Noe, Systemic Risk in Financial Systems, Management Science 47(2), 2001. https://doi.org/10.1287/mnsc.47.2.236.9835
  • D. M. Topkis, Supermodularity and Complementarity, Princeton University Press, 1998. https://doi.org/10.1515/9781400822539
13 thms4 active usersReviewed
🏆Completed
Linear OptimizationOptimal TransportOptimization·Captain: mikedeng1

Computational Optimal Transport V: A Feasible Pair of Kantorovich Potentials Is Optimal or Strictly Improves Along a Direction (1_S, −1_S′)Textbook

Motivation

The discrete optimal transport problem between two histograms is a linear program, and much of the algorithmic theory of optimal transport is the theory of solving that linear program well. Chapter 3 of Peyré and Cuturi's Computational Optimal Transport (Foundations and Trends in Machine Learning, 2019) surveys the classical combinatorial solvers: the network simplex, dual ascent methods, and the auction algorithm. Dual ascent methods work entirely with the dual variables, the Kantorovich potentials (f,g)(f, g)(f,g): they keep a feasible pair of potentials and improve it step by step until it is optimal. The specialisation of this idea to assignment problems is the Hungarian algorithm of Kuhn (1955), and its general form is the primal-dual method for network flow problems presented in Bertsimas and Tsitsiklis, Introduction to Linear Optimization (1997, §7.7), on which §3.6 of the book is modelled.

The mathematical engine of every dual ascent method is one alternative: a feasible pair of potentials is either already optimal, or it can be improved along a direction of a very special, combinatorial form. This mission formalizes that alternative (Proposition 3.6 of the book) together with the results it rests on.

Setting

Fix integers n,m≥1n, m \ge 1n,m≥1, a cost matrix C∈Rn×mC \in \mathbb{R}^{n\times m}C∈Rn×m, and two histograms a∈Σna \in \Sigma_na∈Σn​, b∈Σmb \in \Sigma_mb∈Σm​, where Σn={a∈R+n:∑iai=1}\Sigma_n = \{a \in \mathbb{R}^n_+ : \sum_i a_i = 1\}Σn​={a∈R+n​:∑i​ai​=1} is the probability simplex. Write [ ⁣[n] ⁣]={1,…,n}[\![n]\!] = \{1, \dots, n\}[[n]]={1,…,n} for the row indices and, following the book, [ ⁣[m] ⁣]′={1′,…,m′}[\![m]\!]' = \{1', \dots, m'\}[[m]]′={1′,…,m′} for the column indices.

The couplings between aaa and bbb form the transportation polytope

U(a,b)={P∈R+n×m:P1m=a, PT1n=b},U(a,b) = \{P \in \mathbb{R}^{n\times m}_+ : P\mathbb{1}_m = a,\ P^{\mathsf T}\mathbb{1}_n = b\},U(a,b)={P∈R+n×m​:P1m​=a, PT1n​=b},

and the primal problem is LC(a,b)=min⁡P∈U(a,b)⟨C,P⟩\mathrm{L}_C(a,b) = \min_{P\in U(a,b)} \langle C, P\rangleLC​(a,b)=minP∈U(a,b)​⟨C,P⟩ with ⟨C,P⟩=∑i,jCi,jPi,j\langle C, P\rangle = \sum_{i,j} C_{i,j}P_{i,j}⟨C,P⟩=∑i,j​Ci,j​Pi,j​. A pair of vectors (f,g)∈Rn×Rm(f, g) \in \mathbb{R}^n \times \mathbb{R}^m(f,g)∈Rn×Rm is dual feasible, written (f,g)∈R(C)(f,g) \in R(C)(f,g)∈R(C), when fi+gj≤Ci,jf_i + g_j \le C_{i,j}fi​+gj​≤Ci,j​ for all (i,j)(i, j)(i,j). The dual problem (3.4) is

LC(a,b)=max⁡(f,g)∈R(C)⟨f,a⟩+⟨g,b⟩.\mathrm{L}_C(a,b) = \max_{(f,g)\in R(C)} \langle f, a\rangle + \langle g, b\rangle .LC​(a,b)=(f,g)∈R(C)max​⟨f,a⟩+⟨g,b⟩.

For a feasible pair (f,g)(f, g)(f,g), a pair of indices (i,j′)(i, j')(i,j′) is balanced if fi+gj=Ci,jf_i + g_j = C_{i,j}fi​+gj​=Ci,j​ and inactive if fi+gj<Ci,jf_i + g_j < C_{i,j}fi​+gj​<Ci,j​. A matrix PPP and a pair (f,g)(f, g)(f,g) are complementary if Pi,j>0P_{i,j} > 0Pi,j​>0 implies Ci,j=fi+gjC_{i,j} = f_i + g_jCi,j​=fi​+gj​, that is, PPP is supported on balanced pairs. For S⊂[ ⁣[n] ⁣]S \subset [\![n]\!]S⊂[[n]] the vector 1S∈Rn\mathbb{1}_S \in \mathbb{R}^n1S​∈Rn has ones at the indices in SSS and zeros elsewhere; likewise 1S′∈Rm\mathbb{1}_{S'} \in \mathbb{R}^m1S′​∈Rm for S′⊂[ ⁣[m] ⁣]′S' \subset [\![m]\!]'S′⊂[[m]]′.

Formalization targets

Goal: Proposition 3.6 (p. 416)

For a∈Σna \in \Sigma_na∈Σn​, b∈Σmb \in \Sigma_mb∈Σm​ and (f,g)∈R(C)(f,g) \in R(C)(f,g)∈R(C): either (f,g)(f, g)(f,g) is optimal for (3.4), or there exist S⊂[ ⁣[n] ⁣]S \subset [\![n]\!]S⊂[[n]], S′⊂[ ⁣[m] ⁣]′S' \subset [\![m]\!]'S′⊂[[m]]′ and ε0>0\varepsilon_0 > 0ε0​>0 such that for every 0<ε≤ε00 < \varepsilon \le \varepsilon_00<ε≤ε0​,

(f~,g~)=(f,g)+ε(1S,−1S′)∈R(C)and⟨f~,a⟩+⟨g~,b⟩>⟨f,a⟩+⟨g,b⟩.(\tilde f, \tilde g) = (f, g) + \varepsilon(\mathbb{1}_S, -\mathbb{1}_{S'}) \in R(C) \quad\text{and}\quad \langle \tilde f, a\rangle + \langle \tilde g, b\rangle > \langle f, a\rangle + \langle g, b\rangle .(f~​,g~​)=(f,g)+ε(1S​,−1S′​)∈R(C)and⟨f~​,a⟩+⟨g~​,b⟩>⟨f,a⟩+⟨g,b⟩.

Milestones

  1. Proposition 3.3 (p. 405). If P∈U(a,b)P \in U(a,b)P∈U(a,b) and (f,g)∈R(C)(f,g) \in R(C)(f,g)∈R(C) are complementary, then PPP is primal optimal and (f,g)(f,g)(f,g) is dual optimal.
  2. Proposition 3.5 (p. 415). If every balanced pair (i,j′)(i, j')(i,j′) with i∈Si \in Si∈S has j′∈S′j' \in S'j′∈S′, then (f,g)+ε(1S,−1S′)∈R(C)(f,g) + \varepsilon(\mathbb{1}_S, -\mathbb{1}_{S'}) \in R(C)(f,g)+ε(1S​,−1S′​)∈R(C) for all sufficiently small ε>0\varepsilon > 0ε>0.
  3. Objective change (proof of Proposition 3.6, pp. 416–417). The step changes the dual objective by exactly ε(1STa−1S′Tb)\varepsilon(\mathbb{1}_S^{\mathsf T}a - \mathbb{1}_{S'}^{\mathsf T}b)ε(1ST​a−1S′T​b).
  4. Labeled sets (proof of Proposition 3.6, pp. 416–417). If no coupling in U(a,b)U(a,b)U(a,b) is complementary to (f,g)(f,g)(f,g), then there are S,S′S, S'S,S′ with every balanced pair leaving SSS landing in S′S'S′, and
1STa−1S′Tb>0.\mathbb{1}_S^{\mathsf T}a - \mathbb{1}_{S'}^{\mathsf T}b > 0 .1ST​a−1S′T​b>0.

Significance

The result. Proposition 3.6 says that non-optimality of a feasible dual pair is always witnessed by a direction with entries in {0,±1}\{0, \pm 1\}{0,±1}, determined by two index sets, which keeps the pair feasible for a positive step and strictly improves the objective. This is what makes dual ascent a finite combinatorial method rather than a generic linear-programming iteration: the search for an ascent direction reduces to a maximum-flow computation on the bipartite graph of balanced pairs. Combined with the step length of Proposition 3.5, it is the primal-dual method, which reduces to the Hungarian algorithm on assignment problems. Milestone 1 is the optimality certificate of complementary slackness, used throughout the book's chapter 3.

Formalizing it. These results are classical and proved in the book and in Bertsimas and Tsitsiklis; no machine-checked proof of them is known to exist. The mission produces a formal statement and proof of the optimality-or-ascent alternative for the discrete Kantorovich dual, together with the complementary-slackness certificate in the transport setting. Milestone 4 is a Hall-type statement (a supply–demand theorem on a bipartite graph) whose formal proof is reusable for other matching and transportation results.

Difficulty

Milestones 1–3 are short computations. The content of the goal is in milestone 4. The obvious argument is linear-programming duality: if (f,g)(f,g)(f,g) is not optimal, some feasible direction improves the objective. But LP duality only produces an arbitrary real direction; the claim that a direction of the form (1S,−1S′)(\mathbb{1}_S, -\mathbb{1}_{S'})(1S​,−1S′​) suffices is a combinatorial statement. The book obtains S,S′S, S'S,S′ as the labeled nodes of a maximal flow (Ford–Fulkerson) and argues through max-flow/min-cut; the flow bookkeeping printed on p. 417 is garbled, so the step from "no complementary coupling exists" to "1STa>1S′Tb\mathbb{1}_S^{\mathsf T}a > \mathbb{1}_{S'}^{\mathsf T}b1ST​a>1S′T​b for a set closed under balanced edges" has to be supplied carefully. Separately, connecting "not optimal" to "no complementary coupling exists" needs the converse direction of complementary slackness or strong duality for the transport problem.

Formalization scope

Row and column indices are Fin n and Fin m (0-based); the primed column set [ ⁣[m] ⁣]′[\![m]\!]'[[m]]′ is just Fin m. Cost matrices and couplings are Matrix (Fin n) (Fin m) ℝ; histograms and potentials are real functions on Fin n, Fin m; Σn\Sigma_nΣn​ is Mathlib's stdSimplex ℝ (Fin n). Index sets S,S′S, S'S,S′ are Finsets and 1S\mathbb{1}_S1S​ is indicatorVec S. "Optimal for Problem (3.4)" is the predicate IsDualOptimal: feasible, and no feasible pair has a larger objective (no real infimum or supremum is used, so no junk value can enter). The book's "for a small enough ε>0\varepsilon > 0ε>0" is stated as "for every ε∈(0,ε0]\varepsilon \in (0, \varepsilon_0]ε∈(0,ε0​]", which is equivalent because R(C)R(C)R(C) is convex and the objective is linear.

Standing assumptions, all from the book: (f,g)(f, g)(f,g) is dual feasible (p. 415, "In what follows, (f,g)(f,g)(f,g) is a feasible dual pair in R(C)R(C)R(C)"); a,ba, ba,b are histograms in the simplex (used for the goal and milestone 4; without equal masses the dual is unbounded and optimality fails for every pair). Milestone 4 replaces the book's flow hypothesis "the throughput is strictly smaller than 1" by the equivalent flow-free statement "no coupling in U(a,b)U(a,b)U(a,b) is complementary to (f,g)(f,g)(f,g)"; flows, capacities and the labeling algorithm appear in no statement.

The goal admits a trivializing formalization: allowing an arbitrary direction (u,v)(u, v)(u,v) instead of (1S,−1S′)(\mathbb{1}_S, -\mathbb{1}_{S'})(1S​,−1S′​) turns Proposition 3.6 into plain non-optimality of a linear program. The statement here fixes the direction to (1S,−1S′)(\mathbb{1}_S, -\mathbb{1}_{S'})(1S​,−1S′​) exactly as the book does.

A complete development needs finite LP duality or complementary slackness for the transportation problem, and a max-flow/min-cut or Hall-type theorem on bipartite graphs with vertex capacities. Both are reusable well beyond this mission. Contributions welcome: proofs of the milestones, a self-contained proof of milestone 4 by induction or by a max-flow argument, and alternative proofs of the goal through LP duality plus a vertex argument.

Selected references

  • G. Peyré, M. Cuturi, Computational Optimal Transport, Foundations and Trends in Machine Learning 11(5–6):355–607, 2019. https://doi.org/10.1561/2200000073 (§3.1–3.3, §3.6, pp. 400–417)
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997, §7.7 (the primal-dual method) and pp. 305–308 (Ford–Fulkerson and the labeling algorithm).
  • H. W. Kuhn, The Hungarian method for the assignment problem, Naval Research Logistics Quarterly 2(1–2):83–97, 1955. https://doi.org/10.1002/nav.3800020109
  • L. R. Ford, D. R. Fulkerson, Maximal flow through a network, Canadian Journal of Mathematics 8:399–404, 1956. https://doi.org/10.4153/CJM-1956-045-5
9 thms4 active usersReviewed
🏆Completed
Group TheoryNumber Theory·Captain: mikedeng1

New Proofs of Plünnecke-type Estimates for Product Sets in Groups 1: In an Abelian Group, |A + B| ≤ α|A| Gives One Nonempty X ⊆ A with |X + hB| ≤ αʰ|X| for Every hResearch Paper

Motivation

A basic question of additive combinatorics asks how a set grows under repeated addition. If a finite set AAA in an abelian group satisfies ∣A+B∣≤α∣A∣|A + B| \le \alpha |A|∣A+B∣≤α∣A∣ for some finite set BBB, how large can the iterated sumsets hB=B+⋯+BhB = B + \cdots + BhB=B+⋯+B be? Plünnecke's inequality gives the answer used throughout the subject: some nonempty part of AAA grows by at most a factor α\alphaα per added copy of BBB. Combined with Ruzsa's triangle inequality it becomes the Plünnecke–Ruzsa inequality ∣mB−nB∣≤αm+n∣A∣|mB - nB| \le \alpha^{m+n}|A|∣mB−nB∣≤αm+n∣A∣, which underlies Freĭman-type structure theorems, sum–product estimates and the polynomial Freĭman–Ruzsa programme.

Timeline.

  • 1970: H. Plünnecke proves the inequality for iterated sumsets in abelian groups with a graph-theoretic method (commutative layered graphs and Menger's theorem).
  • 1989: I. Z. Ruzsa simplifies Plünnecke's argument and combines it with the triangle inequality to bound ∣mB−nB∣|mB - nB|∣mB−nB∣.
  • 2011: G. Petridis gives a short elementary proof, without graphs (arXiv:1101.3507, Combinatorica 32, 2012). His argument also shows that one subset X⊆AX \subseteq AX⊆A works for every number of summands hhh, and it extends to triple products CXBCXBCXB in non-abelian groups.

Setting

Let GGG be a group with finite subsets AAA, BBB, CCC. The product set is AB={ab:a∈A, b∈B}AB = \{ab : a \in A,\ b \in B\}AB={ab:a∈A, b∈B}, and ∣⋅∣|\cdot|∣⋅∣ denotes cardinality. In an abelian group, written additively, the sumset is A+B={a+b:a∈A, b∈B}A + B = \{a + b : a \in A,\ b \in B\}A+B={a+b:a∈A, b∈B}, and for h≥0h \ge 0h≥0 the iterated sumset hBhBhB is B+⋯+BB + \cdots + BB+⋯+B with hhh summands, 0B={0}0B = \{0\}0B={0}. It is not the dilate {hb:b∈B}\{hb : b \in B\}{hb:b∈B}.

A nonempty subset X⊆AX \subseteq AX⊆A has minimal growth under BBB if

∣XB∣∣X∣≤∣ZB∣∣Z∣for every nonempty Z⊆A.\frac{|XB|}{|X|} \le \frac{|ZB|}{|Z|} \quad\text{for every nonempty } Z \subseteq A.∣X∣∣XB∣​≤∣Z∣∣ZB∣​for every nonempty Z⊆A.

Such an XXX exists whenever AAA is nonempty, since AAA has finitely many subsets. In Lean, GGG is a Group or AddCommGroup with decidable equality, the sets are Finset G with the pointwise operations of Mathlib (A * B, A + B, h • B), and cardinalities are #A cast to ℝ.

Formalization targets

Goal: Theorem 3.1

For finite AAA, BBB in an abelian group with AAA nonempty and ∣A+B∣≤α∣A∣|A + B| \le \alpha|A|∣A+B∣≤α∣A∣, there is a nonempty X⊆AX \subseteq AX⊆A with

∣X+hB∣≤αh∣X∣for every h≥0.|X + hB| \le \alpha^h |X| \qquad \text{for every } h \ge 0.∣X+hB∣≤αh∣X∣for every h≥0.

The point is the order of quantifiers: one XXX serves all hhh.

Milestones

  1. Proposition 2.1 (p. 5). If ∣XB∣/∣X∣≤∣ZB∣/∣Z∣|XB|/|X| \le |ZB|/|Z|∣XB∣/∣X∣≤∣ZB∣/∣Z∣ for every Z⊆XZ \subseteq XZ⊆X, then ∣CXB∣≤∣XB∣∣X∣ ∣CX∣|CXB| \le \frac{|XB|}{|X|}\,|CX|∣CXB∣≤∣X∣∣XB∣​∣CX∣ for every finite CCC, in any group. This is already on the platform, proved, as FamousTheorems.pluennecke_petridis (additive notation, cross-multiplied), and enters the mission as a reference.
  2. Theorem 1.5 (p. 3). In any group, ∣AB∣≤α∣A∣|AB| \le \alpha|A|∣AB∣≤α∣A∣ with AAA nonempty gives a nonempty X⊆AX \subseteq AX⊆A with
∣CXB∣≤α∣CX∣for every finite C.|CXB| \le \alpha |CX| \quad\text{for every finite } C.∣CXB∣≤α∣CX∣for every finite C.
  1. Inductive step of Theorem 3.1 (p. 7). For X⊆AX \subseteq AX⊆A of minimal growth and ∣A+B∣≤α∣A∣|A+B| \le \alpha|A|∣A+B∣≤α∣A∣:
∣X+hB∣≤α ∣X+(h−1)B∣(h≥1).|X + hB| \le \alpha\,|X + (h-1)B| \quad (h \ge 1).∣X+hB∣≤α∣X+(h−1)B∣(h≥1).

Significance

Theorem 3.1 is the form of Plünnecke's inequality used in applications. Two consequences follow directly. Taking A=BA = BA=B gives ∣hB∣≤αh∣B∣|hB| \le \alpha^h|B|∣hB∣≤αh∣B∣ whenever ∣2B∣≤α∣B∣|2B| \le \alpha|B|∣2B∣≤α∣B∣. Combining one XXX for all hhh with Ruzsa's triangle inequality gives ∣mB−nB∣≤αm+n∣A∣|mB - nB| \le \alpha^{m+n}|A|∣mB−nB∣≤αm+n∣A∣ (Theorem 1.2 of the paper). With a separate XXX for each hhh, the second step would need the same set for mmm and nnn, and that is exactly what Theorem 3.1 provides. Theorem 1.5 is the non-abelian ingredient: missions 2 and 3 of this series apply it to obtain explicit Plünnecke-type bounds for ∣Bh∣|B^h|∣Bh∣ and ∣SBh∣|SB^h|∣SBh∣ in arbitrary groups.

Formalizing it. The results are proved and classical. Mathlib already contains Proposition 2.1 (Finset.pluennecke_petridis_inequality_mul) and the Plünnecke–Ruzsa inequality Finset.pluennecke_ruzsa_inequality_nsmul_sub_nsmul_add. Its proof runs through a private lemma that bounds ∣X+hB∣|X + hB|∣X+hB∣ for one fixed minimiser, but no public statement in Mathlib or on the platform asserts Theorem 3.1 or Theorem 1.5 in the form "there exists a nonempty XXX for all hhh" (respectively "for all CCC"). This mission adds those statements as reusable, citable nodes in the paper's numbering.

Difficulty

A first attempt iterates the hypothesis directly: ∣A+2B∣≤α∣A+B∣|A + 2B| \le \alpha|A + B|∣A+2B∣≤α∣A+B∣ would follow if A+BA + BA+B again grew by a factor α\alphaα under BBB, but nothing controls the growth of A+BA + BA+B. The ratio ∣ZB∣/∣Z∣|ZB|/|Z|∣ZB∣/∣Z∣ is not monotone in ZZZ, and passing to subsets of AAA can only help if the subset is chosen correctly. Choosing a different good subset for each hhh gives Theorem 1.1 but loses the uniformity. The work is to show that one fixed subset controls all the products CXBCXBCXB simultaneously, and in the non-abelian Theorem 1.5 to keep the order of the factors CCC, XXX, BBB throughout.

Formalization scope

  • Theorem 3.1 and the inductive step are stated in an AddCommGroup with DecidableEq. Theorem 1.5 is stated in a Group, with no commutativity, as on the page. The factor order C⋅X⋅BC \cdot X \cdot BC⋅X⋅B is preserved.
  • hBhBhB is h • B (the hhh-fold sumset; 0 • B = {0}), and "for all hhh" ranges over all natural numbers, including the true case h=0h = 0h=0.
  • α\alphaα is an arbitrary real number; cardinalities are cast to ℝ. No hypothesis α≥1\alpha \ge 1α≥1 is added: it follows from the hypotheses once AAA and BBB are nonempty (with BBB empty they force only α≥0\alpha \ge 0α≥0, and every conclusion is still true).
  • Nonempty witness. The page says "there exists X⊆AX \subseteq AX⊆A". Since ∅+hB=∅\emptyset + hB = \emptyset∅+hB=∅, the empty set would satisfy the printed statements trivially, and that formalization is ruled out: the goal and Theorem 1.5 assume AAA nonempty and assert XXX nonempty, matching the paper's choice of XXX as a minimiser of a ratio defined on nonempty sets.
  • Minimal growth in the step milestone is written cross-multiplied, ∣X+B∣ ∣Z∣≤∣Z+B∣ ∣X∣|X+B|\,|Z| \le |Z+B|\,|X|∣X+B∣∣Z∣≤∣Z+B∣∣X∣, over nonempty Z⊆AZ \subseteq AZ⊆A; the step is stated for h≥1h \ge 1h≥1 with natural-number subtraction guarded by that hypothesis.
  • Ruzsa's covering lemma and Ruzsa's triangle inequality, quoted in §4, are in Mathlib (Finset.ruzsa_covering_mul, Finset.ruzsa_triangle_inequality_mul_mulInv_mul) and are not items of this mission.
  • No new definitions are needed. Welcome contributions: proofs of the three draft statements, and, separately, the deduction of Theorem 1.2 from Theorem 3.1.

Selected references

  • G. Petridis, New proofs of Plünnecke-type estimates for product sets in groups, arXiv:1101.3507v3, 2011; Combinatorica 32 (2012). https://arxiv.org/abs/1101.3507 , https://doi.org/10.1007/s00493-012-2818-5
  • H. Plünnecke, Eine zahlentheoretische Anwendung der Graphentheorie, J. Reine Angew. Math. 243 (1970) 171–183. https://doi.org/10.1515/crll.1970.243.171
  • I. Z. Ruzsa, An application of graph theory to additive number theory, Scientia, Ser. A 3 (1989) 97–109 (no online version).
  • T. Tao, V. Vu, Additive Combinatorics, Cambridge University Press, 2006. https://doi.org/10.1017/CBO9780511755149
4 thms4 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism Design·Captain: mikedeng1

Strategy-Proofness and Arrow's Conditions 1: A Strict Voting Procedure with at Least Three Possible Outcomes Is Strategy-Proof Iff It Is DictatorialResearch Paper

Motivation

A committee that chooses one alternative by voting would like a voting procedure under which no member can gain by misreporting their preferences. Such a procedure is called strategy-proof. Gibbard (Econometrica 41, 1973) and Satterthwaite (J. Econ. Theory 10, 1975) proved independently that, once at least three outcomes are possible, the only strategy-proof procedures are dictatorial. The result is the starting point of the theory of strategy-proof mechanisms: it is why mechanism design restricts preference domains (single-peaked preferences, quasi-linear utilities) or allows randomization.

This mission formalizes Theorem 1 of Satterthwaite's paper, in the version circulated as Northwestern University CMS-EMS Discussion Paper No. 122 (revised December 12, 1974). Its formulation has one feature that the textbook version lacks: the hypothesis is on the range of the procedure, not on the whole alternative set, and the dictatorship is accordingly relative to that range.

Setting

A committee has a finite set InI_nIn​ of n≥1n\ge 1n≥1 individuals and a finite set SmS_mSm​ of mmm alternatives. In a strict committee every individual's ballot BiB_iBi​ is a strong order on SmS_mSm​, a ranking without ties; x Bˉi yx\,\bar B_i\,yxBˉi​y means that BiB_iBi​ ranks xxx strictly above yyy. The set of strong orders is ρm\rho_mρm​, and a ballot set is B=(B1,…,Bn)∈ρmnB=(B_1,\dots,B_n)\in\rho^n_mB=(B1​,…,Bn​)∈ρmn​.

A strict voting procedure vnmv^{nm}vnm assigns to each ballot set a single alternative vnm(B)∈Smv^{nm}(B)\in S_mvnm(B)∈Sm​. Its range TpT_pTp​ is the set of alternatives it selects at some ballot set, and p=∣Tp∣p=|T_p|p=∣Tp​∣, so 1≤p≤m1\le p\le m1≤p≤m.

Individual iii can manipulate vnmv^{nm}vnm at BBB if some ballot Bi′B_i'Bi′​ gives

vnm(B1,…,Bi′,…,Bn) Bˉi vnm(B1,…,Bi,…,Bn),v^{nm}(B_1,\dots,B_i',\dots,B_n)\ \bar B_i\ v^{nm}(B_1,\dots,B_i,\dots,B_n),vnm(B1​,…,Bi′​,…,Bn​) Bˉi​ vnm(B1​,…,Bi​,…,Bn​),

an outcome iii strictly prefers by the standard of the original ballot. The procedure is strategy-proof if no individual can manipulate it at any ballot set.

The procedure is dictatorial if some individual iii exists such that, at every ballot set BBB, vnm(B)v^{nm}(B)vnm(B) is the element of the range TpT_pTp​ that BiB_iBi​ ranks highest. It is fully dictatorial if in addition Tp=SmT_p=S_mTp​=Sm​ and partially dictatorial if Tp⊊SmT_p\subsetneq S_mTp​⊊Sm​.

The proof uses three further notions. Condition U requires that if every BiB_iBi​ ranks the same x∈Tpx\in T_px∈Tp​ above all other elements of TpT_pTp​, then vnm(B)=xv^{nm}(B)=xvnm(B)=x. The procedure is weak alternative-excluding if Tp⊊SmT_p\subsetneq S_mTp​⊊Sm​, and strong alternative-excluding if in addition it satisfies Condition U. Finally θT(Bi)\theta_T(B_i)θT​(Bi​) is the restriction of BiB_iBi​ to a subset TTT.

Formalization targets

Goal: Theorem 1 (p. 11)

For a strict committee with n≥1n\ge 1n≥1 and m≥p≥3m\ge p\ge 3m≥p≥3,

vnm is strategy-proof  ⟺  vnm is dictatorial.v^{nm}\ \text{is strategy-proof}\iff v^{nm}\ \text{is dictatorial}.vnm is strategy-proof⟺vnm is dictatorial.

Milestones

  1. Lemma 1 (p. 13): a strategy-proof strict procedure satisfies Condition U.
  2. Lemma 2 (p. 15): with one individual and three alternatives, a strategy-proof procedure is fully dictatorial or strong alternative-excluding.
  3. Lemma 3 (pp. 16–17): for n+1n+1n+1 individuals and three alternatives, individuals 1,…,n1,\dots,n1,…,n cannot manipulate vn+1,3v^{n+1,3}vn+1,3 if and only if each of the procedures B↦vn+1,3(B,Bn+1)B\mapsto v^{n+1,3}(B,B_{n+1})B↦vn+1,3(B,Bn+1​), one for each ballot of individual n+1n+1n+1, is strategy-proof.
  4. Lemma 4 (p. 22): the induction step from nnn to n+1n+1n+1 individuals for three alternatives.
  5. Lemma 5 (p. 25): for n≥1n\ge 1n≥1, m≥3m\ge 3m≥3, a strategy-proof procedure is fully dictatorial or strong alternative-excluding.
  6. Lemma 6 (p. 26): for n≥2n\ge 2n≥2, if θT(Ci)=θT(Di)\theta_{T}(C_i)=\theta_{T}(D_i)θT​(Ci​)=θT​(Di​) for all iii, with T=TpT=T_pT=Tp​, then vnm(C)=vnm(D)v^{nm}(C)=v^{nm}(D)vnm(C)=vnm(D).
  7. Proof of Theorem 1, (27)–(28) (p. 27): in the case of a strategy-proof, strong alternative-excluding vnmv^{nm}vnm with m>p≥3m>p\ge 3m>p≥3, it induces a strategy-proof procedure vnpv^{np}vnp on the alternatives of its range with vnp[θT(B1),…,θT(Bn)]=vnm(B)v^{np}[\theta_T(B_1),\dots,\theta_T(B_n)]=v^{nm}(B)vnp[θT​(B1​),…,θT​(Bn​)]=vnm(B).

Significance

Theorem 1 characterizes the strategy-proof strict voting procedures completely: given p≥3p\ge 3p≥3, they are exactly the procedures that let one individual pick, from a fixed menu TpT_pTp​, their favourite element. The classical statement assumes the procedure can select every alternative; Theorem 1 shows that excluding alternatives from the menu does not help, since a procedure with any menu of at least three alternatives is still governed by one individual. The paper's correspondence theorem with Arrow's social welfare functions (its Theorem 2) and its extension to ballots with indifference (Theorem 1') build on this statement.

The full-range case is on the platform already: AGT.gibbard_satterthwaite (Theorem 9.8 of Nisan–Roughgarden–Tardos–Vazirani, Algorithmic Game Theory) is proved and states that an incentive compatible social choice function onto at least three alternatives has a dictator; it is included here as a reference item and is exactly the case Tp=SmT_p=S_mTp​=Sm​ of Lemma 5. The open item MechanismDesign.SocialChoice.gibbard_satterthwaite (Börgers, Proposition 8.1) poses the full-range equivalence. Theorem 1 contains both as the special case Tp=SmT_p=S_mTp​=Sm​. What this mission adds is the range-restricted statement and the paper's own route to it: the induction on the number of individuals for three alternatives (Lemmas 2–4) and the reduction of a procedure with a proper range to its range (Lemma 6 and (27)–(28)). The paper only sketches Lemma 4 and defers the induction on mmm to Satterthwaite's dissertation, so the formal development fills these gaps.

Difficulty

The "if" direction is immediate. For the "only if" direction the natural first idea is to apply the full-range theorem to the procedure viewed as a map into TpT_pTp​. This fails as stated: the procedure is still defined on rankings of all mmm alternatives, and nothing yet says that its choice ignores how individuals rank alternatives outside TpT_pTp​. That is the content of Lemma 6, which needs strategy-proofness and Condition U; only after it does the procedure factor through rankings of TpT_pTp​, and only then is the factor itself strategy-proof. The full-range case itself is the classical theorem, whose known proofs (via Arrow's theorem, or by pivotal-voter arguments) are combinatorial and long.

Formalization scope

  • Individuals and alternatives are finite types ι and A; nnn = Fintype.card ι, mmm = Fintype.card A, and the n+1n+1n+1 individuals of Lemmas 3–4 are Option ι, with none the individual n+1n+1n+1.
  • Strict ballots and strategy-proofness come from the published definition agt_social (namespace AGT): a ballot is a relation r with IsStrictTotalOrder A r, r x y is the paper's x Bˉi yx\,\bar B_i\,yxBˉi​y, and strategy-proofness is AGT.IncentiveCompatible, which is the paper's definition (1) on ρmn\rho^n_mρmn​.
  • The range is taken over strict ballot sets only, and ppp is its Set.ncard. Theorem 1 assumes n≥1n\ge 1n≥1 and p≥3p\ge 3p≥3; m≥pm\ge pm≥p holds automatically, so m≥3m\ge 3m≥3 is not a separate hypothesis.
  • Dictatorial reads the paper's dictator function fTif^i_TfTi​ as "the BiB_iBi​-maximal element of TpT_pTp​", which for strong orders is unique.
  • θT(Ci)=θT(Di)\theta_T(C_i)=\theta_T(D_i)θT​(Ci​)=θT​(Di​) is encoded as agreement of the two strict relations on T×TT\times TT×T, and the procedure vnpv^{np}vnp of (28) lives on the subtype of the range.
  • Lemmas keep their printed hypotheses (m≥3m\ge 3m≥3, p≥1p\ge 1p≥1, Lemma 6's n≥2n\ge 2n≥2), even where the conclusion would hold without them. The range restriction milestone keeps the proof's case assumptions of strong alternative exclusion and m>p≥3m>p\ge 3m>p≥3.

Two encodings would trivialize the goal and are excluded: a range taken over all relation profiles (junk values would make p≥3p\ge 3p≥3 meaningless), and a dictatorship that only constrains ballot sets at which the dictator's overall favourite lies in TpT_pTp​, or that asks for the dictator's favourite in all of SmS_mSm​ (false whenever Tp⊊SmT_p\subsetneq S_mTp​⊊Sm​). The bound p≥3p\ge 3p≥3 is needed: a procedure with two possible outcomes, such as majority vote between two fixed alternatives, is strategy-proof and not dictatorial, and an imposed procedure (p=1p=1p=1) is dictatorial only vacuously.

Contributions are welcome at every milestone, and the restriction-to-range step (Lemma 6 and (27)–(28)) is reusable for any statement that transfers results from full-range to range-restricted procedures.

Selected references

  • M. A. Satterthwaite, Strategy-proofness and Arrow's Conditions: Existence and Correspondence Theorems for Voting Procedures and Social Welfare Functions, Northwestern University CMS-EMS Discussion Paper No. 122, rev. Dec. 12, 1974; published in J. Econ. Theory 10(2) (1975) 187–217. https://doi.org/10.1016/0022-0531(75)90050-2
  • A. Gibbard, Manipulation of Voting Schemes: A General Result, Econometrica 41(4) (1973) 587–601. https://doi.org/10.2307/1914083
  • N. Nisan, Introduction to Mechanism Design (for Computer Scientists), Chapter 9 of N. Nisan, T. Roughgarden, É. Tardos, V. V. Vazirani (eds.), Algorithmic Game Theory, Cambridge University Press, 2007. https://doi.org/10.1017/CBO9780511800481
  • T. Börgers, An Introduction to the Theory of Mechanism Design, Oxford University Press, 2015, Chapter 8. https://doi.org/10.1093/acprof:oso/9780199734023.001.0001
11 thms4 active usersReviewed
🏆Completed
Machine LearningOperations ResearchTheoretical Computer Science·Captain: mikedeng1

The Weighted Majority Algorithm 7: On a Class Shattered by Its Domain, Every Deterministic Learner's Mistake Bounds Satisfy Σ 2^(−M_i) < 2Research Paper

Motivation

An online learner predicts a binary label for each instance before seeing that instance's correct label. Its guarantee is usually measured by its worst possible number of mistakes against a target function. Such guarantees can differ greatly across target functions: an algorithm might learn one target quickly while taking much longer on another. Littlestone and Warmuth's analysis of the Weighted Majority Algorithm asks which collections of individual mistake guarantees can coexist for one deterministic learner. In Section 7 of their 1994 paper, they isolate a condition under which these guarantees obey a strict numerical constraint. The condition concerns how the target functions vary together over the instance domain, so the result applies without a probability distribution on instances or labels.

The theorem also supports the paper's comparison between arbitrary deterministic learners and Weighted Majority. Given individual mistake bounds, its inequality is the numerical condition that makes a suitable initial weighting of the target functions possible in Theorem 7.1 and Corollary 7.1 of the same paper. The present mission centers on the inequality itself, which is independent of a particular implementation of Weighted Majority.

Setting

Let XXX be an instance domain, possibly finite or infinite, and let φ1,…,φn:X→{0,1}\varphi_1,\ldots,\varphi_n:X\to\{0,1\}φ1​,…,φn​:X→{0,1} be a finite family of target functions. A trial presents an instance x∈Xx\in Xx∈X to a learner, asks it to predict either 000 or 111, and then reveals a label. A finite sequence is consistent with φi\varphi_iφi​ when each revealed label equals φi(x)\varphi_i(x)φi​(x) at that trial's instance. The learner may use the current instance and the complete history of earlier labeled trials when predicting; it does not see the current label first. No sampling or independence assumption is made.

The family is shattered by its domain when every pattern b=(b1,…,bn)∈{0,1}nb=(b_1,\ldots,b_n)\in\{0,1\}^nb=(b1​,…,bn​)∈{0,1}n appears as the vector of function values at some instance:

∀b∈{0,1}n∃x∈X∀i∈{1,…,n}, φi(x)=bi.\forall b\in\{0,1\}^n\quad\exists x\in X\quad\forall i\in\{1,\ldots,n\},\ \varphi_i(x)=b_i.∀b∈{0,1}n∃x∈X∀i∈{1,…,n}, φi​(x)=bi​.

This is a dual notion of shattering. The familiar VC condition asks whether a class of functions realizes every labeling of chosen instances. Here the domain realizes every joint value pattern of a chosen family of functions. The two conditions should not be interchanged.

Let AAA be any deterministic online learner. Write MiM_iMi​ for the supremum of the number of mistakes made by AAA over every finite sequence consistent with φi\varphi_iφi​. Since mistake counts are natural numbers, a finite supremum is an attained natural-number maximum. The theorem assumes each MiM_iMi​ is finite. In the Lean representation, this is a separate finiteness condition on each target's extended-natural mistake bound.

Formalization targets

Strict constraint on individual mistake bounds

The goal is Theorem 7.2 of Littlestone and Warmuth, pp. 244–245. For every domain, every finite family shattered by that domain, and every deterministic online learner with finite individual mistake bounds,

∑i=1n2−Mi<2.\sum_{i=1}^{n}2^{-M_i}<2.i=1∑n​2−Mi​<2.

The inequality is strict. Replacing it by a weak inequality would lose the stated result and the threshold used in the paper's later comparison with Weighted Majority. The theorem quantifies over the learner itself; it does not select a specially behaved learning rule.

Arithmetic milestones

Lemma 7.1 concerns positive real numbers with integral adjacent quotients. When a positive target sss is no larger than their sum and s/r1s/r_1s/r1​ is integral, some prefix sums exactly to sss. Lemma 7.2 concerns positive powers of two with integer exponents. If a power 2ℓ2^\ell2ℓ lies at least as high as each individual weight and at most as high as the total weight, some subset sums exactly to 2ℓ2^\ell2ℓ. Both statements and their exact source wording are recorded as the mission's milestones; they are the numbered arithmetic results used in Theorem 7.2.

Significance

The theorem limits the set of claims that one deterministic learner can make simultaneously. Small MiM_iMi​ contribute large terms to the sum, so a learner cannot have arbitrarily small worst-case mistake counts for all members of a domain-shattered family. This is a worst-case statement about every finite consistent trial sequence, rather than an average-case statement about a chosen data distribution. The paper's Corollary 7.1 uses the resulting inequality to select initial weights for a Weighted Majority comparison, but that later algorithmic statement is outside this mission's goal.

Formalizing this result adds a reusable dual-shattering predicate and an exact constraint on per-target online mistake bounds to the existing online-learning definitions. The paper proves the theorem, while the mission's Lean goal and its two milestone lemmas are open proof obligations. The separate published online-learning module provides the definitions of deterministic predictors, trial histories, mistake counts, and extended-natural worst-case bounds; it does not already prove this theorem.

Difficulty

For a single target, an arbitrary learner may have a small finite mistake bound. The difficulty is relating those bounds across different targets without placing extra restrictions on the learner. Domain shattering gives the adversary control over the simultaneous predictions of all functions at an instance, but the labels of one trial sequence must still remain consistent with a target. A simple count of targets or of possible patterns does not directly produce the strict weighted sum, particularly when the different MiM_iMi​ are unequal. The two arithmetic lemmas address exact sums of structured weights; the main theorem must also connect such weights to the learner's worst-case mistakes.

Formalization scope

The function family is indexed by Fin n, with zero-based Lean indices corresponding to the paper's 1,…,n1,\ldots,n1,…,n. The domain XXX is an arbitrary type and may be infinite. Labels and predictions are Bool. ShatteredByDomain states that every Boolean pattern is realized by some domain point. The published UnderstandingML_Online definition gives OnlineAlg X Bool, finite trial histories, mistakes, and mistakeBound. The latter is valued in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞} and ranges over all finite sequences labeled by the target. Each MiM_iMi​ is converted to a natural number only after assuming its bound is finite. The powers 2−Mi2^{-M_i}2−Mi​ and their finite sum are real numbers. The n=0n=0n=0 conclusion is the empty sum 0<20<20<2; the shattering predicate itself then requires an instance to realize the unique empty pattern.

The two milestones use real-valued weights. Lemma 7.1 assumes n≥1n\ge1n≥1 because the source refers to r1r_1r1​. Lemma 7.2 represents the source's integral base-two logarithms by equations ri=2kir_i=2^{k_i}ri​=2ki​ with integer kik_iki​, which also enforce positivity. Its maximum hypothesis is written pointwise, so an empty family is harmless: the other inequality 2ℓ≤02^\ell\le02ℓ≤0 cannot hold. A coordinate family on X={0,1}nX=\{0,1\}^nX={0,1}n is verified locally to satisfy the shattering predicate, ruling out a vacuous encoding of that central assumption. Contributions proving either arithmetic milestone or the main theorem within these exact definitions are in scope.

Selected references

  • Nick Littlestone and Manfred K. Warmuth, The Weighted Majority Algorithm, Information and Computation 108(2), 212–261, 1994. DOI: 10.1006/inco.1994.1009.
  • Shai Shalev-Shwartz and Shai Ben-David, Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press, 2014, Chapter 21. DOI: 10.1017/CBO9781107298019.
5 thms4 active usersReviewed
🏆Completed
Graph TheoryLinear OptimizationOperations Research·Captain: mikedeng1

Matching, Euler Tours and the Chinese Postman I: The Convex Hull of Nonnegative Integer Parity Solutions Is the Polyhedron of Odd-Set InequalitiesResearch Paper

Motivation

The Chinese postman problem, posed by Meigu Guan (Kwan Mei-Ko) in 1962, asks for a shortest closed walk in a graph that traverses every edge at least once: the route of a postman who must cover every street and return to the post office. It is the basic model of arc routing (street sweeping, snow ploughing, meter reading, inspection of networks), and it is one of the first combinatorial optimization problems shown to be solvable in polynomial time by matching methods.

Edmonds and Johnson, Matching, Euler tours and the Chinese postman (Mathematical Programming 5, 1973), reduce the postman problem to a parity problem: choose nonnegative integers xex_exe​, the number of extra traversals of each edge, so that every node becomes even, at minimum total length. Their §3 gives a complete linear description of this parity problem. The description is the first instance of what is now called the TTT-join polyhedron (with TTT the set of odd-degree nodes), a standard object of polyhedral combinatorics and a frequent example of total dual integrality.

Timeline:

  • 1962: Guan states the postman problem and an optimality criterion for it.
  • 1965: Edmonds proves the matching polyhedron theorem and gives the blossom algorithm for weighted matching (Edmonds 1965).
  • 1973: Edmonds and Johnson specialise both to the postman problem, giving the polyhedron in the edge variables alone (this mission) and a blossom algorithm that solves it (Edmonds–Johnson 1973).

Setting

A graph GGG has a finite set NNN of nodes and a finite set EEE of edges; each edge meets two different nodes, and several edges may meet the same pair of nodes. The degree of a node nnn is the number of edges meeting it, ∑e∈Eane\sum_{e\in E} a_{ne}∑e∈E​ane​, where ane=1a_{ne}=1ane​=1 if eee meets nnn and 000 otherwise. Set bn=1b_n=1bn​=1 when the degree of nnn is odd (an odd node) and bn=0b_n=0bn​=0 otherwise.

An edge eee meets a set S⊆NS\subseteq NS⊆N when exactly one of its two ends lies in SSS. A set S⊆NS\subseteq NS⊆N is an odd set when it contains an odd number of odd nodes, and any number of even nodes.

The parity points X⊆REX\subseteq\mathbb R^EX⊆RE are the vectors with

xe∈Z,xe≥0(e∈E),∑e∈Eanexe≡bn(mod2)(n∈N),x_e\in\mathbb Z,\quad x_e\ge 0\quad(e\in E),\qquad \sum_{e\in E}a_{ne}x_e\equiv b_n \pmod 2\quad(n\in N),xe​∈Z,xe​≥0(e∈E),e∈E∑​ane​xe​≡bn​(mod2)(n∈N),

the conditions (3.1), (3.2), (3.6) of the paper. Adding xex_exe​ copies of each edge eee to GGG makes every degree even, and an Euler tour of the enlarged graph is a postman tour of GGG. The postman polyhedron is

P={x∈RE: xe≥0 (e∈E),  ∑{xe:e meets S}≥1 for every odd set S},P=\Big\{x\in\mathbb R^E:\ x_e\ge 0\ (e\in E),\ \ \sum\{x_e : e\text{ meets }S\}\ge 1\ \text{for every odd set } S\Big\},P={x∈RE: xe​≥0 (e∈E),  ∑{xe​:e meets S}≥1 for every odd set S},

the conditions (3.2) and (3.5). For lengths c∈REc\in\mathbb R^Ec∈RE the objective is z=∑ecexez=\sum_e c_e x_ez=∑e​ce​xe​. The dual linear program has a variable ySy_SyS​ for each odd set, constraints yS≥0y_S\ge 0yS​≥0 and ∑{yS:e meets S}≤ce\sum\{y_S: e\text{ meets }S\}\le c_e∑{yS​:e meets S}≤ce​, and objective v=∑SySv=\sum_S y_Sv=∑S​yS​.

Formalization targets

Goal: the polyhedron theorem (p. 93)

conv⁡X=P.\operatorname{conv} X = P .convX=P.

Both inclusions are claimed. The equality is between subsets of RE\mathbb R^ERE, so it also asserts that the convex hull of XXX is closed.

Milestones

In the paper's order of argument:

  1. (3.13), p. 95: an integer solution of (3.6) has ∑{xe:e meets S}≡1(mod2)\sum\{x_e : e\text{ meets }S\}\equiv 1 \pmod 2∑{xe​:e meets S}≡1(mod2) for every odd set SSS.
  2. p. 95: conv⁡X⊆P\operatorname{conv}X\subseteq PconvX⊆P.
  3. (3.10), p. 94: weak duality, v≤zv\le zv≤z for x∈Px\in Px∈P and yyy dual feasible.
  4. (3.11)–(3.12), p. 95: complementary slackness makes xxx and yyy optimal.
  5. p. 95: for c≥0c\ge 0c≥0 there is an integral parity point xxx and a dual feasible yyy satisfying (3.11) and (3.12). The paper proves this with the algorithm of §4.
  6. p. 96: if some ce<0c_e<0ce​<0, zzz is unbounded below on PPP and on XXX.
  7. (3.19), p. 96: for c≥0c\ge 0c≥0, the minimum of zzz over PPP is attained at a parity point.

There are two companion statements. The first (pp. 93–94) says that in ∑eanexe−2wn=bn\sum_e a_{ne}x_e-2w_n=b_n∑e​ane​xe​−2wn​=bn​ with x≥0x\ge 0x≥0, integrality of wnw_nwn​ already forces wn≥0w_n\ge 0wn​≥0. The second (p. 91) is the polyhedron theorem in the variables (x,w)(x,w)(x,w): the convex hull of the integer solutions of (3.1)–(3.3) is the set of solutions of (3.2), (3.2′), (3.3), (3.5).

Significance

The theorem turns the parity problem, an integer program, into a linear program over an explicitly described polyhedron. Optimal postman tours therefore come with dual certificates: a packing of odd cuts whose total value matches the tour's extra length. The same description underlies the theory of TTT-joins and TTT-cuts (Schrijver 2003, Chapter 29).

No machine-checked proof of the TTT-join polyhedron theorem exists, on Prove2Me or, to our knowledge, in Mathlib. This mission states it in the multigraph setting of the paper. Milestones 1–4 and 6 are elementary and can serve as warm-ups. Milestone 5, total dual integrality of the odd-cut system, is the substantive step. The paper obtains it from a blossom algorithm; the milestone is stated as an existence result, so any proof of it closes it.

Difficulty

The inclusion conv⁡X⊆P\operatorname{conv}X\subseteq PconvX⊆P is a parity count. The reverse inclusion is the theorem. Two first ideas fail. Total unimodularity does not apply, because the odd-cut constraint matrix is not totally unimodular and PPP has many constraints whose tightness interacts. Reading the result off the matching polyhedron theorem needs the auxiliary loops wnw_nwn​ and an elimination step, and the 1965 matching polyhedron describes perfect matchings of a simple graph, not this parity system on a multigraph. Some argument for integrality of the minimum for every c≥0c\ge 0c≥0 is needed, and the paper's is an algorithm with a dual certificate. A further point is that PPP and XXX are unbounded: equality of hulls is not just agreement of minima over bounded objectives, and the case of objectives with a negative coefficient has to be handled separately (milestone 6).

Formalization scope

A graph is the local ChinesePostman.Polyhedron.Graph V E: a map ends : E → Sym2 V with a proof that no edge is a loop, over finite types V and E. Mathlib's SimpleGraph is not used, because the paper allows parallel edges. Degrees, odd nodes and bnb_nbn​ are computed from the graph; the set of odd nodes is never a free parameter. "eee meets SSS" means exactly one end in SSS. Odd sets range over all subsets S⊆NS\subseteq NS⊆N with an odd number of odd nodes, with no nonemptiness or properness condition. Parity points are real images of integer vectors E → ℤ, so integrality is part of XXX. Dual variables are functions Finset V → ℝ whose values matter only on odd sets: the sign condition and every sum are restricted to the odd sets. Lengths ccc are arbitrary reals except where the page assumes ce≥0c_e\ge 0ce​≥0 (milestones 5 and 7).

Trivializing readings are ruled out: (3.5) taken over nonempty proper sets only, "meets" read as "has at least one end in", the odd nodes taken as an arbitrary set TTT, or XXX allowed to contain non-integral points would each give a different, and in some cases false or trivial, statement.

Every definition the statements need is in one file, ChinesePostman.Polyhedron.Setting. A complete development needs finite-dimensional convexity (Mathlib's convexHull) and linear programming duality or an integrality argument. A Lean proof of total dual integrality for odd-cut systems would be reusable for matching and TTT-join problems beyond this paper. Proofs of any milestone, and alternative proofs of milestone 5, are welcome.

Selected references

  • J. Edmonds and E. L. Johnson, Matching, Euler tours and the Chinese postman, Mathematical Programming 5 (1973) 88–124. https://doi.org/10.1007/BF01580113
  • J. Edmonds, Maximum matching and a polyhedron with 0,1-vertices, Journal of Research of the National Bureau of Standards 69B (1965) 125–130. https://doi.org/10.6028/jres.069B.013
  • M. Guan (Kwan Mei-Ko), Graphic programming using odd or even points, Chinese Mathematics 1 (1962) 273–277.
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer, 2003, Chapter 29 (T-joins and T-cuts). https://doi.org/10.1007/978-3-540-44389-6
11 thms4 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Scheduling of Vehicles from a Central Depot to a Number of Delivery Points: The Savings Procedure Always Ends in a Feasible Truck Allocation Whose Mileage Is the Initial Less the Linked SavingsResearch Paper

Motivation

Delivering goods from one depot to many customers with a fleet of trucks is the vehicle routing problem. Dantzig and Ramser formulated it in 1959 as the "truck dispatching problem" (Management Sci. 6 (1959), doi:10.1287/mnsc.6.1.80). Five years later Clarke and Wright proposed the savings procedure (Oper. Res. 12 (1964), 568–581, doi:10.1287/opre.12.4.568): start with one truck per customer and repeatedly join two routes where joining saves the most distance, as long as the trucks can still carry the loads. On the twelve-customer example of Dantzig and Ramser it reached 290 units against their 294.

The savings procedure became the standard construction heuristic for vehicle routing. It appears in every textbook treatment of the problem, is the initial solution of many metaheuristics, and is the benchmark against which later construction methods are compared. The paper states the procedure and its bookkeeping (the half matrix, the vector QQQ, Table II) but proves nothing about it. That every run of the procedure ends, and ends in a feasible allocation, is left to the reader.

Setting

A depot P0P_0P0​ serves customers P1,…,PMP_1,\dots,P_MP1​,…,PM​. The distance dy,zd_{y,z}dy,z​ between every two points is given, and customer PjP_jPj​ requires a load qjq_jqj​. Trucks come in nnn capacity classes: xix_ixi​ trucks of capacity CiC_iCi​ are available, with C1<⋯<CnC_1<\dots<C_nC1​<⋯<Cn​, and the trucks of the smallest capacity are unlimited, x1=∞x_1=\inftyx1​=∞ (p. 569).

A run is the ordered list of customers Pa1,…,PakP_{a_1},\dots,P_{a_k}Pa1​​,…,Pak​​ served by one truck, which drives P0Pa1⋯PakP0P_0P_{a_1}\cdots P_{a_k}P_0P0​Pa1​​⋯Pak​​P0​. Its load is ∑iqai\sum_i q_{a_i}∑i​qai​​. A state of the procedure is a list of runs; its mileage is the total length of its runs. A list of runs is an allocation if every customer lies on exactly one run, and it is feasible if each run can be given a truck of capacity at least its load without using more trucks of any class than are available.

The saving of the cell (y:z)(y:z)(y:z) is d0,y+d0,z−dy,zd_{0,y}+d_{0,z}-d_{y,z}d0,y​+d0,z​−dy,z​. The half matrix records ty,z=1t_{y,z}=1ty,z​=1 if PyP_yPy​ and PzP_zPz​ are adjacent on a run, and ty,0∈{0,1,2}t_{y,0}\in\{0,1,2\}ty,0​∈{0,1,2} counts how many ends of runs lie at PyP_yPy​. Table II counts, for each capacity level CiC_iCi​, the runs with load above CiC_iCi​ and the trucks with capacity above CiC_iCi​.

The procedure starts with the runs [P1],…,[PM][P_1],\dots,[P_M][P1​],…,[PM​], so ty,0=2t_{y,0}=2ty,0​=2 for every customer. A cell (y:z)(y:z)(y:z) is admissible if (I) ty,0>0t_{y,0}>0ty,0​>0 and tz,0>0t_{z,0}>0tz,0​>0; (II) PyP_yPy​ and PzP_zPz​ are on different runs; (III) after replacing those two runs by one run of load Qy+QzQ_y+Q_zQy​+Qz​, no column of Table II has more runs than trucks. A step links an admissible cell of maximum saving, ties broken arbitrarily, by joining the two runs end to end at PyP_yPy​ and PzP_zPz​. The procedure stops when no cell is admissible.

Formalization targets

Goal: correctness of the procedure

Assume symmetric distances, C1<⋯<CnC_1<\dots<C_nC1​<⋯<Cn​, x1=∞x_1=\inftyx1​=∞, and that the initial one-truck-per-customer allocation passes the Table II test. Then every run of the procedure is finite whatever the tie-breaks; at every reachable state from which a link is possible a step exists; and every final state SSS is a feasible allocation satisfying relation (A), ∑z≠yty,z=2\sum_{z\ne y}t_{y,z}=2∑z=y​ty,z​=2 for every customer, with

mileage(S)=2∑j=1Md0,j−∑1≤y<z≤Mty,z=1(d0,y+d0,z−dy,z).\text{mileage}(S)=2\sum_{j=1}^M d_{0,j}-\sum_{\substack{1\le y<z\le M\\ t_{y,z}=1}}\bigl(d_{0,y}+d_{0,z}-d_{y,z}\bigr).mileage(S)=2j=1∑M​d0,j​−1≤y<z≤Mty,z​=1​∑​(d0,y​+d0,z​−dy,z​).

Milestones

mileage(link(S,y,z))=mileage(S)−(d0,y+d0,z−dy,z)for admissible (y:z),\text{mileage}(\text{link}(S,y,z))=\text{mileage}(S)-(d_{0,y}+d_{0,z}-d_{y,z})\quad\text{for admissible }(y:z),mileage(link(S,y,z))=mileage(S)−(d0,y​+d0,z​−dy,z​)for admissible (y:z),

relation (A) at every reachable state, the permanence of links between customers, and

#{runs with load>Ci}≤∑k>ixk  (i=1,…,n)  ⟺  the runs can be allocated to trucks,\#\{\text{runs with load}>C_i\}\le\sum_{k>i}x_k\ \ (i=1,\dots,n)\iff\text{the runs can be allocated to trucks},#{runs with load>Ci​}≤k>i∑​xk​  (i=1,…,n)⟺the runs can be allocated to trucks,

which together give feasibility of every reachable state. Two further milestones: when Cn≥∑jqjC_n\ge\sum_j q_jCn​≥∑j​qj​ and the distances are a metric, the optimum equals the traveling salesman optimum (p. 569); and on the data of Table I every run of the procedure ends with total distance 290.

Significance

The goal is the specification the paper's procedure meets: it always terminates, never gets stuck, and outputs routes the fleet can actually drive, with the mileage the half-matrix bookkeeping predicts. The equivalence of the Table II test with truck feasibility is the reason the procedure can check capacities by counting columns instead of solving an assignment problem; it is a nested-class instance of Hall's marriage condition and is reusable for any routing or bin-assignment problem with ordered vehicle classes.

None of these statements is formalized anywhere, and the paper does not prove them. The paper makes no claim of optimality ("near-optimal", p. 568, is not quantified), and the mission does not either. A formal model of the procedure as a nondeterministic transition system is a base on which later results about savings heuristics (worst-case ratios, parallel and sequential variants) can be stated.

Difficulty

The obvious argument for termination, "each link removes a run", needs the invariant that every reachable state is a partition of the customers into runs; the procedure manipulates ordered lists and reverses runs, so the invariant must be carried through every step. Feasibility is not preserved by an arbitrary link but only by one that passes condition (III), and turning the column test into an actual assignment of runs to trucks is a matching argument that fails without both x1=∞x_1=\inftyx1​=∞ and the ordering of the capacities. Because ties are broken arbitrarily, every statement must hold for all runs of a nondeterministic procedure, not for one canonical execution. The worked example requires following every tie-break.

Formalization scope

Points are Fin (M+1) with depot 0, and a run's length is SupplyChainTheory.routeCost from the referenced module SupplyChainTheory_vrp. Capacity class i : Fin (n+1) is the paper's Ci+1C_{i+1}Ci+1​; availabilities are in ℕ∞; loads and capacities are real. A state is a list of runs, each an ordered list of customers; the matrix ttt and the vector QQQ are computed from the state. The procedure is a step relation, and every invariant is stated for reachable states. Termination is Acc of the step relation at the initial state.

Choices committed to:

  • distances are arbitrary real, symmetric numbers (the half matrix, p. 573); no nonnegativity or triangle inequality is assumed in the goal, and savings may be negative;
  • every run: ties are free, as the paper suggests choosing randomly;
  • reachable states: invariants are not claimed for arbitrary lists of runs;
  • Table II is read cumulatively: column "Over CiC_iCi​" compares runs with load >Ci>C_i>Ci​ against all trucks of capacity >Ci>C_i>Ci​, as the printed Tables II, IV and VI show;
  • x1=∞x_1=\inftyx1​=∞ and C1<⋯<CnC_1<\dots<C_nC1​<⋯<Cn​ are hypotheses; qj≤Cnq_j\le C_nqj​≤Cn​ is not separately assumed, since it follows from the initial Table II test;
  • the initial one-truck-per-customer allocation is assumed feasible (p. 572);
  • the metric hypotheses enter only the traveling-salesman milestone.

A correctness claim only about final states, without termination and progress, would hold for a procedure with no moves; a step relation with a fixed tie-break would prove less than the paper; invariants for arbitrary states are false; and a mileage identity for an arbitrary partition says nothing about the procedure's output. None of these is the target.

Not formalized: the informal C1≪∑qjC_1\ll\sum q_jC1​≪∑qj​, the shadow-cost reading of p. 571, the decomposition savings (2)–(5) of the general scheme, the load-splitting reduction of pp. 572–573, the Dantzig–Ramser methods, and the empirical comparisons and appendices.

Contributions welcome: proofs of the milestones, in particular the Table II equivalence, which needs a Hall-type argument for nested classes, and a decision procedure for the worked example.

Selected references

  • G. Clarke and J. W. Wright, Scheduling of vehicles from a central depot to a number of delivery points, Operations Research 12(4) (1964), 568–581. https://doi.org/10.1287/opre.12.4.568
  • G. B. Dantzig and J. H. Ramser, The truck dispatching problem, Management Science 6(1) (1959), 80–91. https://doi.org/10.1287/mnsc.6.1.80
  • P. Hall, On representatives of subsets, Journal of the London Mathematical Society 10 (1935), 26–30. https://doi.org/10.1112/jlms/s1-10.37.26
12 thms4 active usersReviewed
🏆Completed
Operations ResearchProbabilityTheoretical Computer Science·Captain: mikedeng1

An Optimal Algorithm for On-line Bipartite Matching 1: RANKING Finds a Matching of Expected Size at Least n(1 − 1/e) − o(n) on Every Graph with a Perfect MatchingResearch Paper

Motivation

Online matching describes allocation when requests must be answered as they arrive. A matching decision uses only the edges revealed so far and cannot be revised when later requests appear. In the bipartite setting studied by Karp, U. Vazirani, and V. Vazirani, the arriving vertices are girls and the possible partners are boys. Even when the full graph has a perfect matching, a fixed greedy priority can leave many girls unmatched. The paper introduced RANKING, which randomly chooses the boys' priority order once and then uses that order for every arrival.

The question is quantitative: how many pairs does RANKING guarantee in expectation against a graph and an arrival order chosen before its random ranking? The paper's target is a fraction approaching 1−1/e1-1/e1−1/e of the nnn pairs in a perfect matching. Its printed Theorem 1 concerns an auxiliary algorithm called EARLY; the RANKING statement follows the intended chain through Lemmas 3 and 5. The original EARLY analysis has a gap for general upper-triangular matrices, so this mission states the RANKING target and the earlier, unaffected lemmas separately. This distinction matters because an assertion about EARLY would be a different formalization target.

Setting

A bipartite graph has a boy side UUU and a girl side VVV, each with nnn vertices. An edge (u,v)(u,v)(u,v) means that boy uuu may be paired with girl vvv. A matching is a collection of edges in which no boy or girl occurs twice. The standing hypothesis for the performance guarantee is that the graph has a perfect matching: some bijection from boys to girls selects an edge for every boy. The graph is otherwise arbitrary.

Girls arrive in a predetermined order. When girl vvv arrives, only her incident edges are revealed. RANKING first chooses a uniformly random permutation π\piπ of the boys. For each arriving girl, it selects the highest-ranked adjacent boy who is still unmatched, if one exists. Write MR(G,π)M_{\mathrm R}(G,\pi)MR​(G,π) for the final matching. The expected size is the finite average over all n!n!n! rankings. The guarantee must hold for every graph and every predetermined arrival order; relabeling girls lets the formal statement fix their order to n,n−1,…,1n,n-1,\ldots,1n,n−1,…,1.

The paper also uses a dual rows-arrive view. Boys arrive in an order and choose among eligible girls, whose priority order is fixed. This is the same greedy rule with the sides exchanged. For its triangular reduction, the columns are numbered 1,…,n1,\ldots,n1,…,n and column nnn has highest priority. An upper-triangular matrix with unit diagonal is a graph with every edge (i,i)(i,i)(i,i) and with an edge (i,j)(i,j)(i,j) only when i≤ji\le ji≤j. On such a graph, the auxiliary algorithm EARLY declines to match row iii if column iii is already covered by EARLY's own matching. For any matching MMM, D(M)D(M)D(M) denotes the indices for which both row iii and column iii are covered.

Formalization targets

RANKING guarantee

For every ε>0\varepsilon>0ε>0, one threshold NNN must work for every size n≥Nn\ge Nn≥N and every graph GGG with a perfect matching:

Eπ∼Unif(Sn)∣MR(G,π)∣≥(1−e−1−ε)n.\mathbb E_{\pi\sim\mathrm{Unif}(S_n)}|M_{\mathrm R}(G,\pi)| \ge (1-e^{-1}-\varepsilon)n.Eπ∼Unif(Sn​)​∣MR​(G,π)∣≥(1−e−1−ε)n.

This is the uniform lower-bound reading of the paper's n(1−1/e)−o(n)n(1-1/e)-o(n)n(1−1/e)−o(n) target. It does not prescribe a finite-nnn additive constant. The mission goal is the RANKING assertion drawn from the paper's Theorem 1 and Lemmas 3 and 5. The six milestones formalize the paper's Lemmas 1–5 and the corollary to Lemma 4, in their source order. They cover the side-exchange identity, arbitrary refusal algorithms, the triangular reduction, the matching-count identity, its expected form, and the pointwise comparison with EARLY.

Significance

The guarantee gives a concrete worst-case floor for a simple randomized allocation rule: as the graph size grows, RANKING matches at least an asymptotic 1−1/e1-1/e1−1/e fraction of the pairs available in a perfect matching, in expectation. The order is selected before the random permutation, matching the paper's performance measure. The lower bound remains meaningful on sparse graphs and does not rely on a density assumption. The original paper also studies the limit on what any randomized online algorithm can guarantee; that upper-bound result is treated in a separate mission.

A formal development here would provide reusable finite definitions for online greedy matching, arbitrary state-dependent refusal, fixed-order duality, and uniform expectation over permutations. The goal is a theorem statement awaiting a machine-checked proof; compiling the draft declarations verifies their Lean syntax and types, not their truth. The local mission separates the valid early structural statements from later statements whose published EARLY argument does not justify them on general upper-triangular graphs.

Difficulty

The random permutation does not make the fate of different vertices independent. Matching one girl removes a boy who might be essential to a later girl, so a per-arrival probability estimate cannot simply be added across all arrivals. The dual and triangular views capture useful structure, but turning that structure into a uniform bound for every graph is the main obstacle. In particular, reasoning about EARLY as if its matched-column set had the same monotonicity as unrestricted RANKING fails on some upper-triangular matrices. A proof of the goal must establish the RANKING guarantee without treating those later EARLY statements as available facts.

Formalization scope

Boys and girls are both Fin n; an adjacency matrix is a relation between them. A published predicate represents a perfect matching as an edge-preserving bijection. The generic greedy run processes arrival times in increasing order and interprets a smaller priority index as higher rank. It makes a new matching decision only from the current matching and the arriving vertex. RANKING's returned edges are consistently ordered as (boy, girl), even though girls arrive. The dual run has rows arriving in an arbitrary permutation and takes column n−1n-1n−1 as highest priority in Lean's zero-based numbering. EARLY's refusal test consults the matching constructed by EARLY itself.

All expectations are finite averages over Equiv.Perm (Fin n), scaled by 1/n!1/n!1/n!. The formal o(n)o(n)o(n) claim is ∀ε>0, ∃N, ∀n≥N, ∀G\forall\varepsilon>0,\ \exists N,\ \forall n\ge N,\ \forall G∀ε>0, ∃N, ∀n≥N, ∀G with a perfect matching, the displayed lower bound. Placing NNN before GGG preserves the worst-case meaning. The perfect-matching condition is essential: the empty graph cannot satisfy a positive linear guarantee. The triangular matrix in Lemma 3 retains every diagonal edge, so a zero matrix cannot witness the reduction. These conventions rule out vacuous versions of the goal and reduction.

The definitions of partial matching, covered vertices, greedy run, RANKING, EARLY, and uniform average are part of the mission. A complete proof may build further finite counting and permutation machinery; such lemmas can be shared beyond this paper. Contributions toward the six milestone statements, the goal, and faithful supporting results are in scope. Lemmas 6–12 and the printed EARLY Theorem 1 are outside this mission because their analysis depends on claims that fail for some matrices allowed by their surrounding assumptions.

Selected references

  • Richard M. Karp, Umesh V. Vazirani, and Vijay V. Vazirani, An Optimal Algorithm for On-line Bipartite Matching, Proceedings of the 22nd Annual ACM Symposium on Theory of Computing, 1990, pp. 352–358. DOI: 10.1145/100216.100262.
10 thms4 active usersReviewed
🏆Completed
ProbabilityStatistics·Captain: mikedeng1

Two Moments Suffice for Poisson Approximations: The Chen-Stein Method 2: A Dependent Bernoulli Process Is Within 2(2b₁+2b₂+b₃) of a Poisson Process in Total VariationResearch Paper

Motivation

Many counting problems in probability, combinatorics and statistics ask for the law of the number of occurrences of rare, weakly dependent events: long head runs in coin tossing, matching segments between two DNA sequences, isolated vertices or small subgraphs in a random graph, clusters of points in a scan statistic. Chen's 1975 adaptation of Stein's method gives an explicit error bound for approximating such a count by a Poisson law. Arratia, Goldstein and Gordon (Ann. Probab. 17 (1989) 9–25) recast it in terms of a neighbourhood of dependence for each event. In this form the error bound needs only the first two moments of the indicators whenever each event is independent of the events outside its neighbourhood. The paper's examples (head runs, DNA sequence matching, birthday-type problems) made this form standard in applied probability.

The paper has two main results. Theorem 1 bounds the distance between the law of the total count and a Poisson law; it is essentially contained in Chen (1975). Theorem 2, which the authors describe as new, is a process version. It compares the joint law of all the indicators, that is, where the events occur, with a Poisson process. Theorem 3, a corollary, compares a dependent family of events with an independent family having the same marginal probabilities. This mission formalizes Theorem 2, the finite-dimensional bound it is derived from, the steps of its proof in §6, and Theorem 3.

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) be a probability space and III an index set. For α∈I\alpha\in Iα∈I let XαX_\alphaXα​ be a Bernoulli random variable, Xα∈{0,1}X_\alpha\in\{0,1\}Xα​∈{0,1}, with

pα=P(Xα=1)>0,λ=∑α∈Ipα∈(0,∞).p_\alpha=P(X_\alpha=1)>0,\qquad \lambda=\sum_{\alpha\in I}p_\alpha\in(0,\infty).pα​=P(Xα​=1)>0,λ=α∈I∑​pα​∈(0,∞).

For each α\alphaα fix a set Bα⊆IB_\alpha\subseteq IBα​⊆I with α∈Bα\alpha\in B_\alphaα∈Bα​, the neighbourhood of dependence of α\alphaα. Put pαβ=E(XαXβ)p_{\alpha\beta}=E(X_\alpha X_\beta)pαβ​=E(Xα​Xβ​) and

b1=∑α∈I∑β∈Bαpαpβ,b2=∑α∈I∑α≠β∈Bαpαβ,b3=∑α∈IE∣E{Xα−pα∣σ(Xβ:β∈I−Bα)}∣.b_1=\sum_{\alpha\in I}\sum_{\beta\in B_\alpha}p_\alpha p_\beta,\qquad b_2=\sum_{\alpha\in I}\sum_{\alpha\neq\beta\in B_\alpha}p_{\alpha\beta},\qquad b_3=\sum_{\alpha\in I}E\bigl|E\{X_\alpha-p_\alpha\mid\sigma(X_\beta:\beta\in I-B_\alpha)\}\bigr|.b1​=α∈I∑​β∈Bα​∑​pα​pβ​,b2​=α∈I∑​α=β∈Bα​∑​pαβ​,b3​=α∈I∑​E​E{Xα​−pα​∣σ(Xβ​:β∈I−Bα​)}​.

Roughly, b1b_1b1​ measures the size of the neighbourhoods, b2b_2b2​ the expected number of neighbours of an occurrence, and b3b_3b3​ the dependence between an event and the events outside its neighbourhood. In many applications XαX_\alphaXα​ is independent of σ(Xβ:β∉Bα)\sigma(X_\beta:\beta\notin B_\alpha)σ(Xβ​:β∈/Bα​), so b3=0b_3=0b3​=0.

The dependent Bernoulli process is X=(Xα)α∈I\mathbf X=(X_\alpha)_{\alpha\in I}X=(Xα​)α∈I​, a random element of Z+I\mathbb Z_+^IZ+I​. The Poisson process on III with intensity p(⋅)p_{(\cdot)}p(⋅)​ is Y=(Yα)α∈I\mathbf Y=(Y_\alpha)_{\alpha\in I}Y=(Yα​)α∈I​ with the YαY_\alphaYα​ mutually independent and YαY_\alphaYα​ Poisson with mean pαp_\alphapα​.

Distances are measured in the paper's total variation norm,

∥L(U)−L(V)∥=sup⁡∥h∥=1∣Eh(U)−Eh(V)∣=2sup⁡A∣P(U∈A)−P(V∈A)∣,\|\mathcal L(U)-\mathcal L(V)\|=\sup_{\|h\|=1}|Eh(U)-Eh(V)|=2\sup_A|P(U\in A)-P(V\in A)|,∥L(U)−L(V)∥=∥h∥=1sup​∣Eh(U)−Eh(V)∣=2Asup​∣P(U∈A)−P(V∈A)∣,

which is twice the usual total variation distance.

Formalization targets

Goal: Theorem 2

∥L(X)−L(Y)∥≤2(2b1+2b2+b3).\|\mathcal L(\mathbf X)-\mathcal L(\mathbf Y)\|\le2(2b_1+2b_2+b_3).∥L(X)−L(Y)∥≤2(2b1​+2b2​+b3​).

The bound has no dependence on λ\lambdaλ and no assumption on III beyond countability (which the setting forces).

Milestones, in attack order

  1. TiSih=hT_iS_ih=hTi​Si​h=h (§6, p. 22). For functions on Z+d\mathbb Z_+^dZ+d​, the coordinatewise Stein operators (Tif)(j)=jif(j)−λif(j+ei)(T_if)(j)=j_if(j)-\lambda_if(j+e_i)(Ti​f)(j)=ji​f(j)−λi​f(j+ei​) and (Sih)(j+ei)=−(λiP(Zi=ji))−1E{h(j1,…,Zi,…,jd)1(Zi≤ji)}(S_ih)(j+e_i)=-(\lambda_iP(Z_i=j_i))^{-1}E\{h(j_1,\dots,Z_i,\dots,j_d)1(Z_i\le j_i)\}(Si​h)(j+ei​)=−(λi​P(Zi​=ji​))−1E{h(j1​,…,Zi​,…,jd​)1(Zi​≤ji​)} satisfy TiSih=hT_iS_ih=hTi​Si​h=h.
  2. Bounds on fi=Si(h−Pih)f_i=S_i(h-P_ih)fi​=Si​(h−Pi​h) (§6, p. 22), where PihP_ihPi​h averages hhh over a Poisson(λi\lambda_iλi​) iii-th coordinate. For ∥h∥≤1\|h\|\le1∥h∥≤1, ∥fi∥<2(1∧1.4λi−1/2)\|f_i\|<2(1\wedge1.4\lambda_i^{-1/2})∥fi​∥<2(1∧1.4λi−1/2​) and ∥Δkfi∥<4(1∧1.4λi−1/2)\|\Delta_kf_i\|<4(1\wedge1.4\lambda_i^{-1/2})∥Δk​fi​∥<4(1∧1.4λi−1/2​).
  3. Display (15) (p. 24). E{(Xα−pα)(f(U+Xβek)−f(U))}≤2∥f∥(pαβ+pαpβ)E\{(X_\alpha-p_\alpha)(f(U+X_\beta e_k)-f(U))\}\le2\|f\|(p_{\alpha\beta}+p_\alpha p_\beta)E{(Xα​−pα​)(f(U+Xβ​ek​)−f(U))}≤2∥f∥(pαβ​+pα​pβ​) for any random UUU.
  4. Displays (13)–(14), the step i=1i=1i=1 (p. 23). With Wj=∑α∈I(j)XαW_j=\sum_{\alpha\in I(j)}X_\alphaWj​=∑α∈I(j)​Xα​ the block sums of a partition and Z1Z_1Z1​ an independent Poisson(λ1\lambda_1λ1​),
∣Eh(W1,…,Wd)−Eh(Z1,W2,…,Wd)∣≤2∥f1∥∑I(1)pα2+2∥f1∥∑I(1)∑α≠β∈Bα(pαβ+pαpβ)+∥f1∥∑I(1)sα.|Eh(W_1,\dots,W_d)-Eh(Z_1,W_2,\dots,W_d)|\le2\|f_1\|\sum_{I(1)}p_\alpha^2+2\|f_1\|\sum_{I(1)}\sum_{\alpha\ne\beta\in B_\alpha}(p_{\alpha\beta}+p_\alpha p_\beta)+\|f_1\|\sum_{I(1)}s_\alpha.∣Eh(W1​,…,Wd​)−Eh(Z1​,W2​,…,Wd​)∣≤2∥f1​∥I(1)∑​pα2​+2∥f1​∥I(1)∑​α=β∈Bα​∑​(pαβ​+pα​pβ​)+∥f1​∥I(1)∑​sα​.
  1. The finite-dimensional bound (Theorem 2, p. 11). For a partition of III into nonempty blocks I(1),…,I(d)I(1),\dots,I(d)I(1),…,I(d) with Wj=∑I(j)XαW_j=\sum_{I(j)}X_\alphaWj​=∑I(j)​Xα​, Zj=∑I(j)YαZ_j=\sum_{I(j)}Y_\alphaZj​=∑I(j)​Yα​ and λj=EWj\lambda_j=EW_jλj​=EWj​:
∥L((W1,…,Wd))−L((Z1,…,Zd))∥≤2(1∧1.4(min⁡iλi)−1/2)(2b1+2b2+b3).\|\mathcal L((W_1,\dots,W_d))-\mathcal L((Z_1,\dots,Z_d))\|\le2\bigl(1\wedge1.4(\min_i\lambda_i)^{-1/2}\bigr)(2b_1+2b_2+b_3).∥L((W1​,…,Wd​))−L((Z1​,…,Zd​))∥≤2(1∧1.4(imin​λi​)−1/2)(2b1​+2b2​+b3​).

Companion results

  • Theorem 3 (p. 12). For an independent Bernoulli process X′\mathbf X'X′ with the same marginals as X\mathbf XX, ∥L(X)−L(X′)∥≤2(2b1+2b2+b3)+4∑pα2\|\mathcal L(\mathbf X)-\mathcal L(\mathbf X')\|\le2(2b_1+2b_2+b_3)+4\sum p_\alpha^2∥L(X)−L(X′)∥≤2(2b1​+2b2​+b3​)+4∑pα2​.
  • The remark after Theorem 3. ∥L(X′)−L(Y)∥≤2∑pα2\|\mathcal L(\mathbf X')-\mathcal L(\mathbf Y)\|\le2\sum p_\alpha^2∥L(X′)−L(Y)∥≤2∑pα2​, so 4∑pα24\sum p_\alpha^24∑pα2​ in Theorem 3 can be replaced by 2∑pα22\sum p_\alpha^22∑pα2​.

Significance

The result. Theorem 2 says that when b1b_1b1​, b2b_2b2​, b3b_3b3​ are small, the set of indices at which the dependent events occur is close in law to a Poisson process with the same intensity. The bound covers every event about the locations, not just the total count. It is in the strong total variation norm and needs only moment information when b3=0b_3=0b3​=0. Theorem 3 turns this into a decoupling statement: a dependent family of rare events is almost indistinguishable from an independent family with the same marginals. The process bound is the form used when the positions of rare events matter, for example in the distribution of the location of the longest match in sequence comparison and in scan statistics.

Formalizing it. The results are proved in the paper; none is machine-checked. A formal development would give a Lean statement and proof of a Chen–Stein bound with explicit constants, for countable index sets and arbitrary dependence. It would also include the coordinatewise Stein operators on Z+d\mathbb Z_+^dZ+d​ and the bounds on their solutions, which are reusable for other multivariate Poisson approximations. A companion mission formalizes Theorem 1, including Lemma 1 (the bounds on the one-variable Stein solution) on which milestone 2 rests.

Difficulty

The total variation distance between two laws on Z+I\mathbb Z_+^IZ+I​ cannot be bounded coordinate by coordinate, because the XαX_\alphaXα​ are dependent. The one-variable Stein equation controls only the law of a single integer-valued statistic. The paper passes through finite-dimensional block sums and replaces the coordinates one at a time. At each replacement the error has to be charged to the terms of b1,b2,b3b_1,b_2,b_3b1​,b2​,b3​ indexed by the current block, so that the total over all blocks reproduces 2b1+2b2+b32b_1+2b_2+b_32b1​+2b2​+b3​ without a factor ddd. Two further points need care. First, the bound ∥Δkf1∥≤2∥f1∥\|\Delta_kf_1\|\le2\|f_1\|∥Δk​f1​∥≤2∥f1​∥ is the only one available for differences in a coordinate other than the one being replaced; this is why the constants are larger than in Theorem 1. Second, the infinite index set requires a limiting argument from finitely many blocks to the full process.

Formalization scope

  • The index set is a countable type. The page says "arbitrary index set", but pα>0p_\alpha>0pα​>0 and ∑pα<∞\sum p_\alpha<\infty∑pα​<∞ force countability; the assumption also makes X\mathbf XX measurable as a map into NI\mathbb N^INI with the product σ-algebra.
  • The XαX_\alphaXα​ are measurable, N\mathbb NN-valued and bounded by 111. pαp_\alphapα​ is P(Xα=1)P(X_\alpha=1)P(Xα​=1). The standing hypotheses pα>0p_\alpha>0pα​>0, ∑pα=λ\sum p_\alpha=\lambda∑pα​=λ and λ>0\lambda>0λ>0 are explicit.
  • b1,b2,b3b_1,b_2,b_3b1​,b2​,b3​ and sαs_\alphasα​ are [0,∞][0,\infty][0,∞]-valued, and every bound is an inequality in [0,∞][0,\infty][0,∞], so a divergent series is never read as 000. The conditional expectation in sαs_\alphasα​ is taken with respect to a σ-algebra generated by measurable maps, hence a genuine sub-σ-algebra.
  • The norm ∥L(U)−L(V)∥\|\mathcal L(U)-\mathcal L(V)\|∥L(U)−L(V)∥ is twice the published definition MarkovChainCLT.tvDist (supremum over measurable sets of ∣μ(A)−ν(A)∣|\mu(A)-\nu(A)|∣μ(A)−ν(A)∣). Dropping the factor 222 would make the goal twice as strong and false in general.
  • Y\mathbf YY (and X′\mathbf X'X′ in Theorem 3) lives on its own probability space. Mutual independence of the YαY_\alphaYα​ and of the Xα′X'_\alphaXα′​ is a hypothesis. Without it the law of the process is not determined by the marginals and the statements are false.
  • Block sums WjW_jWj​ are N\mathbb NN-valued tsums, equal to the true sums almost surely. A partition is a surjection I→{1,…,d}I\to\{1,\dots,d\}I→{1,…,d} (Fin d), so Lean's coordinate 0 is the paper's coordinate 111.
  • (Sih)(j)(S_ih)(j)(Si​h)(j) is set to 000 when ji=0j_i=0ji​=0, as for SSS in §4. The strict inequalities in milestone 2 use the actual sup norms over Z+d\mathbb Z_+^dZ+d​.

Needed infrastructure: product measures and independence on NI\mathbb N^INI, Poisson laws (Mathlib's poissonMeasure), conditional expectation, and a one-variable Stein bound (Lemma 1). Contributions of proofs of any milestone, of the general step iii of §6, and of the one-dimensional Lemma 1 are welcome.

Selected references

  • R. Arratia, L. Goldstein, L. Gordon, Two moments suffice for Poisson approximations: the Chen-Stein method, Ann. Probab. 17(1) (1989) 9–25. https://doi.org/10.1214/aop/1176991491
  • L. H. Y. Chen, Poisson approximation for dependent trials, Ann. Probab. 3(3) (1975) 534–545. https://doi.org/10.1214/aop/1176996359
  • A. D. Barbour, G. K. Eagleson, Poisson approximation for some statistics based on exchangeable trials, Adv. Appl. Probab. 15(3) (1983) 585–600. https://doi.org/10.2307/1426620
  • A. D. Barbour, L. Holst, S. Janson, Poisson Approximation, Oxford University Press, 1992. https://global.oup.com/academic/product/poisson-approximation-9780198522355
8 thms4 active usersReviewed
🏆Completed
ProbabilityStatistics·Captain: mikedeng1

Two Moments Suffice for Poisson Approximations: The Chen-Stein Method 1: Total Variation Bound 2[(b₁+b₂)(1−e^{−λ})/λ + b₃′(1∧1.4λ^{−1/2})] for a Sum of Dependent IndicatorsResearch Paper

Motivation

Counts of rare events often look Poisson even when the events are dependent. For example, a local pattern in a random graph can overlap another copy of the pattern, so the corresponding occurrence indicators are not independent. The useful question is quantitative: how far is the distribution of the total count from a Poisson distribution with the same mean? Arratia, Goldstein and Gordon give a bound in terms of three quantities that can be estimated from neighbourhoods of dependence. Their 1989 paper applies the Chen–Stein method to the count and then to the full point process. This mission concerns the count bound, Theorem 1.

The authors explain that the result is essentially contained in Chen’s earlier work, while their one-variable proof prepares the process result in Theorem 2. The bound remains useful as a precise statement of the dependence conditions under which the Poisson approximation works. The process theorem belongs to the companion mission.

Setting

Let III index Bernoulli indicators XαX_\alphaXα​, each taking values in {0,1}\{0,1\}{0,1} on a probability space with law PPP. Write pα=P(Xα=1)>0p_\alpha=P(X_\alpha=1)>0pα​=P(Xα​=1)>0, and let

W=∑α∈IXα,λ=EW=∑α∈Ipα∈(0,∞).W=\sum_{\alpha\in I}X_\alpha,\qquad \lambda=E W=\sum_{\alpha\in I}p_\alpha\in(0,\infty).W=α∈I∑​Xα​,λ=EW=α∈I∑​pα​∈(0,∞).

For each α\alphaα, choose a dependence neighbourhood Bα⊆IB_\alpha\subseteq IBα​⊆I containing α\alphaα. The neighbourhoods need not be symmetric, and the theorem imposes no independence condition: dependence on indicators outside BαB_\alphaBα​ is measured directly. Define pαβ=E(XαXβ)p_{\alpha\beta}=E(X_\alpha X_\beta)pαβ​=E(Xα​Xβ​) and

b1=∑α∑β∈Bαpαpβ,b2=∑α∑β∈Bαβ≠αpαβ.\begin{aligned} b_1&=\sum_\alpha\sum_{\beta\in B_\alpha}p_\alpha p_\beta,\\ b_2&=\sum_\alpha\sum_{\substack{\beta\in B_\alpha\\\beta\ne\alpha}}p_{\alpha\beta}. \end{aligned}b1​b2​​=α∑​β∈Bα​∑​pα​pβ​,=α∑​β∈Bα​β=α​∑​pαβ​.​

The remaining quantities use conditional expectation. Let Vα=∑β∉BαXβV_\alpha=\sum_{\beta\notin B_\alpha}X_\betaVα​=∑β∈/Bα​​Xβ​, and let Fα\mathcal F_\alphaFα​ be the sigma algebra generated by all XβX_\betaXβ​ outside BαB_\alphaBα​. Put

sα′=E∣E[Xα−pα∣Vα]∣,b3′=∑αsα′,sα=E∣E[Xα−pα∣Fα]∣,b3=∑αsα.\begin{aligned} s'_\alpha&=E\left|E[X_\alpha-p_\alpha\mid V_\alpha]\right|, & b'_3&=\sum_\alpha s'_\alpha,\\ s_\alpha&=E\left|E[X_\alpha-p_\alpha\mid\mathcal F_\alpha]\right|, & b_3&=\sum_\alpha s_\alpha. \end{aligned}sα′​sα​​=E∣E[Xα​−pα​∣Vα​]∣,=E∣E[Xα​−pα​∣Fα​]∣,​b3′​b3​​=α∑​sα′​,=α∑​sα​.​

Conditioning on the count VαV_\alphaVα​ retains less information than conditioning on all far indicators, so sα′≤sαs'_\alpha\le s_\alphasα′​≤sα​. Let ZZZ have the Poisson law with mean λ\lambdaλ. The paper defines ∥L(W)−L(Z)∥\|\mathcal L(W)-\mathcal L(Z)\|∥L(W)−L(Z)∥ as twice the usual supremum over events: 2sup⁡A∣P(W∈A)−P(Z∈A)∣2\sup_A|P(W\in A)-P(Z\in A)|2supA​∣P(W∈A)−P(Z∈A)∣.

Formalization targets

Theorem 1: total variation and the zero-count event

The goal is the complete four-clause statement of Theorem 1, including its strict final inequality:

∥L(W)−L(Z)∥≤2[(b1+b2)1−e−λλ+b3′min⁡{1,1.4λ−1/2}]≤2(b1+b2+b3),∣P(W=0)−e−λ∣≤(b1+b2+b3′)1−e−λλ<min⁡{1,λ−1}(b1+b2+b3).\begin{aligned} \|\mathcal L(W)-\mathcal L(Z)\| &\le 2\left[(b_1+b_2)\frac{1-e^{-\lambda}}{\lambda} +b'_3\min\{1,1.4\lambda^{-1/2}\}\right]\\ &\le 2(b_1+b_2+b_3),\\ |P(W=0)-e^{-\lambda}| &\le (b_1+b_2+b'_3)\frac{1-e^{-\lambda}}{\lambda} <\min\{1,\lambda^{-1}\}(b_1+b_2+b_3). \end{aligned}∥L(W)−L(Z)∥∣P(W=0)−e−λ∣​≤2[(b1​+b2​)λ1−e−λ​+b3′​min{1,1.4λ−1/2}]≤2(b1​+b2​+b3​),≤(b1​+b2​+b3′​)λ1−e−λ​<min{1,λ−1}(b1​+b2​+b3​).​

The intermediate targets are the Stein-operator inverse identity, the bound on a telescoping term, display (11) relating the approximation error to b1,b2,b3′b_1,b_2,b'_3b1​,b2​,b3′​, and the two clauses of Lemma 1. The goal keeps the coefficients and both forms of b3b_3b3​ fixed, as the paper states them.

Significance

The result reduces a distributional approximation question to local sums of probabilities and conditional-dependence errors. When b1b_1b1​, b2b_2b2​ and b3b_3b3​ are small, the entire law of the count is close to its Poisson comparison law, and the probability of no occurrence has its own sharper bound. The latter is useful whenever a model asks whether at least one rare event occurs. The result applies without demanding exact independence outside the chosen neighbourhoods; the residual dependence appears in b3b_3b3​.

The paper proves these results. The formalization task is to give the known estimates machine-checked statements and proofs with the constants and probability conventions exposed. Mathlib supplies the Poisson measure and conditional expectation, while the mission adds the paper-specific neighbourhood sums and Stein operators. The formalized theorem can be reused for count approximations in other dependent-indicator models once those models supply bounds on the three error quantities. No machine-checked proof is claimed here: the theorem items are proposed targets with sorry bodies.

Difficulty

A first approximation based only on EWE WEW misses overlapping event pairs. Bounding pair dependence through b2b_2b2​ alone also misses dependence between one indicator and the aggregate of far indicators. The authors' third term measures that remaining effect by conditional expectation. The proof must control the Stein solution uniformly while preserving its precise constants; replacing that control with a qualitative bound would not recover Theorem 1. In the countably infinite setting, the sums and conditional expectations also require careful handling of convergence and measurability. The proof of Lemma 1 is attributed in the paper to Barbour and Eagleson; it is a substantive target here rather than an assumed bound.

Formalization scope

The Lean index type is countable. Under the paper's assumptions pα>0p_\alpha>0pα​>0 and ∑αpα<∞\sum_\alpha p_\alpha<\infty∑α​pα​<∞, only countably many indices can exist, so this representation retains the stated probabilistic setting. Indicators are measurable natural-number-valued functions with values at most one. The parameter λ\lambdaλ is a positive real equipped with the exact HasSum statement for the probabilities. The Poisson law is Mathlib's poissonMeasure at λ\lambdaλ converted to a nonnegative real parameter.

The sums defining b1,b2,b3,b3′b_1,b_2,b_3,b'_3b1​,b2​,b3​,b3′​ use extended nonnegative reals, so divergence becomes +∞+\infty+∞ rather than the real tsum default zero. The random counts WWW and VαV_\alphaVα​ use natural-number tsum; their divergent-input default can occur only on a null set under the finite-mean hypotheses and therefore does not change their laws. Measurability of these counts follows from countability and measurability of each indicator. The far-field sigma algebra is generated by the measurable indicators, and the formalization checks that it lies below the ambient sigma algebra, avoiding a default-zero conditional expectation. The paper's total variation norm is exactly 2 * MarkovChainCLT.tvDist, with the factor two retained.

The source writes a strict final inequality without discussing infinite error sums. The Lean statement conditions that single strict clause on b1+b2+b3<∞b_1+b_2+b_3<\inftyb1​+b2​+b3​<∞; otherwise both sides can be infinite and strict comparison is false. The other three clauses allow infinite bounds, as the source does. Lemma 1 fixes the Stein inverse at zero exactly as the paper chooses and uses explicit pointwise sup-norm bounds over all nonnegative integers. Display (11) allows ∣h(k)∣≤1|h(k)|\le1∣h(k)∣≤1, a strengthening of the displayed ∥h∥=1\|h\|=1∥h∥=1 case. These choices rule out loss of the norm's factor two, disappearing divergent sums, default-zero mapped measures or conditional expectations, and an unannounced independence assumption.

Selected references

  • Richard Arratia, Larry Goldstein and Louis Gordon, Two moments suffice for Poisson approximations: the Chen-Stein method, Annals of Probability 17(1), 9–25, 1989. DOI 10.1214/aop/1176991491.
8 thms4 active usersReviewed
Discrete GeometryLinear Optimization·Captain: mikedeng1

A Counterexample to the Hirsch Conjecture I: A 43-Dimensional Polytope with 86 Facets Whose Diameter Exceeds 43Research Paper

Motivation

The Hirsch conjecture, stated by Warren M. Hirsch in a 1957 letter to George Dantzig, asserts that the combinatorial diameter of a ddd-dimensional polytope with nnn facets is at most n−dn-dn−d. The diameter is the largest number of edge steps needed to walk between two vertices of the polytope. The question matters to linear optimization: every edge-following pivot rule of the simplex method, starting at a vertex of the feasible region, needs at least as many pivots as the graph distance to an optimal vertex. A polynomial bound on polytope diameters is a necessary condition for a strongly polynomial simplex method, which is still unknown.

Timeline of the conjecture before the counterexample:

  • 1967, Klee and Walkup: the conjecture fails for unbounded polyhedra, and for bounded polytopes it is equivalent to the ddd-step conjecture (the case n=2dn=2dn=2d). They also proved it for n−d≤5n-d\le 5n−d≤5.
  • 1992, Kalai and Kleitman: a quasi-polynomial upper bound nlog⁡2d+2n^{\log_2 d+2}nlog2​d+2 on the diameter.
  • 2010, Santos: a counterexample in dimension 43 with 86 facets (arXiv:1006.2814, published in Ann. of Math. 176 (2012) 383–412). It is the subject of this mission.
  • 2012, Matschke, Santos and Weibel: smaller 5-dimensional spindles, giving counterexamples in dimension 20 (arXiv:1202.4701).

The polynomial Hirsch conjecture, which asks only for a bound polynomial in nnn and ddd, remains open.

Setting

A polytope in Rd\mathbb R^dRd is written as Hpoly(a,b)={x:⟨ai,x⟩≤bi, i=1,…,n}\mathrm{Hpoly}(a,b)=\{x:\langle a_i,x\rangle\le b_i,\ i=1,\dots,n\}Hpoly(a,b)={x:⟨ai​,x⟩≤bi​, i=1,…,n}. A facet presentation is one in which Hpoly(a,b)\mathrm{Hpoly}(a,b)Hpoly(a,b) has nonempty interior and no inequality is redundant. For a bounded polytope it then has dimension ddd, and its nnn inequalities correspond one to one to its facets. A step between two vertices crosses an edge (a one-dimensional face). The polytope is non-Hirsch when its diameter exceeds n−dn-dn−d.

A spindle (Santos, Definition 1.4) is a polytope with two distinguished vertices u,vu,vu,v such that every facet contains exactly one of them. Its length is the graph distance from uuu to vvv. The polar objects are prismatoids: polytopes with two parallel facets Q+,Q−Q^+,Q^-Q+,Q− containing all vertices, whose width is the dual-graph distance between Q+Q^+Q+ and Q−Q^-Q−.

Santos's explicit object is the 5-prismatoid QQQ whose vertices are the 48 rows of Table 1 of the paper: 1+,…,24+1^+,\dots,24^+1+,…,24+ with x5=1x_5=1x5​=1 and 1−,…,24−1^-,\dots,24^-1−,…,24− with x5=−1x_5=-1x5​=−1. Its polar QΔ={x∈R5:⟨r,x⟩≤1 for each row r}Q^\Delta=\{x\in\mathbb R^5:\langle r,x\rangle\le1\ \text{for each row } r\}QΔ={x∈R5:⟨r,x⟩≤1 for each row r} is a spindle with apices e5e_5e5​ and −e5-e_5−e5​. Table 2 of the paper lists the 322 facets of QQQ, which are the 322 vertices of QΔQ^\DeltaQΔ: ±e5\pm e_5±e5​ and the points 1c0(±c1,±c2,±c3,±c4,c5)\frac1{c_0}(\pm c_1,\pm c_2,\pm c_3,\pm c_4,c_5)c0​1​(±c1​,±c2​,±c3​,±c4​,c5​) of twenty types B,B′,…,K,K′B,B',\dots,K,K'B,B′,…,K,K′ with sixteen sign patterns each. The symmetry group Σ\SigmaΣ of QQQ has order 64; its index-two subgroup Σ+\Sigma^+Σ+ preserves Q+Q^+Q+ and Q−Q^-Q−.

Formalization targets

Goal: Corollary 1.7

∃ a:Fin 86→R43, b∈R86:Hpoly(a,b) nonempty, bounded, a facet presentation, and diam⁡Hpoly(a,b)>43.\exists\, a:\mathrm{Fin}\,86\to\mathbb R^{43},\ b\in\mathbb R^{86}:\quad \mathrm{Hpoly}(a,b)\ \text{nonempty, bounded, a facet presentation, and}\ \operatorname{diam}\mathrm{Hpoly}(a,b)>43.∃a:Fin86→R43, b∈R86:Hpoly(a,b) nonempty, bounded, a facet presentation, and diamHpoly(a,b)>43.

The goal fixes the dimension (43) and the number of facets (86), as the paper does. It does not assert the exact diameter (44, remarked on p. 24).

Milestones

  1. §3, first bullet (polar form): QΔQ^\DeltaQΔ is a bounded 48-facet spindle with apices ±e5\pm e_5±e5​, the rows tight at e5e_5e5​ being 1+,…,24+1^+,\dots,24^+1+,…,24+.
  2. Theorem 4.1(1) (polar form): the 322 points of Table 2 are distinct vertices of QΔQ^\DeltaQΔ; the letter classes are Σ+\Sigma^+Σ+-orbits and the six Σ\SigmaΣ-orbits are A ∪ L, B ∪ K, C ∪ J, D ∪ I, E ∪ H, F ∪ G.
  3. Theorem 4.1(2) (polar form): QΔQ^\DeltaQΔ has no other vertices.
  4. Theorem 3.1 (polar form): the distance from e5e_5e5​ to −e5-e_5−e5​ in the graph of QΔQ^\DeltaQΔ is exactly 6.
  5. Theorem 1.6: a 5-spindle with 48 facets, 322 vertices and length exactly six exists.
  6. Inductive step of Theorem 2.6 (polar form): a ddd-spindle with n>2dn>2dn>2d facets and length at least lll yields a (d+1)(d+1)(d+1)-spindle with n+1n+1n+1 facets and length at least l+1l+1l+1.
  7. Theorem 1.5 (strong ddd-step theorem): a ddd-spindle with nnn facets and length at least lll yields an (n−d)(n-d)(n−d)-spindle with 2n−2d2n-2d2n−2d facets and length at least l+n−2dl+n-2dl+n−2d, non-Hirsch when l>dl>dl>d.

Significance

Corollary 1.7 settles the Hirsch conjecture in the negative. Theorem 1.5 is the reusable part: it turns any spindle whose length exceeds its dimension into a counterexample. That made the later search for small spindles (Matschke–Santos–Weibel) a finite, low-dimensional problem. Theorem 1.6 is the concrete certificate. Its claims about Tables 1 and 2 are finite statements about explicit rational data.

The result is proved, and several pieces are already formalized on Prove2Me. Hirsch.santos_counterexample (Proved) states that some polytope violates the bound n−dn-dn−d, with no dimension or facet count. Hirsch.strong_dstep_spindle (Proved) is the "in particular" clause of Theorem 1.5, counting inequalities rather than facets. Lemmas 2.2 and 2.4 of the paper are Proved in polar form (Hirsch.spindle_inward_row_push_graph, Hirsch.spindle_wedge_vertex_graph_projection), as is the bound n≥2dn\ge2dn≥2d for spindles (Hirsch.spindle_n_ge_two_d). This mission adds the dimension-43, 86-facet statement with facets counted exactly, the general length bound l+n−2dl+n-2dl+n−2d with the spindle structure preserved, and a machine-checkable account of Santos's specific spindle.

Difficulty

The obvious first idea for the 5-dimensional milestones is brute computation. This is feasible in principle but heavy in Lean. Showing that 322 given points are extreme requires exhibiting, for each, five linearly independent tight rows among 48. Showing that no other vertex exists requires a complete enumeration argument rather than a membership check. Exact distance 6 requires the full adjacency structure between the 322 vertices, not only a path.

For the general theorems, the difficulty is that the construction is a one-point suspension followed by a perturbation. Edges and facets of the new polytope must be controlled, with the face lattice changing only in a prescribed way. Diameter is not monotone under arbitrary perturbations, and in particular a walk can become shorter. Keeping the facet count exact (not merely the inequality count) adds an irredundancy argument at each step.

Formalization scope

Polytopes are H-presentations Hirsch.Hpoly a b with a : Fin n → EuclideanSpace ℝ (Fin d), from the platform definition Hirsch_model. "A ddd-polytope with nnn facets" is boundedness plus IsFacetPresentation: nonempty interior and every row irredundant. Without this predicate, padding with redundant rows would change the bound n−dn-dn−d, and the statement would collapse to the platform's dimension-free Hirsch.santos_counterexample. Diameter and length use the platform's padded walks (Hirsch.DiamLE, Hirsch.Reach). "Length at least LLL" means no walk of fewer than LLL steps, and "length exactly LLL" adds a walk of LLL steps. The junk-valued Hirsch.gdist is never used.

All prismatoid statements of the paper (§3, Theorems 2.6, 3.1, 4.1) are stated for the polar spindle, which the paper licenses (pp. 6, 8, 9). Vertices of QQQ become rows, facets of QQQ become vertices, the width becomes the apex distance, and Q±Q^\pmQ± become ±e5\pm e_5±e5​. Natural-number expressions n−dn-dn−d, 2n−2d2n-2d2n−2d, l+(n−2d)l+(n-2d)l+(n−2d) are faithful because spindles have n≥2dn\ge2dn≥2d. Theorem 1.5's "length lll" is read as "length at least lll", which is equivalent by monotonicity. Tables 1 and 2 are written entry by entry in Lean in the page's order.

Useful contributions include proofs of the finite Table 1/Table 2 facts by certified computation, reusable lemmas on one-point suspensions and on facet presentations under perturbation, and a proof of Corollary 1.7 from milestones 5 and 7.

Selected references

  • F. Santos, A counterexample to the Hirsch conjecture, Ann. of Math. 176 (2012) 383–412; cited version arXiv:1006.2814v3. https://arxiv.org/abs/1006.2814 , https://doi.org/10.4007/annals.2012.176.1.7
  • V. Klee and D. W. Walkup, The d-step conjecture for polyhedra of dimension d < 6, Acta Math. 117 (1967) 53–78. https://doi.org/10.1007/BF02395040
  • G. Kalai and D. J. Kleitman, A quasi-polynomial bound for the diameter of graphs of polyhedra, Bull. Amer. Math. Soc. 26 (1992) 315–316. https://arxiv.org/abs/math/9204233
  • B. Matschke, F. Santos and C. Weibel, The width of five-dimensional prismatoids, Proc. London Math. Soc. 110 (2015) 647–672. https://arxiv.org/abs/1202.4701
15 thms4 active usersReviewed
🏆Completed
Graph TheoryOperations ResearchOptimization·Captain: mikedeng1

Maximal Flow Through a Network I: The Minimal Cut Theorem — the Maximal Flow Value Equals the Minimum Value of a Disconnecting SetResearch Paper

Motivation

The question behind this mission was posed by T. E. Harris to L. R. Ford, Jr. and D. R. Fulkerson at RAND, in the setting of rail transport: given a rail network linking two cities, with a capacity on every link, find the largest steady flow from one city to the other. Ford and Fulkerson's answer, the minimal cut theorem, published in the Canadian Journal of Mathematics in 1956 (DOI 10.4153/CJM-1956-045-5), says that the obvious upper bound, the total capacity of a set of links whose removal separates the two cities, is always achieved by some flow.

The theorem became the starting point of network flow theory, and through it of a large part of combinatorial optimization and operations research: transportation, assignment, scheduling and network reliability problems are routinely reduced to it.

Timeline.

  • 1927: K. Menger proves that the minimum number of vertices separating two vertex sets of a graph equals the maximum number of disjoint paths joining them (Fund. Math. 10), the unit-capacity ancestor of the theorem.
  • 1955: Harris and Ross study the Soviet rail network as a capacity problem in a RAND report; Harris formulates the maximal flow problem (Schrijver's historical account: Math. Program. 91, 2002).
  • 1956: Ford and Fulkerson publish the minimal cut theorem for undirected networks, with a non-constructive proof based on maximal flows (this paper). Independently, Elias, Feinstein and Shannon state and prove the max-flow min-cut theorem for directed networks (IRE Trans. Inf. Theory 2, 1956), and Dantzig and Fulkerson obtain it from linear programming duality.
  • 1956–1962: Ford and Fulkerson's labelling (augmenting path) algorithm, collected in Flows in Networks (Princeton, 1962).
  • 1972: Edmonds and Karp give polynomial bounds for augmenting-path methods (J. ACM 19).

Setting

A network NNN consists of a finite set of vertices VVV, a finite set of arcs EEE, two distinct vertices, the source aaa and the sink bbb, and a positive capacity c(e)>0c(e)>0c(e)>0 on every arc. Each arc eee has two distinct end vertices; arcs are undirected, and several arcs may join the same pair of vertices.

A chain joining uuu and www is a set of distinct arcs that can be arranged as α1(v0v1),α2(v1v2),…,αm(vm−1vm)\alpha_1(v_0v_1),\alpha_2(v_1v_2),\dots,\alpha_m(v_{m-1}v_m)α1​(v0​v1​),α2​(v1​v2​),…,αm​(vm−1​vm​) with v0=uv_0=uv0​=u, vm=wv_m=wvm​=w and the vertices v0,…,vmv_0,\dots,v_mv0​,…,vm​ pairwise distinct; each arc may be traversed in either direction. The null chain (m=0m=0m=0) joins uuu to itself.

A flow fff assigns a number f(C)≥0f(C)\ge 0f(C)≥0 to each chain CCC joining aaa and bbb (and 000 to every other set of arcs) such that the load ℓf(e)=∑C∋ef(C)\ell_f(e)=\sum_{C\ni e}f(C)ℓf​(e)=∑C∋e​f(C) satisfies ℓf(e)≤c(e)\ell_f(e)\le c(e)ℓf​(e)≤c(e) for every arc. Its value is val(f)=∑Cf(C)\mathrm{val}(f)=\sum_C f(C)val(f)=∑C​f(C). An arc is saturated by fff if ℓf(e)=c(e)\ell_f(e)=c(e)ℓf​(e)=c(e). A maximal flow is a flow of largest value.

A set DDD of arcs is a disconnecting set if every chain joining aaa and bbb contains an arc of DDD; its value is v(D)=∑e∈Dc(e)v(D)=\sum_{e\in D}c(e)v(D)=∑e∈D​c(e). A cut is a disconnecting set no proper subset of which is disconnecting.

The proof introduces two further objects: the set SSS of arcs saturated by every maximal flow, and the set L⊆SL\subseteq SL⊆S of left arcs, those arcs of SSS whose left vertex (the end vertex met first by a positive chain flow of a maximal flow, travelling from aaa) can be reached from aaa by a chain with no arc saturated by some maximal flow.

Formalization targets

Goal: Theorem 1 (Minimal cut theorem), p. 400

∃ m∈R:m=max⁡f flowval(f)=min⁡D disconnectingv(D),\exists\, m\in\mathbb R:\quad m=\max_{f\ \text{flow}}\mathrm{val}(f)=\min_{D\ \text{disconnecting}}v(D),∃m∈R:m=f flowmax​val(f)=D disconnectingmin​v(D),

with both the maximum and the minimum attained. The statement mentions only flows and disconnecting sets, not the proof objects SSS and LLL.

Milestones, in the order of the paper's proof

  1. A maximal flow exists, and the set of maximal flows is convex (p. 400).
  2. Lemma 1: SSS is a disconnecting set (p. 400).
  3. Every arc of SSS receives the same orientation from all positive chain flows of all maximal flows: its left vertex is unique (pp. 400–401).
  4. Lemma 2: LLL is a disconnecting set (p. 401).
  5. Lemma 3: no positive chain flow of a maximal flow contains more than one arc of LLL (p. 401).
  6. val(f)≤v(D)\mathrm{val}(f)\le v(D)val(f)≤v(D) for every flow fff and every disconnecting set DDD (p. 402).
  7. LLL is a cut of minimal value, and every maximal flow has value v(L)v(L)v(L) (p. 402).

Two further statements of the paper are included as items without being milestones: the remark that a disconnecting set of minimal value is a cut (p. 400), and the Corollary (p. 402): if a set AAA of arcs meets every cut in exactly one arc, adding kkk to the capacity of each arc of AAA raises the maximal flow value by kkk.

Significance

The minimal cut theorem turns a maximization over flows into a minimization over finite sets of arcs, so an optimal flow comes with a short certificate of optimality. It implies Menger's theorem (unit capacities), and through it König's theorem on bipartite matchings and Hall's marriage theorem. The Corollary is the tool behind the paper's own computing procedure for source–sink planar networks (§2, formalized in a companion mission).

The theorem is classical and proved. What this mission adds is a machine-checked proof of the paper's own formulation: undirected arcs, parallel arcs, flows decomposed along chains (path flows, with no circulations), and the minimum taken over arc sets meeting every chain, together with the proof's intermediate claims. Max-flow min-cut theorems already on the platform (Applied Combinatorics VIII, AppliedComb.Flows.max_flow_min_cut; Introduction to Linear Optimization X, LinearOptimization.max_flow_min_cut) concern directed networks with edge flows obeying conservation and cuts given by vertex sets. They are related results, not this statement, and connecting the two models is itself welcome work.

Difficulty

Weak duality (milestone 6) is immediate; the content is the reverse inequality. The obvious first step, taking a maximal flow and observing that its saturated arcs separate aaa from bbb, does not finish the proof: a positive chain flow may pass through several saturated arcs, so the total capacity of the saturated arcs can exceed the flow value. One has to single out a disconnecting subset that every positive chain flow crosses exactly once, and there is no canonical choice from a single flow. The paper's sets SSS and LLL are defined from all maximal flows at once, and the work consists in showing that these sets are well behaved. The orientation claim in particular needs an exchange argument on two chains that cross at an arc, where the recombined arc sequences may revisit vertices and must be reduced to chains. In a formal development this "a walk contains a chain" step and the averaging of maximal flows over finitely many chains are the main bookkeeping costs.

Formalization scope

  • A network is a structure on a vertex type V and an arc type E, both Fintype with decidable equality, with end-vertex maps tail, head (labels only, no direction), tail e ≠ head e, a source and a sink with source ≠ sink, and capacities cap : E → ℝ with 0 < cap e. These are the paper's standing assumptions; there are no others in §1. In particular, no planarity is assumed and an arc may join aaa and bbb directly.
  • A chain is a Finset E that is the arc set of some arrangement (list of arcs, list of pairwise distinct vertices, each arc joining consecutive vertices in either order).
  • A flow is a function f : Finset E → ℝ, non-negative, zero off the chains joining source and sink, with every arc load at most the capacity. A collection of chain flows that lists a chain twice merges into this form without changing the value or any load.
  • "Maximal" means of maximum value. The goal is stated with IsGreatest and IsLeast on the sets of flow values and of values of disconnecting sets, so no supremum of a real set appears and both extrema must be attained.
  • A trivializing formalization is ruled out: chains must be self-avoiding and must join the source and the sink, the disconnecting condition quantifies over exactly these chains, and the minimum ranges over all disconnecting sets rather than over a family chosen to match a given flow.
  • Needed infrastructure: finite sums over Finset (Finset E), convexity in Finset E → ℝ, compactness of the flow polytope (for existence), and lemmas on lists (extracting a chain from a walk). The walk-to-chain lemma and weak duality are reusable for the companion mission and for any path-flow model.

Selected references

  • L. R. Ford, Jr. and D. R. Fulkerson, Maximal Flow Through a Network, Canadian Journal of Mathematics 8 (1956), 399–404. https://doi.org/10.4153/CJM-1956-045-5
  • P. Elias, A. Feinstein and C. E. Shannon, A note on the maximum flow through a network, IRE Transactions on Information Theory 2 (1956), 117–119. https://doi.org/10.1109/TIT.1956.1056816
  • K. Menger, Zur allgemeinen Kurventheorie, Fundamenta Mathematicae 10 (1927), 96–115. https://doi.org/10.4064/fm-10-1-96-115
  • L. R. Ford, Jr. and D. R. Fulkerson, Flows in Networks, Princeton University Press, 1962.
  • J. Edmonds and R. M. Karp, Theoretical improvements in algorithmic efficiency for network flow problems, Journal of the ACM 19 (1972), 248–264. https://doi.org/10.1145/321694.321699
  • A. Schrijver, On the history of the transportation and maximum flow problems, Mathematical Programming 91 (2002), 437–445. https://doi.org/10.1007/s101070100259
13 thms4 active usersReviewed
🏆Completed
Graph TheoryLinear OptimizationOperations Research+1·Captain: mikedeng1

Maximum Matching and a Polyhedron With 0,1-Vertices: The Vertices of the Matching Polyhedron Are Exactly the Matching VectorsResearch Paper

Motivation

A matching in a graph is a set of edges no two of which share a node. Given a real weight on every edge, the maximum-weight matching problem asks for a matching of largest total weight. It is one of the basic problems of combinatorial optimization: assignment, pairing and scheduling problems reduce to it, and it is the standard example of a combinatorial problem that is solvable in polynomial time although it is not obviously a linear program.

For bipartite graphs the problem is a linear program in disguise: the polytope cut out by nonnegativity and the node-degree inequalities has only 0–1 vertices (the Birkhoff–von Neumann theorem in the square case; Mathlib has it as extremePoints_doublyStochastic). For general graphs this fails already on a triangle, where the vector with every coordinate 1/21/21/2 satisfies all degree inequalities but is not a combination of matchings. Edmonds' 1965 paper (DOI 10.6028/jres.069b.013) adds one family of inequalities, one for each odd set of nodes, and proves that the resulting polyhedron has exactly the matching vectors as its vertices. The companion paper Paths, trees, and flowers gives the cardinality algorithm on which the weighted algorithm of §7 is built.

Timeline:

  • 1931: König and Egerváry prove the min–max theorems for bipartite matching; 1946: Birkhoff shows that the doubly stochastic matrices are the convex hull of the permutation matrices (the bipartite perfect-matching polytope).
  • 1947: Tutte characterizes graphs with a perfect matching.
  • 1965: Edmonds, Paths, trees, and flowers: the blossom algorithm for maximum-cardinality matching.
  • 1965: Edmonds, this paper: Theorem (P) (the matching polyhedron) and Theorem (M) (blossom-shrinking optimality certificates), with a weighted matching algorithm.

Setting

Let GGG be a finite graph with node set VVV and edge set EEE; each edge meets two different nodes, its ends. Real variables xex_exe​ correspond to the edges e∈Ee\in Ee∈E. The polyhedron C⊆REC\subseteq\mathbb R^EC⊆RE is the set of vectors xxx satisfying

  1. xe≥0x_e\ge 0xe​≥0 for every edge eee;
  2. ∑e meets vxe≤1\sum_{e \text{ meets } v} x_e\le 1∑e meets v​xe​≤1 for every node vvv;
  3. ∑e has both ends in Sxe≤r\sum_{e \text{ has both ends in } S} x_e\le r∑e has both ends in S​xe​≤r for every set SSS of 2r+12r+12r+1 nodes, rrr a strictly positive integer.

The matching vectors PPP are the vectors with every component 000 or 111 that satisfy (2); they are the incidence vectors of matchings. For edge weights c∈REc\in\mathbb R^Ec∈RE, the linear form (4) is W(c,x)=∑ecexeW(c,x)=\sum_e c_e x_eW(c,x)=∑e​ce​xe​.

The dual program has a variable yvy_vyv​ for each node and zSz_SzS​ for each odd set SSS (∣S∣=2rS+1|S|=2r_S+1∣S∣=2rS​+1, rS≥1r_S\ge1rS​≥1). Its objective is (5) U(y,z)=∑vyv+∑SrSzSU(y,z)=\sum_v y_v+\sum_S r_S z_SU(y,z)=∑v​yv​+∑S​rS​zS​, subject to (6) y,z≥0y,z\ge0y,z≥0 and (7) yv1+yv2+∑S∋v1,v2zS≥cey_{v_1}+y_{v_2}+\sum_{S\ni v_1,v_2}z_S\ge c_eyv1​​+yv2​​+∑S∋v1​,v2​​zS​≥ce​ for every edge eee with ends v1,v2v_1,v_2v1​,v2​. For a matching MMM, conditions (8)–(10) are the complementary slackness conditions: yv=0y_v=0yv​=0 at nodes not covered by MMM, equality in (7) on MMM, and every odd set with zS>0z_S>0zS​>0 contains exactly rSr_SrS​ edges of MMM.

A blossom sequence {Gi}i=0n\{G_i\}_{i=0}^n{Gi​}i=0n​ (Theorem (M)) starts from G0=GG_0=GG0​=G with matching M0=MM_0=MM0​=M and repeatedly shrinks an odd circuit BiB_iBi​ (a blossom, 2ai+12a_i+12ai​+1 edges of which aia_iai​ are matched) to a single node, carrying node weights w(vi)w(v^i)w(vi) and edge weights w(ei)w(e^i)w(ei) that obey conditions (a)–(k) of p. 127.

In the Lean development these are Graph, IsMatching, incidence, matchingPolyhedron (CCC), matchingVectors (PPP), W, U, DualFeasible ((6)–(7)), CompSlack ((8)–(10)) and BlossomSequence, all in the namespace EdmondsMatching65.Polyhedron.

Formalization targets

Goal: Theorem (P)

ext⁡(C)=P.\operatorname{ext}(C)=P.ext(C)=P.

The vertices (extreme points) of CCC are exactly the matching vectors of GGG. Hence the maximum weight of a matching equals max⁡{W(c,x):x∈C}\max\{W(c,x):x\in C\}max{W(c,x):x∈C} for every ccc.

Milestones

  1. P⊆ext⁡(C)P\subseteq\operatorname{ext}(C)P⊆ext(C) (§2, p. 126).
  2. If for every ccc some 0–1 point of CCC maximizes W(c,⋅)W(c,\cdot)W(c,⋅) over CCC, then ext⁡(C)=P\operatorname{ext}(C)=Pext(C)=P (§2, p. 126).
  3. Weak duality: W(c,x)≤U(y,z)W(c,x)\le U(y,z)W(c,x)≤U(y,z) for x∈Cx\in Cx∈C and ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfying (6)–(7) (§3, p. 126).
  4. If MMM is a matching and ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfies (6)–(10), then W(c,χM)=U(y,z)W(c,\chi^M)=U(y,z)W(c,χM)=U(y,z) (§3, p. 127).
  5. A blossom sequence for MMM yields ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfying (6)–(10) (§5, pp. 127–128).
  6. For every ccc some maximum matching has a blossom sequence (§6, p. 128).
  7. Theorem (M): a matching is maximum if and only if a blossom sequence for it exists (§4, p. 127).
  8. For every ccc there are a matching MMM and ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfying (6)–(10) (§3, p. 127).

Significance

The result. Theorem (P) turns maximum-weight matching in general graphs into a linear program over an explicitly described polyhedron, and Theorem (M) with the §5 translation gives a short certificate of optimality for every maximum matching. Together they established the template of polyhedral combinatorics: describe the convex hull of the combinatorial objects by inequalities, and prove the description through linear programming duality and an algorithm. The matching polytope underlies the analysis of the weighted blossom algorithm, separation over odd-set inequalities (Padberg–Rao), and many later integrality results; Edmonds' own §8 states the extension to degree-constrained subgraphs.

Formalizing it. The theorem has been proved since 1965 and appears in every text on combinatorial optimization; this mission asks for a machine-checked proof of the polytope statement for general finite graphs, including parallel edges, together with the duality certificate and the blossom-sequence characterization. The prove2me platform has a proved form of Edmonds' perfect matching polytope theorem on complete graphs in convex-decomposition form (MetricTSP.pm_polytope_decomposition), a different polytope with a different conclusion; nothing states Theorem (P) or Theorem (M).

Difficulty

The inclusion P⊆ext⁡(C)P\subseteq\operatorname{ext}(C)P⊆ext(C) and weak duality are routine. The difficulty is the reverse inclusion: showing that no fractional point of CCC is a vertex. The bipartite argument (a fractional point has a cycle of fractional edges along which it can be perturbed both ways) breaks on odd cycles: perturbing along an odd circuit violates a degree inequality, and the odd-set inequalities that cut off the half-integral points are exponentially many and overlap. The paper's route needs, for every weight vector, an optimal matching together with a dual solution satisfying (6)–(10), and the existence of that certificate is the substance of the weighted matching algorithm: the blossom sequence of Theorem (M) must be constructed, and the translation (11)–(16) from node and edge weights of the contracted graphs to ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ must be verified through the whole shrinking history.

Formalization scope

  • The graph is a finite node type V, a finite edge type E and an end map ends : E → Sym2 V with no loops. Parallel edges are allowed: the contracted graphs of Theorem (M) have them, and Theorem (P) holds for multigraphs; simple graphs are the case of an injective end map.
  • Vectors are E → ℝ, one coordinate per edge. Vertices are Mathlib's Set.extremePoints ℝ. Odd sets carry an explicit r : ℕ with 1 ≤ r and |S| = 2r + 1; even sets and singletons carry no inequality.
  • Edge weights are arbitrary reals; matchings need not be perfect and may be empty. No connectivity, no parity of |V|.
  • The dual variable z is a function on all node sets of which only odd sets are read.
  • A contracted graph Gᵢ is a partition of V into blocks; an edge of G is an edge of Gᵢ when its ends lie in different blocks. Each Mᵢ must be a matching of Gᵢ, and all of (a)–(k) appear as fields of BlossomSequence; a sequence missing any of them would make milestone 6 trivial or milestone 5 false.
  • A trivializing formalization is ruled out: coordinates indexed by node pairs (Sym2 V → ℝ) leave non-edge coordinates free and give a polyhedron with no extreme points, and the goal is stated as equality of extreme points, not as a convex-hull identity or as the existence of a dual certificate.
  • Needed infrastructure: extreme points of polyhedra as unique maximizers of linear forms, finite LP weak duality over these index sets, and the weighted blossom algorithm (or another proof of milestone 8). The polyhedral lemmas are reusable for other integrality results; contributions on any milestone are welcome.

Selected references

  • J. Edmonds, Maximum Matching and a Polyhedron With 0,1-Vertices, J. Res. Nat. Bur. Standards Sect. B 69B (1965), 125–130. https://doi.org/10.6028/jres.069b.013
  • J. Edmonds, Paths, Trees, and Flowers, Canad. J. Math. 17 (1965), 449–467. https://doi.org/10.4153/CJM-1965-045-4
  • W. T. Tutte, The Factorization of Linear Graphs, J. London Math. Soc. 22 (1947), 107–111. https://doi.org/10.1112/jlms/s1-22.2.107
  • M. W. Padberg, M. R. Rao, Odd Minimum Cut-Sets and b-Matchings, Math. Oper. Res. 7 (1982), 67–80. https://doi.org/10.1287/moor.7.1.67
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer, 2003, Chapter 25.
13 thms4 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Theory of Games and Economic Behavior IX: Solutions for Acyclic RelationsTextbook

Motivation

The solution concept of von Neumann and Morgenstern's Theory of Games and Economic Behavior (1944) is defined from two ingredients: a set of imputations and a domination relation between them. A solution is a set of imputations that is internally stable (no member dominates another) and externally stable (every non-member is dominated by some member). In §65 of the book the authors observe that this definition never uses what imputations and domination actually are. They abstract it to an arbitrary set DDD and an arbitrary relation S\mathcal SS on DDD, and ask which properties of S\mathcal SS guarantee that exactly one solution exists.

The abstract notion is what graph theory now calls a kernel of a directed graph: draw an arc x→yx \to yx→y whenever xSyx\mathcal S yxSy; a solution is a set of vertices that is independent and absorbs every vertex outside it. Kernels appear in combinatorial game theory (the losing positions of a finite impartial game form a kernel of its move graph) and in the theory of preference and choice.

Timeline.

  • 1944 (1st ed.; 3rd ed. 1953, reprinted 2007): von Neumann and Morgenstern define solutions for an arbitrary relation (§65), show that a finite set with an acyclic relation has exactly one solution (65:X), and that acyclicity is necessary for every subset to have a unique solution (65:Z).
  • 1953: M. Richardson, Solutions of irreflexive relations, extends existence (not uniqueness) to finite relations without cycles of odd length.

Setting

Let DDD be an arbitrary set and S\mathcal SS an arbitrary relation on DDD; xSyx\mathcal S yxSy is read "xxx dominates yyy". A solution (in DDD for S\mathcal SS) is a set V⊆DV \subseteq DV⊆D with

(65:1)V={ y∈D:xSy holds for no x∈V }.\text{(65:1)}\qquad V = \{\, y \in D : x\mathcal S y \text{ holds for no } x \in V \,\}.(65:1)V={y∈D:xSy holds for no x∈V}.

For E⊆DE \subseteq DE⊆D, an element xxx is a maximum of EEE if x∈Ex \in Ex∈E and no y∈Ey \in Ey∈E has ySxy\mathcal S xySx; the set of maxima is EmE^mEm.

For m≥1m \ge 1m≥1, condition (Am)(A_m)(Am​) says: never x1Sx0,x2Sx1,…,xmSxm−1x_1\mathcal S x_0, x_2\mathcal S x_1, \dots, x_m\mathcal S x_{m-1}x1​Sx0​,x2​Sx1​,…,xm​Sxm−1​ with x0=xmx_0 = x_mx0​=xm​ and all xi∈Dx_i \in Dxi​∈D. The relation is acyclic if it satisfies every (Am)(A_m)(Am​), m=1,2,…m = 1, 2, \dotsm=1,2,…; in particular never xSxx\mathcal S xxSx. It is strictly acyclic if there is no infinite sequence x0,x1,x2,…x_0, x_1, x_2, \dotsx0​,x1​,x2​,… in DDD with xi+1Sxix_{i+1}\mathcal S x_ixi+1​Sxi​ for every iii. Property (65:K) says that every non-empty E⊆DE \subseteq DE⊆D has Em≠⊖E^m \ne \ominusEm=⊖. A partial ordering (65:B) is a transitive relation for which at most one of x=yx = yx=y, xSyx\mathcal S yxSy, ySxy\mathcal S xySx holds.

For the main theorem the book constructs a candidate solution by induction (65.7.1): A1=DA_1 = DA1​=D; Bi=AimB_i = A_i^mBi​=Aim​; CiC_iCi​ is the set of elements of AiA_iAi​ dominated by some element of BiB_iBi​; Ai+1=Ai−Bi−CiA_{i+1} = A_i - B_i - C_iAi+1​=Ai​−Bi​−Ci​. With i0i_0i0​ the first index for which Ai0=⊖A_{i_0} = \ominusAi0​​=⊖,

(65:2)V0=B1∪⋯∪Bi0−1.\text{(65:2)}\qquad V_0 = B_1 \cup \cdots \cup B_{i_0 - 1}.(65:2)V0​=B1​∪⋯∪Bi0​−1​.

In Lean the elements live in a type α, D V : Set α, and S : α → α → Prop with S x y meaning xSyx\mathcal S yxSy; the predicates are IsSolution D S V, maxima E S, IsAcyclic, IsStrictlyAcyclic, HasMaximaProperty, IsPartialOrdering, ConditionG, and the construction stageA, stageB, stageC, V0.

Formalization targets

Goal: (65:X)

If DDD is finite and S\mathcal SS is acyclic on DDD, then

∃! V: V is a solution in D for S,andV is a solution  ⟺  V=V0.\exists!\, V:\ V \text{ is a solution in } D \text{ for } \mathcal S, \qquad\text{and}\qquad V \text{ is a solution} \iff V = V_0 .∃!V: V is a solution in D for S,andV is a solution⟺V=V0​.

Milestones, in attack order

  1. (65:I) For a partial ordering, a finite DDD satisfies (65:G): every non-maximal yyy is dominated by some maximum.
  2. (65:H) For a partial ordering of an arbitrary DDD: VVV is a solution   ⟺  \iff⟺ (65:G) holds and V=DmV = D^mV=Dm.
  3. (65:O:c) Strict acyclicity implies acyclicity; for finite DDD the two are equivalent.
  4. (65:P) (65:K)   ⟺  \iff⟺ strict acyclicity, for arbitrary DDD.
  5. (65:S) For finite DDD and acyclic S\mathcal SS, some AiA_iAi​ is empty.
  6. (65:V) For finite DDD and acyclic S\mathcal SS, every solution equals V0V_0V0​.
  7. (65:W) For finite DDD and acyclic S\mathcal SS, V0V_0V0​ is a solution.
  8. (65:Z) If every E⊆DE \subseteq DE⊆D has a unique solution in EEE for S\mathcal SS, then S\mathcal SS is acyclic on DDD.

Significance

The result itself. (65:X) is the most general of the book's three existence-and-uniqueness theorems for solutions (complete ordering, partial ordering, acyclic relation; 65.8.1). For games proper it has no direct application: the set of imputations of an essential game has no maxima, so (65:K) fails (65.9.1). Its role is to isolate a sufficient condition for a unique solution. With (65:Z), and applied to every subset of DDD, it characterizes the finite relations for which every subset has exactly one solution: exactly the acyclic ones (65.8.2). In graph language it is the statement that a finite directed acyclic graph has exactly one kernel. In combinatorial game theory this is the partition of the positions of a finite impartial game into P- and N-positions. The complete- and partial-ordering results (65:E)–(65:I) are the special cases the book treats first.

Formalizing it. The results are classical and fully proved in the book; to the best of our knowledge none of them is on the Prove2Me platform, and Mathlib has well-foundedness (WellFounded, RelEmbedding of ℕ) but no kernel or von Neumann–Morgenstern solution notion for an abstract relation. The mission produces machine-checked proofs of the book's §65 chain: the equivalence of (65:K) with strict acyclicity for arbitrary sets, the finite equivalence of acyclicity and strict acyclicity, the explicit construction of V0V_0V0​, and the characterization of 65.8.2.

Difficulty

Most of the individual steps are short. The work is in making the book's finite induction precise. The sets AiA_iAi​ are defined recursively and V0V_0V0​ refers to the first empty stage i0i_0i0​. The uniqueness proof (65:V) is a minimal-counterexample argument over the stage index, which moves between "smallest kkk with y∉Aky \notin A_ky∈/Ak​" and the disjoint decomposition (65:U) of DDD into the BiB_iBi​ and CiC_iCi​. A tempting shortcut, taking an arbitrary well-founded rank function instead of the book's construction, proves existence and uniqueness but not that the solution is the V0V_0V0​ of (65:2), which is part of the goal. For (65:P) and (65:O:c) the difficulty is the passage between finite cycles and infinite chains. Going from a chain in a finite set to a repetition needs a pigeonhole argument, and going from a set without maxima to a chain needs dependent choice.

Formalization scope

  • Representation. An ambient type α; D, E, V are Set α; the relation is S : α → α → Prop and is only ever consulted on elements of the set under consideration, so it is the book's relation on DDD (or its restriction to EEE). Finite and infinite sequences are functions ℕ → α.
  • Solutions. IsSolution D S V is the set equation (65:1) literally; it forces V⊆DV \subseteq DV⊆D. Uniqueness in the goal is ∃! over all V : Set α, not over a subtype; there is no degenerate reading in which the solution is fixed by construction.
  • Acyclicity. IsAcyclic D S requires (Am)(A_m)(Am​) for every m≥1m \ge 1m≥1, all cycle elements in DDD. The case m=0m = 0m=0 is excluded, as in the book (it would be unsatisfiable). This is equivalent to the absence of a Relation.TransGen loop inside DDD, but the book's form is stated.
  • Construction. Stages are indexed from 000: stageA D S k is the book's Ak+1A_{k+1}Ak+1​. V0 D S is the union of all BiB_iBi​, which equals B1∪⋯∪Bi0−1B_1 \cup \cdots \cup B_{i_0 - 1}B1​∪⋯∪Bi0​−1​ because every later BiB_iBi​ is empty.
  • Standing hypotheses instantiated. (65:S), (65:V), (65:W) and the goal (65:X) carry the hypotheses of 65.7.1, "DDD finite and S\mathcal SS acyclic" (for finite DDD equivalently strictly acyclic, i.e. (65:K)), as D.Finite and IsAcyclic D S. (65:H) and (65:I) carry the partial-ordering hypothesis (65:B:a), (65:B:b) of 65.5.1, and (65:I) also finiteness of DDD. (65:O:c), (65:P) and (65:Z) are for arbitrary DDD and S\mathcal SS, as 65.6.2 and 65.8.2 state. The empty DDD is allowed everywhere; there the unique solution is ⊖\ominus⊖.
  • Not stated. The infinite case of (65:X) and of (65:Y), which the book leaves open (65.7.1, 65.8.3, question (65:9)); the complete-ordering results (65:E), (65:F), which silently assume D≠⊖D \neq \ominusD=⊖; the counting statement (65:8).
  • Needed infrastructure. Finite-set induction and pigeonhole on Set.Finite, dependent choice for (65:P). The definitions are reusable for any later work on kernels of digraphs and on abstract stable sets. Proofs of any milestone, and alternative proofs of the goal, are welcome.

Selected references

  • J. von Neumann and O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary edition, Princeton University Press, 2007 (reprint of the 3rd ed., 1953), §65, pp. 587–602. https://doi.org/10.1515/9781400829460
  • M. Richardson, Solutions of irreflexive relations, Annals of Mathematics 58 (1953), 573–590. https://doi.org/10.2307/1969755
13 thms4 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Theory of Games and Economic Behavior VII: Simple Games, Weighted Majorities and the Main Simple SolutionTextbook

Motivation

Many collective decisions are taken by coalitions that either carry the vote or do not: committees, legislatures, shareholder meetings, councils with weighted votes. In such a situation the only aim of a participant is to be part of a coalition that wins, and nothing is left to bargain about except the division of the prize inside the winning coalition. Chapter X of von Neumann and Morgenstern's Theory of Games and Economic Behavior (1944; 3rd ed. 1953) isolates exactly this class of zero-sum nnn-person games, the simple games, and studies their numerical description by weighted majorities and their finite main simple solutions.

The chapter is the origin of a large later literature: simple games and weighted voting games are the standard model of voting bodies in political science and social choice (for instance the Shapley–Shubik power index, 1954). The characterization of which simple games admit homogeneous weights, and the solutions they carry, starts here.

Setting

A zero-sum nnn-person game with players I={1,…,n}I = \{1, \dots, n\}I={1,…,n} is represented by its characteristic function vvv, a real function on the subsets of III with v(⊖)=0v(\ominus) = 0v(⊖)=0, v(−S)=−v(S)v(-S) = -v(S)v(−S)=−v(S) (−S-S−S the complement) and v(S∪T)≧v(S)+v(T)v(S \cup T) \geqq v(S) + v(T)v(S∪T)≧v(S)+v(T) for disjoint S,TS, TS,T. An imputation is a vector α⃗\vec\alphaα with αi≧v((i))\alpha_i \geqq v((i))αi​≧v((i)) and ∑iαi=0\sum_i \alpha_i = 0∑i​αi​=0; α⃗\vec\alphaα dominates β⃗\vec\betaβ​ if some nonempty SSS has ∑i∈Sαi≦v(S)\sum_{i\in S}\alpha_i \leqq v(S)∑i∈S​αi​≦v(S) and αi>βi\alpha_i > \beta_iαi​>βi​ for i∈Si \in Si∈S; a solution is a set VVV of imputations none of which dominates another and which dominates every imputation outside it (30.1.1). The game is inessential when its reduced form vanishes identically, essential otherwise.

A coalition SSS is flat if v(S)=∑k∈Sv((k))v(S) = \sum_{k\in S} v((k))v(S)=∑k∈S​v((k)). The losing coalitions LΓL_\GammaLΓ​ are the flat sets, and the winning coalitions WΓW_\GammaWΓ​ are the sets whose complement is flat. The game is simple if it is essential and every coalition is winning or losing. WmW^mWm denotes the minimal winning coalitions, those of which no proper subset wins.

Weights w1,…,wnw_1, \dots, w_nw1​,…,wn​ define the winning system W={S:∑i∈Swi>12∑iwi}W = \{S : \sum_{i\in S} w_i > \tfrac12 \sum_i w_i\}W={S:∑i∈S​wi​>21​∑i​wi​}, and under the conditions (50:B) (non-negative weights, no player with half the total weight, no ties) this is the weighted majority game [w1,…,wn][w_1,\dots,w_n][w1​,…,wn​]. The weights are homogeneous if the advantage aS=∑i∈Swi−∑i∈−Swia_S = \sum_{i\in S} w_i - \sum_{i\in -S} w_iaS​=∑i∈S​wi​−∑i∈−S​wi​ is the same for all SSS in WmW^mWm.

In §50 the game is taken in reduced form with γ=1\gamma = 1γ=1, so v((i))=−1v((i)) = -1v((i))=−1. For numbers xi≧0x_i \geqq 0xi​≧0 and a coalition SSS let α⃗S\vec\alpha^SαS give −1-1−1 to the players outside SSS and −1+xi-1 + x_i−1+xi​ to player iii in SSS. When the xix_ixi​ satisfy ∑i∈Sxi=n\sum_{i \in S} x_i = n∑i∈S​xi​=n for every S∈WmS \in W^mS∈Wm, the set VVV of all α⃗S\vec\alpha^SαS, S∈WmS \in W^mS∈Wm, is a main simple solution.

Formalization targets

Goal: (50:K), p. 444

Every homogeneous weighted majority game possesses a main simple solution,\text{Every homogeneous weighted majority game possesses a main simple solution,}Every homogeneous weighted majority game possesses a main simple solution,

namely the set of α⃗S\vec\alpha^SαS, S∈WmS \in W^mS∈Wm, with xi=nbwix_i = \frac{n}{b} w_ixi​=bn​wi​, b=12(∑iwi+a)b = \frac12(\sum_i w_i + a)b=21​(∑i​wi​+a), aaa the common advantage. Conversely, if xi≧0x_i \geqq 0xi​≧0 solve ∑i∈Sxi=n\sum_{i\in S} x_i = n∑i∈S​xi​=n on WmW^mWm, then wi=xiw_i = x_iwi​=xi​ are homogeneous weights for the game if and only if

∑i=1nxi<2n.\sum_{i=1}^n x_i < 2n .i=1∑n​xi​<2n.

Milestones

  1. (49:C) LΓL_\GammaLΓ​ contains the empty set and all one-element sets.
  2. (49:A) WΓ,LΓW_\Gamma, L_\GammaWΓ​,LΓ​ are mapped onto each other by complementation, WΓW_\GammaWΓ​ is closed under supersets, and LΓL_\GammaLΓ​ is closed under subsets.
  3. (49:B) WΓ∩LΓ=⊖W_\Gamma \cap L_\Gamma = \ominusWΓ​∩LΓ​=⊖ if and only if the game is essential. If the game is inessential, every set is both winning and losing.
  4. (49:F) The pairs W,LW, LW,L of simple games are exactly those satisfying (48:A:a)–(48:A:d) and (49:C).
  5. (50:A) The essential three-person game is simple: it is the direct majority game.
  6. (50:B) Non-negative weights define a winning system with (49:W*) if and only if (50:B:a), (50:B:b) hold.
  7. (50:D) aS>0a_S > 0aS​>0 on WWW, aS<0a_S < 0aS​<0 on LLL, and aS=0a_S = 0aS​=0 never occurs.
  8. (50:G) An imputation β⃗\vec\betaβ​ is undominated by V={α⃗S:S∈U}V = \{\vec\alpha^S : S \in U\}V={αS:S∈U} if and only if R(β⃗)∈U+R(\vec\beta) \in U^+R(β​)∈U+.
  9. (50:J) The exact criterion (50:8*), (50:9*) for VVV to be a solution.

Significance

The result links two descriptions of a simple game. One is numerical: a vector of weights, normalized by homogeneity. The other is game-theoretic: a finite solution in which each minimal winning coalition forms and divides a fixed total among its members. When the weights are homogeneous they are, up to scale, the shares in the main simple solution. When a main simple solution exists, its shares are homogeneous weights exactly under the inequality (50:20). The criterion (50:J) behind it is the chapter's general tool for deciding which systems of "profitable" minimal winning coalitions yield a finite solution. It is used again in the enumeration of simple games in §§51–55.

All of the results are proved in the book. As far as a search of the Prove2Me library shows (queries on simple game, weighted majority, winning coalition and stable set, 2026-09-28), none of them has been machine-checked. The only stable-set statements on the platform concern feasible payoff vectors of convex games, which is a different domain. The mission therefore asks for a formal proof of the known results, including the case analysis of §50.5–50.6, and in doing so it produces a reusable Lean theory of simple games and their winning systems.

Difficulty

The characterizations of §49 are set-theoretic, but they depend on superadditivity to show that subsets of flat sets are flat, and on the strategic-equivalence description of essentiality. The substantial part is (50:J). Deciding whether VVV is a solution means classifying every imputation β⃗\vec\betaβ​ by the set R(β⃗)R(\vec\beta)R(β​) where it meets the shares −1+xi-1 + x_i−1+xi​.

The natural first attempt is to check only the minimal winning coalitions. It fails, because domination can be exercised through any winning coalition. The book's argument has to exclude sets of U+U^+U+ with ∑i∈Txi<n\sum_{i\in T} x_i < n∑i∈T​xi​<n by producing infinitely many undominated imputations against a finite VVV. It also has to handle indifferent players with xi=0x_i = 0xi​=0, whose presence makes R(β⃗)R(\vec\beta)R(β​) larger than the coalition that generated β⃗\vec\betaβ​. For the converse half of the goal, the obstacle is the strict inequality a>0a > 0a>0: the equations (50:17) are linear and say nothing about it.

Formalization scope

Players are Fin n (the book's player iii is index i−1i - 1i−1), coalitions are Finset (Fin n), and characteristic functions are Finset (Fin n) → ℝ. Imputations are vectors Fin n → ℝ, and systems of coalitions are Set (Finset (Fin n)). A game is identified with its characteristic function (by 26.1 every vvv satisfying (25:3:a)–(25:3:c) arises from a game). The theory is the "old" one of 30.1.1 (49.1.1), with no excess. The definitions of imputation, domination and solution are the same as in mission V of this series and are restated here, because a draft cannot import another draft.

The standing hypotheses, stated in each theorem where the book has them in force:

  • (25:3:a)–(25:3:c) on vvv in every theorem;
  • simplicity (essential + (49:1:b)) in (50:G), (50:J), (50:K);
  • the reduced form with γ=1\gamma = 1γ=1, as v((i))=−1v((i)) = -1v((i))=−1 for all iii (50.4.1), in (50:G), (50:J), (50:K);
  • U⊆WmU \subseteq W^mU⊆Wm, (50:7) xi≧0x_i \geqq 0xi​≧0 and (50:8) ∑i∈Sxi=n\sum_{i\in S} x_i = n∑i∈S​xi​=n for S∈US \in US∈U (50.5.1) in (50:G), (50:J);
  • (50:B) on the weights in (50:D) and in the first half of (50:K);
  • non-negative weights in (50:B). The book states (50:B) for arbitrary real weights, but its "only if" direction is false without wi≧0w_i \geqq 0wi​≧0: [10,10,10,−110][10, 10, 10, -\tfrac1{10}][10,10,10,−101​] is a counterexample. The corrected statement is recorded in the item.

The numbers xix_ixi​ are given for every player. Players in no minimal winning coalition, for whom the book defines no xix_ixi​, do not affect any α⃗S\vec\alpha^SαS. In the converse of (50:K) the derived weights are wi=xiw_i = x_iwi​=xi​ for every player.

The goal is not the bare solvability of (50:17). A statement that only asserted "xxx exists with (50:7), (50:17)" would reduce to linear algebra. The goal asserts that the set of α⃗S\vec\alpha^SαS is a solution in the sense of 30.1.1, with domination requiring a nonempty effective set, and it adds the converse equivalence with (50:20). The set VVV is built from WmW^mWm only, never from all of WWW.

Welcome contributions: proofs of the §49 milestones, which form a small reusable library on winning and losing systems; a proof of (50:G) and (50:J); and lemmas connecting WΓW_\GammaWΓ​ of a simple reduced game with the explicit formula (49:2), v(S)=n−∣S∣v(S) = n - |S|v(S)=n−∣S∣ on WWW and −∣S∣-|S|−∣S∣ on LLL.

Selected references

  • J. von Neumann, O. Morgenstern, Theory of Games and Economic Behavior, 60th-anniversary ed., Princeton University Press, 2007 (reprint of the 3rd ed., 1953), Chapter X, §§48–50, pp. 420–444. https://doi.org/10.1515/9781400829460
  • L. S. Shapley, M. Shubik, "A method for evaluating the distribution of power in a committee system", American Political Science Review 48 (1954) 787–792. https://doi.org/10.2307/1951053
13 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: mikedeng1

An Efficient Approximation Scheme for the One-Dimensional Bin-Packing Problem II: Geometric Grouping with Residual LP RoundingResearch Paper

Motivation

One-dimensional bin packing asks for the fewest unit-capacity bins that hold a given list of items with sizes in (0,1)(0,1)(0,1). Deciding whether two bins suffice is NP-hard (it contains the partition problem), so no polynomial-time algorithm guarantees a ratio below 3/23/23/2 unless P = NP. The natural question is therefore asymptotic: how small can the additive error A(I)−OPT(I)A(I) - OPT(I)A(I)−OPT(I) be made, as a function of the optimum OPT(I)OPT(I)OPT(I)?

  • 1974: D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey and R. L. Graham analysed First Fit and First Fit Decreasing, with asymptotic ratios 17/1017/1017/10 and 11/911/911/9 (SIAM J. Comput. 3(4)).
  • 1981: W. Fernandez de la Vega and G. S. Lueker gave an asymptotic approximation scheme: for every ε>0\varepsilon > 0ε>0, (1+ε) OPT(I)+1(1+\varepsilon)\,OPT(I) + 1(1+ε)OPT(I)+1 bins in linear time (Combinatorica 1).
  • 1982: N. Karmarkar and R. M. Karp replaced the multiplicative error by an additive one: OPT(I)+O(log⁡2OPT(I))OPT(I) + O(\log^2 OPT(I))OPT(I)+O(log2OPT(I)) bins in polynomial time (Proc. 23rd FOCS). This mission formalizes that bound.
  • 2017: R. Hoberg and T. Rothvoss improved the additive error to O(log⁡OPT)O(\log OPT)O(logOPT) (SODA 2017). Whether OPT(I)+O(1)OPT(I) + O(1)OPT(I)+O(1) is achievable remains open.

Its main device, geometric grouping followed by rounding a linear program over bin configurations, recurs in later additive results and in cutting-stock problems.

Setting

An instance III is a finite multiset of piece sizes in the open interval (0,1)(0,1)(0,1). Write n(I)n(I)n(I) for the number of pieces, m(I)m(I)m(I) for the number of distinct sizes, SIZE(I)SIZE(I)SIZE(I) for the total size and a(I)a(I)a(I) for the smallest size. A packing is a multiset of bins whose union is III and in each of which the sizes sum to at most 111; its cost is the number of bins, and OPT(I)OPT(I)OPT(I) is the least cost.

A configuration is a nonempty multiset of sizes occurring in III that fits in one bin. The fractional bin-packing problem is the linear program

(I)min⁡ 1⋅xs.t.x≥0,Ax≥b,(I)\qquad \min\ \mathbf 1\cdot x\quad\text{s.t.}\quad x \ge 0,\quad Ax \ge b,(I)min 1⋅xs.t.x≥0,Ax≥b,

with one variable xjx_jxj​ per configuration, where AtjA_{tj}Atj​ counts the pieces of size ttt in configuration jjj and btb_tbt​ the pieces of size ttt in III. Its value is LIN(I)LIN(I)LIN(I). A basic feasible solution is an extreme point of the feasible region.

Geometric grouping with parameter kkk sorts the pieces in non-increasing order and cuts them into consecutive groups G1,G2,…,GqG_1, G_2, \dots, G_qG1​,G2​,…,Gq​, each the shortest run of pieces of total size at least kkk. Within each group GiG_iGi​ (i≥2i \ge 2i≥2) only as many of the largest pieces as Gi−1G_{i-1}Gi−1​ has are kept; they are rounded up to the largest size in GiG_iGi​, giving Gi′G_i'Gi′​. The rounded pieces form JJJ, and G1G_1G1​ together with the unrounded leftovers ΔGi\Delta G_iΔGi​ form J′J'J′.

ALGORITHM 2 with a positive integer kkk and a positive real ggg:

  1. Eliminate all pieces of size ≤g\le g≤g.
  2. While SIZE>1+11−1/kln⁡1gSIZE > 1 + \frac{1}{1-1/k}\ln\frac1gSIZE>1+1−1/k1​lng1​: group the current instance into J,J′J, J'J,J′; pack J′J'J′ in at most 2k[2+ln⁡1g]2k[2 + \ln\frac1g]2k[2+lng1​] bins; obtain a basic feasible solution xxx of the LP of JJJ with cost at most LIN(J)+1LIN(J)+1LIN(J)+1; open ⌊xj⌋\lfloor x_j\rfloor⌊xj​⌋ bins of each configuration jjj, fill them with pieces, and delete the pieces so packed.
  3. Pack the remaining pieces in at most 2+21−1/kln⁡1g2 + \frac{2}{1-1/k}\ln\frac1g2+1−1/k2​lng1​ bins.
  4. Reinsert the eliminated pieces, using a new bin only when necessary.

Its cost on III is written A(I)A(I)A(I).

Formalization targets

Goal: Theorem 4 with explicit constants

For every instance III with SIZE(I)≥2SIZE(I) \ge 2SIZE(I)≥2, every packing that ALGORITHM 2 with k=2k=2k=2 and g=1/SIZE(I)g = 1/SIZE(I)g=1/SIZE(I) can output is a packing of III with

A(I)≤OPT(I)+(1+log⁡2OPT(I))(9+4ln⁡OPT(I))+2+4ln⁡OPT(I).A(I) \le OPT(I) + \bigl(1 + \log_2 OPT(I)\bigr)\bigl(9 + 4\ln OPT(I)\bigr) + 2 + 4\ln OPT(I).A(I)≤OPT(I)+(1+log2​OPT(I))(9+4lnOPT(I))+2+4lnOPT(I).

This is the paper's A(I)≤OPT(I)+O(log⁡2OPT(I))A(I) \le OPT(I) + O(\log^2 OPT(I))A(I)≤OPT(I)+O(log2OPT(I)), with the constants that its proof yields.

The general bound for ALGORITHM 2

For integers k≥2k \ge 2k≥2, 0<g≤120 < g \le \tfrac120<g≤21​ and SIZE(I)≥1SIZE(I) \ge 1SIZE(I)≥1:

A(I)≤max⁡{(1+2g) OPT(I)+1, OPT(I)+[1+ln⁡SIZE(I)ln⁡k][1+4k+2kln⁡1g]+2+21−1kln⁡1g}.A(I) \le \max\Bigl\{(1+2g)\,OPT(I) + 1,\ OPT(I) + \Bigl[1 + \frac{\ln SIZE(I)}{\ln k}\Bigr]\Bigl[1 + 4k + 2k\ln\frac1g\Bigr] + 2 + \frac{2}{1-\frac1k}\ln\frac1g\Bigr\}.A(I)≤max{(1+2g)OPT(I)+1, OPT(I)+[1+lnklnSIZE(I)​][1+4k+2klng1​]+2+1−k1​2​lng1​}.

Milestones

In attack order: Lemmas 1–3; Theorem 2 (items 1–3, the bound on J′J'J′, item 4 corrected); the per-iteration shrinking of SIZESIZESIZE; the bound on the number ttt of iterations; the telescoping of LINLINLIN; the bin count after Step 3; the general bound.

Significance

The bound gives a polynomial-time algorithm whose additive error is polylogarithmic in the optimum, hence a fully polynomial asymptotic approximation scheme (O(log⁡2OPT)=o(OPT)O(\log^2 OPT) = o(OPT)O(log2OPT)=o(OPT)). Varying kkk and ggg trades running time for error, as the paper notes after Theorem 4. The scheme of solving the rounded LP, keeping its integer part and re-grouping the residual is reused by later additive results, including the O(log⁡OPT)O(\log OPT)O(logOPT) bound of Hoberg and Rothvoss.

The result has been proved since 1982. No machine-checked proof of it, or of any bin-packing approximation guarantee of this kind, is known to exist in Lean or Mathlib. The mission produces a formal version whose hypotheses and constants are explicit. It also corrects two printed statements whose published forms are false: Theorem 2, item 4, and the chain of inequalities in the analysis that relies on it. The corrections are disclosed in the statements.

Difficulty

Rounding a single LP solution does not suffice. A basic solution of the configuration LP has at most mmm fractional variables, and after rounding down, the leftover pieces form an instance of size at most m(J)m(J)m(J). With linear grouping that leftover is of order 1/ε21/\varepsilon^21/ε2 and costs a constant factor. The difficulty is making the residual shrink geometrically. Geometric grouping must produce an instance JJJ with m(J)≤SIZE/k+O(ln⁡(1/g))m(J) \le SIZE/k + O(\ln(1/g))m(J)≤SIZE/k+O(ln(1/g)) distinct sizes while discarding only O(kln⁡(1/g))O(k\ln(1/g))O(kln(1/g)) in J′J'J′. The residual must then be re-grouped and re-solved. Each step must be accounted for simultaneously in SIZESIZESIZE, LINLINLIN and OPTOPTOPT, with an additive loss per iteration; the harmonic-sum estimate behind SIZE(J′)SIZE(J')SIZE(J′) and the telescoping of LINLINLIN across iterations carry most of the weight.

Formalization scope

  • Model. An instance is a Multiset ℝ with sizes in the open interval (0,1)(0,1)(0,1); real sizes generalize the paper's rationals, and the interval is open because a group of size at least kkk must contain more than kkk pieces. Packings are Multiset (Multiset ℝ). OPTOPTOPT and LINLINLIN are infima over nonempty sets. LP solutions are finitely supported functions on configurations; "basic" means extreme point.
  • Subroutine contract. The Fractional Bin-Packing procedure is modelled only by its stated output: any basic feasible solution of cost at most LIN(J)+1LIN(J)+1LIN(J)+1. The ellipsoid method of §6 is not modelled.
  • Runs. ALGORITHM 2 is a relation Alg2Run k g I P, witnessed by a trace. Every bound holds for every run: every admissible subroutine output, every packing at Steps 2 and 3 within the prescribed counts, every choice of pieces for the principal bins (which must fill every available slot), and every order of the Step 4 insertion. A separate well-definedness item states that a run exists, so the bounds are not vacuous.
  • Explicit constants. O(log⁡2OPT(I))O(\log^2 OPT(I))O(log2OPT(I)) in Theorem 4 is replaced by (1+log⁡2OPT)(9+4ln⁡OPT)+2+4ln⁡OPT(1+\log_2 OPT)(9 + 4\ln OPT) + 2 + 4\ln OPT(1+log2​OPT)(9+4lnOPT)+2+4lnOPT. The asymptotic threshold is made explicit as SIZE(I)≥2SIZE(I) \ge 2SIZE(I)≥2. ln⁡\lnln is Real.log and log⁡2\log_2log2​ is Real.logb 2.
  • Corrected statements. The last group of geometric grouping may fall short of kkk, which the paper ignores. For it, ΔGq\Delta G_qΔGq​ consists of the max⁡(0,lq−lq−1)\max(0, l_q - l_{q-1})max(0,lq​−lq−1​) smallest pieces. Theorem 2, item 4 is stated as m(J)≤SIZE(J)/k+ln⁡(1/a(I))+1m(J) \le SIZE(J)/k + \ln(1/a(I)) + 1m(J)≤SIZE(J)/k+ln(1/a(I))+1; the printed version without +1+1+1 fails for I={0.95,0.95,0.95,0.9}I = \{0.95, 0.95, 0.95, 0.9\}I={0.95,0.95,0.95,0.9}, k=2k = 2k=2. Theorem 2 is stated for integers k≥2k \ge 2k≥2, which its proof needs. The iteration bound is stated for t≥1t \ge 1t≥1 and for the instance after Step 1.
  • Out of scope. Running times, polynomiality, the function T(m,n)T(m,n)T(m,n), the number of subroutine calls, §6, ALGORITHM 3 and Theorem 5.
  • Ruling out trivial versions. "There exists a packing with at most OPT(I)+…OPT(I) + \dotsOPT(I)+… bins" is trivially true and is not the goal. The goal bounds every output of the algorithm, and the existence item shows that outputs exist.

Contributions welcome: milestone proofs; a harmonic-sum bound ∑j=ab1/j≤ln⁡ba−1\sum_{j=a}^{b} 1/j \le \ln\frac{b}{a-1}∑j=ab​1/j≤lna−1b​; extreme-point facts for {x≥0:Ax≥b}\{x \ge 0 : Ax \ge b\}{x≥0:Ax≥b} (at most as many nonzero coordinates as rows; an optimal extreme point exists), reusable beyond bin packing; monotonicity of LINLINLIN and OPTOPTOPT under the piecewise order.

Selected references

  • N. Karmarkar, R. M. Karp, An Efficient Approximation Scheme for the One-Dimensional Bin-Packing Problem, Proc. 23rd Annual Symposium on Foundations of Computer Science (SFCS 1982), IEEE, pp. 312–320, 1982. https://doi.org/10.1109/SFCS.1982.61
  • W. Fernandez de la Vega, G. S. Lueker, Bin packing can be solved within 1 + ε in linear time, Combinatorica 1(4), 349–355, 1981. https://doi.org/10.1007/BF02579456
  • D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey, R. L. Graham, Worst-case performance bounds for simple one-dimensional packing algorithms, SIAM J. Comput. 3(4), 299–325, 1974. https://doi.org/10.1137/0203025
  • R. Hoberg, T. Rothvoss, A Logarithmic Additive Integrality Gap for Bin Packing, Proc. 28th ACM-SIAM SODA, 2616–2625, 2017. https://doi.org/10.1137/1.9781611974782.172
21 thms4 active usersReviewed
🏆Completed
Operations ResearchOptimizationProbability·Captain: mikedeng1

The Distributionally Robust Chance-Constrained Vehicle Routing Problem I: With a Subadditive Demand Estimator the Two-Index Vehicle Flow Formulation Is ExactResearch Paper

Motivation

The capacitated vehicle routing problem (CVRP) asks for delivery routes of minimum cost. Each route starts and ends at a depot, every customer is visited exactly once, and the demand served on a route does not exceed the vehicle capacity. The problem is central in logistics and one of the most studied problems in combinatorial optimization. Its standard exact methods are branch-and-cut algorithms built on the two-index vehicle flow formulation, a 0/1 program over arcs whose capacity constraints are the rounded capacity inequalities (RCIs); see Laporte, Nobert and Desrochers (1985) and Semet, Toth and Vigo (2014).

In practice customer demands are uncertain. A chance-constrained CVRP requires each route to respect its capacity with probability at least 1−ϵ1-\epsilon1−ϵ under a known distribution. That distribution is rarely known. Most solution methods also need independent demands. Ghosal and Wiesemann (Oper. Res. 68(3), 2020) study the distributionally robust chance-constrained CVRP. There the chance constraint must hold for every distribution in an ambiguity set P\mathcal PP of plausible distributions. The ambiguity set may contain dependent distributions and uncountably many of them, so it is not clear a priori that the problem can be solved by the usual branch-and-cut machinery. This mission formalizes the paper's answer to that question: its Theorem 1 and the counterexample that precedes it.

Setting

The graph is complete and directed. Its nodes are V={0,…,n}V=\{0,\dots,n\}V={0,…,n} and its arcs are A={(i,j)∈V×V:i≠j}A=\{(i,j)\in V\times V:i\neq j\}A={(i,j)∈V×V:i=j}. Node 000 is the depot and VC={1,…,n}V_C=\{1,\dots,n\}VC​={1,…,n} are the customers. There are mmm vehicles, indexed by K={1,…,m}K=\{1,\dots,m\}K={1,…,m}, each of capacity Q>0Q>0Q>0. Traversing the arc (i,j)(i,j)(i,j) costs c(i,j)≥0c(i,j)\ge 0c(i,j)≥0; costs may be asymmetric.

A route Rk=(Rk,1,…,Rk,nk)\mathbf R_k=(R_{k,1},\dots,R_{k,n_k})Rk​=(Rk,1​,…,Rk,nk​​) is an ordered list of customers, with Rk,0=Rk,nk+1=0R_{k,0}=R_{k,n_k+1}=0Rk,0​=Rk,nk​+1​=0. A route set R=(R1,…,Rm)∈P(VC,m)\mathbf R=(\mathbf R_1,\dots,\mathbf R_m)\in\mathfrak P(V_C,m)R=(R1​,…,Rm​)∈P(VC​,m) partitions VCV_CVC​ into mmm nonempty ordered routes. Its cost is c(R)=∑k∑l=0nkc(Rk,l,Rk,l+1)c(\mathbf R)=\sum_{k}\sum_{l=0}^{n_k}c(R_{k,l},R_{k,l+1})c(R)=∑k​∑l=0nk​​c(Rk,l​,Rk,l+1​).

The demand vector q~∈Rn\tilde{\boldsymbol q}\in\mathbb R^nq~​∈Rn is random. The ambiguity set P\mathcal PP is a set of probability distributions of q~\tilde{\boldsymbol q}q~​ and ϵ∈(0,1)\epsilon\in(0,1)ϵ∈(0,1) is the risk level. The problem RVRP(P\mathcal PP) minimizes c(R)c(\mathbf R)c(R) over route sets such that

P[∑i∈Rkq~i≤Q]≥1−ϵ∀ P∈P, ∀ k∈K.\mathbb P\Big[\textstyle\sum_{i\in\mathbf R_k}\tilde q_i\le Q\Big]\ge 1-\epsilon\qquad\forall\,\mathbb P\in\mathcal P,\ \forall\,k\in K .P[∑i∈Rk​​q~​i​≤Q]≥1−ϵ∀P∈P, ∀k∈K.

With Q-VaR1−ϵ[X~]=inf⁡{x:Q[X~≤x]≥1−ϵ}\mathbb Q\text{-VaR}_{1-\epsilon}[\tilde X]=\inf\{x:\mathbb Q[\tilde X\le x]\ge1-\epsilon\}Q-VaR1−ϵ​[X~]=inf{x:Q[X~≤x]≥1−ϵ}, the demand estimator of the paper's Eq. (2) is

dP(S)=max⁡{⌈1Qsup⁡P∈PP-VaR1−ϵ[∑i∈Sq~i]⌉,1}(S≠∅),dP(∅)=0.d_{\mathcal P}(S)=\max\left\{\left\lceil\frac1Q\sup_{\mathbb P\in\mathcal P}\mathbb P\text{-VaR}_{1-\epsilon}\Big[\sum_{i\in S}\tilde q_i\Big]\right\rceil,1\right\}\quad(S\neq\emptyset),\qquad d_{\mathcal P}(\emptyset)=0 .dP​(S)=max{⌈Q1​P∈Psup​P-VaR1−ϵ​[i∈S∑​q~​i​]⌉,1}(S=∅),dP​(∅)=0.

The problem 2VF(P\mathcal PP) minimizes ∑(i,j)∈Ac(i,j)xij\sum_{(i,j)\in A}c(i,j)x_{ij}∑(i,j)∈A​c(i,j)xij​ over x∈{0,1}Ax\in\{0,1\}^Ax∈{0,1}A with in- and out-degree 111 at every customer and mmm at the depot, and with the RCIs

∑i∈V∖S∑j∈Sxij≥dP(S)∀ S⊆VC, S≠∅.\sum_{i\in V\setminus S}\sum_{j\in S}x_{ij}\ge d_{\mathcal P}(S)\qquad\forall\,S\subseteq V_C,\ S\neq\emptyset .i∈V∖S∑​j∈S∑​xij​≥dP​(S)∀S⊆VC​, S=∅.

A route set induces the arc vector with xij=1x_{ij}=1xij​=1 exactly when (i,j)=(Rk,l,Rk,l+1)(i,j)=(R_{k,l},R_{k,l+1})(i,j)=(Rk,l​,Rk,l+1​) for some k,lk,lk,l (the paper's Eq. (3)). The estimator satisfies the subadditivity condition (S) if dP(S∪T)≤dP(S)+dP(T)d_{\mathcal P}(S\cup T)\le d_{\mathcal P}(S)+d_{\mathcal P}(T)dP​(S∪T)≤dP​(S)+dP​(T) for all S,T⊆VCS,T\subseteq V_CS,T⊆VC​.

Formalization targets

Goal: Theorem 1

Assume q~≥0\tilde{\boldsymbol q}\ge\mathbf 0q~​≥0 P\mathbb PP-a.s. for all P∈P\mathbb P\in\mathcal PP∈P, and assume dPd_{\mathcal P}dP​ is real valued and satisfies (S). Then:

(i)  R feasible in RVRP(P) ⟹ x(R) feasible in 2VF(P),  c(x(R))=c(R);(ii)  x feasible in 2VF(P) ⟹ x=x(R) for an RVRP(P)-feasible R, unique up to reordering routes, c(x)=c(R).\begin{aligned} &\text{(i)}\ \ \mathbf R \text{ feasible in RVRP}(\mathcal P)\ \Longrightarrow\ x(\mathbf R)\text{ feasible in 2VF}(\mathcal P),\ \ c(x(\mathbf R))=c(\mathbf R);\\ &\text{(ii)}\ \ x\text{ feasible in 2VF}(\mathcal P)\ \Longrightarrow\ x=x(\mathbf R)\text{ for an RVRP}(\mathcal P)\text{-feasible }\mathbf R,\text{ unique up to reordering routes},\ c(x)=c(\mathbf R). \end{aligned}​(i)  R feasible in RVRP(P) ⟹ x(R) feasible in 2VF(P),  c(x(R))=c(R);(ii)  x feasible in 2VF(P) ⟹ x=x(R) for an RVRP(P)-feasible R, unique up to reordering routes, c(x)=c(R).​

Milestones

  1. The chance constraint Q[X~≤τ]≥1−ϵ\mathbb Q[\tilde X\le\tau]\ge1-\epsilonQ[X~≤τ]≥1−ϵ is equivalent to Q-VaR1−ϵ[X~]≤τ\mathbb Q\text{-VaR}_{1-\epsilon}[\tilde X]\le\tauQ-VaR1−ϵ​[X~]≤τ (p. 720).
  2. Eq. (1): a route satisfies its robust chance constraint if and only if the worst-case VaR of its cumulative demand is at most QQQ.
  3. Example 1: an instance with two customers where a route set is RVRP(P\mathcal PP)-feasible, yet its induced flow violates the RCI for S={1,2}S=\{1,2\}S={1,2}, since dP({1,2})≥3d_{\mathcal P}(\{1,2\})\ge3dP​({1,2})≥3.
  4. Example 1 (continued): on that instance dPd_{\mathcal P}dP​ violates (S).
  5. Theorem 1 (i) and 6. Theorem 1 (ii), stated separately.

Significance

Theorem 1 separates the modeling question from the algorithmic one. Whenever the ambiguity set yields a subadditive estimator, the distributionally robust CVRP is solved exactly by a two-index flow branch-and-cut. The only change from the deterministic case is the right-hand side dP(S)d_{\mathcal P}(S)dP​(S) of the RCIs, however many distributions P\mathcal PP contains. The companion missions of this series show that (S) holds for every moment ambiguity set (Theorem 2 of the paper) and compute dPd_{\mathcal P}dP​ for several classes of such sets. Example 1 shows that the hypothesis cannot be dropped: ambiguity sets that pin down each customer's marginal distribution break the equivalence.

The paper's proofs are in its online supplement; no machine-checked version of these statements exists. Formalizing them produces a checked reduction between a stochastic routing model and an integer program. It also produces reusable definitions of route sets, induced arc flows and RCIs over directed graphs with a depot.

Difficulty

Direction (ii) is a graph decomposition. A 0/1 vector with the prescribed degrees splits into mmm depot cycles plus possibly depot-free subtours. The RCIs, through the max⁡{⋅,1}\max\{\cdot,1\}max{⋅,1} in dPd_{\mathcal P}dP​, must exclude the subtours, and the RCI on the customers of a single route must enforce that route's chance constraint. Uniqueness up to reordering requires that directed routes are recovered from arcs.

Direction (i) is where (S) enters. The naive argument bounds the number of vehicles entering SSS by dP(S)d_{\mathcal P}(S)dP​(S) directly from the chance constraints. It fails because the chance constraints control each route separately, while dP(S)d_{\mathcal P}(S)dP​(S) looks at the joint worst case of the demands in SSS; Example 1 is exactly this failure. A set SSS is typically visited by several routes, each covering only part of it. Relating the per-route guarantees to the joint quantity dP(S)d_{\mathcal P}(S)dP​(S) needs both hypotheses of the theorem: nonnegative demands and (S).

Formalization scope

Customers are Fin n (0-based; the paper's customer iii is i - 1). Nodes are Fin (n+1) with the depot 0 and customer i at i.succ, and vehicles are Fin m. A route set is R : Fin m → List (Fin n): every route is nonempty and the concatenated routes are a permutation of all customers. Arc vectors are ℕ-valued functions on ordered node pairs, with values in {0,1}\{0,1\}{0,1} and the non-arcs (i,i)(i,i)(i,i) fixed to 000.

Distributions are measures on Fin n → ℝ, and the ambiguity set is a set of probability measures. Chance constraints are written ENNReal.ofReal (1 - ε) ≤ P {q | …}. Value-at-risk is the published MultistageStochastic.valueAtRisk at level 1 - ε. The worst-case VaR is a real sSup and dPd_{\mathcal P}dP​ is integer valued.

Two conventions implicit on the page are explicit hypotheses:

  • Q>0Q>0Q>0, because (2) divides by QQQ;
  • boundedness of the VaR values for every customer set, which encodes the paper's declaration dP:2VC→R+d_{\mathcal P}:2^{V_C}\to\mathbb R_+dP​:2VC​→R+​.

A real sSup of an unbounded set is 000 in Lean. Without the boundedness hypothesis every such estimator would silently equal 111 and (ii) would fail. For an empty ambiguity set the Lean estimator equals 111 on nonempty sets, as the paper's does.

The RCIs range over all nonempty customer sets with the depot on the outside. The estimator keeps the ceiling and the max⁡{⋅,1}\max\{\cdot,1\}max{⋅,1}. 2VF feasibility mentions neither routes nor chance constraints. RVRP feasibility does not mention dPd_{\mathcal P}dP​. A formalization in which either side refers to the other, or in which dPd_{\mathcal P}dP​ drops the max⁡{⋅,1}\max\{\cdot,1\}max{⋅,1}, is not this theorem.

Useful contributions include lemmas on the decomposition of degree-constrained 0/1 arc vectors into depot cycles, monotonicity of VaR under almost-sure ordering, and the CDF right-continuity behind milestone 1.

Related platform work: SupplyChainTheory_vrp formalizes a different, symmetric, unit-demand VRP and is not reused.

Selected references

  • S. Ghosal, W. Wiesemann, The Distributionally Robust Chance-Constrained Vehicle Routing Problem, Operations Research 68(3):716–732, 2020. https://doi.org/10.1287/opre.2019.1924
  • G. Laporte, Y. Nobert, M. Desrochers, Optimal routing under capacity and distance restrictions, Operations Research 33(5):1050–1073, 1985. https://doi.org/10.1287/opre.33.5.1050
  • F. Semet, P. Toth, D. Vigo, Classical exact algorithms for the capacitated vehicle routing problem, in P. Toth, D. Vigo (eds.), Vehicle Routing: Problems, Methods, and Applications, 2nd ed., SIAM, 2014, 37–57. https://doi.org/10.1137/1.9781611973594.ch2
  • J. Lysgaard, A. N. Letchford, R. W. Eglese, A new branch-and-cut algorithm for the capacitated vehicle routing problem, Mathematical Programming 100(2):423–445, 2004. https://doi.org/10.1007/s10107-003-0481-8
12 thms4 active usersReviewed
🏆Completed
Convex OptimizationDiscrete GeometryOperations Research+1·Captain: Shuze Chen

Discrete Convex Analysis XXII: Convex Extensibility of M-Convex FunctionsTextbook

Motivation

A discrete function defined only on the integer lattice cannot, by itself, be minimized by the tools of continuous optimization — gradients and convexity in the classical sense simply do not apply. Murota's theory of M-convex functions closes this gap by showing that the exchange axiom alone, a purely combinatorial condition, is enough to guarantee that a discrete function behaves exactly like a convex one: its minimizers form a well-structured (M-convex) set, it can be extended to a genuine convex function on real space without gaining any new local minima, and its behavior under a change of price vector (in the economic interpretation where the function is a cost and its argument a bundle of goods) satisfies the same gross substitutes law economists have studied since Kelso and Crawford's matching-market models. This mission develops the second half of that connection: from local optimality (established in the companion mission) to the full structural picture — minimizer sets, price-substitution laws, and the extension of M-convex functions to genuine convex functions in real variables.

Companion mission 06-mconvex-functions-i (Discrete Convex Analysis V) and sibling mission 22-ch06b-mconvexfunctions (Discrete Convex Analysis XXI) cover this chapter's optimality theory (the M-optimality criterion, the exchange axiom as sequential improvement) and its algebraic toolkit (domain operations, worked examples). This mission builds the vocabulary those results also need (redeclared here, since sibling drafts cannot yet import one another) and proves the results on minimizer structure, gross substitutability, and convex extension that this chapter's remaining sections develop: the M-convexity of minimizer sets, the gross substitutes and stepwise gross substitutes properties and their characterizing role, a minimizer-cut theorem with scaling, integral convexity of M♮-convex functions, and — this mission's goal — the theorem characterizing M-convexity entirely through the polyhedral structure of a function's convex extension.

Setting

Fix a finite ground set VVV. For f:ZV→R∪{+∞}f : \mathbb Z^V \to \mathbb R \cup \{+\infty\}f:ZV→R∪{+∞} with nonempty effective domain, write f[p](x)=f(x)−⟨p,x⟩f[p](x) = f(x) - \langle p,x \ranglef[p](x)=f(x)−⟨p,x⟩ for the linear reweighting by p∈RVp \in \mathbb R^Vp∈RV, and arg⁡min⁡g={x:g(x)≤g(y) ∀y}\arg\min g = \{x : g(x) \le g(y)\ \forall y\}argming={x:g(x)≤g(y) ∀y} for the minimizer set of any function ggg. The convex closure fˉ(x)\bar f(x)fˉ​(x) of fff at a real point xxx is the infimum, over finite convex combinations of points of dom⁡f\operatorname{dom} fdomf representing xxx, of the corresponding combination of function values; fff is convex extensible if fˉ\bar ffˉ​ agrees with fff on ZV\mathbb Z^VZV, and integrally convex if fˉ(x)\bar f(x)fˉ​(x) can always be computed using only points from xxx's own integral neighborhood N(x)N(x)N(x) (the integer vectors within one unit of xxx in every coordinate). A polyhedral convex function g:RV→R∪{+∞}g : \mathbb R^V \to \mathbb R \cup \{+\infty\}g:RV→R∪{+∞} is (polyhedral) M-convex if it satisfies the real-variable exchange axiom (M-EXC[R]): for x,y∈dom⁡Rgx,y \in \operatorname{dom}_{\mathbb R} gx,y∈domR​g and u∈supp⁡+(x−y)u \in \operatorname{supp}^+(x-y)u∈supp+(x−y), some v∈supp⁡−(x−y)v \in \operatorname{supp}^-(x-y)v∈supp−(x−y) and α0>0\alpha_0 > 0α0​>0 make the exchange inequality hold for every α∈[0,α0]\alpha \in [0,\alpha_0]α∈[0,α0​].

Formalization targets

Goal: convex extensibility characterizes M-convexity

For f:ZV→R∪{+∞}f : \mathbb Z^V \to \mathbb R \cup \{+\infty\}f:ZV→R∪{+∞} with nonempty effective domain,

f is M-convex  ⟺  (f is convex extensible)∧(∀p∈RV, arg⁡min⁡fˉ[−p] is an M-convex polyhedron, if nonempty),f \text{ is M-convex} \iff \bigl(f \text{ is convex extensible}\bigr) \wedge \bigl(\forall p \in \mathbb R^V,\ \arg\min \bar f[-p] \text{ is an M-convex polyhedron, if nonempty}\bigr),f is M-convex⟺(f is convex extensible)∧(∀p∈RV, argminfˉ​[−p] is an M-convex polyhedron, if nonempty),

with the M♮-analogue using M♮-convex polyhedra (Theorem 6.43). This is the weakest stable form: it characterizes M-convexity purely by properties of the (unique) convex closure, without reference to any specific algorithm for computing it or any bound on the polyhedron's complexity.

Supporting structural targets

Ten further results build the toolkit this goal draws on and the picture it completes: the M-convexity of minimizer sets (Proposition 6.29), the gross substitutes and stepwise gross substitutes properties and the theorems showing they characterize M-convexity and M♮-convexity among convex-extensible functions (Propositions 6.32-6.33, 6.35, Theorems 6.34, 6.36), a minimizer-cut theorem with scaling used algorithmically in Chapter 10 (Theorem 6.39), integral convexity of M♮-convex functions (Theorem 6.42), a shared-coefficient convex-combination theorem for pairs of M♮-convex functions used in Chapter 8's separation theorem (Theorem 6.44), and the polyhedral-M-convexity of an M-convex function's convex extension together with the correspondence between polyhedral M♮-convexity and the real exchange axiom (Theorems 6.45, 6.47).

Significance

Theorem 6.43 is what makes the whole edifice of M-convex function theory a genuine extension of M-convex set theory (chapters 4-5) rather than a separate parallel development: it says that knowing a function's convex extension is polyhedral, with every price-weighted minimizer set an M-convex polyhedron, is not merely a consequence of M-convexity but an exact characterization of it. This is the theorem that lets later results (the discrete conjugacy theorem of Chapter 8, the separation theorems for M♮-convex functions) move freely between the discrete and continuous pictures. The gross substitutes property (Propositions 6.32-6.36) is independently significant outside this book: it is the exact condition, discovered independently in mathematical economics (Kelso-Crawford, Gul-Stacchetti), under which competitive equilibria with indivisible goods are guaranteed to exist — Murota's theorem that gross substitutability characterizes M-convexity (among convex-extensible functions) is what unifies the economic and combinatorial literatures on this question, taken up again in Chapter 11.

None of these results are open — they are Murota's systematic account of a theory with roots in matroid theory, submodular optimization, and mathematical economics. What this mission contributes is a faithful, machine-checked formal statement of each, extending the shared Lean vocabulary (MExchangeAxiom, ConvexClosureVal, ArgMinOn) the Discrete Convex Analysis series builds on; no comparable formalization exists on the platform (see Formalization scope).

Difficulty

The forward direction of Theorem 6.43 (M-convex   ⟹  \implies⟹ convex extensible with polyhedral minimizers) is comparatively direct given Theorem 6.42 and Proposition 6.29. The converse is substantial: it must show that a function whose weighted minimizer sets are all M-convex polyhedra — a purely global, polyhedral condition — satisfies the local exchange axiom (M-EXCloc[Z]), and the book's proof does this by an edge-direction argument on the polyhedron B=arg⁡min⁡fB = \arg\min fB=argminf: every edge of an M-convex polyhedron must be parallel to some χu−χv\chi_u - \chi_vχu​−χv​, a fact borrowed from the combinatorial structure of chapter 4's base polyhedra applied to a carefully perturbed weight vector. No shortcut through convex analysis alone succeeds, because ordinary polyhedral theory says nothing about which combinatorial directions a polyhedron's edges must follow — that content comes entirely from the M-convexity of the minimizer sets, not from convexity of the closure by itself.

Formalization scope

Ground-set elements are a Fintype V with DecidableEq; functions are (V→ℤ)→WithTop ℝ (integer domain) or (V→ℝ)→WithTop ℝ (real domain, for the polyhedral theorems). The convex closure is built directly from finite convex-combination representations rather than an abstract closure operator, and integral convexity compares it against the same construction restricted to each point's integral neighborhood (Fintype.piFinset of per-coordinate Finset.Icc). Real M-convex/M♮-convex polyhedra are defined as convex hulls of M-convex/M♮-convex integer sets, reusing chapters 4-5's own characterization. The real-variable exchange axioms (Theorems 6.45, 6.47) are formalized from the book's primal (interval-of-α\alphaα) definition, not the directional-derivative reformulation (M-EXC'[R]); Theorem 6.47's own three-way equivalence is correspondingly stated with only its first two legs (see Difficulty and MODERATION_NOTES.md/HARD.md — this is a documented scope choice, not a trivializing omission, since the six results using the primal axiom already exercise the chapter's real- variable machinery in full). No numeric constants are hard-coded anywhere in this mission beyond the book's own literal coefficients in Theorem 6.39's cut bound ((n-1)(α-1)). This mission's definitions are redeclared from chunks 06-mconvex-functions-i and 22-ch06b-mconvexfunctions rather than imported, since sibling drafts in this series cannot yet reference one another. Contributions completing any of the twelve sorrys are welcome; the goal's converse direction and Theorem 6.44's shared-coefficient construction carry the most independent proof content.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • A. S. Kelso Jr. and V. P. Crawford, "Job matching, coalition formation, and gross substitutes," Econometrica, 50 (1982), pp. 1483-1504.
  • F. Gul and E. Stacchetti, "Walrasian equilibrium with gross substitutes," Journal of Economic Theory, 87 (1999), pp. 95-124.
47 thms4 active usersReviewed
🏆Completed
Discrete GeometryOperations ResearchOptimization·Captain: Shuze Chen

Discrete Convex Analysis I: Valuated MatroidsTextbook

Motivation

Matroids abstract the combinatorial content of linear independence: which sets of columns of a matrix are independent, which are maximal (bases), and how bases relate to each other. This abstraction, isolated independently by Whitney (1935) and van der Waerden's school, turned out to be exactly the right level of generality for a large family of greedy and augmenting-path algorithms — a base of a matroid can always be reached from another by a sequence of single-element swaps, and this exchange property is what makes local search on bases correct and efficient.

A natural question, raised in the 1980s once matroid-based combinatorial optimization was mature, is what happens when bases are not merely present or absent but carry real-valued weights that must interact well with the exchange structure. Dress and Wenzel answered this with the notion of a valuated matroid: a real-valued function on the bases of a matroid satisfying a weighted strengthening of the exchange axiom. Their motivation was explicitly algorithmic — valuated matroids are exactly the structures for which a greedy algorithm computes an optimal basis under linear objectives, and more generally under the family of "tilted" objectives obtained by adding an arbitrary linear functional. Independently, valuated matroids arise from the classical Grassmann–Plücker relation applied to matrices over a field with a valuation (hence the name), connecting them to tropical geometry.

This mission formalizes the two theorems of Murota's Discrete Convex Analysis (2003, §2.4) that make this story precise: the classical correspondence between a matroid's base family and its rank function (Theorem 2.29), and the characterization of valuations by a perturbation-robustness property (Theorem 2.32). Theorem 2.32 is also historically the entry point of the book's central theme — it is the special case, for the two-valued lattice {0,1}V\{0,1\}^V{0,1}V, of the general local-exchange criterion for M-convex functions that occupies chapters 6 and 7.

Setting

Let VVV be a finite set (the ground set). A matroid on VVV is a pair (V,B)(V, \mathcal B)(V,B) where B\mathcal BB, the base family, is a nonempty family of subsets of VVV satisfying the simultaneous exchange axiom (B): for every J,J′∈BJ, J' \in \mathcal BJ,J′∈B and every i∈J∖J′i \in J \setminus J'i∈J∖J′, there exists j∈J′∖Jj \in J' \setminus Jj∈J′∖J such that both

J−i+j:=(J∖{i})∪{j}∈BandJ′+i−j:=(J′∖{j})∪{i}∈B.J - i + j := (J \setminus \{i\}) \cup \{j\} \in \mathcal B \quad\text{and}\quad J' + i - j := (J' \setminus \{j\}) \cup \{i\} \in \mathcal B.J−i+j:=(J∖{i})∪{j}∈BandJ′+i−j:=(J′∖{j})∪{i}∈B.

Equivalently (Theorem 2.29 below), a matroid can be described by its rank function ρ:2V→Z\rho : 2^V \to \mathbb Zρ:2V→Z, a set function satisfying:

  • (R1) 0≤ρ(X)≤∣X∣0 \le \rho(X) \le |X|0≤ρ(X)≤∣X∣ for every X⊆VX \subseteq VX⊆V;
  • (R2) monotonicity: X⊆Y  ⟹  ρ(X)≤ρ(Y)X \subseteq Y \implies \rho(X) \le \rho(Y)X⊆Y⟹ρ(X)≤ρ(Y);
  • (R3) submodularity: ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y)\rho(X) + \rho(Y) \ge \rho(X \cup Y) + \rho(X \cap Y)ρ(X)+ρ(Y)≥ρ(X∪Y)+ρ(X∩Y).

A valuation of a base family B\mathcal BB is a function ω:B→R\omega : \mathcal B \to \mathbb Rω:B→R satisfying the axiom (VM): for every J,J′∈BJ, J' \in \mathcal BJ,J′∈B and i∈J∖J′i \in J \setminus J'i∈J∖J′, there is j∈J′∖Jj \in J' \setminus Jj∈J′∖J with J−i+j,J′+i−j∈BJ - i + j, J' + i - j \in \mathcal BJ−i+j,J′+i−j∈B and

ω(J)+ω(J′)≤ω(J−i+j)+ω(J′+i−j).\omega(J) + \omega(J') \le \omega(J - i + j) + \omega(J' + i - j).ω(J)+ω(J′)≤ω(J−i+j)+ω(J′+i−j).

The pair (V,ω)(V, \omega)(V,ω) is then a valuated matroid. For p:V→Rp : V \to \mathbb Rp:V→R, the perturbation of ω\omegaω by ppp is

ω[−p](J)=ω(J)−∑j∈Jp(j).\omega[-p](J) = \omega(J) - \sum_{j \in J} p(j).ω[−p](J)=ω(J)−j∈J∑​p(j).

Formalization targets

Goal: Theorem 2.32 (the valuated matroid characterization)

ω is a valuation of B  ⟺  ∀ p:V→R, {J∈B:ω[−p](J′)≤ω[−p](J) ∀J′∈B} is a nonempty family satisfying (B).\omega \text{ is a valuation of } \mathcal B \iff \forall\, p : V \to \mathbb R,\ \{J \in \mathcal B : \omega[-p](J') \le \omega[-p](J)\ \forall J' \in \mathcal B\} \text{ is a nonempty family satisfying (B)}.ω is a valuation of B⟺∀p:V→R, {J∈B:ω[−p](J′)≤ω[−p](J) ∀J′∈B} is a nonempty family satisfying (B).

The right-hand side says: for every linear perturbation ppp, the set of ω[−p]\omega[-p]ω[−p]-maximal bases is again the base family of a matroid. The universal quantifier over ppp is not optional — a version of this statement quantified over a single fixed ppp is either vacuous or false, and does not capture what makes valuated matroids useful.

Milestone: Theorem 2.29 (the base-family / rank-function correspondence)

The maps

ρ(X)=max⁡{∣X∩J∣:J∈B},B={J⊆V:ρ(J)=∣J∣=ρ(V)}\rho(X) = \max\{|X \cap J| : J \in \mathcal B\}, \qquad \mathcal B = \{J \subseteq V : \rho(J) = |J| = \rho(V)\}ρ(X)=max{∣X∩J∣:J∈B},B={J⊆V:ρ(J)=∣J∣=ρ(V)}

are mutually inverse bijections between nonempty families satisfying (B) and set functions satisfying (R1)-(R3). This is weaker groundwork than the goal, stated first because it fixes the exact axiomatic vocabulary — (B) and (R) — that Theorem 2.32 is built on.

Significance

The result itself. Theorem 2.32 is the reason valuated matroids are the right object for weighted combinatorial optimization on matroids: it says a function on bases behaves correctly under every linear re-weighting of the ground set exactly when it satisfies the local exchange inequality (VM). This is what guarantees, for instance, that a greedy algorithm which is correct for the unweighted matroid extends correctly to families of tilted objectives, and it is the germ of the general local-optimality criterion for M-convex functions (chapters 6–7), which underlies most of the algorithmic content of the rest of the book. Theorem 2.29 is the classical result — due jointly to the development of matroid theory from the 1930s onward — that the base-exchange and rank-submodularity axiomatizations of a matroid carry the same information; it is the finite, unweighted precursor of Theorem 2.32.

Formalizing it. Neither theorem has a machine-checked proof on the platform prior to this mission (see Formalization scope for the prior-art check). Theorem 2.29's own proof is elementary but has two independent halves (each map preserves its target axiom class, and the two maps compose to the identity in both directions) that must all be established; Theorem 2.32's proof, as given in the source, defers entirely to a later, more general chapter-6 theorem, so a solver working only from this mission must either reconstruct a direct combinatorial argument for this special case or await chunk 06 (DiscreteConvex.MConvexFunctions, a separate mission) and specialize its main theorem.

Difficulty

The obvious approach to Theorem 2.32 — fix an optimal basis JJJ for ω[−p]\omega[-p]ω[−p] and try to show the exchange condition on maximizers directly from (VM) — proves one direction (VM implies the maximizer property) in a few lines, since perturbing does not change which exchange moves are available. The converse is the substantial direction: from "the maximizer set is always a matroid, for every ppp," one must recover the single global inequality (VM) that must hold for all pairs J,J′∈BJ, J' \in \mathcal BJ,J′∈B, not just optimal ones. The standard argument constructs, for a given non-optimal pair, a perturbation ppp under which that specific pair becomes simultaneously optimal, and this construction is exactly the step the book skips by citing chapter 6's general theorem. A formalization attempting to bypass this by only checking the maximizer property for a finite or generic sample of perturbations would trivialize the statement to something false or vacuous — a pitfall the goal's explicit ∀ p is designed to prevent.

Formalization scope

The ground set VVV is a Fintype with DecidableEq; 2V2^V2V is represented as Finset (Finset V), and V→RV \to \mathbb RV→R as a plain function type. The rank function is Z\mathbb ZZ-valued (matching the book's own convention for matroid rank, as opposed to the R\mathbb RR-valued conventions used from chapter 6 onward for general M-convex functions); RankOfFamily is implemented with Finset.sup over N\mathbb NN rather than a partial max', so that it is a total function — its junk value at the empty family is never invoked, since every hypothesis in this mission supplies nonemptiness explicitly, matching the book's own phrasing.

A trivializing formalization of the goal is one that quantifies over a single fixed ppp, or allows B\mathcal BB to be empty; both are explicitly excluded by keeping B.Nonempty\mathcal B.\text{Nonempty}B.Nonempty a hypothesis and ppp universally quantified inside the theorem statement itself.

Checked against Mathlib (commit 0df444a360eaa60ab8c11dca51a86af692955474): Mathlib's Matroid structure is axiomatized via the single-element (asymmetric) exchange property, classically but not definitionally equivalent to Murota's simultaneous axiom (B) used throughout this book, and Mathlib provides no constructor recovering a base family or a Matroid from a bare rank function satisfying (R1)-(R3). Theorem 2.29 is therefore genuine, reusable infrastructure, not a restatement of existing Mathlib API. No reference item was found on the platform for either theorem (GET /theorems?q=matroid, q=valuated matroid return only unrelated tropical-geometry and k-server results). Contributions to a shared DiscreteConvex.Combinatorial definitions layer (the exchange and rank axioms) are welcome from later chunks of this series that build on matroid or base-polyhedron structure.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003. DOI: 10.1137/1.9780898718508.
  • H. Whitney, "On the abstract properties of linear dependence," American Journal of Mathematics, 57(3), 1935, pp. 509–533.
  • A. W. M. Dress, W. Wenzel, "Valuated matroids," Advances in Mathematics, 93(2), 1992, pp. 214–250.
  • R. A. Brualdi, "Comments on bases in dependence structures," Bulletin of the Australian Mathematical Society, 1(2), 1969, pp. 161–167.
13 thms4 active usersReviewed
🏆Completed
Theoretical Computer Science·Captain: mikedeng1

Three Partition Refinement Algorithms 2: Refining by the Smaller HalfResearch Paper

Motivation

Many equivalence problems on finite structures reduce to computing the coarsest partition of a finite set that is compatible with a relation. Deciding whether two states of a finite labelled transition system are bisimilar, testing congruence of finite-state processes in Milner's calculus of communicating systems (CCS), and minimizing a deterministic finite automaton are all instances. Kanellakis and Smolka studied the relational version in connection with CCS equivalence and gave an O(mn)O(mn)O(mn)-time algorithm, conjecturing that O(mlog⁡n)O(m \log n)O(mlogn) was possible. Paige and Tarjan's 1987 paper answers that conjecture with an algorithm that has since become the standard method for bisimulation minimization in model checkers and process-algebra tools.

Timeline:

  • 1971 — Hopcroft gives an O(nlog⁡n)O(n \log n)O(nlogn) algorithm for minimizing deterministic finite automata, i.e. for the coarsest partition stable with respect to one or more functions, using the rule "process the smaller half".
  • 1983/1990 — Kanellakis and Smolka give an O(mn)O(mn)O(mn)-time, O(m+n)O(m + n)O(m+n)-space algorithm for the relational problem, and O(c2nlog⁡n)O(c^2 n \log n)O(c2nlogn) when every element has at most ccc successors; they conjecture an O(mlog⁡n)O(m \log n)O(mlogn) algorithm.
  • 1987 — Paige and Tarjan combine Hopcroft's smaller-half strategy with refinement by unions of blocks and obtain O(mlog⁡n)O(m \log n)O(mlogn) time and O(m+n)O(m + n)O(m+n) space for the relational problem.

Setting

Let UUU be a finite set with n=∣U∣n = |U|n=∣U∣ elements and let E⊆U×UE \subseteq U \times UE⊆U×U be a binary relation on UUU; write xEyxEyxEy for (x,y)∈E(x, y) \in E(x,y)∈E and m=∣E∣m = |E|m=∣E∣. For S⊆US \subseteq US⊆U the preimage of SSS is

E−1(S)={x∈U∣∃y∈S, xEy}.E^{-1}(S) = \{x \in U \mid \exists y \in S,\ xEy\}.E−1(S)={x∈U∣∃y∈S, xEy}.

A partition of UUU is a family of nonempty, pairwise disjoint subsets of UUU, its blocks, whose union is UUU. A partition RRR is a refinement of a partition PPP if every block of RRR lies inside a block of PPP.

A set B⊆UB \subseteq UB⊆U is stable with respect to S⊆US \subseteq US⊆U if B⊆E−1(S)B \subseteq E^{-1}(S)B⊆E−1(S) or B∩E−1(S)=∅B \cap E^{-1}(S) = \emptysetB∩E−1(S)=∅: either every element of BBB has an EEE-successor in SSS, or none does. A partition is stable with respect to SSS if all its blocks are, and a partition is stable if it is stable with respect to each of its own blocks.

Given EEE and an initial partition PPP, the coarsest stable refinement of PPP is a stable partition QQQ refining PPP such that every stable partition refining PPP is a refinement of QQQ. The relational coarsest partition problem asks for it.

The algorithms refine by the operation split(S,Q)\mathrm{split}(S, Q)split(S,Q), which replaces each block BBB of QQQ that meets both E−1(S)E^{-1}(S)E−1(S) and its complement by the two blocks B∩E−1(S)B \cap E^{-1}(S)B∩E−1(S) and B−E−1(S)B - E^{-1}(S)B−E−1(S). The set SSS is a splitter of QQQ if split(S,Q)≠Q\mathrm{split}(S, Q) \neq Qsplit(S,Q)=Q.

  • The naïve algorithm starts from Q=PQ = PQ=P and, while possible, picks a splitter SSS of QQQ that is a union of blocks of QQQ and replaces QQQ by split(S,Q)\mathrm{split}(S, Q)split(S,Q).
  • The improved algorithm also maintains a partition XXX, initially {U}\{U\}{U}, of which QQQ is a refinement. While Q≠XQ \neq XQ=X, it picks a block S∈XS \in XS∈X that is not a block of QQQ and a block B∈QB \in QB∈Q with B⊆SB \subseteq SB⊆S and ∣B∣≤∣S∣/2|B| \le |S|/2∣B∣≤∣S∣/2, replaces SSS in XXX by BBB and S−BS - BS−B, and replaces QQQ by split(S−B,split(B,Q))\mathrm{split}(S - B, \mathrm{split}(B, Q))split(S−B,split(B,Q)).

The improved algorithm is analysed under the standing assumption ∣E({x})∣≥1|E(\{x\})| \ge 1∣E({x})∣≥1 for all x∈Ux \in Ux∈U: every element has at least one successor. (The paper reduces the general case to this one by a preprocessing step.)

Formalization targets

Goal: the improved algorithm

For every run (Q0,X0)=(P,{U}),…,(QK,XK)(Q_0, X_0) = (P, \{U\}), \dots, (Q_K, X_K)(Q0​,X0​)=(P,{U}),…,(QK​,XK​) of the improved algorithm with refining blocks B0,…,BK−1B_0, \dots, B_{K-1}B0​,…,BK−1​:

  1. at every stage QjQ_jQj​ and XjX_jXj​ are partitions, QjQ_jQj​ refines XjX_jXj​, and QjQ_jQj​ is stable with respect to every block of XjX_jXj​;
  2. if QK=XKQ_K = X_KQK​=XK​, then QKQ_KQK​ is the coarsest stable refinement of PPP;
  3. if QK≠XKQ_K \neq X_KQK​=XK​, another step applies;
  4. K≤n−1K \le n - 1K≤n−1;
  5. every x∈Ux \in Ux∈U satisfies
#{ j<K∣x∈Bj }≤log⁡2n+1.\#\{\, j < K \mid x \in B_j \,\} \le \log_2 n + 1.#{j<K∣x∈Bj​}≤log2​n+1.

Items 1–4 are the correctness of the improved algorithm, which the paper deduces from that of the naïve one. Item 5 is the counting fact on which the O(mlog⁡n)O(m \log n)O(mlogn) bound rests.

Milestones

  • §3, p. 978: SSS is a splitter of QQQ if and only if QQQ is unstable with respect to SSS.
  • Properties (1)–(3), p. 978: stability is inherited under refinement and under union; split\mathrm{split}split is monotone in its second argument.
  • §3, p. 979: a stable partition is stable with respect to every union of its blocks.
  • Lemma 2, p. 979: every stable refinement of PPP refines each partition produced by the naïve algorithm.
  • Theorem 2, p. 979: the naïve algorithm stops after at most n−1n - 1n−1 steps at the unique coarsest stable refinement.
  • Property (4), p. 978: split\mathrm{split}split is commutative, and split(S,split(Q,P))\mathrm{split}(S, \mathrm{split}(Q, P))split(S,split(Q,P)) is the coarsest refinement of PPP stable with respect to both SSS and QQQ.
  • Lemma 3, p. 980: the three-way split of a block DDD into D11D_{11}D11​, D12D_{12}D12​ and D2D_2D2​, including D12=D1∩(E−1(B)−E−1(S−B))D_{12} = D_1 \cap (E^{-1}(B) - E^{-1}(S - B))D12​=D1​∩(E−1(B)−E−1(S−B)).

Significance

The coarsest stable refinement of the partition of states by their labels is the bisimilarity relation of a finite transition system, so the goal certifies, for any sequence of choices, the correctness of the refinement loop at the core of bisimulation minimization. The halving count is the combinatorial half of the O(mlog⁡n)O(m \log n)O(mlogn) bound: once the implementation charges O(∣B∣+∑y∈B∣E−1({y})∣)O(|B| + \sum_{y \in B} |E^{-1}(\{y\})|)O(∣B∣+∑y∈B​∣E−1({y})∣) per refining block BBB, the count bounds the total work.

The results are proved in the paper, some by one-line arguments and the elementary properties (1)–(4) not at all ("stated without proof"). No machine-checked proof of the Paige–Tarjan algorithm's correctness or of its halving count is known to be available in Lean or Mathlib. The mission produces a checked account of the invariant, the final correctness and the counting argument for every run, not only for a particular implementation.

Difficulty

The correctness of the improved algorithm is not a special case of the naïve one read off directly. An improved step refines by BBB and by S−BS - BS−B, and S−BS - BS−B is a union of blocks of QQQ only because QQQ refines XXX. The invariant that QQQ is stable with respect to every block of XXX is what makes Q=XQ = XQ=X a stopping condition, and it holds initially only under the standing assumption. The naive idea of reusing Hopcroft's argument fails: for relations, stability with respect to SSS and BBB does not imply stability with respect to S−BS - BS−B, which is why both refinements are performed. For the halving count, the refining blocks that contain a fixed element must be shown to be nested across steps, which requires tracking how blocks of XXX are replaced.

Formalization scope

  • UUU is a Fintype with decidable equality, EEE a decidable relation U → U → Prop. Partitions are Finset (Finset U) with an explicit predicate IsPartition (nonempty, pairwise disjoint blocks covering UUU); blocks are required to be nonempty, which the paper leaves implicit.
  • "Coarsest" means: every stable partition refining PPP refines it. The paper's "every other stable partition" is read this way, since a stable partition that does not refine PPP need not refine the answer.
  • Algorithms are step relations; a run is a finite sequence of states indexed by Fin (K + 1), with the choices Sj,BjS_j, B_jSj​,Bj​ recorded. Every statement holds for every run, so no choice rule is fixed.
  • Added hypotheses: UUU nonempty (so {U}\{U\}{U} is a partition and "at most n−1n - 1n−1 steps" is meaningful); the standing assumption ∀x ∃y, xEy\forall x\, \exists y,\ xEy∀x∃y, xEy for the goal only. Lemma 2 is stated for every stable refinement of PPP, which is what its proof gives and what Theorem 2 uses; it implies the printed form.
  • Explicit forms: ∣B∣≤∣S∣/2|B| \le |S|/2∣B∣≤∣S∣/2 is 2 * B.card ≤ S.card, K≤n−1K \le n - 1K≤n−1 is K + 1 ≤ n, log⁡2\log_2log2​ is Real.logb 2 of nnn cast to R\mathbb{R}R. The termination bound for the improved algorithm is not printed in the paper and is derived as in the proof of Theorem 2. Running times (O(mn)O(mn)O(mn), O(mlog⁡n)O(m \log n)O(mlogn)) and the data structures of the implementation are out of scope.
  • A trivializing reading is ruled out: the goal quantifies over all runs from (P,{U})(P, \{U\})(P,{U}) with every side condition of the step (in particular S∉QS \notin QS∈/Q and the half-size condition), and the conclusion is a full correctness statement, not the existence of some stable partition; the discrete partition is stable but is not the answer in general.
  • Reusable beyond this mission: preimage, stability, split\mathrm{split}split and its algebra (properties (1)–(4)), which apply to Hopcroft's algorithm and to bisimulation minimization in general. Contributions proving the elementary properties first, then Lemma 2 and Theorem 2, are the natural attack order.

Selected references

  • R. Paige, R. E. Tarjan, Three Partition Refinement Algorithms, SIAM Journal on Computing 16(6):973–989, 1987. https://doi.org/10.1137/0216062
  • P. C. Kanellakis, S. A. Smolka, CCS expressions, finite state processes, and three problems of equivalence, Information and Computation 86(1):43–68, 1990. https://doi.org/10.1016/0890-5401(90)90025-D
  • J. E. Hopcroft, An n log n algorithm for minimizing states in a finite automaton, in Theory of Machines and Computations, Academic Press, 1971, pp. 189–196. https://doi.org/10.1016/B978-0-12-417750-5.50022-1
  • A. V. Aho, J. E. Hopcroft, J. D. Ullman, The Design and Analysis of Computer Algorithms, Addison-Wesley, 1974.
12 thms4 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming XV: Dominants of Polytopes and Upper SeparationTextbook

Motivation

Many real-world disjunctive models are not unions of polyhedra in a single shared space, but unions of polyhedra in different spaces linked by a logical implication: some action affecting one set of entities has consequences for another. Balas's treatment of such models (§17 of the book, following [17]) reduces to understanding a single auxiliary object attached to each polytope in isolation: its dominant, the set of points that dominate (coordinatewise) some feasible point. Dominants and their duals, blockers, have a long history in combinatorial optimization — blocking-pair theory for covering and packing polyhedra traces to Fulkerson (D. R. Fulkerson, Blocking and anti-blocking pairs of polyhedra, Mathematical Programming 1 (1971), 168–194, https://doi.org/10.1007/BF01584085) — but this chapter develops a self-contained, constructive theory tailored to polytopes inside the unit cube, culminating in an exact, facet-complete description of the dominant for an arbitrary such polytope.

Setting

For a polyhedron P⊆R+nP \subseteq \mathbb{R}^n_+P⊆R+n​, the dominant is P+:=P+R+n={y≥0:y≥x for some x∈P}P^+ := P + \mathbb{R}^n_+ = \{y \ge 0 : y \ge x \text{ for some } x \in P\}P+:=P+R+n​={y≥0:y≥x for some x∈P}, and the blocker is P∗:={π∈R+n:πx≥1 for all x∈P}P^* := \{\pi \in \mathbb{R}^n_+ : \pi x \ge 1 \text{ for all } x \in P\}P∗:={π∈R+n​:πx≥1 for all x∈P} — the covering inequalities valid for PPP. (The blocker is not the reverse polar of 02b-polarity: restricting to the nonnegative orthant is essential and changes the object.) For x∗∈R+nx^* \in \mathbb{R}^n_+x∗∈R+n​, the upper-separation value is αP(x∗):=min⁡{πx∗:π∈P∗}\alpha_P(x^*) := \min\{\pi x^* : \pi \in P^*\}αP​(x∗):=min{πx∗:π∈P∗}; a violated covering inequality for x∗x^*x∗ exists exactly when αP(x∗)<1\alpha_P(x^*) < 1αP​(x∗)<1. A polytope P⊆[0,1]nP \subseteq [0,1]^nP⊆[0,1]n is upper monotone (with respect to [0,1]n[0,1]^n[0,1]n) if P=P+∩[0,1]nP = P^+ \cap [0,1]^nP=P+∩[0,1]n — the natural "closure" condition under which the theory of this chapter applies cleanly.

For S⊆N:={1,…,n}S \subseteq N := \{1,\dots,n\}S⊆N:={1,…,n}, write a(S):=∑j∈Saja(S) := \sum_{j\in S} a_ja(S):=∑j∈S​aj​. Given P⊆RnP \subseteq \mathbb{R}^nP⊆Rn and a coordinate subset SSS, the projection PSP^SPS keeps only the SSS-coordinates, letting the rest range freely. ISI^SIS is the set of valid inequalities πx≥1\pi x \ge 1πx≥1 of PSP^SPS with πj>0\pi_j > 0πj​>0 exactly on SSS, tight at ∣S∣|S|∣S∣ linearly independent points of PSP^SPS.

Formalization targets

Proposition 13.1. For an upper monotone P=⋂iPiP = \bigcap_i P_iP=⋂i​Pi​ (each PiP_iPi​ a single inequality in [0,1]n[0,1]^n[0,1]n), P+=⋂iPi+P^+ = \bigcap_i P_i^+P+=⋂i​Pi+​.

Theorem 13.3. For P={x∈[0,1]n:ax≥1}P = \{x \in [0,1]^n : ax \ge 1\}P={x∈[0,1]n:ax≥1} (a≥0a \ge 0a≥0) upper monotone,

P+={x≥0:∑j∈Sajxj1−a(N∖S)≥1 for every S⊆N with 1−a(N∖S)>0}.P^+ = \Big\{x \ge 0 : \sum_{j\in S} \frac{a_j x_j}{1-a(N\setminus S)} \ge 1 \text{ for every } S\subseteq N \text{ with } 1-a(N\setminus S)>0\Big\}.P+={x≥0:j∈S∑​1−a(N∖S)aj​xj​​≥1 for every S⊆N with 1−a(N∖S)>0}.

Theorem 13.5. For the same PPP and any x∗≥0x^* \ge 0x∗≥0, with xq∗x^*_qxq∗​ the greatest coordinate value xj∗x^*_jxj∗​ satisfying a(N∖S(xj∗))<1a(N\setminus S(x^*_j))<1a(N∖S(xj∗​))<1 and xj∗≤g(xj∗)x^*_j \le g(x^*_j)xj∗​≤g(xj∗​): S(αP)=S(xq∗)S(\alpha_P) = S(x^*_q)S(αP​)=S(xq∗​) and αP=g(xq∗)\alpha_P = g(x^*_q)αP​=g(xq∗​), an explicit, computable value.

Theorem 13.7 (goal). For an arbitrary polytope P⊆[0,1]nP \subseteq [0,1]^nP⊆[0,1]n (not necessarily upper monotone):

P+={x≥0:πx≥1 for every S⊆N and π∈IS},P^+ = \{x \ge 0 : \pi x \ge 1 \text{ for every } S \subseteq N \text{ and } \pi \in I^S\},P+={x≥0:πx≥1 for every S⊆N and π∈IS},

and every one of these inequalities is facet-defining for P+P^+P+.

Corollary 13.8. Every facet-defining inequality of P+P^+P+ has at most dim⁡(P)+1\dim(P)+1dim(P)+1 nonzero coefficients.

The targets move from the intersection-distributivity fact (13.1) through an explicit, exponentially-large but fully closed-form facet system for the single-inequality case (13.3) and its constructive, polynomial evaluation recipe (13.5) to the fully general facet characterization (13.7, requiring no monotonicity assumption at all) and its immediate corollary on facet sparsity (13.8).

Significance

Theorem 13.7 is a rare case in polyhedral combinatorics of a complete and exact facet description obtained for the dominant of an arbitrary polytope, not merely a valid relaxation or an algorithmic separation oracle — every facet is accounted for, and every listed inequality is genuinely a facet, not merely valid. Corollary 13.8's support bound is the mechanism that makes Theorem 13.10 (not part of this mission) tractable: it lets the facets of a dominant built from a disjunction of polytopes in different spaces be characterized purely in terms of each factor's own low-dimensional facets, avoiding an exponential blowup in the combined space.

Both directions are proved in the source (Balas's own treatment, following the joint framework of [17]) but have no counterpart on this platform: nothing existing treats dominants, blockers, or upper monotonicity. This mission produces the first Lean statements of all five targets.

Difficulty

The obvious shortcut for Theorem 13.7 is to state only the validity half of the claim (every inequality from ISI^SIS is valid for P+P^+P+) and treat "facet-defining" as a decoration — after all, Proposition 13.1's polar-style validity argument generalizes easily. But the theorem's actual force is the converse: not merely that these inequalities suffice to describe P+P^+P+, but that none of them is redundant, and no other facet exists. The book's own converse proof needs a genuine perturbation argument (splitting a facet candidate with fewer than ∣S∣|S|∣S∣ independent tight points into two distinct valid inequalities averaging back to it, contradicting facetness) — this is where the real content lives, and a formalization that only captures the forward direction would understate the theorem substantially.

For Theorem 13.5, the difficulty is that S(α)S(\alpha)S(α) and g(α)g(\alpha)g(α) are themselves defined in terms of α\alphaα, so "the largest xj∗x^*_jxj∗​ satisfying [a condition stated in terms of S(xj∗)S(x^*_j)S(xj∗​) and g(xj∗)g(x^*_j)g(xj∗​)]" is a genuinely self-referential extremal characterization, not a closed-form formula one could simply plug into — hence its faithful statement (via IsGreatest over an explicit, self-referential candidate set) rather than an unwound algebraic expression.

Formalization scope

The ambient space is Fin n → ℝ throughout, matching the series default. Dominant/Blocker are given their own names (not reusing, even informally, 02b-polarity's polar/reverse-polar vocabulary), per BRIEF.md's explicit warning that the nonnegativity restriction makes these different objects. PolyDim/IsFacet are restated from 02b-polarity/11a-intersection-cuts (affine dimension via Module.finrank of vectorSpan, faces via IsExtreme), since Chapter 2 already pins these down precisely for this series and Chapter 13's own facet claims use the same notion. IsUpperMonotone is stated exactly as Definition 4 (P = P⁺ ∩ [0,1]ⁿ), not paraphrased as coordinatewise monotonicity, per BRIEF.md's explicit warning that these are different conditions.

IsInIS (membership in ISI^SIS) uses LinearIndependent ℝ directly for the "|S| linearly independent points" hypothesis, matching the book's own wording; since every such point satisfies πx=1\pi x=1πx=1, a linear dependence among them is automatically an affine dependence (the coefficients of any nontrivial linear relation among them must sum to zero), so this is not a weakening of the more familiar "affinely independent" reading a reader might otherwise expect. A trivializing formalization to rule out explicitly: describing Theorem 13.7's P+P^+P+ using only the validity half of the claim (dropping "each of these inequalities is facet-defining for P+P^+P+") — this mission states both conjuncts, since the facet-exactness is the theorem's genuine content beyond a Farkas-style validity certificate.

This mission depends on no other chunk's Lean definitions; it restates the affine-dimension/facet vocabulary of 02b-polarity/11a-intersection-cuts only informally, per the series convention. Corollary 13.6 (an O(n)O(n)O(n)-time algorithmic claim for computing αP\alpha_PαP​) is out-of-cone per BRIEF.md: it is fully quantified, not a veto-V3 case, but is a computational-complexity statement outside this mission's polyhedral-characterization scope.

Selected references

  • D. R. Fulkerson, Blocking and anti-blocking pairs of polyhedra, Mathematical Programming 1 (1971), 168–194. https://doi.org/10.1007/BF01584085
  • E. Balas and R. G. Jeroslow, Strengthening cuts for mixed integer programs (for the broader monotonization-of-polyhedra context cited by this chapter's introduction), European Journal of Operational Research 4 (1980), 224–234. https://doi.org/10.1016/0377-2217(80)90106-X
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 13, §13.1–13.2. https://doi.org/10.1007/978-3-030-00148-3
8 thms4 active users
PreviousPage 2 of 26Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me