Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Linear Optimization

330 missions · 198 completed

Missions

Open132Completed198All330
Operations ResearchOptimizationTheoretical Computer Science·Captain: ORdos

Smale's Ninth Problem: Strongly Polynomial Linear ProgrammingOpen Problem

The problem of solving linear inequalities

The linear feasibility problem takes a matrix A∈Rm×nA \in \mathbb{R}^{m\times n}A∈Rm×n and a vector b∈Rmb \in \mathbb{R}^mb∈Rm and asks whether the system of mmm linear inequalities in nnn real unknowns

{ x∈Rn∣Ax≥b }  ≠  ∅\{\,x \in \mathbb{R}^n \mid Ax \ge b\,\} \;\ne\; \emptyset{x∈Rn∣Ax≥b}=∅

has a solution. By linear programming duality, optimizing a linear objective over such a set reduces to feasibility, so this decision problem carries the whole complexity of linear programming.

What "polynomial time" means here depends on the machine. In the bit model the input is a list of rational numbers, its size LLL counts the bits of all numerators and denominators, and an algorithm is polynomial if it runs in time poly(m,n,L)\mathrm{poly}(m, n, L)poly(m,n,L). In the real-number model the input is a list of mn+mmn + mmn+m exact real numbers, each arithmetic operation (+,−,×,÷+, -, \times, \div+,−,×,÷), comparison, or memory move costs one unit, and a running time may only depend on mmm and nnn. An algorithm polynomial in this second sense is what Smale asks for; the closely related bit-model notion — poly(m,n)\mathrm{poly}(m,n)poly(m,n) arithmetic operations and polynomially bounded intermediate bit sizes — is called strongly polynomial. This mission fixes the real-number model precisely as a Blum–Shub–Smale (BSS) machine (Blum–Shub–Smale 1989): a finite program of instructions acting on a bi-infinite tape Z→R\mathbb{Z} \to \mathbb{R}Z→R of real registers — loads of arbitrary real machine constants, exact field arithmetic at fixed addresses, two-sided tape shifts, a sign-test branch, and accept/reject — with cost equal to the number of executed instructions. The convention that costs something: the program must be uniform, one finite instruction list serving every mmm, nnn, and every real instance. Uniformity is exactly what separates the question from point-location tricks available to non-uniform families of decision trees.

Why it matters

For optimization, the question is the last gap in the complexity of its central problem. Linear programs with combinatorial structure already admit strongly polynomial algorithms — Tardos (1986) solved every LP whose running time may depend on the entries of AAA but not on bbb or ccc, covering network flows and all {0,±1}\{0,\pm1\}{0,±1}-constraint problems — and a positive answer for general LP would extend that unification to the whole class, while explaining why simplex-type methods behave so well in practice (Spielman–Teng 2004).

For the theory of computation over the reals, the problem is a benchmark for what unit-cost exact arithmetic can do: it is Problem 9 on Smale's list of mathematical problems for the twenty-first century (Smale 1998), posed in the BSS model as the real-number analogue of the P-versus-NP style questions of that program, and it interacts with polyhedral combinatorics through the polynomial Hirsch conjecture: a polynomial bound on polytope diameters is a necessary condition for any polynomial pivot rule. A problem that calibrates both the practice of optimization and the foundations of real computation is a subject, not a special case.

The question and what is known

Question (Smale’s 9th).Is there a uniform BSS program deciding {x∣Ax≥b}≠∅ in poly(m,n) steps?\textbf{Question (Smale's 9th).}\quad \text{Is there a uniform BSS program deciding } \{x \mid Ax \ge b\} \ne \emptyset \text{ in } \mathrm{poly}(m,n) \text{ steps?}Question (Smale’s 9th).Is there a uniform BSS program deciding {x∣Ax≥b}=∅ in poly(m,n) steps?

The timeline splits into a negative branch (lower bounds against algorithm classes) and a positive branch (polynomial algorithms in weaker senses).

Lower bounds. Klee–Minty (1972) constructed a deformed cube on which Dantzig's largest-coefficient simplex rule visits all 2n2^n2n vertices; analogous exponential examples were later found for essentially every deterministic pivot rule, and randomized rules were driven to subexponential lower bounds by Friedmann–Hansen–Zwick (2011) — against upper bounds of exp⁡(O(nlog⁡n))\exp(O(\sqrt{n \log n}))exp(O(nlogn​)) from Kalai (1992) and Matoušek–Sharir–Welzl (1996). On the interior-point side, Allamigeon–Benchimol–Gaubert–Joswig (2018) showed by tropical methods that log-barrier path following is not strongly polynomial, and Allamigeon–Gaubert–Vandame (2022) extended this to every self-concordant barrier: no interior-point method of that class can settle the question positively.

Polynomial algorithms in weaker senses. Khachiyan (1979/80) proved LP feasibility is polynomial in the bit model via the ellipsoid method; Karmarkar (1984) and then Renegar (1988) brought interior-point methods to O(n L)O(\sqrt{n}\,L)O(n​L) iterations. Megiddo (1984) solved LP in linear time for every fixed dimension; Tardos (1986) gave the combinatorial strongly polynomial class; Vavasis–Ye (1996) and Dadush–Huiberts–Natura–Végh (2020) replaced the bit size by condition measures of AAA alone; Ye (2011) proved policy iteration strongly polynomial for fixed-discount Markov decision processes.

The central difficulty is visible in every positive result: each known iteration count is controlled by a scale-dependent quantity — bit length, condition number, barrier curvature — that is unbounded over the real instances with m,nm, nm,n fixed. The naive plan, "run the ellipsoid method and round", fails at its first step in the real model: the number of iterations needed to separate a feasible system from an infeasible one grows with the thinness of the feasible set, which is not a function of (m,n)(m, n)(m,n); no data-independent perturbation ε\varepsilonε exists when the data are arbitrary reals. All results above are proved on paper only; none has a machine-checked proof in the literature. What is already formalized, on this platform, is the substrate this mission builds on: the simplex iteration (mission Introduction to Linear Optimization IV), the ellipsoid method with its volume-halving correctness theorem (XI), interior-point path following (XII), and self-concordance with the barrier method (Convex Optimization VI).

A hierarchy of formalization targets

The mission's milestone list realizes this hierarchy in order; each level states what it deliberately leaves open.

Level 0 — the model works. A uniform BSS program decides one-variable feasibility in linear time:

∃ P, C  ∀m, ∀(a,b)∈Rm×Rm: P decides {x∈R∣aix≥bi ∀i}≠∅ within C(m+1) steps.\exists\,P,\,C\ \ \forall m,\ \forall (a,b) \in \mathbb{R}^m \times \mathbb{R}^m:\ P \text{ decides } \{x \in \mathbb{R} \mid a_i x \ge b_i\ \forall i\} \ne \emptyset \text{ within } C(m{+}1) \text{ steps}.∃P,C  ∀m, ∀(a,b)∈Rm×Rm: P decides {x∈R∣ai​x≥bi​ ∀i}=∅ within C(m+1) steps.

It fixes nothing about n≥2n \ge 2n≥2; its role is to certify that the machine model and cost semantics of the goal are non-vacuous.

Level 1 — the classical method is exponential. On the Klee–Minty cube, Dantzig's rule admits a run of

2n−1 pivots2^n - 1 \text{ pivots}2n−1 pivots

from the all-slack basis to the optimum. It leaves open all other pivot rules — extensions to further rules are welcome as strengthenings.

Level 2 — the bit model succeeds. Through the Cramer–Hadamard solution bound ∣xj∣≤n! Un|x_j| \le n!\,U^n∣xj​∣≤n!Un and the perturbation estimates, Khachiyan's theorem: for integer data bounded by UUU, every admissible ellipsoid run decides feasibility within

t∗≤106 (n+2)4(log⁡2U+n+2) iterations.t^* \le 10^6\,(n{+}2)^4(\log_2 U + n + 2) \text{ iterations}.t∗≤106(n+2)4(log2​U+n+2) iterations.

The generous constants are deliberate — only the polynomial order is load-bearing. This level leaves open exactly the dependence on log⁡U\log UlogU.

Level 3 — the goal (open). A uniform program with data-independent polynomial cost:

∃ P, C, d  ∀m,n,A,b: P decides {x∣Ax≥b}≠∅ within C (mn+m+2)d steps.\exists\,P,\,C,\,d\ \ \forall m, n, A, b:\ P \text{ decides } \{x \mid Ax \ge b\} \ne \emptyset \text{ within } C\,(mn + m + 2)^d \text{ steps}.∃P,C,d  ∀m,n,A,b: P decides {x∣Ax≥b}=∅ within C(mn+m+2)d steps.

The statement asserts only the shape of the truth — no hard-coded degree or constant — so it is stable under every future quantitative improvement. These levels do not exhaust the project: Tardos' combinatorial LP theorem, Ye's fixed-discount MDP result, and impossibility statements for restricted program classes in the style of Allamigeon–Gaubert–Vandame are natural later milestones.

Formalization scope

Polyhedra, simplex states, pivots, and ellipsoid runs are the platform's existing LinearOptimization development over Matrix (Fin m) (Fin n) ℝ, with {x∣Ax≥b}\{x \mid Ax \ge b\}{x∣Ax≥b} as polyhedron A b; algorithms with data-dependent iteration counts are formalized as run predicates, as in the parent missions. The new SmaleNinth definitions supply what the goal genuinely needs and the run-predicate style cannot express: a concrete inductive type of BSS programs with operational semantics and unit-cost accounting, the Klee–Minty data with Dantzig's rule, and the explicit Khachiyan constants. One convention closes the degenerate escape hatch: the goal quantifies over finite BSSProgram terms under the fixed encodeLP input convention — formalizing "algorithm" as an arbitrary function Rmn+m→Bool\mathbb{R}^{mn+m} \to \mathrm{Bool}Rmn+m→Bool would make the statement trivially true and is not the theorem. Division is totalized as x/0=0x/0 = 0x/0=0 and the branch test is xi≤0x_i \le 0xi​≤0; both are benign for the class of programs quantified over.

The machine module is infrastructure beyond this mission — any real-number complexity statement (other Smale problems, sums-of-square-roots, BSS-completeness) can reuse it, as can any pivot-rule lower bound reuse the Klee–Minty module. Formalization forces distinctions the literature leaves informal: which machine variant carries the unit-cost claim, how ties in Dantzig's rule are resolved, and which of the interchangeable Khachiyan constants each estimate actually needs. Welcome contributions include proofs of any milestone, alternative exponential instances for other pivot rules, sharper constants in the Khachiyan module, and ports of the known strongly polynomial special cases.

Selected references

  • L. Blum, M. Shub, S. Smale, On a theory of computation and complexity over the real numbers, Bull. AMS 21(1):1–46, 1989. DOI
  • S. Smale, Mathematical problems for the next century, Math. Intelligencer 20(2):7–15, 1998. DOI
  • V. Klee, G. J. Minty, How good is the simplex algorithm?, in Inequalities III, Academic Press, 1972, pp. 159–175.
  • L. G. Khachiyan, Polynomial algorithms in linear programming, USSR Comput. Math. Math. Phys. 20:53–72, 1980. DOI
  • N. Karmarkar, A new polynomial-time algorithm for linear programming, Combinatorica 4:373–395, 1984. DOI
  • J. Renegar, A polynomial-time algorithm, based on Newton's method, for linear programming, Math. Programming 40:59–93, 1988. DOI
  • É. Tardos, A strongly polynomial algorithm to solve combinatorial linear programs, Oper. Res. 34(2):250–256, 1986. DOI
  • N. Megiddo, Linear programming in linear time when the dimension is fixed, J. ACM 31(1):114–127, 1984. DOI
  • G. Kalai, A subexponential randomized simplex algorithm, STOC 1992. DOI
  • O. Friedmann, T. D. Hansen, U. Zwick, Subexponential lower bounds for randomized pivoting rules for the simplex algorithm, STOC 2011. DOI
  • D. A. Spielman, S.-H. Teng, Smoothed analysis of algorithms: why the simplex algorithm usually takes polynomial time, J. ACM 51(3):385–463, 2004. DOI
  • S. A. Vavasis, Y. Ye, A primal-dual interior point method whose running time depends only on the constraint matrix, Math. Programming 74:79–120, 1996. DOI
  • Y. Ye, The simplex and policy-iteration methods are strongly polynomial for the Markov decision problem with a fixed discount rate, Math. Oper. Res. 36(4):593–603, 2011. DOI
  • X. Allamigeon, P. Benchimol, S. Gaubert, M. Joswig, Log-barrier interior point methods are not strongly polynomial, SIAM J. Appl. Algebra Geom. 2(1):140–178, 2018. DOI
  • X. Allamigeon, S. Gaubert, N. Vandame, No self-concordant barrier interior point method is strongly polynomial, STOC 2022. arXiv
  • D. Dadush, S. Huiberts, B. Natura, L. A. Végh, A scaling-invariant algorithm for linear programming whose running time depends only on the constraint matrix, STOC 2020. arXiv
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997 (Chapters 3, 8, 9 — formalized in the Introduction to Linear Optimization mission series).
  • B. Korte, J. Vygen, Combinatorial Optimization: Theory and Algorithms, 6th ed., Springer, 2018, §4.1–4.5.
29 thms6 active usersReviewed
Computational GeometryOperations ResearchTheoretical Computer Science·Captain: mikedeng1

Linear Programming in Linear Time When the Dimension Is Fixed: Fixed-Dimension LP Feasibility Decided in Linear Time on the Real RAMResearch Paper

Motivation

A linear program asks for a point x∈Rdx\in\mathbb{R}^dx∈Rd minimizing cTxc^TxcTx subject to nnn linear inequalities ∑j=1daijxj≥bi\sum_{j=1}^d a_{ij}x_j\ge b_i∑j=1d​aij​xj​≥bi​. Many problems in computational geometry and statistics are linear programs with few variables and very many constraints: separating two point sets by a line or plane, fitting a line in the Chebyshev (L∞L_\inftyL∞​) norm, finding the smallest disk or ball containing a point set (a related convex problem). For these problems the number of variables ddd is a small constant, and what matters is how the running time grows with nnn.

Nimrod Megiddo showed that for every fixed ddd the problem can be solved in time C(d)⋅nC(d)\cdot nC(d)⋅n (J. ACM 31(1), 1984).

Timeline.

  • 1983. Megiddo (SIAM J. Comput. 12) and, independently, Dyer (SIAM J. Comput. 13 (1984)) give linear-time algorithms for d=2d=2d=2 and d=3d=3d=3.
  • 1984. Megiddo extends the method to every fixed ddd, with C(d)<22d+2C(d)<2^{2^{d+2}}C(d)<22d+2 (the paper formalized here).
  • 1988–1991. Clarkson (J. ACM 42 (1995), conference version 1988) gives a randomized algorithm with expected time O(d2n)+dO(d)log⁡nO(d^2n)+d^{O(\sqrt d)}\log nO(d2n)+dO(d​)logn. Seidel (Discrete Comput. Geom. 6 (1991)) gives a simple randomized O(d! n)O(d!\,n)O(d!n) algorithm.
  • 1992–1996. Matoušek, Sharir and Welzl and, independently, Kalai give subexponential randomized bounds. Chazelle and Matoušek derandomize the linear dependence with C(d)=dO(d)C(d)=d^{O(d)}C(d)=dO(d) (J. Algorithms 21 (1996)).

Setting

Fix ddd. An instance is a matrix A∈Rn×dA\in\mathbb{R}^{n\times d}A∈Rn×d and a vector b∈Rnb\in\mathbb{R}^nb∈Rn, and its feasible region is the polyhedron P(A,b)={x∈Rd:Ax≥b}P(A,b)=\{x\in\mathbb{R}^d: Ax\ge b\}P(A,b)={x∈Rd:Ax≥b}. Here nnn is the number of constraints and ddd the number of variables.

The model of computation is the real RAM. A program is a finite list of instructions acting on real registers, integer pointer registers and a memory Z→R\mathbb{Z}\to\mathbb{R}Z→R. It performs exact +,−,×,/+,-,\times,/+,−,×,/ on reals at unit cost, tests the sign of a real, sets, copies, increments, decrements and compares pointers, and loads and stores through pointers. The input is the standard encoding of (A,b)(A,b)(A,b) in memory: the numbers nnn and ddd, then AAA row by row, then bbb. A program decides an instance within TTT steps with output β∈{accept,reject}\beta\in\{\text{accept},\text{reject}\}β∈{accept,reject} if it halts on that output after at most TTT steps.

Megiddo's method rests on multidimensional search. There is an unknown point x∗∈Rdx^*\in\mathbb{R}^dx∗∈Rd and an oracle that, for any hyperplane {x:aTx=b}\{x: a^Tx=b\}{x:aTx=b}, answers whether aTx∗<ba^Tx^*<baTx∗<b, =b=b=b or >b>b>b. Given hyperplanes Hi={aiTx=bi}H_i=\{a_i^Tx=b_i\}Hi​={aiT​x=bi​} with ai≠0a_i\ne0ai​=0, the question is how many oracle calls determine the position of x∗x^*x∗ relative to all of them. A search strategy is a ternary decision tree: inner nodes are hyperplane queries, leaves carry outputs, and the tree is built from the data alone. For linear programming, x∗x^*x∗ is an optimal solution, or a minimizer of the infeasibility function f(x)=max⁡i(bi−aiTx)f(x)=\max_i(b_i-a_i^Tx)f(x)=maxi​(bi​−aiT​x) when the system is infeasible. The oracle is implemented by solving problems in d−1d-1d−1 variables.

Formalization targets

Goal: linear-time feasibility on the real RAM

∀d ∃R ∃C ∀n ∀A∈Rn×d, b∈Rn:R decides within C (n+1) steps whether {x:Ax≥b}≠∅.\forall d\ \exists R\ \exists C\ \forall n\ \forall A\in\mathbb{R}^{n\times d},\,b\in\mathbb{R}^n:\quad R\text{ decides within }C\,(n+1)\text{ steps whether } \{x: Ax\ge b\}\neq\emptyset.∀d ∃R ∃C ∀n ∀A∈Rn×d,b∈Rn:R decides within C(n+1) steps whether {x:Ax≥b}=∅.

The program and the constant depend on ddd only. No explicit form of C(d)C(d)C(d) is fixed.

Milestones

  1. One query settles half of nnn hyperplanes on the line (A(1)=1A(1)=1A(1)=1, B(1)=12B(1)=\tfrac12B(1)=21​).
  2. v(ϵ)=(1,ϵ,…,ϵd−1)v(\epsilon)=(1,\epsilon,\dots,\epsilon^{d-1})v(ϵ)=(1,ϵ,…,ϵd−1) is orthogonal to some aia_iai​ for at most n(d−1)n(d-1)n(d−1) values of ϵ\epsilonϵ, so there is a basis in which all aij≠0a_{ij}\ne0aij​=0.
  3. For hyperplanes of opposite slopes in the (x1,x2)(x_1,x_2)(x1​,x2​) plane, the answers for Hik(1)H^{(1)}_{ik}Hik(1)​ and Hik(2)H^{(2)}_{ik}Hik(2)​ settle one of HiH_iHi​, HkH_kHk​.
  4. A linearly dependent pair of opposite slopes has ai1=ak1=0a_{i1}=a_{k1}=0ai1​=ak1​=0, and the middle hyperplane settles one of them.
  5. Approach I: 2d−12^{d-1}2d−1 queries settle at least ⌊21−2dn⌋\lfloor 2^{1-2^d}n\rfloor⌊21−2dn⌋ hyperplanes.
  6. C(d)log⁡nC(d)\log nC(d)logn queries settle all nnn hyperplanes.
  7. If a hyperplane contains no optimal point, all optimal points lie on one side of it.
  8. The oracle, Case I: at an optimum relative to {xd=0}\{x_d=0\}{xd​=0}, two auxiliary systems decide the side or certify global optimality.
  9. The oracle, Case II: at a minimizer of fff on {xd=0}\{x_d=0\}{xd​=0}, systems (1) and (2) decide the side or certify infeasibility.

Significance

The result. For every fixed dimension, linear programming is solvable in time linear in the number of constraints. The algorithm is also strongly polynomial in fixed dimension: its operation count does not depend on the bit size of the data. Deciding whether the optimum is at most ttt is feasibility of Ax≥bAx\ge bAx≥b together with −cTx≥−t-c^Tx\ge-t−cTx≥−t, so the goal also covers the decision form of optimization. The prune-and-search technique of the paper, which discards a constant fraction of the constraints per round, became a standard tool of computational geometry.

Formalizing it. The result is proved and classical. The platform already has the cases d=1d=1d=1 (linear time) and d=2d=2d=2 (quadratic time, by Fourier–Motzkin elimination) on the same machine and input encoding (SmaleNinth.real_ram_decides_one_variable_lp_linear, SmaleNinth.real_ram_decides_two_variable_lp_quadratic). No machine-checked proof of the general statement is known. The work consists of the query-complexity layer (milestones 1–6), the convex-analytic correctness of the oracle (milestones 7–9), and a real-RAM implementation with a step count linear in nnn, including linear-time median selection. Alternative proofs, for example through Clarkson's or Seidel's algorithms made deterministic, are welcome for the goal.

Difficulty

The obvious approach is to find the optimum by testing constraints one by one or by eliminating variables. Fourier–Motzkin elimination produces Θ(n2)\Theta(n^2)Θ(n2) constraints after one step. Pivoting methods have no known bound linear in nnn. The key difficulty is to discard a constant fraction of the constraints using only a constant number of recursive calls in dimension d−1d-1d−1, when no single hyperplane test gives information about more than one constraint. The multidimensional search layer gives this, and it is where the pairing of hyperplanes by slope and the degenerate cases (dependent pairs, zero coefficients) have to be handled exactly. At the machine level, the step count must stay linear in nnn for a fixed program, so every median selection and every recursive call must be implemented within the budget, with the recursion depth depending on ddd only.

Formalization scope

  • Machine and input. The machine is the platform's real RAM SmaleNinth.RAMProgram with RAMDecidesInTime, and the input convention is SmaleNinth.encodeLP (published definitions, reused unchanged). No instruction is added: there is no LP, median, floor or sort primitive. Time is the number of machine steps.
  • Quantifier order. ∀d ∃R ∃C ∀n,A,b\forall d\ \exists R\ \exists C\ \forall n, A, b∀d ∃R ∃C ∀n,A,b. The bound is C(n+1)C(n+1)C(n+1) in the number nnn of constraints, so that the machine can halt at n=0n=0n=0. The paper's C(d)<22d+2C(d)<2^{2^{d+2}}C(d)<22d+2 counts unspecified units of "effort" with an unquantified θ(nd)\theta(nd)θ(nd) term, and it is not transferred to machine steps. Where a milestone's proof fixes a constant exactly, the constant is stated: 2d−12^{d-1}2d−1 queries and ⌊n/22d−1⌋\lfloor n/2^{2^d-1}\rfloor⌊n/22d−1⌋ settled hyperplanes in milestone 5.
  • Feasibility only. The machine outputs accept or reject. Returning an optimizer, "unbounded", or a minimizer of fff is not part of the goal. The case d=0d=0d=0 is included.
  • Query trees. Nodes are queries compare (a ⬝ᵥ x) b and nothing else, leaves hold fixed values, and correctness is required for every xxx. A tree over arbitrary tests of xxx would make milestones 5 and 6 empty, and it is excluded by the definition.
  • Indices. The paper's x1,x2x_1,x_2x1​,x2​ are indices 0, 1 of Fin (d + 2), and its xdx_dxd​ is Fin.last d of Fin (d + 1).
  • Corrections. Two passages of §4 are stated in corrected form. The Case I auxiliary objective includes the ±cd\pm c_d±cd​ term of the direction. In Case II, feasibility of (1) puts improvement in {xd>0}\{x_d>0\}{xd​>0}, where the page's last sentence says {xd<0}\{x_d<0\}{xd​<0}. The pairing claim carries ak1ai2−ak2ai1≠0a_{k1}a_{i2}-a_{k2}a_{i1}\ne0ak1​ai2​−ak2​ai1​=0, the hypothesis its argument uses, since linear independence alone does not give it.
  • Not included. Approach II and its bound O(n(log⁡n)d2)O(n(\log n)^{d^2})O(n(logn)d2), the remarks on slowly growing ddd, the randomized variants, and the applications of §1.
  • Reusable parts. The query-tree definition and milestones 1–6 apply to any prune-and-search problem with a hyperplane oracle. The oracle lemmas (7–9) are statements about convex piecewise-linear functions and polyhedra.

Selected references

  • N. Megiddo, Linear programming in linear time when the dimension is fixed, J. ACM 31(1):114–127, 1984. https://doi.org/10.1145/2422.322418
  • N. Megiddo, Linear-time algorithms for linear programming in R3R^3R3 and related problems, SIAM J. Comput. 12(4):759–776, 1983. https://doi.org/10.1137/0212052
  • M. E. Dyer, Linear time algorithms for two- and three-variable linear programs, SIAM J. Comput. 13(1):31–45, 1984. https://doi.org/10.1137/0213003
  • K. L. Clarkson, Las Vegas algorithms for linear and integer programming when the dimension is small, J. ACM 42(2):488–499, 1995. https://doi.org/10.1145/201019.201036
  • R. Seidel, Small-dimensional linear programming and convex hulls made easy, Discrete Comput. Geom. 6:423–434, 1991. https://doi.org/10.1007/BF02574699
  • B. Chazelle, J. Matoušek, On linear-time deterministic algorithms for optimization problems in fixed dimension, J. Algorithms 21(3):579–597, 1996. https://doi.org/10.1006/jagm.1996.0046
16 thms5 active usersReviewed
Combinatorics·Captain: Shuze Chen

The Polynomial Hirsch ConjectureOpen Problem

Motivation

The simplex method walks along edges of a polytope from vertex to vertex. Whether any pivot rule could ever make that walk short in the worst case is governed by a prior, purely geometric question: how far apart, in the edge graph, can two vertices of a polytope be? Warren Hirsch conjectured in 1957 that the diameter of a ddd-dimensional polytope with nnn facets is at most n−dn - dn−d. Half a century of upper bounds stalled at quasi-polynomial, and Santos disproved the conjecture itself in 2012 — but only by a constant factor. The surviving question, the subject of the Polymath 3 project, is the polynomial Hirsch conjecture: is the diameter bounded by a polynomial in nnn and ddd?

Timeline

  • 1957. Hirsch states the conjecture diam≤n−d\mathrm{diam} \le n - ddiam≤n−d in a letter to Dantzig, who publishes it in Linear Programming and Extensions (1963).
  • 1964–1966. Klee determines the exact maximum diameter of 333-polytopes with nnn facets, ⌊2n/3⌋−1\lfloor 2n/3\rfloor - 1⌊2n/3⌋−1 — the Hirsch bound holds up to dimension three.
  • 1967. Klee and Walkup (Acta Math.) refute the unbounded-polyhedron version, prove the bounded conjecture for n−d≤5n - d \le 5n−d≤5, and reduce the general case to the ddd-step conjecture (n=2dn = 2dn=2d).
  • 1970. Larman (Proc. LMS) proves diam≤n 2d−3\mathrm{diam} \le n\,2^{d-3}diam≤n2d−3 — linear in the number of facets for each fixed dimension, still the best bound of that shape.
  • 1989. Naddef (Math. Programming) proves 0/10/10/1-polytopes satisfy the Hirsch bound, with diameter at most ddd.
  • 1992. Kalai and Kleitman (Bull. AMS) prove diam≤nlog⁡2d+2\mathrm{diam} \le n^{\log_2 d + 2}diam≤nlog2​d+2 in under a page — the quasi-polynomial barrier every later bound refines. The same year brings subexponential pivot rules (Kalai; Matoušek–Sharir–Welzl), the algorithmic counterpart.
  • 2010. Eisenbrand, Hähnle, Razborov, and Rothvoß (Math. OR) show the known upper-bound arguments survive in a purely combinatorial abstraction — which admits almost-quadratic lower bounds, so a polynomial bound must use real geometry. Kalai launches Polymath 3 on the polynomial version.
  • 2010–2012. Santos (Annals of Math.) disproves the Hirsch conjecture: a 434343-dimensional polytope with 868686 facets and diameter at least 444444, via spindles of large width.
  • 2014–2019. Todd (SIAM J. Discrete Math.) sharpens Kalai–Kleitman to (n−d)log⁡2d(n-d)^{\log_2 d}(n−d)log2​d; Sukegawa refines further. Matschke, Santos, and Weibel (Proc. LMS 2015) shrink the counterexample to dimension 202020 with 404040 facets and diameter 212121. All known violations remain constant-factor; all known bounds remain quasi-polynomial.

Setting

Work in Rd\mathbb{R}^dRd. An H-polytope is a set cut out by finitely many linear inequalities: given vectors a1,…,an∈Rda_1, \dots, a_n \in \mathbb{R}^da1​,…,an​∈Rd and reals b1,…,bnb_1, \dots, b_nb1​,…,bn​, it is

P  =  { x∈Rd∣⟨ai,x⟩≤bi for i=1,…,n },P \;=\; \{\, x \in \mathbb{R}^d \mid \langle a_i, x\rangle \le b_i \text{ for } i = 1, \dots, n \,\},P={x∈Rd∣⟨ai​,x⟩≤bi​ for i=1,…,n},

where ⟨ai,x⟩=∑j=1daijxj\langle a_i, x\rangle = \sum_{j=1}^d a_{ij} x_j⟨ai​,x⟩=∑j=1d​aij​xj​ is the standard inner (dot) product — so each condition ⟨ai,x⟩≤bi\langle a_i, x\rangle \le b_i⟨ai​,x⟩≤bi​ is one linear inequality, with normal vector aia_iai​ and offset bib_ibi​. Throughout, PPP is assumed nonempty and bounded. The parameter nnn counts the inequalities in the given description; since every polytope with fff facets admits a description by exactly fff inequalities, bounds stated in terms of nnn over all descriptions are equivalent to bounds in terms of facet counts.

A vertex of PPP is an extreme point. Two vertices u≠vu \ne vu=v are adjacent when the segment [u,v][u, v][u,v] is an extreme subset of PPP; for a polytope the convex extreme subsets are exactly the faces, so this says precisely that [u,v][u,v][u,v] is a one-dimensional face — an edge. The combinatorial diameter of PPP is the diameter of the graph of vertices and edges. Throughout, "diameter at most BBB" is expressed as: every two vertices are joined by a walk of BBB steps, each step staying put or crossing an edge — a form that is monotone in BBB and asserts connectivity of the graph (Balinski's theorem) as part of the claim.

Formalization targets

Goal — the polynomial Hirsch conjecture

∃ c,k∈N: every nonempty bounded P={x∈Rd∣⟨ai,x⟩≤bi, i≤n} has diameter≤c (n+d)k.\exists\, c, k \in \mathbb{N}:\ \text{every nonempty bounded } P = \{x \in \mathbb{R}^d \mid \langle a_i, x \rangle \le b_i,\ i \le n\} \text{ has diameter} \le c\,(n + d)^k.∃c,k∈N: every nonempty bounded P={x∈Rd∣⟨ai​,x⟩≤bi​, i≤n} has diameter≤c(n+d)k.

Every polynomial in nnn and ddd is dominated by some c(n+d)kc(n+d)^kc(n+d)k and conversely, so this is exactly polynomiality, with no committed degree — the form that survives any future sharpening of constants or exponents.

Milestones — the known ladder

Six classical results over the same definitions: the Hirsch bound n−dn - dn−d in dimension d≤3d \le 3d≤3 (Klee; Klee–Walkup); Larman's bound n⋅2d−3n \cdot 2^{d-3}n⋅2d−3; Naddef's bound ddd for 0/10/10/1-polytopes; the Kalai–Kleitman bound nlog⁡2d+2n^{\log_2 d + 2}nlog2​d+2; Todd's bound (n−d)log⁡2d(n-d)^{\log_2 d}(n−d)log2​d for full-dimensional PPP with n≥d≥3n \ge d \ge 3n≥d≥3; and — in the other direction — the Santos counterexample: a nonempty bounded H-polytope whose diameter exceeds n−dn - dn−d.

Significance

A polynomial diameter bound is necessary for any pivot rule of the simplex method to run in polynomial time in the worst case: if vertices can be super-polynomially far apart, no edge-following algorithm can connect them quickly. A refutation would close off one of the main hoped-for routes to a strongly polynomial linear programming algorithm (Smale's ninth problem). The conjecture is also the test question of polyhedral graph theory: the Kalai–Kleitman argument uses so little about polytopes that it holds for far more general set systems, and Eisenbrand, Hähnle, Razborov, and Rothvoß (Math. OR 2010) showed such abstractions admit almost-quadratic lower bounds — so a proof of the conjecture must use geometry the abstract setting lacks, and a disproof must beat the abstraction barrier's constructions with actual polytopes.

None of these results has been formalized in any proof assistant; Mathlib has extreme points and faces of convex sets, but no polytope combinatorics — no vertex-edge graph, no diameter, no facet counting. This mission builds that layer: an H-polytope model, adjacency via faces, and walk-based diameter bounds, against which both the upper-bound ladder and the Santos disproof can be machine-checked. The Kalai–Kleitman proof is one page from first principles and is the natural summit; the Santos construction is a concrete finite object whose verification is a different, computational kind of challenge.

Difficulty

The naive approach — walk toward the target vertex by always improving some linear objective — is exactly the simplex method, and proving any polynomial bound on such walks is open for every known pivot rule; monotone variants of the diameter question have exponential lower bounds. The obvious inductive strategy (bound the diameter by recursing on facets) is precisely what Kalai–Kleitman optimizes, and it provably cannot go below quasi-polynomial without using metric or topological properties of actual polytopes, by the abstraction lower bound above. On the other side, making diameters large is blocked by the wedge/spindle calculus only producing constant-factor violations. The problem sits in a genuine gap: no technique on either side is known to reach polynomial.

Formalization scope

The Lean model commits to: ambient space EuclideanSpace ℝ (Fin d); the polytope as Hpoly a b = {x | ∀ i, ⟪a i, x⟫ ≤ b i} for a : Fin n → EuclideanSpace ℝ (Fin d), b : Fin n → ℝ, with nonemptiness and Bornology.IsBounded as explicit hypotheses (boundedness is essential: Klee–Walkup's unbounded counterexample would otherwise trivialize the Santos milestone); vertices as Set.extremePoints ℝ; adjacency as u ≠ v ∧ IsExtreme ℝ P (segment ℝ u v); and diameter bounds as the walk predicate DiamLE, whose stationary steps make it monotone in the bound. Real-exponent bounds enter through Real.logb and the natural floor. In larman_bound and the two Hirsch-form bounds the subtraction is natural-number (truncated) subtraction, which only weakens nothing: the stated forms are true as written for all n,dn, dn,d in scope. The dimension parameter ddd is the ambient dimension; lower-dimensional polytopes are included, and every milestone is stated so as to remain true for them, with todd_bound requiring full-dimensionality ((interior P).Nonempty) as in its source.

Welcome contributions: any milestone in any order (dimension_three_bound for d≤1d \le 1d≤1 cases and structural lemmas about Adj and DiamLE are natural entry points, and kalai_kleitman_bound is the summit); reusable infrastructure — polytopes have finitely many extreme points, faces of H-polytopes, Balinski connectivity — published as platform theorems; and, as a separate expedition, the explicit Santos or Matschke–Santos–Weibel polytope. Statements about unbounded polyhedra, the simplex method itself, and subexponential pivot rules are left to future missions.

Selected references

  • V. Klee, D. Walkup, The d-step conjecture for polyhedra of dimension d < 6, Acta Math. 117 (1967). doi:10.1007/BF02392971
  • D. Larman, Paths on polytopes, Proc. London Math. Soc. 20 (1970). doi:10.1112/plms/s3-20.2.249
  • D. Naddef, The Hirsch conjecture is true for (0,1)-polytopes, Math. Programming 45 (1989). doi:10.1007/BF01589418
  • G. Kalai, D. Kleitman, A quasi-polynomial bound for the diameter of graphs of polyhedra, Bull. AMS 26 (1992). arXiv:math/9204233
  • F. Santos, A counterexample to the Hirsch conjecture, Annals of Mathematics 176 (2012). arXiv:1006.2814
  • M. Todd, An improved Kalai–Kleitman bound for the diameter of a polyhedron, SIAM J. Discrete Math. 28 (2014). arXiv:1402.3579
  • B. Matschke, F. Santos, C. Weibel, The width of five-dimensional prismatoids, Proc. London Math. Soc. 110 (2015). arXiv:1202.4701
  • F. Eisenbrand, N. Hähnle, A. Razborov, T. Rothvoß, Diameter of polyhedra: limits of abstraction, Math. Oper. Res. 35 (2010). doi:10.1287/moor.1100.0470
  • F. Santos, Recent progress on the combinatorial diameter of polytopes and simplicial complexes, TOP 21 (2013) (survey). arXiv:1307.5900
81 thms5 active usersReviewed
Complexity TheoryOperations ResearchOptimization·Captain: mikedeng1

On Adaptive-Step Primal-Dual Interior-Point Algorithms for Linear Programming 3: The Potential-Reduction Algorithm in N∞⁻(β) with ρ − n of Order n² Attains Precision t in O(nt) IterationsResearch Paper

Motivation

Primal–dual interior-point methods solve a linear program by following, approximately, the central path of strictly feasible primal–dual pairs. Two families dominate the theory. Path-following methods keep the iterates in a neighbourhood of the path and measure progress by the duality gap. Potential-reduction methods measure progress by a merit function, the primal–dual potential of Todd and Ye (Todd–Ye 1990), and choose the step to decrease it.

The potential carries a parameter ρ>n\rho > nρ>n. The classical analyses (Ye 1991, Freund, Anstreicher–Bosch, Kojima–Mizuno–Yoshise) give O(n t)O(\sqrt n\,t)O(n​t) iterations with ρ=n+Θ(n)\rho = n + \Theta(\sqrt n)ρ=n+Θ(n​). Practical codes, however, performed better with much larger ρ\rhoρ (McShane–Monma–Shanno, Lustig–Marsten–Shanno). Mizuno, Todd and Ye (Cornell ORIE Technical Report No. 944, 1990, rev. 1991; journal version Math. Oper. Res. 18(4), 1993, doi:10.1287/moor.18.4.964) supply a worst-case justification for a large parameter. With ρ=n+Θ(n2)\rho = n + \Theta(n^2)ρ=n+Θ(n2) and the step chosen to minimise the potential inside the wide neighbourhood N∞−(β)\mathcal N_\infty^-(\beta)N∞−​(β), the method needs O(nt)O(nt)O(nt) iterations. That matches the adaptive-step path-following method in the same neighbourhood (their Theorem 2).

Timeline:

  • 1990: Todd and Ye introduce the primal–dual potential function.
  • 1989–1991: Kojima–Mizuno–Yoshise, Ye, Freund and others prove O(n t)O(\sqrt n\,t)O(n​t) bounds for ρ=n+Θ(n)\rho = n + \Theta(\sqrt n)ρ=n+Θ(n​).
  • 1990–1991: Mizuno, Todd and Ye prove the O(nt)O(nt)O(nt) bound for ρ=n+Θ(n2)\rho = n + \Theta(n^2)ρ=n+Θ(n2) (Theorem 3 of the report formalized here).

Setting

Fix m≥0m \ge 0m≥0, n≥1n \ge 1n≥1, A∈Rm×nA \in \mathbb R^{m\times n}A∈Rm×n, b∈Rmb \in \mathbb R^mb∈Rm, c∈Rnc \in \mathbb R^nc∈Rn. The primal problem is min⁡cTx\min c^TxmincTx subject to Ax=bAx = bAx=b, x≥0x \ge 0x≥0. The dual is max⁡bTy\max b^TymaxbTy subject to ATy+s=cA^Ty + s = cATy+s=c, s≥0s \ge 0s≥0. The strictly feasible set F0\mathcal F^0F0 is the set of pairs (x,s)(x, s)(x,s) with x>0x > 0x>0, s>0s > 0s>0, Ax=bAx = bAx=b and ATy+s=cA^Ty + s = cATy+s=c for some yyy. The duality measure is μ=xTs/n\mu = x^Ts/nμ=xTs/n.

For z∈Rnz \in \mathbb R^nz∈Rn put (z−)j=min⁡{zj,0}(z^-)_j = \min\{z_j, 0\}(z−)j​=min{zj​,0} and ∥z∥∞−=∥z−∥∞\|z\|_\infty^- = \|z^-\|_\infty∥z∥∞−​=∥z−∥∞​. For β∈(0,1)\beta \in (0,1)β∈(0,1), the wide neighbourhood is

N∞−(β)={(x,s)∈F0:∥Xs−μe∥∞−≤βμ},\mathcal N_\infty^-(\beta) = \{(x,s) \in \mathcal F^0 : \|Xs - \mu e\|_\infty^- \le \beta\mu\},N∞−​(β)={(x,s)∈F0:∥Xs−μe∥∞−​≤βμ},

i.e. xjsj≥(1−β)μx_js_j \ge (1-\beta)\muxj​sj​≥(1−β)μ for all jjj, where X=diag(x)X = \mathrm{diag}(x)X=diag(x) and eee is the all-ones vector.

The potential is

ψ(x,s)=ρlog⁡(xTs)−∑j=1nlog⁡(xjsj),ρ>n,\psi(x,s) = \rho\log(x^Ts) - \sum_{j=1}^n \log(x_js_j), \qquad \rho > n,ψ(x,s)=ρlog(xTs)−j=1∑n​log(xj​sj​),ρ>n,

with the natural logarithm. At (x,s)(x,s)(x,s) and for γ∈(0,1)\gamma \in (0,1)γ∈(0,1), a search direction d=(dx,dy,ds)d = (d_x, d_y, d_s)d=(dx​,dy​,ds​) solves

Sdx+Xds=γμe−Xs,Adx=0,ATdy+ds=0,S d_x + X d_s = \gamma\mu e - Xs,\qquad A d_x = 0,\qquad A^Td_y + d_s = 0,Sdx​+Xds​=γμe−Xs,Adx​=0,ATdy​+ds​=0,

and the iterates move along x(θ)=x+θdxx(\theta) = x + \theta d_xx(θ)=x+θdx​, s(θ)=s+θdss(\theta) = s + \theta d_ss(θ)=s+θds​. The scaled vectors are pj=sj/xj (dx)jp_j = \sqrt{s_j/x_j}\,(d_x)_jpj​=sj​/xj​​(dx​)j​ and qj=xj/sj (ds)jq_j = \sqrt{x_j/s_j}\,(d_s)_jqj​=xj​/sj​​(ds​)j​, Pq=(pjqj)jPq = (p_jq_j)_jPq=(pj​qj​)j​, and θ2−=min⁡{1,βγμ/∥Pq∥∞−}\theta_2^- = \min\{1, \beta\gamma\mu/\|Pq\|_\infty^-\}θ2−​=min{1,βγμ/∥Pq∥∞−​}.

Algorithm 3. Start from (x0,s0)∈N∞−(β)(x^0,s^0) \in \mathcal N_\infty^-(\beta)(x0,s0)∈N∞−​(β) with (x0)Ts0≤2t(x^0)^Ts^0 \le 2^t(x0)Ts0≤2t and ψ(x0,s0)≤(ρ−n)t+nlog⁡n\psi(x^0,s^0) \le (\rho-n)t + n\log nψ(x0,s0)≤(ρ−n)t+nlogn. While (xk)Tsk>2−t(x^k)^Ts^k > 2^{-t}(xk)Tsk>2−t, compute ddd at (xk,sk)(x^k, s^k)(xk,sk), choose θˉ\bar\thetaθˉ with (x(θˉ),s(θˉ))∈N∞−(β)(x(\bar\theta), s(\bar\theta)) \in \mathcal N_\infty^-(\beta)(x(θˉ),s(θˉ))∈N∞−​(β) and ψ(x(θˉ),s(θˉ))≤ψ(x(θ),s(θ))\psi(x(\bar\theta), s(\bar\theta)) \le \psi(x(\theta), s(\theta))ψ(x(θˉ),s(θˉ))≤ψ(x(θ),s(θ)) for every θ\thetaθ with (x(θ),s(θ))∈N∞−(β)(x(\theta), s(\theta)) \in \mathcal N_\infty^-(\beta)(x(θ),s(θ))∈N∞−​(β), and move to (x(θˉ),s(θˉ))(x(\bar\theta), s(\bar\theta))(x(θˉ),s(θˉ)).

Formalization targets

Goal: Theorem 3 (p. 11)

Let β,γ∈(0,1)\beta,\gamma \in (0,1)β,γ∈(0,1) with γ≤2(1−β)\gamma \le 2(1-\beta)γ≤2(1−β) and

ρ=n+(3βγ(1−γ)log⁡11−β)n2.\rho = n + \Bigl(\frac{3}{\beta\gamma(1-\gamma)}\log\frac{1}{1-\beta}\Bigr)n^2.ρ=n+(βγ(1−γ)3​log1−β1​)n2.

For every t>0t > 0t>0 and every run of Algorithm 3,

∃ k≤⌈6nt11βγ(1−γ)⌉:(xk)Tsk≤2−t.\exists\, k \le \Bigl\lceil \frac{6nt}{11\beta\gamma(1-\gamma)} \Bigr\rceil:\quad (x^k)^Ts^k \le 2^{-t}.∃k≤⌈11βγ(1−γ)6nt​⌉:(xk)Tsk≤2−t.

The paper states "O(nt)O(nt)O(nt) iterations". The explicit count is the one its own proof yields, and it is stated so that the goal is not an existential over a constant.

Milestones

  1. §5, p. 11. ψ(x,s)=(ρ−n)log⁡(xTs)−∑jlog⁡xjsjxTs/n+nlog⁡n≥(ρ−n)log⁡(xTs)+nlog⁡n\psi(x,s) = (\rho-n)\log(x^Ts) - \sum_j\log\frac{x_js_j}{x^Ts/n} + n\log n \ge (\rho-n)\log(x^Ts) + n\log nψ(x,s)=(ρ−n)log(xTs)−∑j​logxTs/nxj​sj​​+nlogn≥(ρ−n)log(xTs)+nlogn. Hence reducing ψ\psiψ to −(ρ−n)t+nlog⁡n-(\rho-n)t + n\log n−(ρ−n)t+nlogn gives xTs≤2−tx^Ts \le 2^{-t}xTs≤2−t.
  2. (16), p. 12. One step of Algorithm 3 satisfies ψ(x(θˉ),s(θˉ))−ψ(x,s)≤−(3n2θ2−βγ−n)log⁡11−β\psi(x(\bar\theta),s(\bar\theta)) - \psi(x,s) \le -\bigl(\frac{3n^2\theta_2^-}{\beta\gamma} - n\bigr)\log\frac{1}{1-\beta}ψ(x(θˉ),s(θˉ))−ψ(x,s)≤−(βγ3n2θ2−​​−n)log1−β1​.
  3. Proof of Theorem 3, p. 12. For n≥1n \ge 1n≥1, every step decreases ψ\psiψ by at least 11nlog⁡11−β11n\log\frac{1}{1-\beta}11nlog1−β1​.

Significance

The result shows that a potential-reduction method with ρ−n\rho - nρ−n of order n2n^2n2 keeps a polynomial worst-case bound. The earlier analyses cited by the report used ρ−n\rho - nρ−n of order n\sqrt nn​. It thereby gives a worst-case justification for the large parameters that worked in practice. It also connects the two families: the direction is the path-following direction, and only the step rule changes. Corollary 3 of the paper adds that iterations with a small second-order term PqPqPq decrease the potential far more.

The result is proved in the report. As far as the platform's index shows, no part of it has been machine-checked. The platform already holds the potential function (Bertsimas–Tsitsiklis §9.3) and a proved bookkeeping theorem converting a constant per-iteration decrease into an iteration count (Bertsimas–Tsitsiklis Theorem 9.4). This mission adds the analysis of a concrete algorithm: the admissibility of the step θ2−\theta_2^-θ2−​ in N∞−(β)\mathcal N_\infty^-(\beta)N∞−​(β), the potential decrease (16), and the complexity bound.

Difficulty

The step θˉ\bar\thetaθˉ is defined by minimisation, not by an explicit formula, so its decrease must be bounded by comparison with a step whose effect can be computed. That reference step must be shown to stay in the neighbourhood. This requires controlling the second-order term PqPqPq of the Newton direction in the one-sided norm ∥⋅∥∞−\|\cdot\|_\infty^-∥⋅∥∞−​, together with the centrality of the current iterate. A fixed decrease of order nnn arises only because ρ−n\rho - nρ−n is of order n2n^2n2. Below that scale, the duality-gap term of the potential no longer dominates the loss in centrality from a long step.

A second obstacle is specific to formal work. Algorithm 3's rule ranges over every real θ\thetaθ whose point lies in the neighbourhood, and a minimiser need not exist. The goal must hold for every run, including the degenerate ones.

Formalization scope

Vectors are Fin n → ℝ, with index j=1,…,nj = 1,\dots,nj=1,…,n mapped to Fin n; ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ is Mathlib's sup norm. The general standard-form LP pair is a separate definition, and the neighbourhood and algorithm build on its strict feasibility predicate. ψ\psiψ is the published definition LinearOptimization.interiorPointPotential with q:=ρq := \rhoq:=ρ. It equals (1) at every strictly positive pair, and it is evaluated only at points of N∞−(β)\mathcal N_\infty^-(\beta)N∞−​(β). All logarithms are natural, and 2±t2^{\pm t}2±t are real powers with real t>0t > 0t>0. A run is a pair of sequences satisfying the start conditions and, whenever the current gap exceeds 2−t2^{-t}2−t, the step relation of Algorithm 3. Iterates after termination are unconstrained.

Conventions and repairs:

  • θ2−:=1\theta_2^- := 1θ2−​:=1 when ∥Pq∥∞−=0\|Pq\|_\infty^- = 0∥Pq∥∞−​=0, reading βγμ/0\beta\gamma\mu/0βγμ/0 as +∞+\infty+∞.
  • The per-iteration milestone keeps the page's n≥1n \ge 1n≥1. The paper's step θ2−≥4βγ/n\theta_2^- \ge 4\beta\gamma/nθ2−​≥4βγ/n needs 4βγ≤n4\beta\gamma \le n4βγ≤n, which can fail for n=1n = 1n=1; but for n=1n = 1n=1 the potential is unbounded below along the line inside the neighbourhood, so no step exists and the statement holds vacuously there. The goal keeps n≥1n \ge 1n≥1 as well.
  • The minimisation in Algorithm 3 ranges over all real θ\thetaθ, as printed. It does not range over a segment, and the step is not the largest admissible step of Algorithm 2.
  • Both start conditions are kept: (x0)Ts0≤2t(x^0)^Ts^0 \le 2^t(x0)Ts0≤2t from Algorithm 2 and the potential bound of §5.

A formalization in which no run can exist for any instance, or in which ρ\rhoρ or the iteration count absorbs an instance-dependent constant, would trivialize the goal. The step relation above is satisfiable for n≥2n \ge 2n≥2 whenever the potential attains its minimum along the line, and the count is the explicit expression above.

Needed infrastructure: the algebra of system (2), namely dxTds=0d_x^Td_s = 0dxT​ds​=0, the identity μ(θ)=(1−(1−γ)θ)μ\mu(\theta) = (1-(1-\gamma)\theta)\muμ(θ)=(1−(1−γ)θ)μ, and X(θ)s(θ)−μ(θ)e=(1−θ)(Xs−μe)+θ2PqX(\theta)s(\theta) - \mu(\theta)e = (1-\theta)(Xs - \mu e) + \theta^2 PqX(θ)s(θ)−μ(θ)e=(1−θ)(Xs−μe)+θ2Pq. Also needed are the bounds ∥Pq∥∞≤∥r∥2/4\|Pq\|_\infty \le \|r\|^2/4∥Pq∥∞​≤∥r∥2/4 and ∥r∥2≤nμ\|r\|^2 \le n\mu∥r∥2≤nμ on N∞−(β)\mathcal N_\infty^-(\beta)N∞−​(β) when γ≤2(1−β)\gamma \le 2(1-\beta)γ≤2(1−β), and the arithmetic–geometric mean inequality for ψ\psiψ. These facts are shared with the sibling missions on the predictor–corrector and wide-neighbourhood algorithms of the same paper, and lemmas proved here are welcome there. The proved Bertsimas–Tsitsiklis theorem LinearOptimization.interior_point_potential_reduction is included as a reference item for the final counting step. Its hypotheses quantify over all iterations and need explicit dual iterates, so it does not apply verbatim.

Selected references

  • S. Mizuno, M. J. Todd, Y. Ye, On adaptive-step primal-dual interior-point algorithms for linear programming, Cornell ORIE Technical Report No. 944, 1990, rev. 1991; Mathematics of Operations Research 18(4):964–981, 1993. https://doi.org/10.1287/moor.18.4.964
  • M. J. Todd, Y. Ye, A centered projective algorithm for linear programming, Mathematics of Operations Research 15(3):508–529, 1990. https://doi.org/10.1287/moor.15.3.508
12 thms4 active usersReviewed
Complexity TheoryOptimization·Captain: mikedeng1

On Linear Characterizations of Combinatorial Optimization Problems II: A Small Polynomial-Time Generator of Violated Inequalities Puts the Decision Problem in PResearch Paper

Motivation

Many combinatorial optimization problems ask for the largest value of a linear objective over discrete feasible solutions. A linear program over the convex hull of those solutions has the same optimum, so one approach is to describe that hull by inequalities. For matching, for example, inequalities support efficient optimization; for other problems, the full family can be very large. A generator of violated inequalities offers a different interface: given a proposed point, it either certifies hull membership or produces one valid inequality that the point violates. Karp and Papadimitriou asked what the existence of an efficient generator implies for the underlying decision problem. Their answer is Theorem 2 of the technical report.

The report appeared as MIT/LCS/TM-154 in 1980 and later in SIAM Journal on Computing in 1982. Its first theorem addresses a small facial description whose inequality family belongs to NP. This mission concerns its second theorem, where the inequalities may be generated on demand in polynomial time. The conclusion is stronger: the decision language itself belongs to P. The report derives an NP-complete consequence as Corollary 2, conditional on the unresolved equality P = NP. The published article gives the later bibliographic record; all numbering here follows the technical report.

Setting

A combinatorial optimization problem C=(L,n,S)C=(L,n,S)C=(L,n,S) consists of a binary input language LLL, a nonnegative integer dimension n(z)n(z)n(z), and a set S(z)⊆Z+n(z)S(z)\subseteq\mathbb Z_+^{n(z)}S(z)⊆Z+n(z)​ of feasible vectors for each z∈Lz\in Lz∈L. The report requires polynomial-time recognition of LLL, of correctly sized pairs ⟨z,y⟩\langle z,y\rangle⟨z,y⟩, and of feasible pairs ⟨z,x⟩\langle z,x\rangle⟨z,x⟩. An instance adds an integer objective c∈Zn(z)c\in\mathbb Z^{n(z)}c∈Zn(z). Its threshold decision language is

D(C)={⟨z,c,k⟩:z∈L, k∈Z, ∃x∈S(z), c⋅x≥k}.D(C)=\{\langle z,c,k\rangle:z\in L,\ k\in\mathbb Z,\ \exists x\in S(z),\ c\cdot x\ge k\}.D(C)={⟨z,c,k⟩:z∈L, k∈Z, ∃x∈S(z), c⋅x≥k}.

Write CH(S(z))\mathrm{CH}(S(z))CH(S(z)) for the convex hull of the feasible vectors. A generator G(C)G(C)G(C) receives z∈Lz\in Lz∈L and a rational vector p∈Qn(z)p\in\mathbb Q^{n(z)}p∈Qn(z). It returns “O.K.” exactly when ppp belongs to the hull. Otherwise it returns an integer vector fff and integer ggg for which f⋅p>gf\cdot p>gf⋅p>g while f⋅x≤gf\cdot x\le gf⋅x≤g for every x∈S(z)x\in S(z)x∈S(z). The family FG(C)F_G(C)FG​(C) contains every triple ⟨z,f,g⟩\langle z,f,g\rangle⟨z,f,g⟩ that occurs as some output. It is a facial description because its inequalities describe the hull exactly. The generator is small if one polynomial p0p_0p0​ bounds every coefficient in every output by 2p0(∣z∣+n(z))2^{p_0(|z|+n(z))}2p0​(∣z∣+n(z)) in absolute value. Its running time is measured on the full encoded query, including every rational coordinate. These definitions are from §§2 and 4 of the report.

Formalization targets

Theorem 2

The goal is the report's stated implication:

G(C) is a small polynomial-time generator⟹D(C)∈P.G(C)\text{ is a small polynomial-time generator}\quad\Longrightarrow\quad D(C)\in\mathrm P.G(C) is a small polynomial-time generator⟹D(C)∈P.

It allows any c.o.p. satisfying Definition 1, including an empty feasible set or dimension zero. It does not assert P = NP; that consequence needs the additional hypothesis that D(C)D(C)D(C) is NP-complete. The goal is supported by five source claims: the output family is facial; feasibility of system (4) is equivalent to membership in D(C)D(C)D(C); Lemma 4 bounds the distance from a rational point to a small hyperplane; its Corollary extends the bound to a real point on a flat; and Lemma 5 controls distance to a flat after one more hyperplane is added. The system (4) target is

∃x∈Qn(z):c⋅x≥k,f⋅x≤g(⟨z,f,g⟩∈FG(C))⟺⟨z,c,k⟩∈D(C).\exists x\in\mathbb Q^{n(z)}:\quad c\cdot x\ge k,\quad f\cdot x\le g\quad(\langle z,f,g\rangle\in F_G(C))\quad\Longleftrightarrow\quad\langle z,c,k\rangle\in D(C).∃x∈Qn(z):c⋅x≥k,f⋅x≤g(⟨z,f,g⟩∈FG​(C))⟺⟨z,c,k⟩∈D(C).

The distance targets use the report's parameter ttt and the bounds 2−(n(z)+1)t2^{-(n(z)+1)t}2−(n(z)+1)t and (2t−1)δ(2^t-1)\delta(2t−1)δ, exactly as printed on pp. 12–13.

Significance

Theorem 2 turns an efficient separation interface into an efficient test for the threshold language. Consequently, if a c.o.p.'s decision language is NP-complete, a small polynomial-time generator would imply P = NP, as the report's Corollary 2 says. This gives a complexity barrier to a whole class of proposed cutting-plane interfaces, independently of how many inequalities the complete description contains. The result concerns the worst-case running time and output coefficient size; it does not rule out useful generators without those guarantees. Karp and Papadimitriou also point out positive applications to problems already known to be in P.

The mathematical theorem was proved in the report. The mission asks for a machine-checked version of that known result, with explicit interfaces for the generator, coefficient bounds, and the underlying complexity class. The local platform catalog already contains Cook's Turing-machine definitions and a reusable binary-integer encoding; it also contains point-to-hyperplane distance results and a Gram-determinant distance result in other settings. Theorem 2 and these particular source claims are new formalization targets here. The distance and encoding interfaces can serve later missions about separation oracles and bit complexity.

Difficulty

Calling the generator once does not by itself decide whether the objective threshold is attainable: the point supplied to it may be outside the hull, and a single returned inequality says only that this point is excluded. Repeatedly asking at an unchanged point may return the same inequality. The report must also control very small separations, coefficient sizes, and finite precision when an iterative linear-feasibility procedure uses the oracle. Lemmas 4 and 5 quantify the geometric gaps and movement that such a procedure needs. Its Lemmas 2, 3, and 6 address the surrounding perturbation, volume, and iteration arguments; Lemma 6 explicitly relies on another analysis for the finite-precision bound. These are substantive proof obligations even though their statements are not all separate milestones in this proposal. See §4 of the report.

Formalization scope

The report's footnote uses RRR for the rationals. Thus ppp, the hull, and system (4) live in Qn(z)\mathbb Q^{n(z)}Qn(z). Euclidean distances are evaluated after casting coordinates into EuclideanSpace R (Fin n)\mathrm{EuclideanSpace}\,\mathbb R\,(\mathrm{Fin}\ n)EuclideanSpaceR(Fin n); a hyperplane distance is the quotient ∣f⋅r−g∣/∥f∥2|f\cdot r-g|/\|f\|_2∣f⋅r−g∣/∥f∥2​, and distance to a flat uses Euclidean infimum distance. The report does not define “affinely independent hyperplanes”; this mission reads it as linear independence of their normals, which ensures a common flat. Small hyperplanes have nonzero normals, avoiding a zero denominator.

The alphabet is {0,1,−,#}\{0,1,-,\#\}{0,1,−,#}. Binary tuple codes contain zzz, an explicit vector dimension, and every integer; a rational coordinate contains its reduced numerator and denominator. The generator's string function must match the mathematical oracle on every valid query and be polynomial time in the complete code length. A malformed string is outside D(C)D(C)D(C). The source's arbitrary polynomial bound is written ma+am^a+ama+a for one exponent aaa fixed before all instances. For the bit-length parameter ttt, the printed logarithms of possibly nonpositive cic_ici​ and kkk are read as ceiling logarithms of absolute values, with clog⁡2(0)=0\operatorname{clog}_2(0)=0clog2​(0)=0 and the printed +1+1+1 terms retained. The source's formula ε=2−(2n(z)+2)t\varepsilon=2^{-(2n(z)+2)t}ε=2−(2n(z)+2)t remains relevant to the eventual proof of Theorem 2, although no ε\varepsilonε system is a separate draft item here.

Every oracle answer must separate the queried point and remain valid on all of S(z)S(z)S(z); these obligations prevent an arbitrary function from satisfying the goal. The c.o.p. structure retains all three polynomial-recognition conditions of Definition 1. The paper's displayed “min” in (3) is inconsistent with its threshold language and surrounding maximization formulas; D(C)D(C)D(C) uses the printed c⋅x≥kc\cdot x\ge kc⋅x≥k. The typed source's “x∉Hx\notin Hx∈/H” in Lemma 4 is read as the already named point r∉Hr\notin Hr∈/H.

Contributions can develop the rational-hull equivalence, the two quantitative hyperplane lemmas, the finite-precision ellipsoid procedure underlying Lemma 6, or the perturbation and volume claims. The complexity substrate is Cook's one-tape model of P and NP, and the binary integer codec is the published ProjSchedTW_Complexity_Encoding definition. The geometry lemmas are phrased so that existing Mathlib Euclidean-space results can be reused without changing the source's rational optimization domain.

Selected references

  • Richard M. Karp and Christos H. Papadimitriou, On Linear Characterizations of Combinatorial Optimization Problems, MIT/LCS/TM-154, Massachusetts Institute of Technology, 1980. Technical report.
  • Richard M. Karp and Christos H. Papadimitriou, “On Linear Characterizations of Combinatorial Optimization Problems,” SIAM Journal on Computing 11 (1982), 620–632. DOI.
  • Stephen A. Cook, “The Complexity of Theorem-Proving Procedures,” Proceedings of the Third Annual ACM Symposium on Theory of Computing, 1971. DOI.
11 thms4 active usersReviewed
Complexity TheoryOperations Research·Captain: mikedeng1

On Linear Characterizations of Combinatorial Optimization Problems I: A Small Facial Description in NP Puts the Decision Problem in co-NPResearch Paper

Motivation

Polyhedral combinatorics attacks a combinatorial optimization problem by replacing its finite set of feasible solutions with the convex hull of that set and describing the hull by linear inequalities. Once such a description is known, the problem becomes a linear program, and linear programming duality supplies optimality certificates. For matchings, matroids and network flows this programme succeeded completely (Edmonds' matching polytope is the classical example). For the traveling salesman problem, set covering and integer programming, decades of work produced large families of valid and facet-defining inequalities but never a complete list.

R. M. Karp and C. H. Papadimitriou asked whether the failure is accidental. Their answer, in the MIT technical report On linear characterizations of combinatorial optimization problems (MIT/LCS/TM-154, February 1980; journal version SIAM J. Comput. 11 (1982) 620–632), is that for NP-complete problems a usable complete description cannot exist unless NP = co-NP. This mission formalizes the first of their two complexity results, Theorem 1, together with the steps of its proof and its Corollary 1.

Setting

A combinatorial optimization problem (c.o.p.) CCC consists of a set L⊆{0,1}∗L\subseteq\{0,1\}^*L⊆{0,1}∗ of inputs, a function nnn assigning to each input z∈Lz\in Lz∈L a number of variables n(z)≥0n(z)\ge 0n(z)≥0, and for each z∈Lz\in Lz∈L a set S(z)⊆(Z+)n(z)S(z)\subseteq(\mathbb Z^+)^{n(z)}S(z)⊆(Z+)n(z) of nonnegative integer vectors, the feasible solutions. The three languages LLL, {⟨z,y⟩:∣y∣=n(z)}\{\langle z,y\rangle : |y|=n(z)\}{⟨z,y⟩:∣y∣=n(z)} and {⟨z,x⟩:x∈S(z)}\{\langle z,x\rangle : x\in S(z)\}{⟨z,x⟩:x∈S(z)} must be recognizable in polynomial time. An instance is a pair ⟨z,c⟩\langle z,c\rangle⟨z,c⟩ with z∈Lz\in Lz∈L and c∈Zn(z)c\in\mathbb Z^{n(z)}c∈Zn(z), and the decision problem of CCC is

D(C)={⟨z,c,k⟩:z∈L, c∈Zn(z), k∈Z, ∃x∈S(z)  c⋅x≥k}.D(C)=\{\langle z,c,k\rangle : z\in L,\ c\in\mathbb Z^{n(z)},\ k\in\mathbb Z,\ \exists x\in S(z)\ \ c\cdot x\ge k\}.D(C)={⟨z,c,k⟩:z∈L, c∈Zn(z), k∈Z, ∃x∈S(z)  c⋅x≥k}.

Write CH(S(z))⊆Qn(z)\mathrm{CH}(S(z))\subseteq\mathbb Q^{n(z)}CH(S(z))⊆Qn(z) for the convex hull of S(z)S(z)S(z) over the rationals. A facial description of CCC is a set F(C)F(C)F(C) of triples ⟨z,f,g⟩\langle z,f,g\rangle⟨z,f,g⟩, with z∈Lz\in Lz∈L, f∈Zn(z)f\in\mathbb Z^{n(z)}f∈Zn(z) and g∈Zg\in\mathbb Zg∈Z, such that for every z∈Lz\in Lz∈L and every x∈Qn(z)x\in\mathbb Q^{n(z)}x∈Qn(z)

x∈CH(S(z))  ⟺  f⋅x≤g  for all ⟨z,f,g⟩∈F(C).x\in\mathrm{CH}(S(z))\iff f\cdot x\le g\ \text{ for all }\langle z,f,g\rangle\in F(C).x∈CH(S(z))⟺f⋅x≤g  for all ⟨z,f,g⟩∈F(C).

It is small if for some polynomial ppp every component of every triple ⟨z,f,g⟩∈F(C)\langle z,f,g\rangle\in F(C)⟨z,f,g⟩∈F(C) has absolute value at most 2p(∣z∣+n(z))2^{p(|z|+n(z))}2p(∣z∣+n(z)), so that each coefficient has polynomially many bits. The statement F(C)∈NPF(C)\in\mathrm{NP}F(C)∈NP means that the language of the triples of F(C)F(C)F(C) is in NP: membership of a listed inequality has short, checkable proofs.

Formalization targets

Goal: Theorem 1 (p. 7)

F(C) a small facial description of C,F(C)∈NP ⟹ D(C)∈co-NP.F(C)\ \text{a small facial description of }C,\quad F(C)\in\mathrm{NP}\ \Longrightarrow\ D(C)\in\text{co-NP}.F(C) a small facial description of C,F(C)∈NP ⟹ D(C)∈co-NP.

Milestones, in the order the proof uses them

  1. (p. 5) For a small facial description and every z∈Lz\in Lz∈L, only finitely many triples have first entry zzz, and CH(S(z))\mathrm{CH}(S(z))CH(S(z)) is the intersection of finitely many half-spaces.
  2. (pp. 7–8, (i)⇔(ii)) ⟨z,c,k⟩∉D(C)\langle z,c,k\rangle\notin D(C)⟨z,c,k⟩∈/D(C) iff c⋅x<kc\cdot x<kc⋅x<k for every x∈CH(S(z))x\in\mathrm{CH}(S(z))x∈CH(S(z)).
  3. (p. 8, (ii)⇔(iii)) For a facial description, the same holds with CH(S(z))\mathrm{CH}(S(z))CH(S(z)) replaced by the system f⋅x≤gf\cdot x\le gf⋅x≤g, ⟨z,f,g⟩∈F(C)\langle z,f,g\rangle\in F(C)⟨z,f,g⟩∈F(C).
  4. (p. 8, (iii)⇔(vi)) For a small facial description and S(z)≠∅S(z)\neq\emptysetS(z)=∅: c⋅x<kc\cdot x<kc⋅x<k on that system iff there are n(z)n(z)n(z) triples ⟨z,fi,gi⟩∈F(C)\langle z,f_i,g_i\rangle\in F(C)⟨z,fi​,gi​⟩∈F(C) whose matrix F\mathbf FF is nonsingular and the solution yyy of yTF=cy^T\mathbf F=cyTF=c satisfies y≥0y\ge 0y≥0 and yTg<ky^Tg<kyTg<k.

After the goal: Corollary 1 (p. 8)

D(C) NP-complete, F(C) small facial, F(C)∈NP ⟹ NP=co-NP.D(C)\ \text{NP-complete},\ F(C)\ \text{small facial},\ F(C)\in\mathrm{NP}\ \Longrightarrow\ \mathrm{NP}=\text{co-NP}.D(C) NP-complete, F(C) small facial, F(C)∈NP ⟹ NP=co-NP.

Significance

Theorem 1 converts a question of polyhedral combinatorics into one of complexity theory. Corollary 1 then says that for the traveling salesman problem, Hamiltonian circuit, set covering, integer programming and every other c.o.p. with an NP-complete decision problem, no complete linear description of the hulls has both polynomially sized coefficients and polynomially verifiable membership, unless NP = co-NP. This explains why the search for complete descriptions of such polytopes has not succeeded and why research on them turned to partial descriptions and separation. The companion result of the same paper (Theorem 2, the subject of the second mission in this series) treats separation routines and P instead of facial descriptions and co-NP.

The result itself is proved, by a short argument in the paper. To our knowledge it has no machine-checked proof. Formalizing it requires connecting three things that the platform holds only separately: Cook's Turing-machine classes P, NP and co-NP (published as CookPvsNP_defs), linear programming duality over the rationals (Farkas' lemma is published, e.g. LinearOptimization.farkas_inequality_form_fintype, for real matrices), and polynomial-time arithmetic on binary-encoded rational data, such as solving a nonsingular integer linear system. The last ingredient, a polynomial-time verifier built from a polynomial-time recognizer, is reusable for every co-NP or NP membership proof on the platform.

Difficulty

The mathematical content of Theorem 1 is the duality chain (i)⇔(vi): the "no" answer is certified by n(z)n(z)n(z) inequalities of F(C)F(C)F(C) and a basic dual solution. Two points make the formal proof harder than the paper's page suggests.

First, the duality chain needs care at its edges. When S(z)S(z)S(z) is empty the chain (iii)⇔(vi) can fail, so the verifier must also accept a different certificate (an infeasibility certificate from at most n(z)+1n(z)+1n(z)+1 triples), while milestone 4 carries the hypothesis S(z)≠∅S(z)\neq\emptysetS(z)=∅. Pointedness of the hull, which follows from S(z)⊆(Z+)n(z)S(z)\subseteq(\mathbb Z^+)^{n(z)}S(z)⊆(Z+)n(z), is what guarantees n(z)n(z)n(z) linearly independent rows.

Second, "Algorithm B clearly runs in polynomial time" hides a complete complexity argument on Cook's one-tape machines: parsing the input, testing z∈Lz\in Lz∈L and ∣c∣=n(z)|c|=n(z)∣c∣=n(z) with the recognizers of Definition 1, guessing the matrix within the size bound given by smallness, invoking the NP verifier of F(C)F(C)F(C) n(z)n(z)n(z) times, and solving yTF=cy^T\mathbf F=cyTF=c exactly over Q\mathbb QQ with polynomially bounded bit sizes (Cramer's rule bounds the numerators and denominators of yyy). The certificate must be of length polynomial in the input, which uses the uniform polynomial in the definition of "small". The naive certificate, a single optimal vertex of the hull, does not work: it proves a "yes" answer, not a "no".

Formalization scope

All definitions live in the namespace KarpPapadimitriou.Facial. Strings are List Bool; S(z)S(z)S(z) is a set of Fin (n z) → ℤ with nonnegative entries; CH(S(z))\mathrm{CH}(S(z))CH(S(z)) is convexHull ℚ of its image in Fin (n z) → ℚ, because the paper's "R" denotes the rationals (footnote, p. 3). Tuples are coded over the four-letter alphabet {0,1,−,#}\{0,1,-,\#\}{0,1,−,#} of the published ProjSchedTW_Complexity_Encoding, integers in binary, vectors prefixed by their length so that codes are uniquely decodable. P, NP, co-NP and NP-completeness are the published CookPvsNP_defs; D(C)D(C)D(C) and the triple language of F(C)F(C)F(C) are sets of codes, so strings encoding no triple lie in the complement of D(C)D(C)D(C), as in Algorithm B's step (i). The three polynomial-time conditions of Definition 1 are fields of the structure COP.

Explicit readings of the paper's loose phrases:

  • "polynomial ppp" in "small" is m↦mk+km\mapsto m^k+km↦mk+k with one kkk for all triples;
  • "has optimal value <k<k<k" for (ii) and (iii) is "every feasible point has value <k<k<k", meaningful for infeasible and unbounded programs;
  • "the system yTF=cy^T\mathbf F=cyTF=c has a unique nonnegative solution yyy with yTg<ky^Tg<kyTg<k" is "det⁡F≠0\det\mathbf F\neq0detF=0 and the solution satisfies y≥0y\ge 0y≥0, yTg<ky^Tg<kyTg<k";
  • (iii)⇔(vi) carries the hypothesis S(z)≠∅S(z)\neq\emptysetS(z)=∅, tacit in the paper; Theorem 1 does not;
  • "NP = co-NP" in Corollary 1 holds for every finite nonempty alphabet, since Cook's classes are indexed by the alphabet.

Printed slips: display (3) reads "min" while D(C)D(C)D(C) and the proof maximize; Algorithm B's step (v) reads "yTb>ky^Tb>kyTb>k" for yTg<ky^Tg<kyTg<k. Both are formalized in the corrected sense.

A trivializing formalization is ruled out: the goal quantifies over every c.o.p. and every small facial description, with complements taken over all strings, and no hypothesis restricts S(z)S(z)S(z) or F(C)F(C)F(C) beyond Definition 1 and the definitions of p. 4–5. Claim 1 (p. 9), announced without proof, is not part of the mission.

Contributions welcome: proofs of the four milestones (milestone 4 is an exercise in rational LP duality on finite systems), a reusable library of polynomial-time integer and rational arithmetic on Cook's machines, and the closure of NP under polynomial-time reductions across alphabets that Corollary 1 needs.

Selected references

  • R. M. Karp and C. H. Papadimitriou, On linear characterizations of combinatorial optimization problems, MIT/LCS/TM-154, February 1980. https://dspace.mit.edu/server/api/core/bitstreams/eb122126-c312-4445-a8d2-153e3e7d285f/content ; journal version SIAM J. Comput. 11 (1982) 620–632, https://doi.org/10.1137/0211053
  • S. A. Cook, The P versus NP problem, Clay Mathematics Institute Millennium Problem description, 2000. https://www.claymath.org/wp-content/uploads/2022/06/pvsnp.pdf
  • J. Edmonds, Maximum matching and a polyhedron with 0,1-vertices, J. Res. Nat. Bur. Standards 69B (1965) 125–130. https://doi.org/10.6028/jres.069B.013
  • A. Schrijver, Theory of Linear and Integer Programming, Wiley, 1986 (LP duality, basic solutions, sizes of solutions of linear systems). ISBN 978-0-471-98232-6
  • M. Grötschel and M. W. Padberg, On the symmetric travelling salesman problem I: Inequalities, Math. Programming 16 (1979) 265–280. https://doi.org/10.1007/BF01582116
10 thms4 active usersReviewed
CombinatoricsDiscrete Geometry·Captain: mikedeng1

A Counterexample to the Hirsch Conjecture I: A 43-Dimensional Polytope with 86 Facets Whose Diameter Exceeds 43Research Paper

Motivation

The Hirsch conjecture, stated by Warren M. Hirsch in a 1957 letter to George Dantzig, asserts that the combinatorial diameter of a ddd-dimensional polytope with nnn facets is at most n−dn-dn−d. The diameter is the largest number of edge steps needed to walk between two vertices of the polytope. The question matters to linear optimization: every edge-following pivot rule of the simplex method, starting at a vertex of the feasible region, needs at least as many pivots as the graph distance to an optimal vertex. A polynomial bound on polytope diameters is a necessary condition for a strongly polynomial simplex method, which is still unknown.

Timeline of the conjecture before the counterexample:

  • 1967, Klee and Walkup: the conjecture fails for unbounded polyhedra, and for bounded polytopes it is equivalent to the ddd-step conjecture (the case n=2dn=2dn=2d). They also proved it for n−d≤5n-d\le 5n−d≤5.
  • 1992, Kalai and Kleitman: a quasi-polynomial upper bound nlog⁡2d+2n^{\log_2 d+2}nlog2​d+2 on the diameter.
  • 2010, Santos: a counterexample in dimension 43 with 86 facets (arXiv:1006.2814, published in Ann. of Math. 176 (2012) 383–412). It is the subject of this mission.
  • 2012, Matschke, Santos and Weibel: smaller 5-dimensional spindles, giving counterexamples in dimension 20 (arXiv:1202.4701).

The polynomial Hirsch conjecture, which asks only for a bound polynomial in nnn and ddd, remains open.

Setting

A polytope in Rd\mathbb R^dRd is written as Hpoly(a,b)={x:⟨ai,x⟩≤bi, i=1,…,n}\mathrm{Hpoly}(a,b)=\{x:\langle a_i,x\rangle\le b_i,\ i=1,\dots,n\}Hpoly(a,b)={x:⟨ai​,x⟩≤bi​, i=1,…,n}. A facet presentation is one in which Hpoly(a,b)\mathrm{Hpoly}(a,b)Hpoly(a,b) has nonempty interior and no inequality is redundant. For a bounded polytope it then has dimension ddd, and its nnn inequalities correspond one to one to its facets. A step between two vertices crosses an edge (a one-dimensional face). The polytope is non-Hirsch when its diameter exceeds n−dn-dn−d.

A spindle (Santos, Definition 1.4) is a polytope with two distinguished vertices u,vu,vu,v such that every facet contains exactly one of them. Its length is the graph distance from uuu to vvv. The polar objects are prismatoids: polytopes with two parallel facets Q+,Q−Q^+,Q^-Q+,Q− containing all vertices, whose width is the dual-graph distance between Q+Q^+Q+ and Q−Q^-Q−.

Santos's explicit object is the 5-prismatoid QQQ whose vertices are the 48 rows of Table 1 of the paper: 1+,…,24+1^+,\dots,24^+1+,…,24+ with x5=1x_5=1x5​=1 and 1−,…,24−1^-,\dots,24^-1−,…,24− with x5=−1x_5=-1x5​=−1. Its polar QΔ={x∈R5:⟨r,x⟩≤1 for each row r}Q^\Delta=\{x\in\mathbb R^5:\langle r,x\rangle\le1\ \text{for each row } r\}QΔ={x∈R5:⟨r,x⟩≤1 for each row r} is a spindle with apices e5e_5e5​ and −e5-e_5−e5​. Table 2 of the paper lists the 322 facets of QQQ, which are the 322 vertices of QΔQ^\DeltaQΔ: ±e5\pm e_5±e5​ and the points 1c0(±c1,±c2,±c3,±c4,c5)\frac1{c_0}(\pm c_1,\pm c_2,\pm c_3,\pm c_4,c_5)c0​1​(±c1​,±c2​,±c3​,±c4​,c5​) of twenty types B,B′,…,K,K′B,B',\dots,K,K'B,B′,…,K,K′ with sixteen sign patterns each. The symmetry group Σ\SigmaΣ of QQQ has order 64; its index-two subgroup Σ+\Sigma^+Σ+ preserves Q+Q^+Q+ and Q−Q^-Q−.

Formalization targets

Goal: Corollary 1.7

∃ a:Fin 86→R43, b∈R86:Hpoly(a,b) nonempty, bounded, a facet presentation, and diam⁡Hpoly(a,b)>43.\exists\, a:\mathrm{Fin}\,86\to\mathbb R^{43},\ b\in\mathbb R^{86}:\quad \mathrm{Hpoly}(a,b)\ \text{nonempty, bounded, a facet presentation, and}\ \operatorname{diam}\mathrm{Hpoly}(a,b)>43.∃a:Fin86→R43, b∈R86:Hpoly(a,b) nonempty, bounded, a facet presentation, and diamHpoly(a,b)>43.

The goal fixes the dimension (43) and the number of facets (86), as the paper does. It does not assert the exact diameter (44, remarked on p. 24).

Milestones

  1. §3, first bullet (polar form): QΔQ^\DeltaQΔ is a bounded 48-facet spindle with apices ±e5\pm e_5±e5​, the rows tight at e5e_5e5​ being 1+,…,24+1^+,\dots,24^+1+,…,24+.
  2. Theorem 4.1(1) (polar form): the 322 points of Table 2 are distinct vertices of QΔQ^\DeltaQΔ; the letter classes are Σ+\Sigma^+Σ+-orbits and the six Σ\SigmaΣ-orbits are A ∪ L, B ∪ K, C ∪ J, D ∪ I, E ∪ H, F ∪ G.
  3. Theorem 4.1(2) (polar form): QΔQ^\DeltaQΔ has no other vertices.
  4. Theorem 3.1 (polar form): the distance from e5e_5e5​ to −e5-e_5−e5​ in the graph of QΔQ^\DeltaQΔ is exactly 6.
  5. Theorem 1.6: a 5-spindle with 48 facets, 322 vertices and length exactly six exists.
  6. Inductive step of Theorem 2.6 (polar form): a ddd-spindle with n>2dn>2dn>2d facets and length at least lll yields a (d+1)(d+1)(d+1)-spindle with n+1n+1n+1 facets and length at least l+1l+1l+1.
  7. Theorem 1.5 (strong ddd-step theorem): a ddd-spindle with nnn facets and length at least lll yields an (n−d)(n-d)(n−d)-spindle with 2n−2d2n-2d2n−2d facets and length at least l+n−2dl+n-2dl+n−2d, non-Hirsch when l>dl>dl>d.

Significance

Corollary 1.7 settles the Hirsch conjecture in the negative. Theorem 1.5 is the reusable part: it turns any spindle whose length exceeds its dimension into a counterexample. That made the later search for small spindles (Matschke–Santos–Weibel) a finite, low-dimensional problem. Theorem 1.6 is the concrete certificate. Its claims about Tables 1 and 2 are finite statements about explicit rational data.

The result is proved, and several pieces are already formalized on Prove2Me. Hirsch.santos_counterexample (Proved) states that some polytope violates the bound n−dn-dn−d, with no dimension or facet count. Hirsch.strong_dstep_spindle (Proved) is the "in particular" clause of Theorem 1.5, counting inequalities rather than facets. Lemmas 2.2 and 2.4 of the paper are Proved in polar form (Hirsch.spindle_inward_row_push_graph, Hirsch.spindle_wedge_vertex_graph_projection), as is the bound n≥2dn\ge2dn≥2d for spindles (Hirsch.spindle_n_ge_two_d). This mission adds the dimension-43, 86-facet statement with facets counted exactly, the general length bound l+n−2dl+n-2dl+n−2d with the spindle structure preserved, and a machine-checkable account of Santos's specific spindle.

Difficulty

The obvious first idea for the 5-dimensional milestones is brute computation. This is feasible in principle but heavy in Lean. Showing that 322 given points are extreme requires exhibiting, for each, five linearly independent tight rows among 48. Showing that no other vertex exists requires a complete enumeration argument rather than a membership check. Exact distance 6 requires the full adjacency structure between the 322 vertices, not only a path.

For the general theorems, the difficulty is that the construction is a one-point suspension followed by a perturbation. Edges and facets of the new polytope must be controlled, with the face lattice changing only in a prescribed way. Diameter is not monotone under arbitrary perturbations, and in particular a walk can become shorter. Keeping the facet count exact (not merely the inequality count) adds an irredundancy argument at each step.

Formalization scope

Polytopes are H-presentations Hirsch.Hpoly a b with a : Fin n → EuclideanSpace ℝ (Fin d), from the platform definition Hirsch_model. "A ddd-polytope with nnn facets" is boundedness plus IsFacetPresentation: nonempty interior and every row irredundant. Without this predicate, padding with redundant rows would change the bound n−dn-dn−d, and the statement would collapse to the platform's dimension-free Hirsch.santos_counterexample. Diameter and length use the platform's padded walks (Hirsch.DiamLE, Hirsch.Reach). "Length at least LLL" means no walk of fewer than LLL steps, and "length exactly LLL" adds a walk of LLL steps. The junk-valued Hirsch.gdist is never used.

All prismatoid statements of the paper (§3, Theorems 2.6, 3.1, 4.1) are stated for the polar spindle, which the paper licenses (pp. 6, 8, 9). Vertices of QQQ become rows, facets of QQQ become vertices, the width becomes the apex distance, and Q±Q^\pmQ± become ±e5\pm e_5±e5​. Natural-number expressions n−dn-dn−d, 2n−2d2n-2d2n−2d, l+(n−2d)l+(n-2d)l+(n−2d) are faithful because spindles have n≥2dn\ge2dn≥2d. Theorem 1.5's "length lll" is read as "length at least lll", which is equivalent by monotonicity. Tables 1 and 2 are written entry by entry in Lean in the page's order.

Useful contributions include proofs of the finite Table 1/Table 2 facts by certified computation, reusable lemmas on one-point suspensions and on facet presentations under perturbation, and a proof of Corollary 1.7 from milestones 5 and 7.

Selected references

  • F. Santos, A counterexample to the Hirsch conjecture, Ann. of Math. 176 (2012) 383–412; cited version arXiv:1006.2814v3. https://arxiv.org/abs/1006.2814 , https://doi.org/10.4007/annals.2012.176.1.7
  • V. Klee and D. W. Walkup, The d-step conjecture for polyhedra of dimension d < 6, Acta Math. 117 (1967) 53–78. https://doi.org/10.1007/BF02395040
  • G. Kalai and D. J. Kleitman, A quasi-polynomial bound for the diameter of graphs of polyhedra, Bull. Amer. Math. Soc. 26 (1992) 315–316. https://arxiv.org/abs/math/9204233
  • B. Matschke, F. Santos and C. Weibel, The width of five-dimensional prismatoids, Proc. London Math. Soc. 110 (2015) 647–672. https://arxiv.org/abs/1202.4701
15 thms4 active usersReviewed
Operations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming IX: The Correspondence Between Lift-and-Project Cuts and Simple Disjunctive CutsTextbook

Motivation

Chapter 6 built lift-and-project (L&P) cuts from a cut-generating LP, and Chapter 7 surveyed alternative nonlinear constructions reaching the same integer hull. This chapter asks a sharper question: how do L&P cuts relate, coefficient for coefficient, to older, more classical cutting planes — simple disjunctive cuts and mixed integer Gomory cuts, derived directly from a simplex tableau rather than from an auxiliary LP? The answer is an exact correspondence: every L&P cut from a basic solution of the cut-generating LP is equivalent to a specific simple disjunctive cut from a specific tableau basis, and conversely. This correspondence is not merely of theoretical interest — it converts a question about an infinite family of cuts into a finite, countable one (bases of a linear system), and it is what lets the chapter's capstone result, Theorem 8.7, establish a uniform rank bound of ppp (the number of 0-1 variables) across four cut families at once, by proving it for one and transporting the proof to the other three.

Setting

(CGLP)k(CGLP)_k(CGLP)k​ (eq. (8.1)) is the cut-generating LP for the disjunction −xk≥0∨xk≥1-x_k \ge 0 \lor x_k \ge 1−xk​≥0∨xk​≥1, with an added normalization constraint ue+u0+ve+v0=1ue+u_0+ve+v_0=1ue+u0​+ve+v0​=1 that makes its feasible polytope bounded — so a "basic solution" can be identified with an extreme point of that polytope. Given a basic solution with u0,v0>0u_0,v_0>0u0​,v0​>0 and basic u/vu/vu/v-components indexed by M1,M2M_1,M_2M1​,M2​ (Lemma 8.1-8.2), the n×nn\times nn×n submatrix A^\hat AA^ of A~\tilde AA~ indexed by J:=M1∪M2J:=M_1\cup M_2J:=M1​∪M2​ is nonsingular, giving a simplex tableau in which xkx_kxk​ is expressed as xk=aˉk0−∑j∈Jaˉkjxjx_k = \bar a_{k0} - \sum_{j\in J}\bar a_{kj}x_jxk​=aˉk0​−∑j∈J​aˉkj​xj​ (eq. (8.5)). The simple disjunctive cut from xk≤0∨xk≥1x_k\le 0 \lor x_k\ge 1xk​≤0∨xk​≥1 applied to this row has coefficients πj:=max⁡{πj1,πj2}\pi_j := \max\{\pi^1_j,\pi^2_j\}πj​:=max{πj1​,πj2​}, π0:=aˉk0(1−aˉk0)\pi_0 := \bar a_{k0}(1-\bar a_{k0})π0​:=aˉk0​(1−aˉk0​) (eq. (8.7)-(8.8)).

Formalization targets

Theorem 8.7 (goal) — a uniform rank bound across four cut families

The rank of the LP relaxation PPP with respect to (a) unstrengthened L&P cuts, (b) simple disjunctive cuts, (c) strengthened L&P cuts, (d) mixed integer Gomory cuts (equivalently, strengthened simple disjunctive cuts) is at most ppp, the number of 0-1 variables.

The chain of results building toward it

Lemma 8.1 (basicness forces u0,v0>0u_0,v_0>0u0​,v0​>0), Lemma 8.2 (a basic solution's index sets give a nonsingular submatrix), Lemma 8.3 (0<aˉk0<10<\bar a_{k0}<10<aˉk0​<1), Theorem 8.4A (a basic L&P cut equals a simple disjunctive cut), Theorem 8.4B (the converse: every simple disjunctive cut from a valid basis equals some basic L&P cut), and Theorem 8.5 (the same correspondence, strengthened).

Significance

The results themselves. Theorems 8.4A/8.4B are, in the book's own words, an "exact correspondence between lift-and-project cuts for a mixed 0-1 program and earlier cuts from the literature" — placing L&P cuts, simple disjunctive cuts, and (via Theorem 8.5) mixed integer Gomory cuts on the same logical footing, all generated by choosing a basis of one underlying linear system. Theorem 8.7 is the payoff: a single uniform bound covering four cut families that the literature had previously bounded (if at all) by separate arguments, and by contrast to the unbounded rank of pure-integer fractional Gomory cuts, exhibiting a case where the mixed 0-1 structure yields much stronger guarantees.

Formalizing it. No object in this mission exists on the platform prior to it or in Mathlib. This mission restates 06-lift-project-cuts's (CGLP)(CGLP)(CGLP) apparatus and Theorem 6.4's strengthened cut formula locally, per the series convention that a draft mission cannot import another draft mission's definitions, adapted throughout to this chapter's normalized (CGLP)k(CGLP)_k(CGLP)k​ and its disjunction on a single fixed coordinate kkk.

Difficulty

Formalizing "basic solution" required a genuine choice: unlike Chapter 6, (CGLP)k(CGLP)_k(CGLP)k​'s normalization constraint makes its feasible set a bounded polytope, so this mission identifies "basic solution" with an extreme point of that polytope (Set.extremePoints) for Lemma 8.1 (whose own statement has no reference to specific index sets), while Lemmas 8.2 onward take the basic index sets M1,M2M_1,M_2M1​,M2​ directly as hypothesis data, matching how those theorems are themselves phrased ("let the basic components... be indexed by M1M_1M1​ and M2M_2M2​"). Theorem 8.7's rank bound required designing one generic HasRankAtMost predicate, parametrized by an abstract cut-closure operator, applicable uniformly to all four families — mirroring the book's own proof structure, which establishes the bound for one family and transports it to the other three via Theorems 8.4A/8.4B and 8.5, rather than arguing each part from scratch.

Formalization scope

The row/variable identification gap (see MODERATION_NOTES.md). The book's own eq. (8.4)- (8.5) identifies certain rows of the augmented, m+p+nm+p+nm+p+n-row matrix A~\tilde AA~ (those that are bound constraints xj≥0x_j\ge 0xj​≥0) with the variables they bound, so that a chosen nonbasic row set JJJ doubles as a set of "nonbasic variables." This mission's abstract row type does not track that identification (matching the abstraction already used throughout 06-lift-project-cuts and 07-higher-dim): Surplus instead defines the tableau row's nonbasic quantities directly as the slack expression sj:=(A~x)j−b~js_j := (\tilde Ax)_j - \tilde b_jsj​:=(A~x)j​−b~j​, a genuine affine function of xxx for every row, which reduces to xjx_jxj​ itself exactly when row jjj is that bound constraint — mathematically equivalent to the book's own substitution, stated without needing the row-to-variable lookup. Eq. (8.10)'s "j∈J∩N′j\in J\cap N'j∈J∩N′" strengthening-eligibility test has the same gap; this mission takes the row-positions eligible for strengthening as an explicit Finset parameter rather than deriving membership from row identity.

Corollary 8.6 is out of scope for this mission — see HARD.md. Its facet-counting bound depends on the same row/variable identification (the printed bound is (m+p+n−1n)\binom{m+p+n-1}{n}(nm+p+n−1​), excluding row kkk specifically because it is xkx_kxk​'s own bound row) and would additionally require a general notion of "number of facets of a polyhedron" that this mission's abstraction, and Mathlib, do not provide; it does not feed Theorem 8.7's own proof, which cites only Theorems 8.4A/8.4B and 8.5.

Theorem 8.7 is stated via one generic HasRankAtMost predicate applied to SplitConvexify (part a) and three closure operators (SimpleDisjClosureOfSet, StrengthenedLPClosureOfSet, MIGClosureOfSet, parts b-d) defined by intersecting a represented polyhedron with every cut of the corresponding family, then lifted to bare sets by quantifying over every linear representation — since, unlike the split-convexification closure, these three cut families are defined via an explicit basis or CGLP solution and so genuinely need some concrete representation of the current polyhedron at each step of the recursion (the same representation-dependence Theorem 7.5's Lovász-Schrijver iteration required in 07-higher-dim).

Selected references

  • E. Balas, Disjunctive Programming, Springer, 2018. DOI: 10.1007/978-3-030-00148-3, Chapter 8.
  • E. Balas, M. Perregaard, A precise correspondence between lift-and-project cuts, simple disjunctive cuts, and mixed integer Gomory cuts for 0-1 programming, Mathematical Programming B 94 (2003), 221–245 (cited in the text as [33], the origin of Lemma 8.2 and Theorems 8.4A/8.4B).
  • E. Balas, M. Perregaard, Lift-and-project for mixed 0-1 programming: recent progress, Discrete Applied Mathematics 123 (2002), 129–154 (cited in the text as [32], the origin of Theorem 8.5's strengthened-cut coefficient identification).
  • F. Eisenbrand, A. Schulz, Bounds on the Chvátal rank of polytopes in the 0-1 cube, in Integer Programming and Combinatorial Optimization (IPCO 7), LNCS 1610 (1999), 137–150 (cited in the text as [73], the source of the unbounded pure-integer Gomory rank result this chapter's Theorem 8.7 contrasts with).
14 thms4 active users
Operations ResearchOptimization·Captain: mikedeng1

On-Demand Delivery from Stores: Dynamic Dispatching and Routing with Random Demand II: A Route Whose Reduced Cost Exceeds ub − φ(RF1) Is in No Optimal Solution of the Routing Subproblem SF1Research Paper

Motivation

Grocery chains and restaurants that promise delivery within an hour or less must decide, at each dispatch epoch, which drivers to send out and along which routes. Liu and Luo (arXiv:2107.13058v3; Manufacturing & Service Operations Management, 2023) model this as a finite-horizon dynamic program and solve its per-period approximation with a logic-based Benders decomposition: a master problem chooses how many drivers to commit to future periods, and a routing subproblem then picks the routes that serve the current orders.

The routing subproblem is a set-partitioning integer program over an exponentially large route set. The paper solves it with a route enumeration algorithm, which generates only the routes that can still appear in an optimal solution. The pruning rule that makes this work is Lemma 2 (p. 19): a route whose LP reduced cost exceeds the gap between an upper bound and the LP bound cannot appear in any optimal solution. Rules of this kind, reduced-cost fixing for set-partitioning formulations, are a standard component of exact vehicle-routing algorithms (see, e.g., Baldacci, Christofides, Mingozzi 2008). This mission formalizes Lemma 2 for the paper's own subproblem.

Setting

Fix a period nnn and a solution (xˉ,zˉ)(\bar{\mathbf x},\bar{\mathbf z})(xˉ,zˉ) of the master problem. The data are:

  • a finite set Rn\mathcal R^nRn of feasible routes, a finite set In\mathcal I^nIn of current customer locations, and the future periods n′∈{n+1,…,N}n'\in\{n+1,\dots,N\}n′∈{n+1,…,N};
  • a route cost crc_rcr​ for every r∈Rnr\in\mathcal R^nr∈Rn;
  • coverage coefficients αi,r∈{0,1}\alpha_{i,r}\in\{0,1\}αi,r​∈{0,1} (route rrr serves location iii) and occupancy coefficients βn′,r∈{0,1}\beta_{n',r}\in\{0,1\}βn′,r​∈{0,1} (route rrr is still running in period n′n'n′);
  • the fleet size Kˉ\bar KKˉ, the number ζnn\zeta^n_nζnn​ of drivers still en route in period nnn, and master values zˉkn′∈{0,1}\bar z^{n'}_k\in\{0,1\}zˉkn′​∈{0,1} with ∑k=0Kˉzˉkn′=1\sum_{k=0}^{\bar K}\bar z^{n'}_k=1∑k=0Kˉ​zˉkn′​=1.

Write bn′=∑k=0Kˉk zˉkn′b_{n'}=\sum_{k=0}^{\bar K}k\,\bar z^{n'}_kbn′​=∑k=0Kˉ​kzˉkn′​, the number of drivers the master solution allows to remain occupied in period n′n'n′.

The routing subproblem SF1 (pp. 16–17) is

min⁡ ∑r∈Rnθrcrs.t.∑rβn′,rθr≤bn′ ∀n′,∑rθr≤Kˉ−ζnn,∑rαi,rθr=1 ∀i∈In,θr∈{0,1}.\min\ \sum_{r\in\mathcal R^n}\theta_r c_r\quad\text{s.t.}\quad \sum_r\beta_{n',r}\theta_r\le b_{n'}\ \forall n',\qquad \sum_r\theta_r\le\bar K-\zeta^n_n,\qquad \sum_r\alpha_{i,r}\theta_r=1\ \forall i\in\mathcal I^n,\qquad \theta_r\in\{0,1\}.min r∈Rn∑​θr​cr​s.t.r∑​βn′,r​θr​≤bn′​ ∀n′,r∑​θr​≤Kˉ−ζnn​,r∑​αi,r​θr​=1 ∀i∈In,θr​∈{0,1}.

Its LP relaxation RF1 replaces θr∈{0,1}\theta_r\in\{0,1\}θr​∈{0,1} by θr≥0\theta_r\ge0θr​≥0 and the partitioning rows by covering rows ∑rαi,rθr≥1\sum_r\alpha_{i,r}\theta_r\ge1∑r​αi,r​θr​≥1; ϕ(RF1)\phi(\mathrm{RF1})ϕ(RF1) denotes its optimal cost. The dual variables are μn′\mu_{n'}μn′​ for the occupancy rows, μn\mu_nμn​ for the fleet row and νi\nu_iνi​ for the covering rows. The reduced cost of a route rrr with respect to a dual solution (μ,μn,ν)(\mu,\mu_n,\nu)(μ,μn​,ν) is

cˉr=cr−∑i∈Inαi,rνi−∑n′=n+1Nβn′,rμn′−μn.\bar c_r=c_r-\sum_{i\in\mathcal I^n}\alpha_{i,r}\nu_i-\sum_{n'=n+1}^N\beta_{n',r}\mu_{n'}-\mu_n .cˉr​=cr​−i∈In∑​αi,r​νi​−n′=n+1∑N​βn′,r​μn′​−μn​.

An upper bound ububub of SF1 is a number at least as large as the optimal cost of SF1.

Formalization targets

Goal: Lemma 2 (p. 19)

Let ububub be an upper bound of SF1, ϕ(RF1)\phi(\mathrm{RF1})ϕ(RF1) the optimal cost of RF1, (μ,μn,ν)(\mu,\mu_n,\nu)(μ,μn​,ν) a dual optimal solution of RF1, and r∈Rnr\in\mathcal R^nr∈Rn. If

cr−∑i∈Inαi,rνi−∑n′=n+1Nβn′,rμn′−μn>ub−ϕ(RF1),c_r-\sum_{i\in\mathcal I^n}\alpha_{i,r}\nu_i-\sum_{n'=n+1}^N\beta_{n',r}\mu_{n'}-\mu_n>ub-\phi(\mathrm{RF1}),cr​−i∈In∑​αi,r​νi​−n′=n+1∑N​βn′,r​μn′​−μn​>ub−ϕ(RF1),

then θr=0\theta_r=0θr​=0 in every optimal solution θ\thetaθ of SF1.

Milestones (Appendix G, p. 42)

For a route rrr, let Irn={i∣αi,r=0}\mathcal I^n_r=\{i\mid\alpha_{i,r}=0\}Irn​={i∣αi,r​=0}, let Rrn\mathcal R^n_rRrn​ be the routes that cover only locations in Irn\mathcal I^n_rIrn​, and let SF1r_rr​ be SF1 on Rrn\mathcal R^n_rRrn​ and Irn\mathcal I^n_rIrn​ with right-hand sides bn′−βn′,rb_{n'}-\beta_{n',r}bn′​−βn′,r​ and Kˉ−ζnn−1\bar K-\zeta^n_n-1Kˉ−ζnn​−1; RF1r_rr​ (75)–(79) is its LP relaxation, and ϕ(SF1r)∈R∪{+∞}\phi(\mathrm{SF1}_r)\in\mathbb R\cup\{+\infty\}ϕ(SF1r​)∈R∪{+∞} its optimal cost.

  1. (74) If cr+ϕ(SF1r)>ubc_r+\phi(\mathrm{SF1}_r)>ubcr​+ϕ(SF1r​)>ub, then rrr is in no optimal solution of SF1.
  2. Dual bound. For any dual feasible (μˉ,μˉn,νˉ)(\bar\mu,\bar\mu_n,\bar\nu)(μˉ​,μˉ​n​,νˉ) of RF1, the restriction (μˉ,μˉn,{νˉi}i∈Irn)(\bar\mu,\bar\mu_n,\{\bar\nu_i\}_{i\in\mathcal I^n_r})(μˉ​,μˉ​n​,{νˉi​}i∈Irn​​) is dual feasible for RF1r_rr​, and
∑n′μˉn′bn′−∑n′βn′,rμˉn′+μˉn(Kˉ−ζnn−1)+∑i∈Irnνˉi≤ϕ(SF1r).\sum_{n'}\bar\mu_{n'}b_{n'}-\sum_{n'}\beta_{n',r}\bar\mu_{n'}+\bar\mu_n(\bar K-\zeta^n_n-1)+\sum_{i\in\mathcal I^n_r}\bar\nu_i\le\phi(\mathrm{SF1}_r).n′∑​μˉ​n′​bn′​−n′∑​βn′,r​μˉ​n′​+μˉ​n​(Kˉ−ζnn​−1)+i∈Irn​∑​νˉi​≤ϕ(SF1r​).
  1. (80) ⇔ (81) For a dual optimal solution of RF1, crc_rcr​ plus the bound of milestone 2 exceeds ububub if and only if the reduced-cost condition of Lemma 2 holds.

Significance

The result. Lemma 2 turns one LP solve into an elimination test for every route at once. The route enumeration algorithm of §5.3 generates only routes whose reduced cost is at most a gap δ\deltaδ, raises δ\deltaδ until it reaches ub−ϕ(RF1)ub-\phi(\mathrm{RF1})ub−ϕ(RF1), and at that point the enumerated route set is guaranteed to contain every optimal solution of SF1. Without the lemma the algorithm would not certify optimality. The same algorithm also solves the single-period problems in the offline estimation stage of the paper's policy, so its correctness underlies all the computational results.

Formalizing it. The lemma is proved in the paper's Online Appendix (Appendix G, p. 42) in a few lines that rest on unstated conventions: the signs of the dual variables, the right-hand sides of SF1r_rr​, and the equality of ϕ(RF1)\phi(\mathrm{RF1})ϕ(RF1) with the dual objective of a dual optimal solution, which is LP strong duality. The formalization pins each of these down. The strong-duality step is available on the platform as LinearOptimization.lp_strong_duality (proved, for general-form LPs indexed by Fin), included as a reference item. No part of this mission is formalized elsewhere.

Difficulty

The elimination test (74) and the dual bound are short combinatorial and weak-duality arguments. The step that does not go through by algebra alone is (80) ⇔ (81): it requires that the dual objective of the dual optimal solution equals ϕ(RF1)\phi(\mathrm{RF1})ϕ(RF1). Treating this equality as a hypothesis would make the step trivial and is excluded; the hypothesis is only that the dual solution maximizes the dual objective over the dual feasible set. Deriving the equality means applying LP strong duality to RF1, whose data are indexed by arbitrary finite types rather than by Fin, so a transport to the platform's general-form LP is needed. A second point is the passage from SF1 to SF1r_rr​: removing a route from an optimal solution must yield a feasible point of SF1r_rr​, which depends on the reduced right-hand sides and on the partitioning rows of SF1 forcing the other routes to avoid rrr's customers.

Formalization scope

All statements live in the namespace OnDemandDelivery.RouteElim. Routes, locations and future periods are arbitrary Fintypes; route vectors are functions to ℝ; Kˉ\bar KKˉ and ζnn\zeta^n_nζnn​ are natural numbers and Kˉ−ζnn\bar K-\zeta^n_nKˉ−ζnn​ is computed in ℝ. The standing assumptions are αi,r,βn′,r∈{0,1}\alpha_{i,r},\beta_{n',r}\in\{0,1\}αi,r​,βn′,r​∈{0,1}, zˉkn′∈{0,1}\bar z^{n'}_k\in\{0,1\}zˉkn′​∈{0,1} and ∑kzˉkn′=1\sum_k\bar z^{n'}_k=1∑k​zˉkn′​=1 (pp. 15–16, (17), (21)).

Conventions committed to:

  • ϕ(RF1)\phi(\mathrm{RF1})ϕ(RF1) is the attained minimum of the cost over the RF1 feasible set (IsLeast), not an arbitrary real.
  • The RF1 dual uses the standard signs for a minimization, which the paper does not print: μn′≤0\mu_{n'}\le0μn′​≤0, μn≤0\mu_n\le0μn​≤0, νi≥0\nu_i\ge0νi​≥0. "Dual optimal" means dual feasible and maximal for the dual objective.
  • "An upper bound ububub of SF1" is the weakest reading: ububub is at least the cost of every optimal solution of SF1.
  • "rrr cannot be in any optimal solution" is θr=0\theta_r=0θr​=0 for every optimal solution of the binary program SF1, not of RF1.
  • SF1r_rr​ has the reduced right-hand sides of (76)–(77); (76)'s unbarred zkn′z^{n'}_kzkn′​ is read as zˉkn′\bar z^{n'}_kzˉkn′​. ϕ(SF1r)\phi(\mathrm{SF1}_r)ϕ(SF1r​) is an EReal, +∞+\infty+∞ when SF1r_rr​ is infeasible, and (74) is stated in EReal.
  • The double sum ∑n′∑kμˉn′kzˉkn′\sum_{n'}\sum_k\bar\mu_{n'}k\bar z^{n'}_k∑n′​∑k​μˉ​n′​kzˉkn′​ is written ∑n′μˉn′bn′\sum_{n'}\bar\mu_{n'}b_{n'}∑n′​μˉ​n′​bn′​.
  • Milestone 2 assumes only dual feasibility, a strengthening of the page's dual optimality.

Trivializing formalizations are ruled out: ϕ(RF1)\phi(\mathrm{RF1})ϕ(RF1) is not a free real, the dual solution is optimal and not merely feasible, no hypothesis states ϕ(RF1)\phi(\mathrm{RF1})ϕ(RF1) equals the dual objective, and the conclusion concerns optimal solutions of SF1.

Needed infrastructure: weak duality for the two LPs (elementary), and a bridge from RF1 to LinearOptimization.GeneralFormLP for strong duality, which is reusable for any LP stated over finite index types. Contributions of such a transport lemma are welcome.

Selected references

  • S. Liu, Z. Luo, On-Demand Delivery from Stores: Dynamic Dispatching and Routing with Random Demand, arXiv:2107.13058v3, 2022; Manufacturing & Service Operations Management, 2023. https://arxiv.org/abs/2107.13058
  • R. Baldacci, N. Christofides, A. Mingozzi, An exact algorithm for the vehicle routing problem based on the set partitioning formulation with additional cuts, Mathematical Programming 115 (2008) 351–385. https://doi.org/10.1007/s10107-007-0178-5
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997 (Theorem 4.4, strong duality).
6 thms3 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

An O(√nL)-Iteration Homogeneous and Self-Dual Linear Programming Algorithm 2: τᵏ Stays Bounded Below If (LP) Has an Optimum, and Otherwise κᵏ Stays Bounded Below and τᵏ/θᵏ Is BoundedResearch Paper

Motivation

Interior-point methods for linear programming are usually analysed under two assumptions: a strictly feasible starting point is known, and the problem has an optimal solution. In practice neither is known in advance. The homogeneous self-dual embedding of Ye, Todd and Mizuno (Math. Oper. Res. 19(1), 1994) removes both assumptions. It embeds a standard-form linear program and its dual into one artificial program that always has an obvious interior starting point. A solution of the artificial program either yields optimal solutions of the original pair or certifies that one of them is infeasible. The embedding underlies the infeasibility detection of several interior-point LP and conic solvers.

The paper's main result is an O(nL)O(\sqrt n L)O(n​L) iteration bound. Section 4, "Analysis of the output", asks a different, practical question: what can be read off the iterates if the algorithm is stopped early, at an approximate solution? Theorem 8 answers it. This mission formalizes Theorem 8 and the results its proof uses.

Setting

Let A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n, b∈Rmb\in\mathbb R^mb∈Rm, c∈Rnc\in\mathbb R^nc∈Rn. The primal and dual programs are

(LP) min⁡{cTx:Ax=b, x≥0},(LD) max⁡{bTy:ATy≤c},\text{(LP)}\ \min\{c^Tx : Ax=b,\ x\ge0\},\qquad \text{(LD)}\ \max\{b^Ty : A^Ty\le c\},(LP) min{cTx:Ax=b, x≥0},(LD) max{bTy:ATy≤c},

with dual slack s=c−ATys=c-A^Tys=c−ATy. An optimal solution pair is an optimal xˉ\bar xxˉ of (LP) together with an optimal (yˉ,sˉ)(\bar y,\bar s)(yˉ​,sˉ) of (LD).

Write eee for the all-ones vector and set bˉ=b−Ae\bar b=b-Aebˉ=b−Ae, cˉ=c−e\bar c=c-ecˉ=c−e, zˉ=cTe+1\bar z=c^Te+1zˉ=cTe+1. The homogeneous self-dual program (HLP), in the paper's normalization y0=0y^0=0y0=0, x0=s0=ex^0=s^0=ex0=s0=e, has variables (y,x,τ,θ,s,κ)(y,x,\tau,\theta,s,\kappa)(y,x,τ,θ,s,κ) with y∈Rmy\in\mathbb R^my∈Rm, x,s∈Rnx,s\in\mathbb R^nx,s∈Rn, τ,θ,κ∈R\tau,\theta,\kappa\in\mathbb Rτ,θ,κ∈R:

min⁡(n+1)θs.t.Ax−bτ+bˉθ=0,s=−ATy+cτ−cˉθ ≥0,κ=bTy−cTx+zˉθ ≥0,−bˉTy+cˉTx−zˉτ=−(n+1),x≥0, τ≥0.\begin{array}{rl} \min & (n+1)\theta\\ \text{s.t.} & Ax-b\tau+\bar b\theta=0,\\ & s=-A^Ty+c\tau-\bar c\theta\ \ge0,\\ & \kappa=b^Ty-c^Tx+\bar z\theta\ \ge0,\\ & -\bar b^Ty+\bar c^Tx-\bar z\tau=-(n+1),\qquad x\ge0,\ \tau\ge0. \end{array}mins.t.​(n+1)θAx−bτ+bˉθ=0,s=−ATy+cτ−cˉθ ≥0,κ=bTy−cTx+zˉθ ≥0,−bˉTy+cˉTx−zˉτ=−(n+1),x≥0, τ≥0.​

Fh\mathcal F_hFh​ is its feasible set and Fh0\mathcal F_h^0Fh0​ the subset with x,τ,s,κ>0x,\tau,s,\kappa>0x,τ,s,κ>0. A self-complementary solution is an optimal solution of (HLP). A strictly self-complementary one also has θ=0\theta=0θ=0 and (x+s;τ+κ)>0(x+s;\tau+\kappa)>0(x+s;τ+κ)>0. For a point of (HLP) put μ=(xTs+τκ)/(n+1)\mu=(x^Ts+\tau\kappa)/(n+1)μ=(xTs+τκ)/(n+1), and for β∈(0,1)\beta\in(0,1)β∈(0,1) let

N(β)={z∈Fh0:∥(Xsτκ)−μe∥2≤βμ}.\mathcal N(\beta)=\Bigl\{z\in\mathcal F_h^0 : \Bigl\|\begin{pmatrix}Xs\\ \tau\kappa\end{pmatrix}-\mu e\Bigr\|_2\le\beta\mu\Bigr\}.N(β)={z∈Fh0​:​(Xsτκ​)−μe​2​≤βμ}.

The predictor–corrector algorithm with β=1/4\beta=1/4β=1/4 starts at z0=(0,e,1,1,e,1)z^0=(0,e,1,1,e,1)z0=(0,e,1,1,e,1). At even kkk (predictor step) it solves the Newton system (11)–(12) with target γμk=0\gamma\mu^k=0γμk=0 and moves along the direction by the largest step that stays in N(2β)\mathcal N(2\beta)N(2β) (13). At odd kkk (corrector step) it solves the system with target μk\mu^kμk and takes a full step.

Formalization targets

Goal: Theorem 8 (p. 63)

For every predictor–corrector sequence (yk,xk,τk,θk,sk,κk)(y^k,x^k,\tau^k,\theta^k,s^k,\kappa^k)(yk,xk,τk,θk,sk,κk):

  1. if (LP) possesses an optimal solution, then for every optimal pair xˉ,(yˉ,sˉ)\bar x,(\bar y,\bar s)xˉ,(yˉ​,sˉ)
τk≥1−2βeTxˉ+eTsˉ+1for all k;\tau^k\ge\frac{1-2\beta}{e^T\bar x+e^T\bar s+1}\quad\text{for all }k;τk≥eTxˉ+eTsˉ+11−2β​for all k;
  1. otherwise there is a fixed ε>0\varepsilon>0ε>0, independent of kkk, with
κk≥(1−2β)εn+1,1−2β2(n+1)≤1−2βκk≤τkθk≤1+2βκk≤(n+1)(1+2β)(1−2β)ε\kappa^k\ge\frac{(1-2\beta)\varepsilon}{n+1},\qquad \frac{1-2\beta}{2(n+1)}\le\frac{1-2\beta}{\kappa^k}\le\frac{\tau^k}{\theta^k}\le\frac{1+2\beta}{\kappa^k}\le\frac{(n+1)(1+2\beta)}{(1-2\beta)\varepsilon}κk≥n+1(1−2β)ε​,2(n+1)1−2β​≤κk1−2β​≤θkτk​≤κk1+2β​≤(1−2β)ε(n+1)(1+2β)​

for all kkk.

Milestones

In the order the proof uses them:

  • the predictor-step and corrector-step claims from the proof of Theorem 6 (p. 62);
  • the iterates lie in N(2β)\mathcal N(2\beta)N(2β) (p. 63);
  • Theorem 2 (iv): the optimal value of (HLP) is 000 and (n+1)θ=xTs+τκ(n+1)\theta=x^Ts+\tau\kappa(n+1)θ=xTs+τκ on Fh\mathcal F_hFh​ (stated for general x0,s0>0x^0,s^0>0x0,s0>0, y0y^0y0);
  • equation (9): eTx+eTs+τ+κ−(n+1)θ=n+1e^Tx+e^Ts+\tau+\kappa-(n+1)\theta=n+1eTx+eTs+τ+κ−(n+1)θ=n+1;
  • an optimal pair scaled by α=(n+1)/(eTxˉ+eTsˉ+1)\alpha=(n+1)/(e^T\bar x+e^T\bar s+1)α=(n+1)/(eTxˉ+eTsˉ+1) is a self-complementary solution;
  • the orthogonality identity (xk)Ts∗+(sk)Tx∗+κkτ∗=(n+1)θk(x^k)^Ts^*+(s^k)^Tx^*+\kappa^k\tau^*=(n+1)\theta^k(xk)Ts∗+(sk)Tx∗+κkτ∗=(n+1)θk;
  • Theorem 2 (v), existence of a strictly self-complementary solution;
  • Theorem 3 (i) and (ii), reading such a solution back into (LP) and (LD);
  • the bound κk≤(n+1)+(n+1)θk≤2(n+1)\kappa^k\le(n+1)+(n+1)\theta^k\le2(n+1)κk≤(n+1)+(n+1)θk≤2(n+1).

Significance

Theorem 8 is a stopping criterion. Either τk\tau^kτk stays bounded away from zero, which happens exactly when (LP) has an optimal solution, or τk\tau^kτk and θk\theta^kθk go to zero at the same rate while κk\kappa^kκk stays bounded away from zero. An implementation can therefore watch τk/θk\tau^k/\theta^kτk/θk and κk\kappa^kκk and decide the status of (LP) from an approximate iterate, without the exact rounding procedure needed for the O(nL)O(\sqrt nL)O(n​L) bound. The bounds hold for real data, with no integrality and no bit length.

Theorem 8 has a published proof on one page, building on the self-duality facts of §2 and the Mizuno–Todd–Ye step analysis. None of it is machine-checked. A complete development would give a verified account of the homogeneous self-dual embedding, including:

  • the skew-symmetric orthogonality argument;
  • Goldman–Tucker strict complementarity for (HLP);
  • the predictor–corrector neighborhood invariants.

These are the ingredients of every analysis of the embedding. Homogeneous self-dual programs appear on Prove2Me in other conventions (Vanderbei's (22.4) and (22.21), Matoušek's (SD)), but their statements concern different programs: no artificial variable θ\thetaθ, no normalizing row. They do not formalize any statement here.

Difficulty

The two branches of Theorem 8 rest on facts of different depth.

  • The first branch needs only an optimal pair of (LP)/(LD), lifted into (HLP), and the identity (xk)Ts∗+(sk)Tx∗+κkτ∗=(n+1)θk(x^k)^Ts^*+(s^k)^Tx^*+\kappa^k\tau^*=(n+1)\theta^k(xk)Ts∗+(sk)Tx∗+κkτ∗=(n+1)θk.
  • The "otherwise" branch needs an optimal solution of (HLP) with κ∗>0\kappa^*>0κ∗>0. Its existence is not elementary. It comes from strict complementarity (Theorem 2 (v)) together with the characterization of Theorem 3 (i). Strict complementarity for linear programs is the Goldman–Tucker theorem, which Mathlib does not contain.
  • The neighborhood invariants behind "the sequence is in N(2β)\mathcal N(2\beta)N(2β)" are the Mizuno–Todd–Ye estimates. They need the orthogonality dxTds+dτdκ=0d_x^Td_s+d_\tau d_\kappa=0dxT​ds​+dτ​dκ​=0 of the Newton directions and a careful quadratic bound on ∥Dxds∥\|D_xd_s\|∥Dx​ds​∥.

The obvious first idea is to treat Theorem 8 as a consequence of Theorem 6. It fails: Theorem 8 is about every iterate of an infinite run and uses no iteration count. The constant ε\varepsilonε depends on the instance and is not explicit.

Formalization scope

  • Data. Real data A : Matrix (Fin m) (Fin n) ℝ, b : Fin m → ℝ, c : Fin n → ℝ, with no rank assumption and no integrality. (LP)/(LD) feasibility and optimality are built on the published general-form LP definition LinearOptimization_DualLP. "(LP) has a solution (feasible and bounded)" in Theorem 3 is read as "(LP) has an optimal solution".
  • Points. A point of (HLP) is a structure with fields y x τ θ s κ. The slacks s,κs,\kappas,κ are pinned to the constraint expressions. (HLP) is defined for general (x0,y0,s0)(x^0,y^0,s^0)(x0,y0,s0); the instance (7) is obtained by substitution. Optimality means minimizing the objective over Fh\mathcal F_hFh​, not "θ=0\theta=0θ=0", so Theorem 2 (iv) is not built into the definition.
  • Norm. The norm in N(β)\mathcal N(\beta)N(β) is the Euclidean norm on Rn+1\mathbb R^{n+1}Rn+1, written out explicitly.
  • Constants. β=1/4\beta=1/4β=1/4 is a named constant. The statements show 1−2β1-2\beta1−2β and 1+2β1+2\beta1+2β as printed.
  • The iteration. It is a relation IsPCSequence: z0=(0,e,1,1,e,1)z^0=(0,e,1,1,e,1)z0=(0,e,1,1,e,1), and each step is zk+1=zk+αdz^{k+1}=z^k+\alpha dzk+1=zk+αd for some solution ddd of (11)–(12). The relation is needed because dyd_ydy​ is not unique when AAA is rank-deficient.
  • Step size. The predictor step size must be the greatest element of the set in (13), as printed. On an instance where that maximum is not attained, no predictor–corrector sequence exists and Theorem 8 holds vacuously there. A sorry-free check shows that z0∈N(1/4)z^0\in\mathcal N(1/4)z0∈N(1/4) for all data, so the sequence does start.
  • The two branches. They are two implications with complementary hypotheses, "(LP) has an optimal solution" and its negation. The negation covers infeasible and unbounded (LP) alike.
  • Quantifiers. The first branch quantifies over all optimal pairs. In the second, ∃ε>0\exists\varepsilon>0∃ε>0 precedes ∀k\forall k∀k.
  • Divisions. The chain keeps the printed divisions. All denominators (κk\kappa^kκk, θk=μk\theta^k=\mu^kθk=μk) are positive on N(2β)\mathcal N(2\beta)N(2β), so Lean's x/0=0x/0=0x/0=0 convention plays no role.
  • Ruled out. A formalization in which ε\varepsilonε may depend on kkk, or in which the first branch asserts the bound for only some optimal pair, would make Theorem 8 trivial or weaker. Both are excluded.

Needed infrastructure: LP duality and Goldman–Tucker strict complementarity for real standard-form programs, and the skew-symmetric orthogonality lemma. These are reusable well beyond this mission. Proofs of any milestone, and alternative arguments (e.g. via the central-path limit) for the existence of κ∗>0\kappa^*>0κ∗>0, are welcome.

Selected references

  • Y. Ye, M. J. Todd, S. Mizuno, An O(nL)O(\sqrt nL)O(n​L)-Iteration Homogeneous and Self-Dual Linear Programming Algorithm, Mathematics of Operations Research 19(1), 53–67, 1994. https://doi.org/10.1287/moor.19.1.53
  • S. Mizuno, M. J. Todd, Y. Ye, On Adaptive-Step Primal-Dual Interior-Point Algorithms for Linear Programming, Mathematics of Operations Research 18(4), 964–981, 1993. https://doi.org/10.1287/moor.18.4.964
  • O. Güler, Y. Ye, Convergence behavior of interior-point algorithms, Mathematical Programming 60, 215–228, 1993. https://doi.org/10.1007/BF01580610
  • A. J. Goldman, A. W. Tucker, Theory of linear programming, in Linear Inequalities and Related Systems, Annals of Mathematics Studies 38, 53–97, 1956. https://doi.org/10.1515/9781400881987-005
17 thms3 active usersReviewed
CombinatoricsDiscrete Geometry·Captain: mikedeng1

The d-Step Conjecture for Polyhedra of Dimension d < 6 1: The Bounded 5-Step Conjecture Holds, Every 5-Polytope with 10 Facets Has Diameter at Most 5, i.e. Δb(5, 10) = 5Research Paper

Motivation

The simplex method and every other edge-following linear programming algorithm moves from vertex to vertex of the feasible region along its edges. The number of steps such an algorithm needs in the worst case is at least the combinatorial diameter of the feasible polyhedron: the largest distance, counted in edges, between two of its vertices. Klee and Walkup introduced the two functions that measure this worst case, Δ(d,n)\Delta(d,n)Δ(d,n) for polyhedra and Δb(d,n)\Delta_b(d,n)Δb​(d,n) for bounded polyhedra of dimension ddd with nnn facets, and wrote that Δ(d,n)\Delta(d,n)Δ(d,n) "represents, in a sense, the number of iterations required to solve the 'worst' linear program of nnn inequalities in ddd variables using the 'best' edge-following algorithm" (Klee and Walkup 1967, p. 54).

The Hirsch conjecture, reported by Dantzig in 1963, asserted Δ(d,n)≤n−d\Delta(d,n)\le n-dΔ(d,n)≤n−d. Its diagonal cases Δ(d,2d)≤d\Delta(d,2d)\le dΔ(d,2d)≤d and Δb(d,2d)≤d\Delta_b(d,2d)\le dΔb​(d,2d)≤d are the general and the bounded ddd-step conjectures.

Timeline.

  • 1957–1963: W. M. Hirsch's conjecture, reported in Dantzig's Linear Programming and Extensions (1963, pp. 160, 168), with the claim that it holds for m≤4m\le 4m≤4.
  • Before 1967: Klee determines Δ(3,n)=n−3\Delta(3,n)=n-3Δ(3,n)=n−3 and Δb(3,n)=⌊2n/3⌋−1\Delta_b(3,n)=\lfloor 2n/3\rfloor-1Δb​(3,n)=⌊2n/3⌋−1 and settles Δb(d,n)\Delta_b(d,n)Δb​(d,n) for n≤d+4n\le d+4n≤d+4 (Canad. J. Math. 16 and the papers cited as [9], [12], [13] by Klee and Walkup, p. 55).
  • 1967: Klee and Walkup (Acta Math. 117) prove Δb(5,10)=5\Delta_b(5,10)=5Δb​(5,10)=5, show that Δb(d,2d)≤d\Delta_b(d,2d)\le dΔb​(d,2d)≤d for all ddd is equivalent to the bounded Hirsch conjecture, and disprove the unbounded conjecture with Δ(4,8)=5\Delta(4,8)=5Δ(4,8)=5.
  • 2012: Santos disproves the bounded Hirsch conjecture with a 43-dimensional polytope with 86 facets (Ann. Math. 176). The bounded ddd-step conjecture therefore fails for some ddd, and the smallest failing ddd is unknown; it is at least 6.

Setting

A polyhedron in Rd\mathbb R^dRd is a nonempty set P={x:⟨ai,x⟩≤bi, i=1,…,n}P=\{x:\langle a_i,x\rangle\le b_i,\ i=1,\dots,n\}P={x:⟨ai​,x⟩≤bi​, i=1,…,n}; a polytope is a bounded polyhedron. PPP is a ddd-polyhedron with nnn facets when it has nonempty interior and none of the nnn inequalities is redundant; then the rows are in bijection with the facets, and row iii is tight at vvv exactly when vvv lies on the iii-th facet. The vertices of PPP are its extreme points. Two vertices u≠vu\ne vu=v span an edge when the segment [u,v][u,v][u,v] is an extreme subset of PPP. A path of length lll is a sequence of lll edges [x0,x1],…,[xl−1,xl][x_0,x_1],\dots,[x_{l-1},x_l][x0​,x1​],…,[xl−1​,xl​], and δP(x,y)\delta_P(x,y)δP​(x,y) is the least length of a path from xxx to yyy. Then

Δb(d,n)=max⁡{δP(x,y):P a d-polytope with n facets, x,y vertices of P}.\Delta_b(d,n)=\max\{\delta_P(x,y): P\text{ a }d\text{-polytope with }n\text{ facets},\ x,y\text{ vertices of }P\}.Δb​(d,n)=max{δP​(x,y):P a d-polytope with n facets, x,y vertices of P}.

PPP is simple when every vertex lies on exactly ddd facets. A face is PPP itself or the intersection of PPP with a supporting hyperplane, never ∅\emptyset∅; its dimension is that of its affine hull. A (k1,…,kr)(k_1,\dots,k_r)(k1​,…,kr​)-path from xxx to yyy is a sequence of faces K1,…,KrK_1,\dots,K_rK1​,…,Kr​ with x∈K1x\in K_1x∈K1​, y∈Kry\in K_ry∈Kr​, dim⁡Ki=ki\dim K_i=k_idimKi​=ki​ and Ki∩Ki+1≠∅K_i\cap K_{i+1}\ne\emptysetKi​∩Ki+1​=∅. A ddd-dimensional Dantzig figure (P,x,y)(P,x,y)(P,x,y) is a ddd-polyhedron PPP with 2d2d2d facets and two vertices x,yx,yx,y such that exactly ddd facets are incident to xxx and the other ddd to yyy. A ddd-polytope QQQ has property A when it has between 2d2d2d and 2d+22d+22d+2 facets and the following holds: if its facets are split into two classes X,Y\mathfrak X,\mathfrak YX,Y of at most d+1d+1d+1 facets each, and both sets XXX, YYY of vertices all of whose facets lie in X\mathfrak XX, respectively Y\mathfrak YY, are nonempty, then some vertex of XXX is joined to some vertex of YYY by a path of length at most ddd.

Formalization targets

Goal: 4.3 THEOREM

Δb(5,10)=5.\Delta_b(5,10)=5.Δb​(5,10)=5.

In two halves: every 555-polytope with 101010 facets satisfies δP(x,y)≤5\delta_P(x,y)\le 5δP​(x,y)≤5 for all vertices x,yx,yx,y, and some 555-polytope with 101010 facets has two vertices with δP(x,y)>4\delta_P(x,y)>4δP​(x,y)>4.

Milestones, in the order the proof uses them

  1. 2.8 THEOREM (bounded part): Δb(d,n)\Delta_b(d,n)Δb​(d,n) is attained by two vertices of a simple ddd-polytope with nnn facets, and for n≥2dn\ge 2dn≥2d by two vertices on no common facet. For n=2dn=2dn=2d this is a bounded simple Dantzig figure.
  2. 3.4 PROPOSITION (a): every simple Dantzig figure admits a (k1,1,k3)(k_1,1,k_3)(k1​,1,k3​)-path for positive k1+1+k3=dk_1+1+k_3=dk1​+1+k3​=d.
  3. 3.1 PROPOSITION: (a) facial paths in all ddd-dimensional simple Dantzig figures, (b) facet-avoiding facial paths in simple ddd-polytopes with 2d+12d+12d+1 facets, and (c) facet-avoiding (1,k1,…,kr)(1,k_1,\dots,k_r)(1,k1​,…,kr​)-paths in bounded (d+1)(d+1)(d+1)-dimensional figures are equivalent.
  4. 3.4 PROPOSITION (b): every bounded simple Dantzig figure admits a (1,k2,1,k4)(1,k_2,1,k_4)(1,k2​,1,k4​)-path for positive 1+k2+1+k4=d1+k_2+1+k_4=d1+k2​+1+k4​=d.
  5. Remark after 3.4: adjacent terms of a facial path in a simple figure merge into their sum.
  6. Remark after 3.4, p. 68: bounded simple Dantzig figures of dimension d≥2d\ge 2d≥2 admit (1,d−2,1)(1,d-2,1)(1,d−2,1)-paths.
  7. 4.1 PROPOSITION: if the middle face QQQ of a (1,d−2,1)(1,d-2,1)(1,d−2,1)-path ([x,x′],Q,[y′,y])([x,x'],Q,[y',y])([x,x′],Q,[y′,y]) has property A, then δP(x,y)≤d\delta_P(x,y)\le dδP​(x,y)≤d.
  8. 4.2 LEMMA: every simple 333-polytope with 666, 777 or 888 facets has property A.

Significance

The result. By the paper's reductions, Δb(d,2d)≤d\Delta_b(d,2d)\le dΔb​(d,2d)≤d for a given ddd is equivalent to the bounded Hirsch bound Δb(d′,d′+d)≤d\Delta_b(d',d'+d)\le dΔb​(d′,d′+d)≤d for every d′d'd′. So 4.3 gives Δb(d,n)≤n−d\Delta_b(d,n)\le n-dΔb​(d,n)≤n−d for all n≤d+5n\le d+5n≤d+5, which is the column n−d=5n-d=5n−d=5 of the paper's Fig. 2. Since Santos's counterexample, the smallest ddd with Δb(d,2d)>d\Delta_b(d,2d)>dΔb​(d,2d)>d is a well-defined open number. This theorem was the first to show it is at least 666; later computer-assisted work treated further small cases, including the bounded 666-step case (Bremner and Schewe 2011). Santos's construction starts from exactly the reduction to Dantzig figures (the "strong ddd-step theorem" for spindles) that this paper uses.

Formalizing it. The result has been proved since 1967; no machine-checked proof of Δb(5,10)=5\Delta_b(5,10)=5Δb​(5,10)=5 exists. The platform has the Hirsch bound in dimension ≤3\le 3≤3 (Hirsch.dimension_three_bound, Hirsch.klee_three_dimensional_bound), the Klee–Walkup wedge reduction at the level of inequality descriptions (Hirsch.balanced_hpoly_transfer), products (Hirsch.diamLE_prod) and Santos's counterexample. The mission adds the facial-path calculus of §3 and the property-A argument of §4. Both are reusable in any later formal treatment of small ddd-step cases.

Difficulty

The obvious approach, a direct case analysis of 555-polytopes with 101010 facets, is out of reach: there are far too many combinatorial types, and nothing bounds the search. The paper first reduces to simple polytopes, and the reduction itself (2.8) rests on a perturbation lemma (2.6) whose proof is deferred to a separate paper by Walkup: simplicity must be gained without shrinking any distance. The facial-path results then pass between bounded and unbounded figures through truncation and the wedge (3.1), and a statement about all unbounded ddd-dimensional figures is what yields one about bounded (d+1)(d+1)(d+1)-dimensional ones. Finally the (d−2)(d-2)(d−2)-face QQQ must be shown to have property A. That property fails for some simple polytopes of classes (4,10)(4,10)(4,10) and (5,11)(5,11)(5,11) (p. 69), so 4.2 depends on the dimension being 333 and on the facet count being at most 888. Its proof uses Euler's relation and Balinski's theorem that the graph of a 333-polytope is 333-connected (posed on the platform as Balinski61.Connectivity.disjoint_paths_between_vertices).

Formalization scope

Polyhedra are Hirsch.Hpoly a b with a : Fin n → EuclideanSpace ℝ (Fin d); edges and walks are Hirsch.Adj and Hirsch.Reach from the published Hirsch_model and Hirsch_walk. The conventions are:

  • "ddd-polyhedron with nnn facets" is a facet presentation: nonempty interior and no redundant row. The rows are exactly the facets; a statement over arbitrary inequality systems would count redundant rows as facets and is not the paper's.
  • δP(x,y)≤L\delta_P(x,y)\le LδP​(x,y)≤L is Hirsch.Reach P L x y, a walk of LLL steps that may stand still. Δb(5,10)=5\Delta_b(5,10)=5Δb​(5,10)=5 is an upper bound for every polytope plus a witness, never a supremum of reals. A version proving only the upper bound, or only the lower bound, is not the goal.
  • Simple means pointed with exactly ddd tight rows at every vertex. On a facet presentation this is equivalent to the paper's "exactly ddd edges at each vertex".
  • Faces are nonempty sets {x∈P:⟨ai,x⟩=bi, i∈I}\{x\in P:\langle a_i,x\rangle=b_i,\ i\in I\}{x∈P:⟨ai​,x⟩=bi​, i∈I}, and dimension is the dimension of the affine span. A Dantzig figure has Fin (2 * d) rows.
  • Property A is defined for a bounded face QQQ of dimension mmm: its facets are the (m−1)(m-1)(m−1)-faces of PPP inside QQQ, and the path runs in QQQ. This keeps 4.1, where QQQ is a (d−2)(d-2)(d−2)-face of a polytope in Rd\mathbb R^dRd, and 4.2, where Q=PQ=PQ=P, under one notion. Facet counts use Set.encard.
  • Explicit readings: 2.8's "Δb\Delta_bΔb​ can be realized as the distance … of a simple polytope" is stated polytope by polytope (δP(u,v)≤δP′(x,y)\delta_P(u,v)\le\delta_{P'}(x,y)δP​(u,v)≤δP′​(x,y)). Only the Δb\Delta_bΔb​ sentences of 2.8 are stated. 3.4's joint hypothesis on k1,…,k4k_1,\dots,k_4k1​,…,k4​ is split by part. The merging remark carries the needed hypothesis ki+ki+1≤dk_i+k_{i+1}\le dki​+ki+1​≤d. The printed "3.5 implies" on p. 67 is read as 3.4.

The paper cites two inputs without proving them: Lemma 2.6 (Walkup's simple perturbation) and Balinski's theorem. A complete development needs face lattices of H-polyhedra, wedges and truncations, and the planar-graph arguments of 4.2. The face and facial-path layer is reusable for the companion mission on Δ(4,8)=5\Delta(4,8)=5Δ(4,8)=5 and for other diameter problems. Contributions are welcome at every milestone, including proofs of 2.6.

Selected references

  • V. Klee and D. W. Walkup, The d-step conjecture for polyhedra of dimension d < 6, Acta Mathematica 117 (1967), 53–78. https://doi.org/10.1007/BF02395040
  • G. B. Dantzig, Linear Programming and Extensions, Princeton University Press, 1963.
  • V. Klee, Diameters of polyhedral graphs, Canadian Journal of Mathematics 16 (1964), 602–614. https://doi.org/10.4153/CJM-1964-058-5
  • M. L. Balinski, On the graph structure of convex polyhedra in n-space, Pacific Journal of Mathematics 11 (1961), 431–434. https://doi.org/10.2140/pjm.1961.11.431
  • F. Santos, A counterexample to the Hirsch conjecture, Annals of Mathematics 176 (2012), 383–412. https://doi.org/10.4007/annals.2012.176.1.7
  • D. Bremner and L. Schewe, Edge-graph diameter bounds for convex polytopes with few facets, Experimental Mathematics 20 (2011), 229–237. https://doi.org/10.1080/10586458.2011.564966
12 thms3 active usersReviewed
Algorithmic Game TheoryOptimization·Captain: mikedeng1

Bimatrix Equilibrium Points and Mathematical Programming: If Z Is Non-Degenerate and uᵀMu ≥ 0, uᵀMu = 0 ⇒ Mu + Mᵀu = 0 for All u ≥ 0, a Non-Empty Z Has an Equilibrium PointResearch Paper

Motivation

The linear complementarity problem asks, for a real square matrix MMM of order nnn and a vector q∈Rnq\in\mathbb R^nq∈Rn, for a vector zzz with

z≥0,w=Mz−q≥0,zTw=0.z\ge 0,\qquad w=Mz-q\ge 0,\qquad z^{\mathsf T}w=0 .z≥0,w=Mz−q≥0,zTw=0.

It is the common form of the Kuhn–Tucker conditions of linear and convex quadratic programs and of the equilibrium conditions of two-person non-zero-sum (bimatrix) games. In 1964 Lemke and Howson gave a constructive existence proof for equilibrium points of bimatrix games by following a path of adjacent extreme points of a polyhedron (Lemke–Howson 1964). In 1965 Lemke adapted that path-following technique to the general problem above, under a condition on MMM that covers the positive semidefinite case treated by Dantzig and Cottle and the case M>0M>0M>0 (Lemke 1965). The resulting procedure, now called Lemke's algorithm or complementary pivoting, became a standard method for linear complementarity problems and a template for later path-following existence proofs (Cottle, Pang, Stone 1992).

Timeline:

  • 1964: Lemke and Howson, adjacent-extreme-point path for bimatrix games.
  • 1965: Lemke, existence for matrices satisfying conditions (i)–(ii) below (the goal of this mission), under a non-degeneracy assumption, by an augmented path with an artificial variable z0z_0z0​.
  • Later literature names matrices with (i)–(ii) copositive-plus, and removes non-degeneracy by lexicographic perturbation.

Setting

Fix a finite index set of size nnn, a real n×nn\times nn×n matrix MMM and q∈Rnq\in\mathbb R^nq∈Rn. Inequalities between vectors are componentwise and eee is the all-ones vector.

  • The set Z={z∈Rn:z≥0, w=Mz−q≥0}Z=\{z\in\mathbb R^n : z\ge 0,\ w=Mz-q\ge 0\}Z={z∈Rn:z≥0, w=Mz−q≥0}; www is always the function Mz−qMz-qMz−q of zzz.
  • An equilibrium point is a point z∈Zz\in Zz∈Z with zTw=0z^{\mathsf T}w=0zTw=0; SSS is the set of them.
  • For any z∈Rnz\in\mathbb R^nz∈Rn, the matrix N(z)N(z)N(z) consists of the columns of (MT,I)(M^{\mathsf T},I)(MT,I) that are kept when one deletes the iii-th column of MTM^{\mathsf T}MT whenever wi≠0w_i\ne 0wi​=0 and the iii-th column of III whenever zi≠0z_i\ne0zi​=0.
  • An extreme point of ZZZ is a point z∈Zz\in Zz∈Z with rank⁡N(z)=n\operatorname{rank}N(z)=nrankN(z)=n; zzz lies on an open edge if z∈Zz\in Zz∈Z and rank⁡N(z)=n−1\operatorname{rank}N(z)=n-1rankN(z)=n−1. An open edge is the set of points of ZZZ sharing the matrix N(z)N(z)N(z) of such a point; a ray is an open edge with exactly one end-point.
  • ZZZ is non-degenerate if for every z∈Rnz\in\mathbb R^nz∈Rn the columns of N(z)N(z)N(z) are linearly independent.
  • For an index sss, Zs={z∈Z:zTw=zsws}Z_s=\{z\in Z : z^{\mathsf T}w=z_sw_s\}Zs​={z∈Z:zTw=zs​ws​}. An adjacency path is a non-empty connected class of closed edges of ZZZ no three of which meet; its end-points are the extreme points lying on exactly one of its edges.
  • The augmented sets: Z∗={(z,z0):z≥0, z0≥0, Mz+z0e−q≥0}Z^*=\{(z,z_0) : z\ge0,\ z_0\ge0,\ Mz+z_0e-q\ge0\}Z∗={(z,z0​):z≥0, z0​≥0, Mz+z0​e−q≥0}, its subset Z0∗Z_0^*Z0∗​ where zTw=0z^{\mathsf T}w=0zTw=0, and, for a number kkk, Z∗∗Z^{**}Z∗∗, the set of the form above for the bordered data (Me−eT0)\begin{pmatrix}M&e\\-e^{\mathsf T}&0\end{pmatrix}(M−eT​e0​), (q−k)\begin{pmatrix}q\\-k\end{pmatrix}(q−k​).

Formalization targets

Goal: Theorem 4 (p. 7)

Suppose ZZZ is non-degenerate and that for every u≥0u\ge0u≥0

(i) uTMu≥0,(ii) uTMu=0 ⟹ Mu+MTu=0.\text{(i)}\ u^{\mathsf T}Mu\ge 0,\qquad \text{(ii)}\ u^{\mathsf T}Mu=0\ \Longrightarrow\ Mu+M^{\mathsf T}u=0 .(i) uTMu≥0,(ii) uTMu=0 ⟹ Mu+MTu=0.

Then

Z≠∅ ⟹ ∃z∈Z, zT(Mz−q)=0.Z\ne\emptyset\ \Longrightarrow\ \exists z\in Z,\ z^{\mathsf T}(Mz-q)=0 .Z=∅ ⟹ ∃z∈Z, zT(Mz−q)=0.

Milestones, in the order the paper's proof uses them

  1. Theorem 1 (p. 3): for non-degenerate ZZZ, ZsZ_sZs​ is empty or a disjoint union of adjacency paths whose end-points are exactly the equilibrium points.
  2. Lemma 2 (p. 4): Z=∅Z=\emptysetZ=∅ iff some u≥0u\ge0u≥0 has MTu≤0M^{\mathsf T}u\le0MTu≤0, uTq>0u^{\mathsf T}q>0uTq>0.
  3. Theorem 2 (p. 4): if some ZsZ_sZs​ contains precisely one ray of a non-degenerate ZZZ, the number of equilibrium points is odd.
  4. p. 6: for kkk chosen as in (12), the starting ray E0∗E_0^*E0∗​ (z=0z=0z=0) is a ray of Z∗∗Z^{**}Z∗∗ inside Z0∗∗Z_0^{**}Z0∗∗​, and it is the only one.
  5. Lemma 2 (p. 6): Z∗∗Z^{**}Z∗∗ has an equilibrium point.
  6. Lemma 3 (p. 7): a ray (zˉ+θu,zˉ0+θu0)(\bar z+\theta u,\bar z_0+\theta u_0)(zˉ+θu,zˉ0​+θu0​) of Z∗Z^*Z∗ in Z0∗Z_0^*Z0∗​ with eTu=1e^{\mathsf T}u=1eTu=1 satisfies uTMu+u0=0u^{\mathsf T}Mu+u_0=0uTMu+u0​=0.
  7. (22)–(25) (pp. 7–8): under (i)–(ii) such a ray has zˉ0=0\bar z_0=0zˉ0​=0 and zˉ\bar zzˉ an equilibrium point of ZZZ, or zˉ0>0\bar z_0>0zˉ0​>0 and Z=∅Z=\emptysetZ=∅.

Companion results

The Corollary (p. 5: q=eq=eq=e, M>0M>0M>0 gives an odd number of equilibrium points), Theorem 3 (p. 5: if zTMz≥0z^{\mathsf T}Mz\ge0zTMz≥0 for all zzz, at most one equilibrium point) and Theorem 5 (p. 8: if moreover Z≠∅Z\ne\emptysetZ=∅, ZZZ has at least nnn rays).

Significance

Theorem 4 is an existence theorem for a class of linear complementarity problems that contains convex quadratic programming (the case zTMz≥0z^{\mathsf T}Mz\ge0zTMz≥0 for all zzz) and strictly positive matrices, and its proof is an algorithm: the path followed is the sequence of pivots of Lemke's method. The parity statements (Theorem 2, the Corollary) are an early instance of the path-following parity arguments later abstracted in the complexity class PPAD (Papadimitriou 1994).

The theorem is classical and proved. To our knowledge neither Lemke's theorem nor the polyhedral path machinery of Theorems 1–2 has a machine-checked proof in Lean or Mathlib. This mission produces the vocabulary of non-degenerate complementarity polyhedra (the matrix N(z)N(z)N(z), open edges, rays, adjacency paths), the parity theorem, and the existence theorem itself; the Farkas-type Lemma 2 (p. 4) is already available on the platform.

Difficulty

The algebraic part (Lemma 3 and (22)–(25)) is short. The difficulty is combinatorial-geometric: Theorem 1 requires that, under non-degeneracy, every extreme point of ZZZ has exactly nnn incident edges, that each point of ZsZ_sZs​ is an extreme point or lies on an open edge, and that the edges contained in ZsZ_sZs​ form paths whose end-points are exactly the equilibrium points; the parity of Theorem 2 then needs finiteness of the set of extreme points. None of this polyhedral structure (edges as zero-pattern classes, their closures and end-points) is in Mathlib. Moreover, the printed proof of Theorem 4 applies Theorem 2 to Z∗∗Z^{**}Z∗∗, whose non-degeneracy the paper obtains from an informal perturbation remark, and it sketches the step from the end of the augmented path to a ray of Z∗Z^*Z∗; a complete proof of the goal must supply these steps or take another route.

Formalization scope

  • Vectors are functions from a finite index type ι\iotaι to R\mathbb RR (n=∣ι∣n=|\iota|n=∣ι∣; Fin n\mathrm{Fin}\,nFinn is a special case); the bordered system lives on ι⊕{∗}\iota\oplus\{\ast\}ι⊕{∗}. www is always Mz−qMz-qMz−q, never a free variable.
  • N(z)N(z)N(z) is the indexed family of its columns, rank⁡N(z)\operatorname{rank}N(z)rankN(z) the dimension of their span; "rank⁡N(z)=n−1\operatorname{rank}N(z)=n-1rankN(z)=n−1" is written rank⁡N(z)+1=n\operatorname{rank}N(z)+1=nrankN(z)+1=n.
  • Non-degeneracy (Def. 3) is linear independence of the columns of N(z)N(z)N(z) for every z∈Rnz\in\mathbb R^nz∈Rn. The phrase "(but not all)" is read as excluding only the empty matrix; the other reading differs only when q=0q=0q=0, and the formal definition is then the stronger hypothesis.
  • An open edge is the set of points of ZZZ with the zero pattern of a point z0z_0z0​ with rank⁡N(z0)=n−1\operatorname{rank}N(z_0)=n-1rankN(z0​)=n−1; closed edges are closures; end-points of an open edge EEE are the points of E‾∖E\overline E\setminus EE∖E; a ray has exactly one. Adjacency paths are classes of closed edges.
  • Conditions (i)–(ii) are quantified over u≥0u\ge0u≥0 only. "Non-negative definite" (Theorems 3, 5) is zTMz≥0z^{\mathsf T}Mz\ge0zTMz≥0 for all zzz, with no symmetry assumed.
  • "An odd number" is finiteness plus odd cardinality; "at least nnn rays" counts rays as an extended natural number; "at most one" is a subsingleton.
  • Equilibrium points include membership in ZZZ: zT(Mz−q)=0z^{\mathsf T}(Mz-q)=0zT(Mz−q)=0 alone holds at z=0z=0z=0 and would make the goal trivial. The goal mentions neither Z∗Z^*Z∗, Z∗∗Z^{**}Z∗∗, kkk, rays nor paths; in particular non-degeneracy of Z∗∗Z^{**}Z∗∗ is not a hypothesis of the goal.
  • Deviations: Lemma 2 (p. 6) assumes non-degeneracy of Z∗∗Z^{**}Z∗∗ (Def. 3 does not define it for the non-square Z∗Z^*Z∗); milestone 4 holds for every kkk without non-degeneracy; Lemma 3 and (22)–(25) parametrize the ray as in (15) without requiring zˉ∗\bar z^*zˉ∗ to be an extreme point, which makes them stronger.

Contributions welcome: the polyhedral lemmas for non-degenerate ZZZ (extreme points have nnn edges, finitely many extreme points), the parity argument, and any complete route to Theorem 4.

Selected references

  • C. E. Lemke, Bimatrix Equilibrium Points and Mathematical Programming, Management Science 11(7):681–689, 1965. https://doi.org/10.1287/mnsc.11.7.681 (cited from the HAL deposit hal-01885823v1)
  • C. E. Lemke, J. T. Howson, Equilibrium Points of Bimatrix Games, J. SIAM 12(2):413–423, 1964. https://doi.org/10.1137/0112033
  • R. W. Cottle, J.-S. Pang, R. E. Stone, The Linear Complementarity Problem, Academic Press 1992; SIAM Classics 2009. https://doi.org/10.1137/1.9780898719000
  • C. H. Papadimitriou, On the complexity of the parity argument and other inefficient proofs of existence, J. Computer and System Sciences 48(3):498–532, 1994. https://doi.org/10.1016/S0022-0000(05)80063-7
10 thms3 active usersReviewed
CombinatoricsDiscrete Geometry·Captain: mikedeng1

A Quasi-Polynomial Bound for the Diameter of Graphs of Polyhedra: Every Polyhedron Given by n Inequalities in ℝ^d, Bounded or Not, Has Graph Diameter at Most n^(log₂ d + 2)Research Paper

Motivation

The simplex method solves a linear program by walking along the edges of the feasible polyhedron, from vertex to vertex. However cleverly a pivot rule chooses its steps, it cannot reach the optimum in fewer steps than the graph distance from the starting vertex. The largest possible graph diameter of a polyhedron therefore bounds from below the worst-case number of pivots of every pivot rule, and whether that diameter is polynomial in the size of the problem is one of the basic open questions of linear optimization (Klee–Kleinschmidt 1987).

Timeline.

  • 1957: Hirsch conjectures that a ddd-dimensional polyhedron with nnn facets has graph diameter at most n−dn-dn−d (reported in Dantzig, Linear Programming and Extensions, 1963).
  • 1967: Klee and Walkup show the conjecture false for unbounded polyhedra, with the lower bound n−d+[d/5]n-d+[d/5]n−d+[d/5] for n≥2dn\ge2dn≥2d (Acta Math. 1967).
  • 1967–1970: Barnette proves Δ(d,n)≤n3d−3\Delta(d,n)\le n3^{d-3}Δ(d,n)≤n3d−3, and Larman improves it to n2d−3n2^{d-3}n2d−3 (Proc. LMS 1970); both are linear in nnn but exponential in ddd.
  • 1990–1992: Kalai proves a subexponential bound, and then Kalai and Kleitman prove the quasi-polynomial bound nlog⁡d+2n^{\log d+2}nlogd+2 that is the subject of this mission (Bull. AMS 1992, arXiv:math/9204233).
  • 2012: Santos disproves the Hirsch conjecture for bounded polytopes (Ann. Math. 2012). Whether a polynomial bound holds remains open; the best general upper bounds known are refinements of the exponent of the Kalai–Kleitman bound.

Setting

A polyhedron in Rd\mathbb R^dRd is the solution set of finitely many linear inequalities,

P={x∈Rd: ⟨ai,x⟩≤bi, i=1,…,n},ai∈Rd, bi∈R.P=\{x\in\mathbb R^d:\ \langle a_i,x\rangle\le b_i,\ i=1,\dots,n\},\qquad a_i\in\mathbb R^d,\ b_i\in\mathbb R .P={x∈Rd: ⟨ai​,x⟩≤bi​, i=1,…,n},ai​∈Rd, bi​∈R.

It may be bounded or unbounded, and empty. Its vertices are its extreme points. Two distinct vertices u,vu,vu,v are adjacent when the segment [u,v][u,v][u,v] is an edge of PPP, a one-dimensional face; unbounded one-dimensional faces (rays) are not edges. The graph G(P)G(P)G(P) consists of these vertices and edges, and its diameter δ(P)\delta(P)δ(P) is the largest graph distance between two vertices. Kalai and Kleitman write Δ(d,n)\Delta(d,n)Δ(d,n) for the largest diameter of the graph of a ddd-dimensional polyhedron with nnn facets.

For a set FFF of row indices, the relaxation QFQ_FQF​ is the polyhedron obtained from PPP by ignoring the inequalities with index outside FFF. A walk of BBB steps is a sequence w0,…,wBw_0,\dots,w_Bw0​,…,wB​ of points in which each step stays put or crosses an edge; "diameter at most BBB" means that any two vertices are joined by such a walk, which includes connectivity of the graph.

Formalization targets

Goal: Theorem 1

Δ(d,n)≤nlog⁡d+2.\Delta(d,n)\le n^{\log d+2}.Δ(d,n)≤nlogd+2.

Stated for polyhedra given by inequalities: for all d,nd,nd,n and all a∈(Rd)na\in(\mathbb R^d)^na∈(Rd)n, b∈Rnb\in\mathbb R^nb∈Rn, the graph of PPP is connected and has diameter at most ⌊nlog⁡2d+2⌋\lfloor n^{\log_2 d+2}\rfloor⌊nlog2​d+2⌋. No nonemptiness, boundedness or full-dimensionality is assumed.

Milestones, in the order the proof uses them

  1. If a vertex ω\omegaω of PPP satisfies with equality only rows in FFF, then ω\omegaω is a vertex of QFQ_FQF​ (published).
  2. If an edge of QFQ_FQF​ starts at a point of PPP and is not an edge of PPP, then it meets the hyperplane of an ignored row at a vertex of PPP adjacent to its start, or at its start (published).
  3. The claim kv≤Δ(d,[n/2])k_v\le\Delta(d,[n/2])kv​≤Δ(d,[n/2]): if every vertex within distance kkk of vvv lies only on rows of FFF, and G(QF)G(Q_F)G(QF​) has diameter at most BBB, then every vertex within distance kkk of vvv is within distance BBB of vvv.
  4. The facet step: any two vertices of a face {x∈P:⟨ai,x⟩=bi}\{x\in P:\langle a_i,x\rangle=b_i\}{x∈P:⟨ai​,x⟩=bi​} with ai≠0a_i\ne0ai​=0 are joined, inside that face, by a walk of at most Δ(d−1,n−1)\Delta(d-1,n-1)Δ(d−1,n−1) edges.
  5. The recursion Δ(d,n)≤Δ(d−1,n−1)+2Δ(d,[n/2])+2\Delta(d,n)\le\Delta(d-1,n-1)+2\Delta(d,[n/2])+2Δ(d,n)≤Δ(d−1,n−1)+2Δ(d,[n/2])+2, for polyhedra with nonzero rows.
  6. The arithmetic: N(d,n)=⌊nlog⁡2d+2⌋N(d,n)=\lfloor n^{\log_2 d+2}\rfloorN(d,n)=⌊nlog2​d+2⌋ satisfies N(d−1,n−1)+2N(d,⌊n/2⌋)+2≤N(d,n)N(d-1,n-1)+2N(d,\lfloor n/2\rfloor)+2\le N(d,n)N(d−1,n−1)+2N(d,⌊n/2⌋)+2≤N(d,n) for d≥2d\ge2d≥2, n≥d+1n\ge d+1n≥d+1.

Significance

The bound is polynomial in nnn for each fixed ddd, and nO(log⁡d)n^{O(\log d)}nO(logd) overall. Before it, every bound was exponential in ddd or subexponential in nnn. It remains, up to improvements of the exponent, the best known upper bound on the diameter of polyhedra, and thus the best known limit on how badly an optimal pivot rule must behave. Its proof is also the template for the later abstractions of the problem (connected layer families, subset partition graphs) in which the polynomial Hirsch question is studied.

The bounded case is already formalized on the platform: Hirsch.kalai_kleitman_bound states the theorem for nonempty bounded polytopes and is Proved, together with the bounded forms of the recursion (Hirsch.kalai_kleitman_recursion), of the facet step (Hirsch.facet_reduction, Hirsch.facet_walk) and of the zero-row reduction (Hirsch.diamLE_of_nonzero_rows), and the one-step relaxation lemma Hirsch.relaxation_no_new_neighbours. Kalai and Kleitman state Theorem 1 for all polyhedra: their introduction contrasts unbounded polyhedra (where Hirsch fails) with bounded ones. This mission formalizes the theorem as the paper states it, including unbounded polyhedra, where the bounded proofs do not apply as written. The combinatorial abstraction of the same bound (EHRR10.KalaiKleitman.diameter_le_kalai_kleitman, for the Eisenbrand–Hähnle–Razborov–Rothvoß model) is a different object and is not reused.

Difficulty

The bounded argument relies on compactness: faces are polytopes, every relaxation used in the induction is again a polytope, and the facet of a polytope is a polytope of one dimension less. The relaxation QFQ_FQF​ contains PPP and is typically unbounded even when PPP is bounded, and for an unbounded polyhedron a face on a facet hyperplane can be unbounded or have no vertices at all. Each step must therefore hold for general polyhedra: that a shortest walk in G(QF)G(Q_F)G(QF​) between two vertices of the ball uses only edges of PPP, and that the graph of a face, identified with a polyhedron in Rd−1\mathbb R^{d-1}Rd−1, sits inside G(P)G(P)G(P). The "maximal positive number kvk_vkv​" of the paper need not exist, and the proof must handle the two cases (no radius qualifies; every radius qualifies) separately. Zero rows are allowed in the goal and must be removed before the recursion applies, since a zero row with bi=0b_i=0bi​=0 is tight everywhere.

Formalization scope

Lean represents Rd\mathbb R^dRd as EuclideanSpace ℝ (Fin d) and the polyhedron as Hirsch.Hpoly a b with a : Fin n → ℝ^d, b : Fin n → ℝ, from the published definition Hirsch_model, which also supplies adjacency Hirsch.Adj (the segment is an extreme subset) and the diameter predicate Hirsch.DiamLE. The mission commits to these explicit readings:

  • "Δ(d,n)≤N\Delta(d,n)\le NΔ(d,n)≤N" is ∀ a b, DiamLE (Hpoly a b) N over nnn inequalities in Rd\mathbb R^dRd. This is equivalent to the facet formulation, since a ddd-dimensional polyhedron is cut out by its facet inequalities and a polyhedron given by nnn inequalities in Rd\mathbb R^dRd has dimension at most ddd and at most nnn facets.
  • "log" is log⁡2\log_2log2​ (Real.logb 2), the power is the real power, and the integer bound is its floor ⌊·⌋₊, which is equivalent because distances are natural numbers.
  • "[n/2][n/2][n/2]" is ⌊n/2⌋\lfloor n/2\rfloor⌊n/2⌋ (ℕ division); "at most n/2n/2n/2 facets" is a row set of cardinality at most ⌊n/2⌋\lfloor n/2\rfloor⌊n/2⌋.
  • An ignored row is replaced by the vacuous inequality ⟨0,x⟩≤1\langle0,x\rangle\le1⟨0,x⟩≤1, which keeps the index type Fin n.
  • Walks have exactly BBB steps with stationary steps allowed, so "BBB steps" means "at most BBB edges".
  • The paper's kvk_vkv​ is not defined; milestone 3 quantifies over every radius with the ball property.
  • Milestones 4 and 5 assume nonzero rows; the goal does not.

A statement with a boundedness or nonemptiness hypothesis, with the graph diameter measured by a distance function whose value on unreachable pairs is 000, or with the bound read with Nat.log or the natural logarithm, is not the target. Contributions welcome: proofs of the general-polyhedron facet step and of milestone 3, a general zero-row reduction, the arithmetic of milestone 6, and the base cases d≤1d\le1d≤1 and n≤dn\le dn≤d.

Selected references

  • G. Kalai and D. J. Kleitman, A quasi-polynomial bound for the diameter of graphs of polyhedra, Bull. Amer. Math. Soc. 26 (1992), 315–316. https://doi.org/10.1090/S0273-0979-1992-00285-9 (arXiv:math/9204233)
  • V. Klee and D. W. Walkup, The d-step conjecture for polyhedra of dimension d < 6, Acta Math. 117 (1967), 53–78. https://doi.org/10.1007/BF02395040
  • V. Klee and P. Kleinschmidt, The d-step conjecture and its relatives, Math. Oper. Res. 12 (1987), 718–755. https://doi.org/10.1287/moor.12.4.718
  • D. G. Larman, Paths on polytopes, Proc. London Math. Soc. (3) 20 (1970), 161–178. https://doi.org/10.1112/plms/s3-20.1.161
  • F. Santos, A counterexample to the Hirsch conjecture, Ann. of Math. 176 (2012), 383–412. https://doi.org/10.4007/annals.2012.176.1.7
9 thms3 active usersReviewed
Discrete GeometryOperations ResearchProbability·Captain: mikedeng1

A Friendly Smoothed Analysis of the Simplex Method: Gaussian-Perturbed Shadows Have at Most 3 + 128πe²d²√(log n)σ⁻²(1 + 4σ√(d log n))(1 + 16σ√(log n)) Expected EdgesResearch Paper

Why the simplex method needs smoothed analysis

The simplex method solves linear programs quickly in practice, yet for most pivot rules there are inputs on which it takes exponentially many steps (Klee and Minty, 1972). Smoothed analysis, introduced by Spielman and Teng (JACM 2004), explains the gap: it measures the expected running time when every constraint row of a worst-case input is perturbed by a small random amount of size σ\sigmaσ. For the shadow vertex pivot rule, the running time is controlled by a purely geometric quantity, the number of edges of a random polygon, and the smoothed complexity of the method is essentially an upper bound on that number.

Timeline (bounds on the expected shadow size of smoothed unit LPs, as surveyed in §1.1 of the paper). Borgwardt (1987) proved Θ(d1.5log⁡n)\Theta(d^{1.5}\sqrt{\log n})Θ(d1.5logn​) for rows drawn from a centered Gaussian, asymptotically as n→∞n\to\inftyn→∞; this is the case aˉi=0\bar a_i=0aˉi​=0 of the model below. Spielman and Teng (2004) gave the first smoothed bound, O(d3nσ−6+d6nlog⁡3n)O(d^3n\sigma^{-6}+d^6n\log^3 n)O(d3nσ−6+d6nlog3n). Deshpande and Spielman (FOCS 2005) improved the dependence on σ\sigmaσ to O(dn2log⁡n σ−2+d2n2log⁡2n)O(dn^2\log n\,\sigma^{-2}+d^2n^2\log^2 n)O(dn2lognσ−2+d2n2log2n). Vershynin (SIAM J. Comput. 2009) reduced the dependence on nnn to polylogarithmic, O(d3σ−4+d5log⁡2n)O(d^3\sigma^{-4}+d^5\log^2 n)O(d3σ−4+d5log2n). Dadush and Huiberts (arXiv:1711.05667, STOC 2018, SIAM J. Comput. 2020) proved O(d2log⁡n σ−2+d2.5log⁡n σ−1+d2.5log⁡1.5n)O(d^2\sqrt{\log n}\,\sigma^{-2}+d^{2.5}\log n\,\sigma^{-1}+d^{2.5}\log^{1.5}n)O(d2logn​σ−2+d2.5lognσ−1+d2.5log1.5n) for Gaussian perturbations by a simpler argument, which also gives bounds for Laplace perturbations.

Setting

Fix dimensions n≥d≥3n\ge d\ge3n≥d≥3 and a shadow plane, a two-dimensional linear subspace W⊆RdW\subseteq\mathbb R^dW⊆Rd, chosen independently of the randomness. The constraint vectors a1,…,an∈Rda_1,\dots,a_n\in\mathbb R^da1​,…,an​∈Rd are independent, and ai∼Nd(aˉi,σ)a_i\sim N_d(\bar a_i,\sigma)ai​∼Nd​(aˉi​,σ) is Gaussian with center aˉi\bar a_iaˉi​, ∥aˉi∥≤1\|\bar a_i\|\le1∥aˉi​∥≤1, and standard deviation σ>0\sigma>0σ>0 in every coordinate, i.e. with density (2πσ2)−d/2e−∥x−aˉi∥2/(2σ2)(2\pi\sigma^2)^{-d/2}e^{-\|x-\bar a_i\|^2/(2\sigma^2)}(2πσ2)−d/2e−∥x−aˉi​∥2/(2σ2).

Let Q=conv⁡(a1,…,an)Q=\operatorname{conv}(a_1,\dots,a_n)Q=conv(a1​,…,an​). The shadow polygon is Q∩WQ\cap WQ∩W. An edge of a convex set KKK is a segment [u,v][u,v][u,v], u≠vu\ne vu=v, which is an extreme subset of KKK; ∣edges⁡(K)∣|\operatorname{edges}(K)|∣edges(K)∣ is the number of edges. The number of pivots of the shadow vertex method on the unit LP {x:Ax≤1}\{x:Ax\le\mathbf1\}{x:Ax≤1} between two objectives spanning WWW is at most ∣edges⁡(Q∩W)∣|\operatorname{edges}(Q\cap W)|∣edges(Q∩W)∣ (the paper's Lemma 11 and Theorem 12).

The proof passes through general row distributions with density μ\muμ and mean yyy, described by four parameters: the log-Lipschitz constant LLL (μ(x)≤eL∥x−x′∥μ(x′)\mu(x)\le e^{L\|x-x'\|}\mu(x')μ(x)≤eL∥x−x′∥μ(x′)); the line variance τ2\tau^2τ2 (the least variance of μ\muμ restricted to a line); the nnn-th deviation rnr_nrn​ (the least rrr with ∫r∞Pr⁡[∣(X−y)Tθ∣≥t] dt≤r/n\int_r^\infty\Pr[|(X-y)^\mathsf T\theta|\ge t]\,dt\le r/n∫r∞​Pr[∣(X−y)Tθ∣≥t]dt≤r/n for all unit θ\thetaθ); and the cutoff radius Rn,dR_{n,d}Rn,d​ (the least RRR with Pr⁡[∥X−y∥≥R]≤1/(d(nd))\Pr[\|X-y\|\ge R]\le 1/(d\binom nd)Pr[∥X−y∥≥R]≤1/(d(dn​))). The Gaussian is not log-Lipschitz; the Laplace–Gaussian distribution LGd(aˉ,σ,r)LG_d(\bar a,\sigma,r)LGd​(aˉ,σ,r), whose density equals the Gaussian one inside the ball of radius rσr\sigmarσ around aˉ\bar aaˉ and decays like e−∥x−aˉ∥r/σe^{-\|x-\bar a\|r/\sigma}e−∥x−aˉ∥r/σ outside, replaces it.

Formalization targets

Goal: Theorem 13 with explicit constants

E[∣edges⁡(conv⁡(a1,…,an)∩W)∣]≤3+128πe2d2log⁡nσ2(1+4σdlog⁡n)(1+16σlog⁡n).\mathbb E\big[|\operatorname{edges}(\operatorname{conv}(a_1,\dots,a_n)\cap W)|\big]\le 3+\frac{128\pi e^2 d^2\sqrt{\log n}}{\sigma^2}\big(1+4\sigma\sqrt{d\log n}\big)\big(1+16\sigma\sqrt{\log n}\big).E[∣edges(conv(a1​,…,an​)∩W)∣]≤3+σ2128πe2d2logn​​(1+4σdlogn​)(1+16σlogn​).

The paper states O(d2log⁡n σ−2+d2.5log⁡n σ−1+d2.5log⁡1.5n)O(d^2\sqrt{\log n}\,\sigma^{-2}+d^{2.5}\log n\,\sigma^{-1}+d^{2.5}\log^{1.5}n)O(d2logn​σ−2+d2.5lognσ−1+d2.5log1.5n); the constant above is the one its proof produces (Theorem 22's proof, Lemma 45, Lemma 46).

Intermediate targets (milestones)

  • the parametrized shadow bound (Theorem 22), E∣edges⁡∣≤2+8πe2d1.5(L/τ)(1+Rn,d)(1+4rn)\mathbb E|\operatorname{edges}|\le 2+8\pi e^2d^{1.5}(L/\tau)(1+R_{n,d})(1+4r_n)E∣edges∣≤2+8πe2d1.5(L/τ)(1+Rn,d​)(1+4rn​);
  • its ingredients: the edge-counting reduction (Lemma 25), the perimeter bound 2π(1+4rn)2\pi(1+4r_n)2π(1+4rn​) (Lemmas 19, 26), the conditioning on bounded diameter (Lemma 29), the chord combination calculus (Lemmas 35, 36), and the two expected-length bounds (Lemmas 39, 40, 41), together with the trade-off LR(1/2)≥d/3LR(1/2)\ge d/3LR(1/2)≥d/3 (Lemma 21);
  • the Gaussian specialisation: Laplace–Gaussian tails (Lemma 44), its parameters (Lemma 45), and the comparison with the Gaussian (Lemma 46).

Significance

The bound gives the best known smoothed complexity of a simplex method, with only log⁡n\sqrt{\log n}logn​ dependence on the number of constraints. Section 4 of the paper turns it into a complete two-phase shadow vertex algorithm with O(d2log⁡n σ−2+d3log⁡1.5n)O(d^2\sqrt{\log n}\,\sigma^{-2}+d^3\log^{1.5}n)O(d2logn​σ−2+d3log1.5n) expected pivots. The parametrized Theorem 22 applies to any perturbation family with bounded parameters, so it also yields shadow bounds for Laplace and other noise models.

The result is proved; it has not been machine-checked. A formalization adds a verified chain from four distributional parameters to a polygon edge count. The intermediate statements have independent value: an expected-perimeter bound for random polygons, the deterministic chord-length identity for simplices, and tail estimates for the Laplace–Gaussian distribution.

Difficulty

The expected number of edges is a sum, over all (nd)\binom nd(dn​) index sets, of the probability that their simplex meets WWW in an edge; there are far too many terms for per-set estimates to give a bound polylogarithmic in nnn. The paper's route (inspired by Kelner and Spielman) instead compares the expected perimeter with the expected length of an edge, and the hard part is a lower bound on the expected length of an edge conditioned on it appearing. That conditioning is on a probability-zero configuration (the simplex lying in a fixed hyperplane), and its analysis needs Blaschke's change of variables, the shape decomposition of the simplex, and log-Lipschitz shifts of densities. On the Gaussian side, the density is not log-Lipschitz, which forces the Laplace–Gaussian detour and a comparison of edge counts under two different laws.

Formalization scope

Rd\mathbb R^dRd is EuclideanSpace ℝ (Fin d), [n][n][n] is Fin n, log⁡\loglog is the natural logarithm. The Gaussian is the published SmoothedSimplex.Shadow.gaussian, the edge relation is the published Hirsch.Adj, and the rows' joint law is Measure.pi. Edges are segments counted once; the perimeter is the sum of edge lengths. Expectations are lower Lebesgue integrals in [0,∞][0,\infty][0,∞], and every edge-count bound also asserts almost-everywhere measurability of the count, so the integral is a genuine expectation. Conditional expectations are stated multiplied out (no division by a probability), and the parameters of Definitions 15–18 are upper-bound predicates (lower bound for the line variance), which is how every statement of the paper uses them.

Hypotheses added relative to the page, each implicit there: σ>0\sigma>0σ>0; L,τ>0L,\tau>0L,τ>0 and R,r≥0R,r\ge0R,r≥0 in Theorem 22; positivity of log-Lipschitz densities; the standing n≥d≥3n\ge d\ge3n≥d≥3 of §3 in Lemma 44. Lemmas 39 and 41 are stated on the explicit conditional densities that the paper derives in Lemma 37, instead of through regular conditional distributions; Lemma 39 takes the conclusion d/3≤LRd/3\le LRd/3≤LR of Lemma 21 as a hypothesis, as its proof uses it. Two printed slips are corrected: Lemma 46's formula is stated for conv⁡(a1,…,an)∩W\operatorname{conv}(a_1,\dots,a_n)\cap Wconv(a1​,…,an​)∩W, as its sentence and proof have it, and Lemma 35 refers to Definition 33 (not 34).

The goal mentions only Gaussian rows, WWW, and the edge count of conv⁡(a)∩W\operatorname{conv}(a)\cap Wconv(a)∩W. It cannot be trivialized by an unsatisfiable parameter hypothesis or a bound on edge lengths, since it has neither; and it counts edges of the polygon, not of the polytope conv⁡(a)\operatorname{conv}(a)conv(a).

A complete development needs: Gaussian and Laplace–Gaussian tail bounds; measurability of the edge count of a random polygon; the perimeter monotonicity of convex sets; Blaschke's change of variables (Theorem 7 of the paper, quoted from Blaschke 1935), which Mathlib does not have; and the regular conditioning of Lemmas 32, 37 and 38. The Blaschke formula, the perimeter facts for convex polygons, and the tail bounds are reusable well beyond this mission. Contributions to any milestone, or to these supporting results as separate theorems, are welcome.

Selected references

  • D. Dadush, S. Huiberts, A Friendly Smoothed Analysis of the Simplex Method, SIAM J. Comput. 49(5), 2020 (STOC 2018); preprint arXiv:1711.05667v4, 2019. https://arxiv.org/abs/1711.05667
  • D. A. Spielman, S.-H. Teng, Smoothed analysis of algorithms: Why the simplex algorithm usually takes polynomial time, J. ACM 51(3), 2004. https://doi.org/10.1145/990308.990310
  • R. Vershynin, Beyond Hirsch Conjecture: Walks on Random Polytopes and Smoothed Complexity of the Simplex Method, SIAM J. Comput. 39(2), 2009. https://doi.org/10.1137/070683386
  • A. Deshpande, D. A. Spielman, Improved smoothed analysis of the shadow vertex simplex method, FOCS 2005 (cited as [DS05] in the paper).
  • V. Klee, G. J. Minty, How good is the simplex algorithm?, in Inequalities III, Academic Press, 1972 (cited as [KM70] in the paper).
20 thms3 active usersReviewed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

The Matroids with the Max-Flow Min-Cut Property: Binary Mengerian Clutters and the Q6 MinorResearch Paper

Motivation

Several classical theorems of combinatorial optimization say that a family of sets arising from a graph packs: the maximum number of pairwise disjoint members equals the minimum size of a set meeting every member. König's theorem on bipartite graphs, Menger's theorem, the max-flow min-cut theorem of Ford and Fulkerson, Edmonds' branching theorem and the Lucchesi–Younger theorem all have this form (Seymour 1977, (1.1)–(1.5)). In the capacitated version (weights on elements, integral flows) the max-flow min-cut theorem says more: the packing property survives every deletion and replication of elements. Clutters with this stronger property are called Mengerian. For each 000–111 matrix they are exactly the systems whose covering linear program and its dual have integral optima for every integral weight vector, which is why the notion matters to integer programming and polyhedral combinatorics.

Seymour's paper answers the question for the class of binary clutters, the clutters coming from binary matroids, which includes path collections, cut collections and odd-circuit collections of graphs. Earlier, Gallai's theorem implied that ports of regular matroids are Mengerian (Seymour 1977, p. 200); combined with Tutte's excluded-minor characterization of regular matroids, this showed that binary clutters without Q6Q_6Q6​ or b(Q6)b(Q_6)b(Q6​) minors are Mengerian. Seymour shows that the second excluded minor is unnecessary, so a single small clutter is the only obstruction.

Setting

All sets are finite. A clutter L\mathbf LL is a finite collection of finite sets, no member of which is contained in another; ∅\emptyset∅ and {∅}\{\emptyset\}{∅} are the two trivial clutters. Its ground set is E(L)=⋃A∈LAE(\mathbf L)=\bigcup_{A\in\mathbf L}AE(L)=⋃A∈L​A. The blocker b(L)b(\mathbf L)b(L) is the collection of minimal subsets of E(L)E(\mathbf L)E(L) that meet every member of L\mathbf LL, and τ(L)\tau(\mathbf L)τ(L) is the minimum cardinality of a member of b(L)b(\mathbf L)b(L).

L\mathbf LL is Mengerian if L={∅}\mathbf L=\{\emptyset\}L={∅}, or if for every weight map w:E(L)→Z+w:E(\mathbf L)\to\mathbb Z^+w:E(L)→Z+ there is an integral packing q:L→Z+q:\mathbf L\to\mathbb Z^+q:L→Z+ with ∑A∋xq(A)≤w(x)\sum_{A\ni x}q(A)\le w(x)∑A∋x​q(A)≤w(x) for each x∈E(L)x\in E(\mathbf L)x∈E(L) and

∑A∈Lq(A)=min⁡B∈b(L)∑x∈Bw(x).\sum_{A\in\mathbf L}q(A)=\min_{B\in b(\mathbf L)}\sum_{x\in B}w(x).A∈L∑​q(A)=B∈b(L)min​x∈B∑​w(x).

For a set ZZZ, the deletion is L∖Z={A∈L:A∩Z=∅}\mathbf L\setminus Z=\{A\in\mathbf L:A\cap Z=\emptyset\}L∖Z={A∈L:A∩Z=∅} and the contraction L/Z\mathbf L/ZL/Z is the collection of minimal members of {A−Z:A∈L}\{A-Z:A\in\mathbf L\}{A−Z:A∈L} (minimal, not minimal nonempty). A minor of L\mathbf LL is any clutter obtained by a finite sequence of deletions and contractions.

A clutter is binary if ∣A∩B∣|A\cap B|∣A∩B∣ is odd for all A∈LA\in\mathbf LA∈L and B∈b(L)B\in b(\mathbf L)B∈b(L); this is condition (3.2)(ii) of the paper, which is equivalent to being a port of a binary matroid. Finally

Q6={{1,3,5},{1,4,6},{2,3,6},{2,4,5}},Q_6=\{\{1,3,5\},\{1,4,6\},\{2,3,6\},\{2,4,5\}\},Q6​={{1,3,5},{1,4,6},{2,3,6},{2,4,5}},

the triangles of K4K_4K4​ with its edges labelled 1,…,61,\dots,61,…,6.

For the structure theory, a circuit of a binary clutter is a minimal nonempty C⊆E(L)C\subseteq E(\mathbf L)C⊆E(L) with ∣C∩B∣|C\cap B|∣C∩B∣ even for every B∈b(L)B\in b(\mathbf L)B∈b(L); xxx and yyy are parallel when {x,y}\{x,y\}{x,y} is a circuit, and the point ⟨x⟩\langle x\rangle⟨x⟩ is the parallel class of xxx. With mb(L)={B∈b(L):∣B∣=τ(L)}mb(\mathbf L)=\{B\in b(\mathbf L):|B|=\tau(\mathbf L)\}mb(L)={B∈b(L):∣B∣=τ(L)}, L\mathbf LL is critical if E(mb(L))=E(L)E(mb(\mathbf L))=E(\mathbf L)E(mb(L))=E(L). In a critical binary clutter, x→yx\to yx→y means that every member of mb(L)mb(\mathbf L)mb(L) containing xxx contains yyy while y∉⟨x⟩y\notin\langle x\rangley∈/⟨x⟩, and yyy is initial if no xxx has x→yx\to yx→y. MBC abbreviates "Mengerian binary clutter".

Formalization targets

Goal: Seymour's theorem (p. 209)

For every binary clutter L\mathbf LL,

L is Mengerian  ⟺  L has no minor isomorphic to Q6.\mathbf L\ \text{is Mengerian}\iff \mathbf L\ \text{has no minor isomorphic to } Q_6 .L is Mengerian⟺L has no minor isomorphic to Q6​.

Milestones

In the order the proof uses them:

  • (2.3) Every minor of a Mengerian clutter is Mengerian.
  • Section 1, p. 193. Q6Q_6Q6​ is not Mengerian. With (2.3) this is the "only if" direction.
  • (3.6)(i) Circuits of a binary clutter have at least two elements.
  • (3.6)(iii) If Z⊆E(L)Z\subseteq E(\mathbf L)Z⊆E(L) meets every member of b(L)b(\mathbf L)b(L) evenly, then ZZZ is a disjoint union of circuits. If it meets every member oddly, then ZZZ is a disjoint union of circuits and one member of L\mathbf LL.
  • (4.3) In a critical MBC, x→yx\to yx→y implies y↛xy\not\to xy→x.
  • (4.4) In a critical MBC, x→yx\to yx→y gives a circuit C∋x,yC\ni x,yC∋x,y with ∣C∣≥3|C|\ge3∣C∣≥3, z→yz\to yz→y for z∈C−{y}z\in C-\{y\}z∈C−{y}, and ∣B−(C−{y})∣≥τ(L)−1|B-(C-\{y\})|\ge\tau(\mathbf L)-1∣B−(C−{y})∣≥τ(L)−1 for B∈b(L)B\in b(\mathbf L)B∈b(L).
  • (4.5) In a critical MBC, a non-initial xxx lies on a circuit CCC with ∣C∣≥3|C|\ge3∣C∣≥3 whose other elements are initial and point to xxx, and ∣B∩(C−{x})∣≤1|B\cap(C-\{x\})|\le1∣B∩(C−{x})∣≤1 for B∈mb(L)B\in mb(\mathbf L)B∈mb(L).
  • (4.6) A nontrivial critical MBC has a member consisting of initial elements.
  • (5.1) A binary clutter with six elements x1,y1,x2,y2,x3,y3x_1,y_1,x_2,y_2,x_3,y_3x1​,y1​,x2​,y2​,x3​,y3​ whose only circuits are the three sets {xi,yi,xj,yj}\{x_i,y_i,x_j,y_j\}{xi​,yi​,xj​,yj​}, together with a member AAA that meets each pair {xi,yi}\{x_i,y_i\}{xi​,yi​} once and satisfies a minimality condition, has a Q6Q_6Q6​ minor.

Significance

The theorem is an excluded-minor characterization of the max-flow min-cut property. For binary clutters it decides exactly when the covering system Mx≥1Mx\ge1Mx≥1, x≥0x\ge0x≥0 has integral optimal primal and dual solutions for every integral cost vector, and it identifies Q6Q_6Q6​ as the single obstruction. Its matroid form (the Corollary, p. 220) states that for a matroid MMM the port Ω(M)\Omega(M)Ω(M) is Mengerian for every element Ω\OmegaΩ if and only if MMM is binary and has no F7∗F_7^*F7∗​ minor. Consequences discussed in the paper include the two-commodity setting of (3.5): the clutter of minimal edge sets joining sss to s′s's′ or ttt to t′t't′ is Mengerian exactly when the graph does not reduce to the configuration of its Figure 2. The theorem is also a basis for later work on ideal and Mengerian clutters, such as Cornuéjols' book Combinatorial Optimization: Packing and Covering (SIAM, 2001).

The result has been proved since 1977. To our knowledge no machine-checked proof exists. Mathlib at the pinned revision has matroids but no clutters, blockers, clutter minors, or matroids representable over GF(2). This mission builds that layer. The minor-closedness of the Mengerian property (2.3), the parity decomposition (3.6)(iii) and the structure theory of critical Mengerian binary clutters (4.3)–(4.6) are results in their own right and are useful beyond the main theorem.

Difficulty

The "only if" direction is short: minors of Mengerian clutters are Mengerian, and Q6Q_6Q6​ fails with unit weights. The "if" direction is, in the author's words, "very much harder". A natural first idea is to show directly, by LP duality, that the covering polyhedron of a Q6Q_6Q6​-free binary clutter is integral. This does not work: integrality of the polyhedron is the weak max-flow min-cut property, and Q6Q_6Q6​ itself has that property while not being Mengerian, so no argument that sees only fractional optima can separate the two cases. The paper's proof works with a minimal counterexample and derives the Q6Q_6Q6​ minor from the structure of critical Mengerian binary clutters in Section 4; its intermediate claims (5.2)–(5.39) hold only for that minimal counterexample, which is why they are not milestones here.

Formalization scope

Elements form a type α with decidable equality. A clutter is L : Finset (Finset α) with the clutter axiom as a hypothesis, E(L)E(\mathbf L)E(L) is the union of members, and deletion and contraction take an arbitrary finite set ZZZ. Weights www and packings qqq are N\mathbb NN-valued. The minimum in the Mengerian condition is expressed as "some B∈b(L)B\in b(\mathbf L)B∈b(L) of least weight has weight equal to the packing value", never as an infimum. {∅}\{\emptyset\}{∅} is Mengerian by the paper's convention, and τ({∅})\tau(\{\emptyset\})τ({∅}), which the paper leaves undefined, has the junk value 000 in Lean; every item reading τ\tauτ excludes {∅}\{\emptyset\}{∅} or is vacuous there. "Minor" is the reflexive–transitive closure of single deletions and contractions. "Has a Q6Q_6Q6​ minor" means that some minor equals the image of Q6Q_6Q6​ (on Fin 6, with the paper's labels shifted down by one) under an injective relabelling Fin 6 ↪ α. Binary clutters are defined by (3.2)(ii); the paper defines them as ports of binary matroids and quotes (3.2) [15, 28] for the equivalence, and Mathlib has no GF(2)-representable matroids at this revision. Circuits are defined intrinsically, which makes (3.6)(ii) hold by definition.

Four readings would change the theorem and are ruled out: real-valued packings qqq (the weak max-flow min-cut property, which Q6Q_6Q6​ has, so the goal would be false), a non-minimal blocker or one not restricted to E(L)E(\mathbf L)E(L), dropping the {∅}\{\emptyset\}{∅} exception, and reading "Q6Q_6Q6​ minor" as literal equality instead of isomorphism.

A complete development needs the blocker calculus ((2.1), (2.2), cited from [28] with proofs omitted), the parity theory of binary clutters, and the replication operation Lw\mathbf L_wLw​. The clutter layer (blocker, minors, Mengerian, binary, circuits) is reusable for later work on ideal clutters, Lehman's theorem and the Corollary's matroid form. Proofs of any milestone, of the helper facts b(b(L))=Lb(b(\mathbf L))=\mathbf Lb(b(L))=L, (2.1) and (2.2), and of the equivalences in (3.2) are welcome.

Selected references

  • P. D. Seymour, The Matroids with the Max-Flow Min-Cut Property, J. Combin. Theory Ser. B 23 (1977) 189–222. https://doi.org/10.1016/0095-8956(77)90031-4
  • J. Edmonds and D. R. Fulkerson, Bottleneck extrema, J. Combin. Theory 8 (1970) 299–306. https://doi.org/10.1016/S0021-9800(70)80083-7
  • L. R. Ford and D. R. Fulkerson, Maximal flow through a network, Canad. J. Math. 8 (1956) 399–404. https://doi.org/10.4153/CJM-1956-045-5
  • G. Cornuéjols, Combinatorial Optimization: Packing and Covering, CBMS-NSF Regional Conf. Ser. in Appl. Math. 74, SIAM, 2001. https://doi.org/10.1137/1.9780898717105
30 thms3 active usersReviewed
Operations ResearchOptimization·Captain: Shuze Chen

Disjunctive Programming XII: Intersection Cuts, Generalized Intersection Cuts, and Lift-and-Project CutsTextbook

Motivation

Intersection cuts (Balas, 1971) are the founding construction of cutting-plane theory for mixed 0-1 and mixed-integer programs: given a fractional LP solution xˉ\bar xxˉ and a convex region SSS around it known to contain no feasible integer point, the hyperplane through the points where SSS's boundary meets the extreme rays of the LP cone at xˉ\bar xxˉ cuts off xˉ\bar xxˉ without cutting off any feasible solution. What makes intersection cuts foundational rather than merely one technique among many is a completeness question: do intersection cuts, iterated over every choice of cutting region, exhaust the strongest possible cuts — the facets of the integer hull itself — or only some weaker subclass? Balas answered this affirmatively for standard intersection cuts (those derived from convex sets free of feasible integer points, as originally defined), while a narrower, more recently popular variant restricted to lattice-free sets provably falls short of this completeness (E. Balas, Intersection Cuts — A New Type of Cutting Planes for Integer Programming, Operations Research 19 (1971), 19–39, https://doi.org/10.1287/opre.19.1.19). This mission formalizes that completeness theorem, together with a companion pair of results (Balas and Kis, 2016) pinning down exactly when a lift-and-project cut — a strictly more general cutting-plane construction from an arbitrary disjunction — coincides with a standard intersection cut, and what happens when it provably does not (E. Balas and T. Kis, On the relationship between standard intersection cuts, lift-and-project cuts, and generalized intersection cuts, Mathematical Programming A 160 (2016), 85–114, https://doi.org/10.1007/s10107-015-0975-1).

Setting

Fix a finite index set ι\iotaι (structural and surplus variables of an LP relaxation together), a basic index set I⊆ιI \subseteq \iotaI⊆ι and a nonbasic (cobasis) set JJJ, with optimal simplex-tableau coefficients aˉij\bar a_{ij}aˉij​ for i∈Ii \in Ii∈I, j∈Jj \in Jj∈J. The extreme ray of the LP cone C(J)C(J)C(J) at a basic solution xˉ\bar xxˉ associated with j∈Jj \in Jj∈J has direction rjr^jrj with rij=−aˉijr^j_i = -\bar a_{ij}rij​=−aˉij​ for i∈Ii \in Ii∈I, rjj=1r^j_j = 1rjj​=1, and rij=0r^j_i = 0rij​=0 otherwise; C(J)C(J)C(J) itself is the cone with apex xˉ\bar xxˉ generated by these n=∣J∣n = |J|n=∣J∣ rays. A convex set SSS is PIP_IPI​-free at xˉ\bar xxˉ if xˉ\bar xxˉ lies in int S\mathrm{int}\, SintS and int S\mathrm{int}\, SintS contains no point of the mixed-integer feasible set PIP_IPI​. The standard intersection cut (SIC) derived from such an SSS is ∑j∈J1λjxj≥1\sum_{j\in J} \tfrac{1}{\lambda_j} x_j \ge 1∑j∈J​λj​1​xj​≥1, where λj\lambda_jλj​ is the largest t≥0t \ge 0t≥0 with xˉ−trj∈S\bar x - t r^j \in Sxˉ−trj∈S.

The corner polyhedron corner(J)\mathrm{corner}(J)corner(J) is the convex hull of the integer points contained in C(J)C(J)C(J); it satisfies C(J)⊃corner(J)⊃conv(PI)C(J) \supset \mathrm{corner}(J) \supset \mathrm{conv}(P_I)C(J)⊃corner(J)⊃conv(PI​). A set FFF is a facet of a polyhedron QQQ if it is a proper extreme subset of QQQ of affine dimension exactly dim⁡(Q)−1\dim(Q) - 1dim(Q)−1.

For a lift-and-project cut, fix P:={x:A~x≥b~}P := \{x : \tilde A x \ge \tilde b\}P:={x:A~x≥b~} and a family of inequalities dtx≥d0td^t x \ge d^t_0dtx≥d0t​, t∈Tt \in Tt∈T, presenting a PIP_IPI​-free polyhedron S:={x:dtx≤d0t, t∈T}S := \{x : d^t x \le d^t_0,\ t\in T\}S:={x:dtx≤d0t​, t∈T}. The associated cut-generating LP (CGLP) constraint set (11.6) is

α−utA~−u0tdt=0,−β+utb~+u0td0t=0 (t∈T),∑t∈T(ute+u0t)=1,ut,u0t≥0,\alpha - u^t \tilde A - u^t_0 d^t = 0, \qquad -\beta + u^t \tilde b + u^t_0 d^t_0 = 0 \ (t\in T), \qquad \textstyle\sum_{t\in T}(u^t e + u^t_0) = 1, \qquad u^t, u^t_0 \ge 0,α−utA~−u0t​dt=0,−β+utb~+u0t​d0t​=0 (t∈T),∑t∈T​(ute+u0t​)=1,ut,u0t​≥0,

whose feasible solutions (α,β,{ut,u0t})(\alpha,\beta,\{u^t,u^t_0\})(α,β,{ut,u0t​}) correspond to valid lift-and-project (L&P) cuts αx≥β\alpha x \ge \betaαx≥β for the disjunction built from PPP and the terms dtx≥d0td^t x \ge d^t_0dtx≥d0t​. An inequality γ1x≥γ01\gamma^1 x \ge \gamma^1_0γ1x≥γ01​ dominates γ2x≥γ02\gamma^2 x \ge \gamma^2_0γ2x≥γ02​ on PPP if every x∈Px \in Px∈P satisfying the first also satisfies the second.

Formalization targets

Theorem 11.2 (goal). Every facet FFF of conv(PI)\mathrm{conv}(P_I)conv(PI​), defined by φx≥φ0\varphi x \ge \varphi_0φx≥φ0​ and cutting off some vertex vvv of PPP (i.e. φv<φ0\varphi v < \varphi_0φv<φ0​), is realized exactly by the standard intersection cut derived at vvv from T:={x:φx≤φ0}T := \{x : \varphi x \le \varphi_0\}T:={x:φx≤φ0​}:

T is PI-free at v,{x:1≤∑j∈J1λjxj}={x:φ0≤φx}.T \text{ is } P_I\text{-free at } v, \qquad \Big\{x : 1 \le \textstyle\sum_{j\in J} \tfrac{1}{\lambda_j} x_j\Big\} = \{x : \varphi_0 \le \varphi x\}.T is PI​-free at v,{x:1≤∑j∈J​λj​1​xj​}={x:φ0​≤φx}.

Corollary 11.3. Every vertex of a corner polyhedron not already in conv(PI)\mathrm{conv}(P_I)conv(PI​) is cut off by some standard intersection cut — the same completeness claim restated at the level of individual excluded vertices rather than facets.

Theorem 11.9. A sufficient condition for an L&P cut to reduce to a standard intersection cut: if a basic feasible CGLP solution's multipliers utu^tut are all supported on a single common nonsingular cobasis ι\iotaι, then

{x:β≤αx}={x:1≤∑jπj sj(x)}\{x : \beta \le \alpha x\} = \{x : 1 \le \textstyle\sum_j \pi_j\, s_j(x)\}{x:β≤αx}={x:1≤∑j​πj​sj​(x)}

for the intersection cut with coefficients πj:=max⁡tπjt\pi_j := \max_{t} \pi^t_jπj​:=maxt​πjt​, πjt:=dt(−aˉj)/(d0t−dtaˉ0)\pi^t_j := d^t(-\bar a_j)/(d^t_0 - d^t \bar a_0)πjt​:=dt(−aˉj​)/(d0t​−dtaˉ0​), expressed via the surplus values sjs_jsj​ at ι\iotaι's rows.

Theorem 11.11. When Theorem 11.9's condition fails — even after every positive rescaling of the solution — no intersection cut from SSS is equivalent to the L&P cut; and when the solution additionally uniquely minimizes the CGLP objective, the L&P cut is strictly better than, and dominated by none of, every intersection cut from SSS.

The targets move from the completeness statement itself (11.2, its vertex-level restatement 11.3) to the mechanism explaining why completeness holds in general: a sufficient condition for literal coincidence (11.9), and a proof that failure of that condition is never fatal to completeness because the L&P cut remains at least as strong, in a precise domination sense (11.11).

Significance

Theorem 11.2 is the theoretical justification for standard intersection cuts as a complete cutting plane paradigm: no facet of the integer hull is out of reach of some choice of PIP_IPI​-free cutting region, in sharp contrast to the restricted (lattice-free) variant that dominates the modern multi-row cut literature but is provably incomplete in this sense. Theorems 11.9 and 11.11 locate lift-and-project cuts precisely relative to this complete family: L&P cuts specialize exactly to intersection cuts under an explicit, checkable structural condition on the CGLP solution, and strictly dominate the intersection-cut family whenever that condition cannot be met — which is what makes lift-and-project the strictly more general (and, on general non-split disjunctions, strictly more powerful) construction.

Both directions are proved in the source (Balas 1971 for Theorem 11.2; Balas and Kis 2016 for Theorems 11.9 and 11.11) but have no counterpart on this platform: nothing existing treats intersection cuts, corner polyhedra, cut-generating LPs, or the correspondence between these two cutting-plane families. This mission produces the first Lean statements of all four.

Difficulty

The obvious shortcut for Theorem 11.2 is to treat "cuts off a vertex" and "is PIP_IPI​-free" as producing merely some valid cut, and stop there — Theorem 1.1 already guarantees that much. The actual content is the equality: the specific intersection cut constructed from the halfspace TTT does not just happen to be valid, it reconstructs φ\varphiφ itself, coefficient for coefficient, because TTT is a single hyperplane so every one of the LP cone's nnn extreme rays exits it through the same boundary. Losing sight of this collapses the theorem into a restatement of Theorem 1.1 with no new content.

For Theorem 11.11, the difficulty is that "no intersection cut from SSS is equivalent" must survive scaling: a naive argument might rule out one specific (α,β)(\alpha,\beta)(α,β)-representative satisfying Theorem 11.9's condition while missing that a positive rescaling of the same cut could still satisfy it under a different multiplier vector. The theorem's hypothesis is deliberately built to close this gap by quantifying over every positive scalar and every feasible solution realizing the rescaled pair, not just the given one.

Formalization scope

The ambient space is a generic finite index type ι for Theorem 11.2/Corollary 11.3 (structural and surplus variables together, matching 01-intro-duality's own convention for the intersection- cut apparatus), and Fin n → ℝ for the CGLP-based Theorems 11.9/11.11, matching the series' default. P_I is left as an abstract parameter throughout (never expanded into an explicit integrality predicate on a specific coordinate subset for Theorem 11.2, matching 01-intro- duality's own treatment), except in the corner-polyhedron definitions, where it is made concrete via a coordinate set Nprime since the corollary's statement depends on it directly. "Facet" and "extreme ray" are restated from 02b-polarity's conventions (affine dimension via Module.finrank of vectorSpan; IsExtreme) rather than reinvented, since Chapter 2 already pins these down precisely for this series. "Basic feasible solution" to the CGLP in Theorem 11.9 is captured entirely by the theorem's own submatrix-support condition, not through a separate, independently-derived basicness predicate — the book's own proof uses no other property of basicness, so adding one would be unused decoration, not additional fidelity. Cut equivalence throughout is formalized as exact set equality of the two halfspaces, matching the series' established convention (e.g. 10-split-closure's Theorem 10.1) for what "equivalent cuts" means.

This mission depends on no other chunk's Lean definitions: the intersection-cut apparatus (extremeRay, PIFree) is restated from 01-intro-duality, the facet apparatus (PolyDim, IsFacet) from 02b-polarity, and the tableau apparatus (Ahat, Bhat, Abar, Abar0, SurplusM) from 08-cut-correspondence/09-simplex-tableau/10-split-closure, per the series convention against importing another draft mission's definitions while chunks are drafted concurrently. A trivializing formalization to rule out explicitly: collapsing Theorem 11.2 to "some intersection cut is valid and cuts off vvv" (already implied by Theorem 1.1 alone) rather than the literal set-equality with the facet's own inequality, which is this theorem's actual content.

Selected references

  • E. Balas, Intersection Cuts — A New Type of Cutting Planes for Integer Programming, Operations Research 19 (1971), 19–39. https://doi.org/10.1287/opre.19.1.19
  • E. Balas and T. Kis, On the relationship between standard intersection cuts, lift-and-project cuts, and generalized intersection cuts, Mathematical Programming A 160 (2016), 85–114. https://doi.org/10.1007/s10107-015-0975-1
  • E. Balas and M. Perregaard, Generalized intersection cuts and a new cut generating paradigm, Mathematical Programming A 137 (2013), 19–35. https://doi.org/10.1007/s10107-011-0483-x
  • E. Balas, Disjunctive Programming, Springer, 2018, Chapter 11, §11.1–11.5. https://doi.org/10.1007/978-3-030-00148-3
11 thms3 active users
Operations ResearchTheoretical Computer Science·Captain: mikedeng1

The Design of Competitive Online Algorithms via a Primal-Dual Approach I: The Online Packing-Covering FrameworkTextbook

Motivation

Many online problems — renting vs. buying equipment, routing traffic without knowing future demand, allocating advertising budget as bids arrive — share a common linear-programming shape: a covering (minimization) problem whose constraints appear one at a time, or its dual packing (maximization) problem whose variables appear one at a time, with no ability to revisit past decisions. Buchbinder and Naor's survey [1] recasts the online primal-dual method, originally developed for offline approximation in Section 2 of the same survey (already covered on this platform via the PrimalDualOnline namespace, citing Buchbinder's thesis [2]), as a general recipe for such online problems, unifying earlier ad hoc analyses of the ski-rental problem (Chapter 3) and paving the way for the online set-cover, routing, caching, and ad-auction algorithms formalized elsewhere in this series. This mission covers Chapter 4, "The Basic Approach": the framework itself and its three founding algorithms.

Setting

Fix a finite index set III of primal variables with non-negative cost coefficients cic_ici​, and a finite index set JJJ of covering constraints, revealed one at a time in the order enumerated by JJJ. Each constraint jjj is given by a set S(j)⊆IS(j) \subseteq IS(j)⊆I (the book's simplified setting, in which every non-zero coefficient equals 111 and every right-hand side equals 111; Chapter 14 removes this restriction) and asserts ∑i∈S(j)xi≥1\sum_{i \in S(j)} x_i \ge 1∑i∈S(j)​xi​≥1. An online covering algorithm may only increase the xix_ixi​, never decrease them, and upon a constraint's arrival must eventually make it hold. The online covering problem is to minimize ∑icixi\sum_i c_i x_i∑i​ci​xi​ subject to every revealed constraint, online. Its Lagrangian dual is the online packing problem: a dual variable yjy_jyj​ arrives together with constraint jjj, may only be increased while jjj is being processed, and the objective is to maximize ∑jyj\sum_j y_j∑j​yj​ subject to ∑j∣i∈S(j)yj≤ci\sum_{j \mid i \in S(j)} y_j \le c_i∑j∣i∈S(j)​yj​≤ci​ for every iii — the packing constraint on iii becomes fully known only once every jjj with i∈S(j)i \in S(j)i∈S(j) has arrived, so it, too, is revealed gradually. d:=max⁡j∣S(j)∣d := \max_j |S(j)|d:=maxj​∣S(j)∣, the largest constraint size, is carried as an explicit parameter throughout.

Section 4.2 gives three algorithms solving both problems simultaneously — the same run produces a covering solution xxx and a packing solution yyy — with the same worst-case guarantee but different flavors: Algorithm 1 is a discrete process (each processing round performs a whole number of identical multiplicative-plus-additive updates until its constraint is satisfied); Algorithm 2 is the continuous limit of Algorithm 1 (dual variables increase continuously and xix_ixi​ follows an explicit exponential of the accumulated dual sum); Algorithm 3 replaces the continuous update with one triggered by an approximate complementary-slackness condition, at the cost of a mild dual infeasibility. All three make essential use of the online order: an algorithm that saw the whole instance up front would trivially solve the offline LP.

Formalization targets

Theorem 4.3 (Algorithm 3 — the goal, p. 124):

(∀i, ∑j∣i∈S(j)yj≤ci(1+ln⁡d)) ∧ (∀x′′ feasible, ∑icixi≤2(1+ln⁡d)∑icixi′′) ∧ (∀y′′ feasible, ∑jyj′′≤2∑jyj).\Big(\forall i,\ \textstyle\sum_{j \mid i \in S(j)} y_j \le c_i(1+\ln d)\Big) \ \wedge\ \Big(\forall x''\text{ feasible},\ \textstyle\sum_i c_i x_i \le 2(1+\ln d)\sum_i c_i x''_i\Big) \ \wedge\ \Big(\forall y''\text{ feasible},\ \textstyle\sum_j y''_j \le 2\sum_j y_j\Big).(∀i, ∑j∣i∈S(j)​yj​≤ci​(1+lnd)) ∧ (∀x′′ feasible, ∑i​ci​xi​≤2(1+lnd)∑i​ci​xi′′​) ∧ (∀y′′ feasible, ∑j​yj′′​≤2∑j​yj​).

Theorem 4.1 (Algorithm 1) and Theorem 4.2 (Algorithm 2, p. 118 and p. 121) are the same three-part guarantee for the other two algorithms, with log⁡2(3d+1)\log_2(3d+1)log2​(3d+1) in place of 1+ln⁡d1+\ln d1+lnd for Algorithm 1 (and its packing solution genuinely integral), and with 2ln⁡(1+d)2\ln(1+d)2ln(1+d) in place of both 2(1+ln⁡d)2(1+\ln d)2(1+lnd) and 222 for Algorithm 2 (whose packing solution is exactly feasible, not merely approximately so). The competitive ratios are stated against an arbitrary offline-feasible comparison solution on each side (covering and packing) rather than against an unconstructed LP optimum — the standard weak-duality reformulation of "ccc-competitive", and the one the book's own proofs (which invoke weak duality directly, never LP optimality) actually establish.

Significance

The framework converts three qualitatively different design intuitions — the ski-rental-style discrete doubling, the continuous primal-dual differential equation, and complementary slackness — into three algorithms with an identical asymptotic guarantee, Θ(log⁡d)\Theta(\log d)Θ(logd), matching the Ω(log⁡d)\Omega(\log d)Ω(logd) (packing) and Ω(log⁡n)\Omega(\log n)Ω(logn) (covering) lower bounds the book proves in Section 4.3 (Lemmas 4.5-4.6, not part of this mission). This is the load-bearing substrate for the rest of the survey: Chapter 5's online set-cover algorithm, Chapter 13's bounded-allocation problem, and Chapter 14's general packing-covering constraints all restate this chapter's framework locally rather than re-deriving it, and are formalized as separate missions in this series. Formalizing it here, once, with the exact constants each proof establishes, is what lets those missions cite a single faithful statement instead of three independently-drifting restatements. No formal development of this framework was found on the platform as of 2026-09-20 (searches below); this mission is the first.

Difficulty

The central obstacle is not the algebra of any single algorithm's proof — each is a short, self-contained argument — but stating the guarantee for an online process using only its final output. An algorithm is characterized here by the closed-form relation its update rule establishes between the accumulated dual sum and the primal value (e.g., Algorithm 3's xi=min⁡(1,d−1exp⁡(di/ci−1))x_i = \min(1, d^{-1}\exp(d_i/c_i - 1))xi​=min(1,d−1exp(di​/ci​−1)) once activated, 000 before), together with primal feasibility as the hypothesis that a run has completed; a formalization that instead handed the algorithm the whole instance in advance, or dropped primal feasibility as a hypothesis, would either trivialize the online promise or make the stated bound simply false. A second difficulty specific to this formalization: Theorem 4.3's own proof bounds the primal cost by splitting it into a piece controlled by the final-state complementary-slackness conditions (immediate from the closed form and the ddd-bound) and a piece controlled by a derivative/telescoping argument over the continuous accumulation process itself — the latter is a genuinely dynamic fact about the trajectory, not just its endpoint, and is recorded as a documented simplification below rather than folded into the hypotheses, since the goal is a faithful statement, not a proof.

Formalization scope

CoveringInstance I J bundles S : J → Finset I, c : I → ℝ, and d : ℝ with 0 < d and ∀ j, (S j).card ≤ d as explicit hypotheses (never derived as d := ⨆ j, (S j).card, matching the book's own presentation and avoiding a vacuous formalization in which d is chosen after the fact to make the bound trivial). dualSum inst y i := ∑_{j \mid i \in S(j)} y_j. Each algorithm's output is a noncomputable def from the accumulated dual data to ℝ (alg1X, alg2X, alg3X), so that "the algorithm's output" is genuinely a function of its dual trajectory rather than an independently-constrained free variable — ruling out the trivializing formalization in which xxx and yyy are unrelated variables merely required to satisfy the conclusion's own inequalities. Reals throughout (ℝ, not ℝ≥0 or ENNReal); Finset.filter realizes "jjj such that i∈S(j)i \in S(j)i∈S(j)"; Real.logb 2 and Real.log (natural log) match the book's own log₂ and ln. Reusable beyond this mission: CoveringInstance, dualSum, and the weak-duality-style "competitive against any feasible comparison solution" pattern, which 05-online-set-cover, 13-bounded-allocation, and 14-general-packing-covering are expected to restate locally (per this series' own rule against cross-draft imports between concurrent missions) rather than import directly. Welcome contributions: completing any of the three sorrys, and formalizing the Section 4.3 lower bounds (Lemmas 4.5-4.6) as a follow-on mission.

Selected references

  • N. Buchbinder, J. Naor. The Design of Competitive Online Algorithms via a Primal-Dual Approach. Foundations and Trends in Theoretical Computer Science, 3(2-3):93-263, 2009. https://doi.org/10.1561/0400000024
  • N. Buchbinder. Designing Competitive Online Algorithms via a Primal-Dual Approach. PhD thesis, Tel Aviv University, 2008. https://www.tau.ac.il/~nivb/download/phd-thsis.pdf
12 thms3 active users
Markov ChainOperations ResearchReinforcement Learning·Captain: mikedeng1

Nonstationary Reinforcement Learning: The Blessing of (More) Optimism I: No Policy Earns More Than the Sum of Per-Step Optimal Gains Plus 4(D_max+1)√((B_r+2D_max B_p)T)Research Paper

Motivation

Reinforcement learning in a changing environment needs a benchmark that remains meaningful when the transition law and rewards vary from round to round. For a stationary Markov decision process (MDP), the optimal long-run average reward is a standard benchmark. In a nonstationary MDP, summing those stationary optima across rounds is convenient, but it need not equal the best expected reward achievable over the whole horizon: today's action changes tomorrow's state. Cheung, Simchi-Levi and Zhu use Proposition 1 to quantify this gap in their analysis of nonstationary reinforcement learning (preprint, pp. 7–8). This mission formalizes that proposition and the explicit estimates in its proof.

The paper develops algorithms for MDPs with drifting rewards and transitions. Its oracle comparison is useful before any algorithm is chosen: it relates a sum of local, stationary benchmarks to the reward of every non-anticipatory policy, including policies that adapt to the observed trajectory. This separates a property of the environment from the performance of a learning rule. The paper was published in Management Science in 2023; this mission follows the numbered statements and pages of the authors' pinned arXiv preprint (Cheung et al., 2020, pp. 6–8).

Setting

A finite nonstationary MDP has a finite state set S\mathcal SS, a nonempty available-action set As\mathcal A_sAs​ at each state sss, and a horizon of TTT rounds. At round ttt, taking action a∈Asa\in\mathcal A_sa∈As​ in state sss gives a stochastic reward with mean rt(s,a)∈[0,1]r_t(s,a)\in[0,1]rt​(s,a)∈[0,1] and moves to a new state according to the probability distribution pt(⋅∣s,a)p_t(\cdot\mid s,a)pt​(⋅∣s,a). A non-anticipatory policy selects an allowed action using the current state and observations from previous rounds. The target concerns expected sums of the mean rewards, so the distributional shape of the reward noise does not enter its formula (preprint, §2.2, pp. 6–7).

The one-step reward variation Br,tB_{r,t}Br,t​ is the largest value of ∣rt+1(s,a)−rt(s,a)∣|r_{t+1}(s,a)-r_t(s,a)|∣rt+1​(s,a)−rt​(s,a)∣ over allowed state–action pairs. The transition variation Bp,tB_{p,t}Bp,t​ is the largest ℓ1\ell_1ℓ1​ distance between the corresponding transition distributions. Their variation budgets are Br=∑t=1T−1Br,tB_r=\sum_{t=1}^{T-1}B_{r,t}Br​=∑t=1T−1​Br,t​ and Bp=∑t=1T−1Bp,tB_p=\sum_{t=1}^{T-1}B_{p,t}Bp​=∑t=1T−1​Bp,t​, exactly as in equation (1). The budgets are computed from the MDP sequence; they are not independent inputs to the theorem (preprint, p. 6, (1)).

For the stationary MDP at round ttt, ρt∗\rho_t^*ρt∗​ is its optimal long-run average reward. The mission represents it as the optimum of the paper's occupancy linear program (15), whose variables are nonnegative state–action occupancies, satisfy flow balance, and sum to one. A diameter DtD_tDt​ bounds the least expected hitting time between any two states under an allowed stationary policy. The paper's Definition 1 includes equal initial and target states, so this includes a return time. Assumption 1 requires a finite diameter at every round; Dmax⁡D_{\max}Dmax​ is a common bound on those diameters (preprint, pp. 7–8, Definition 1 and Assumption 1; p. 33, (15)).

Formalization targets

Proposition 1: the oracle gap

Write B=Br+2Dmax⁡BpB=B_r+2D_{\max}B_pB=Br​+2Dmax​Bp​. For 0<B≤T0<B\le T0<B≤T and the necessary small-budget condition BT≥1BT\ge1BT≥1, the target is

∑t=1Tρt∗≥EΠ ⁣[∑t=1Trt(st,at)]−4(Dmax⁡+1)BT\sum_{t=1}^{T}\rho_t^*\ge \mathbb E^{\Pi}\!\left[\sum_{t=1}^{T}r_t(s_t,a_t)\right] -4(D_{\max}+1)\sqrt{BT}t=1∑T​ρt∗​≥EΠ[t=1∑T​rt​(st​,at​)]−4(Dmax​+1)BT​

for every initial state and every allowed non-anticipatory policy Π\PiΠ. Quantifying over every policy expresses the paper's maximum over policies without introducing a supremum over an unbounded real-valued function space. The first five targets follow Appendix A.2: a bounded optimal dual potential, the gain-drift inequality (18), the pathwise dual inequality (19), the window inequality (23), and the full-horizon inequality (24). Their constants and index ranges are part of the targets (preprint, pp. 8, 33–34).

Significance

The result gives a finite-horizon comparison between two different benchmarks. The sum of stationary gains is additive over time, while the best expected cumulative reward accounts for how actions alter later states. Proposition 1 says that their difference is controlled by variation and diameter under its hypotheses. This is the paper's justification for using the additive oracle in its dynamic-regret definition; the authors note that the later algorithmic bounds are larger than this comparison term (preprint, p. 8, text after Proposition 1).

The mathematical result is already claimed in the paper. This mission asks for a machine-checked version with explicit finite-horizon distributions, the occupancy LP, the diameter convention, and the drift sums. The new Lean statements currently have placeholders for their proofs; the imported finite-MDP definitions are already published. A completed development would provide reusable code for time-dependent MDP trajectory laws and for comparing stationary LP values as a model drifts. It would also make the precise domain of the square-root bound reviewable independently of the algorithms in the remainder of the paper.

Difficulty

The stationary gain ρt∗\rho_t^*ρt∗​ is not a per-round reward guarantee. An action can collect reward now and put the process in a state whose future reward is poor, so summing stationary optima does not directly bound a nonstationary trajectory. Conversely, treating each round as an independent stationary experiment discards the state dependence that the policy exploits. The diameter controls the cost of that dependence, and variation controls changes between the stationary problems. The proof must connect these objects while preserving the exact factors 2Dmax⁡2D_{\max}2Dmax​, 2W2W2W, and 4TDmax⁡/W4TD_{\max}/W4TDmax​/W in Appendix A.2 (preprint, pp. 33–35).

There is also a small-budget obstruction in the printed Proposition 1. Its stated 0<B≤T0<B\le T0<B≤T permits BT<1BT<1BT<1, where the displayed inequality is false: a two-state, one-action example with a slowly returning state, T=2T=2T=2, and reward drift 10−1210^{-12}10−12 has an oracle sum near 2/112/112/11 while the proposed lower bound on that sum is near 111. The mission therefore adds BT≥1BT\ge1BT≥1 and records the difference from the page. Inequality (24), posed separately, retains the paper's every-integer-window form and needs no such pin.

Formalization scope

States and actions are Fin S and Fin A; available actions form a nonempty Finset at each state, and S>0S>0S>0. The imported FiniteMDPLearning structure supplies reward rows in [0,1][0,1][0,1] and transition probability rows. It has rows for actions unavailable at a particular state; all mathematical maxima, LP constraints, policy restrictions, and drift formulas use only allowed pairs. The source's time t∈{1,…,T}t\in\{1,\ldots,T\}t∈{1,…,T} is stored at Lean index t−1t-1t−1. No value of the MDP sequence after the horizon enters a stated budget or reward sum.

The occupancy LP has a nonempty bounded feasible-value set under the standing MDP assumptions; its real supremum denotes ρ∗\rho^*ρ∗. Hitting times and diameters use extended nonnegative reals to retain infinity, rather than silently converting an infinite hitting time to zero. The diameter includes same-state return times and minimizes over deterministic stationary policies; such policies attain the hitting-time minimum. The policy used for cumulative reward is a history-dependent randomized kernel on state–action histories. Conditioning an action rule that also observes past rewards on that history yields the same state–action trajectory law. The nonstationary measure samples the next state with the current round's transition law and is a probability measure.

The fixed Dmax⁡D_{\max}Dmax​ is constrained to bound every round's diameter; it is not an unrelated parameter. The stated BT≥1BT\ge1BT≥1 pin rules out the false small-budget case. In (23), the paper's last-window drift sum includes B⋅,TB_{\cdot,T}B⋅,T​, which equation (1) does not define; the formal sum retains all defined terms through T−1T-1T−1. The goal and milestones do not weaken ρt∗\rho_t^*ρt∗​, restrict the policy class to a convenient subclass, or omit a time step. Contributions on LP duality, finite-horizon trajectory expectations, hitting-time bounds, and drift inequalities are useful beyond this proposition. The paper's headline Theorems 1–4 are not posed here because their O~\widetilde OO notation hides constants (preprint, p. 6, §2.1).

Selected references

  • W. C. Cheung, D. Simchi-Levi and R. Zhu, Non-Stationary Reinforcement Learning: The Blessing of (More) Optimism, arXiv:1906.02922v4, 2020; published as Nonstationary Reinforcement Learning: The Blessing of (More) Optimism, Management Science, 2023. Preprint; published article.
  • T. Jaksch, R. Ortner and P. Auer, Near-Optimal Regret Bounds for Reinforcement Learning, Journal of Machine Learning Research 11, 2010. Article. The source paper cites its diameter and bias-span results in Definition 1 and Appendix A.1.
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994. Book. The source paper cites it for the average-reward occupancy LP on p. 33.
9 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Secretaries with Advice 5: With Binary-Classifier Advice of Recall p and Specificity p′, the Optimal Success Probability Tends to ((1−p′)/p)^((1−p′)/p′)·e^((p−1)/p′)Research Paper

Motivation

A secretary problem asks a decision maker to choose one candidate from a sequence, without being able to recall a rejected candidate. Each arrival reveals how the candidate compares with those seen earlier, but the decision maker does not know the candidate's final rank. A classifier can provide an additional Yes or No signal about whether the current candidate is the best overall. The natural performance question is how much this signal improves the chance of selecting the best candidate when the number of arrivals grows. Dütting, Lattanzi, Paes Leme and Vassilvitskii give an exact finite linear program for this setting and an explicit asymptotic value. This mission makes the limit and its finite prerequisites precise.

The classifier's quality has two parameters with different meanings. Recall ppp is the probability of a Yes signal for the top candidate. Specificity p′p'p′ is the probability of a No signal for any other candidate. Both lie in [1/2,1][1/2,1][1/2,1], as in Example 5 of the paper. At p=p′=1/2p=p'=1/2p=p′=1/2 the signal conveys no information, while p=p′=1p=p'=1p=p′=1 is perfect advice. These endpoints matter to the statement rather than being omitted as special cases. Example 5, pp. 7–8.

Setting

There are n≥1n\ge1n≥1 arrivals, indexed by i=1,…,ni=1,\ldots,ni=1,…,n. Their ranks form a uniformly random permutation; the maximum rank is the candidate to select. At each arrival, the observer sees the relative ranking of candidates already seen and a signal s∈{Y,N}s\in\{Y,N\}s∈{Y,N} from the classifier. An admissible decision can depend on this observed history and may use a stopping probability. It cannot inspect a candidate's hidden final rank. The paper shows that, for this signal model, the optimal stopping probability is characterized by a finite primal linear program. Sections 2 and 6.

For each round and signal, zis∈[0,1]z_i^s\in[0,1]zis​∈[0,1] is a primal variable. Put zˉj=(1−p′)zjY+p′zjN\bar z_j=(1-p')z_j^Y+p'z_j^Nzˉj​=(1−p′)zjY​+p′zjN​. The program has constraints zis≤1−∑j<izˉj/jz_i^s\le1-\sum_{j<i}\bar z_j/jzis​≤1−∑j<i​zˉj​/j, and its objective is ∑i=1n[pziY+(1−p)ziN]/n\sum_{i=1}^n[pz_i^Y+(1-p)z_i^N]/n∑i=1n​[pziY​+(1−p)ziN​]/n. Write Opt⁡(n,p,p′)\operatorname{Opt}(n,p,p')Opt(n,p,p′) for its optimal value. The constraints account for the chance that an earlier candidate has already been selected; the objective weights winning selections by the signal probabilities of the top candidate. This is the Opt⁡\operatorname{Opt}Opt of Section 6, rather than a value defined by an asymptotic formula. Section 6, p. 20.

The paper also considers a rescaled dual with variables wiY,wiNw_i^Y,w_i^NwiY​,wiN​ and an associated pair of thresholds tY,tNt_Y,t_NtY​,tN​. The thresholds are the first rounds at which the corresponding greedy dual coordinate is positive. In the finite formalization, n+1n+1n+1 records a signal whose coordinate is never positive. Proof of Theorem 20, p. 21.

Formalization targets

The main target is the limiting primal optimum for every p,p′∈[1/2,1]p,p'\in[1/2,1]p,p′∈[1/2,1]:

lim⁡n→∞Opt⁡(n,p,p′)=(1−p′p)(1−p′)/p′exp⁡(p−1p′).\lim_{n\to\infty}\operatorname{Opt}(n,p,p') =\left(\frac{1-p'}p\right)^{(1-p')/p'} \exp\left(\frac{p-1}{p'}\right).n→∞lim​Opt(n,p,p′)=(p1−p′​)(1−p′)/p′exp(p′p−1​).

The finite milestones identify the primal optimum with the greedy dual objective, give the exact late dual coordinates and the exact range of the early YYY recursion, and establish tY≤tNt_Y\le t_NtY​≤tN​. The asymptotic milestones state

tNn⟶exp⁡(p−1p′),tYn⟶(1−p′p)1/p′exp⁡(p−1p′).\frac{t_N}{n}\longrightarrow \exp\left(\frac{p-1}{p'}\right),\qquad \frac{t_Y}{n}\longrightarrow \left(\frac{1-p'}p\right)^{1/p'}\exp\left(\frac{p-1}{p'}\right).ntN​​⟶exp(p′p−1​),ntY​​⟶(p1−p′​)1/p′exp(p′p−1​).

A separate companion target gives the finite lower bound Opt⁡(n,p,p′)≥L(p,p′)\operatorname{Opt}(n,p,p')\ge L(p,p')Opt(n,p,p′)≥L(p,p′), where LLL denotes the displayed limit. Theorem 20 states the corresponding infimum inequality but does not separately prove it. Theorem 20 and its proof, pp. 20–22.

Significance

The limit quantifies the benefit of advice across the whole parameter square, including asymmetric classifiers. It recovers the classical value e−1e^{-1}e−1 when p=p′=1/2p=p'=1/2p=p′=1/2, and gives value 111 for perfect advice. The two threshold limits say when each signal begins to justify stopping as the horizon grows. Thus the result specifies both the achievable success probability and the scale of the optimal decisions. Theorem 20, p. 20.

The paper already proves threshold optimality through its linear program and presents the limit calculation. The formalization work here is to establish a full Lean limit theorem from an exact finite LP, including the two endpoint regimes and a finite dual characterization. The nearby classical secretary threshold limit on Prove2Me uses a different rank-based model; it does not state this classifier result. Definitions of the primal feasible set and the backward dual sequence can support later results about other advice distributions.

Difficulty

The source uses approximations throughout its asymptotic argument and explicitly omits terms that vanish as nnn grows. Those omissions cannot be carried into an exact finite statement: the YYY recursion, for example, fails at the round immediately before the NNN threshold because the next NNN dual coordinate is then present. A complete argument has to keep the discrete threshold boundaries and the harmonic sums under control while passing to a limit. The source's displayed theorem also contains an exponent inconsistent with the last equation of its proof; the corrected expression must be checked uniformly, including zero base at p′=1p'=1p′=1. Proof of Theorem 20, pp. 21–22.

Formalization scope

Lean represents time by natural numbers 1,…,n1,\ldots,n1,…,n, matching the paper's displayed LP, and signals by Bool, with true meaning YYY. The primal optimum is the real supremum of objective values over exactly the feasible LP variables. For n≥1n\ge1n≥1 and p,p′∈[1/2,1]p,p'\in[1/2,1]p,p′∈[1/2,1], the zero assignment is feasible and the objective is bounded, so this supremum has its ordinary optimization meaning. Values of a variable array outside 1,…,n1,\ldots,n1,…,n are ignored. The greedy dual is a backward finite recursion, not the definition of Opt⁡\operatorname{Opt}Opt; otherwise the central LP-to-dual milestone would disappear.

The formal thresholds are first positive greedy dual coordinates. If there is no positive NNN coordinate, tN=n+1t_N=n+1tN​=n+1; this occurs when p=1p=1p=1 and has the same normalized limit as the paper's informal tN=nt_N=ntN​=n convention at perfect advice. Real powers use Lean's 00=10^0=100=1, yielding the correct p′=1p'=1p′=1 endpoint. All theorems quantify explicitly over n≥1n\ge1n≥1 where finite rounds are used, and over p,p′∈[1/2,1]p,p'\in[1/2,1]p,p′∈[1/2,1]. The limit uses Filter.Tendsto at infinity. The chapter does not formalize the algorithmic running time, Figures 3 and 7, or the policy-level threshold optimality addressed by the series' preceding mission. Contributions to finite LP duality, harmonic asymptotics, and endpoint analysis are within scope. Sections 6 and Appendix C.

Selected references

  • Paul Dütting, Silvio Lattanzi, Renato Paes Leme and Sergei Vassilvitskii, Secretaries with Advice, arXiv:2011.06726v1, 2020; published in Mathematics of Operations Research, 2024. Preprint.
9 thms2 active usersReviewed
Operations ResearchOptimal TransportOptimization·Captain: mikedeng1

Conic Programming Reformulations of Two-Stage Distributionally Robust Linear Programs over Wasserstein Balls 2: With Q = 0 and Ξ = ℝ^K, the 1-Wasserstein Problem Is the Linear Program (32)Research Paper

Two-stage decisions under an ambiguous distribution

Two-stage stochastic linear programs model decisions taken in two steps: a first-stage decision xxx is fixed before an uncertain parameter ξ\xiξ is observed, and a second-stage (recourse) decision yyy adapts to ξ\xiξ afterwards. They underlie capacity planning, inventory and network design. In practice the distribution of ξ\xiξ is known only through samples ξ^1,…,ξ^I\hat\xi_1,\dots,\hat\xi_Iξ^​1​,…,ξ^​I​. Distributionally robust optimization replaces the unknown distribution by the worst case over an ambiguity set; a popular choice is a Wasserstein ball around the empirical distribution, because it contains the true distribution with high probability and yields out-of-sample guarantees (Mohajerin Esfahani and Kuhn, 2018).

Hanasusanto and Kuhn (arXiv:1609.07505, Operations Research 66(3), 2018) study when the resulting two-stage problem can be solved exactly. Section 3 of their paper gives a copositive reformulation for the 2-Wasserstein ball (the subject of a companion mission). Section 4, the subject of this mission, shows that when the uncertainty enters only the constraints of the recourse problem and the ball is a 1-Wasserstein ball with a polyhedral reference distance, the whole problem is a linear program.

Setting

Let c∈RN1c\in\mathbb R^{N_1}c∈RN1​ and X⊆RN1\mathcal X\subseteq\mathbb R^{N_1}X⊆RN1​ be the first-stage cost and feasible set, q∈RN2q\in\mathbb R^{N_2}q∈RN2​ the second-stage cost, W∈RM×N2W\in\mathbb R^{M\times N_2}W∈RM×N2​ the recourse matrix, and T(x)∈RM×KT(x)\in\mathbb R^{M\times K}T(x)∈RM×K, h(x)∈RMh(x)\in\mathbb R^Mh(x)∈RM affine functions of xxx. The recourse value at ξ∈RK\xi\in\mathbb R^Kξ∈RK is

Z(x,ξ)=inf⁡{ q⊤y:y∈RN2, T(x)ξ+h(x)≤Wy }∈[−∞,+∞].Z(x,\xi)=\inf\{\,q^\top y : y\in\mathbb R^{N_2},\ T(x)\xi+h(x)\le Wy\,\}\in[-\infty,+\infty].Z(x,ξ)=inf{q⊤y:y∈RN2​, T(x)ξ+h(x)≤Wy}∈[−∞,+∞].

The uncertainty affects only the constraints (in the paper's notation, Q=0Q=0Q=0), and there is no support constraint: Ξ=RK\Xi=\mathbb R^KΞ=RK. The problem has sufficiently expensive recourse if some p≥0p\ge 0p≥0 satisfies W⊤p=qW^\top p=qW⊤p=q.

For scaling parameters w+,w−>0w_+,w_->0w+​,w−​>0 the reference distance is d(ξ,ξ′)=∥ξ−ξ′∥d(\xi,\xi')=\|\xi-\xi'\|d(ξ,ξ′)=∥ξ−ξ′∥ with

∥ξ∥=∑k∈[K]max⁡{w+ξk, −w−ξk}.(31)\|\xi\|=\sum_{k\in[K]}\max\{w_+\xi_k,\,-w_-\xi_k\}. \qquad (31)∥ξ∥=k∈[K]∑​max{w+​ξk​,−w−​ξk​}.(31)

Moving a unit of mass in the positive direction of coordinate kkk costs w+w_+w+​, in the negative direction w−w_-w−​. The 1-Wasserstein ball Bϵ1(P^I)\mathcal B^1_\epsilon(\hat{\mathbb P}_I)Bϵ1​(P^I​) consists of the probability measures P\mathbb PP on RK\mathbb R^KRK whose optimal transport cost to P^I=1I∑iδξ^i\hat{\mathbb P}_I=\frac1I\sum_i\delta_{\hat\xi_i}P^I​=I1​∑i​δξ^​i​​ under ddd is at most ϵ\epsilonϵ. The worst-case expectation and the two-stage problem (1) are

Z(x)=sup⁡P∈Bϵ1(P^I)EP[Z(x,ξ~)],inf⁡x∈X c⊤x+Z(x).\mathcal Z(x)=\sup_{\mathbb P\in\mathcal B^1_\epsilon(\hat{\mathbb P}_I)}\mathbb E_{\mathbb P}[Z(x,\tilde\xi)],\qquad \inf_{x\in\mathcal X}\ c^\top x+\mathcal Z(x).Z(x)=P∈Bϵ1​(P^I​)sup​EP​[Z(x,ξ~​)],x∈Xinf​ c⊤x+Z(x).

The dual norm of (31) is ∥z∥∗=sup⁡{z⊤ξ:∥ξ∥≤1}\|z\|_*=\sup\{z^\top\xi:\|\xi\|\le 1\}∥z∥∗​=sup{z⊤ξ:∥ξ∥≤1}.

Formalization targets

Goal: Theorem 6

For ϵ>0\epsilon>0ϵ>0 and every x∈Xx\in\mathcal Xx∈X, Z(x)\mathcal Z(x)Z(x) equals the optimal value of the linear program

min⁡  ϵλ+1I∑i∈[I]q⊤yis.t.  λ≥0,T(x)ξ^i+h(x)≤Wyi  ∀i∈[I],q⊤ϕk≤λ, q⊤ψk≤λ, T(x)ek/w+≤Wϕk, −T(x)ek/w−≤Wψk  ∀k∈[K],(32)\begin{aligned}\min\ \ &\epsilon\lambda+\frac1I\sum_{i\in[I]}q^\top y_i\\ \text{s.t.}\ \ &\lambda\ge 0,\quad T(x)\hat\xi_i+h(x)\le Wy_i\ \ \forall i\in[I],\\ &q^\top\phi_k\le\lambda,\ q^\top\psi_k\le\lambda,\ T(x)e_k/w_+\le W\phi_k,\ -T(x)e_k/w_-\le W\psi_k\ \ \forall k\in[K],\end{aligned}\qquad(32)min  s.t.  ​ϵλ+I1​i∈[I]∑​q⊤yi​λ≥0,T(x)ξ^​i​+h(x)≤Wyi​  ∀i∈[I],q⊤ϕk​≤λ, q⊤ψk​≤λ, T(x)ek​/w+​≤Wϕk​, −T(x)ek​/w−​≤Wψk​  ∀k∈[K],​(32)

and consequently problem (1) has the optimal value of (32) minimized jointly over x∈Xx\in\mathcal Xx∈X and the other variables with c⊤xc^\top xc⊤x added to the objective.

Milestones, in the order of the paper's proof

  1. Theorem 1 in this instance (r=1r=1r=1, gauge cost, Ξ=RK\Xi=\mathbb R^KΞ=RK): Z(x)\mathcal Z(x)Z(x) equals the moment problem (5) and, for ϵ>0\epsilon>0ϵ>0, the dual
Z(x)=inf⁡λ≥0 ϵλ+1I∑isup⁡ξ∈RK[Z(x,ξ)−λ∥ξ−ξ^i∥].\mathcal Z(x)=\inf_{\lambda\ge 0}\ \epsilon\lambda+\frac1I\sum_{i}\sup_{\xi\in\mathbb R^K}\big[Z(x,\xi)-\lambda\|\xi-\hat\xi_i\|\big].Z(x)=λ≥0inf​ ϵλ+I1​i∑​ξ∈RKsup​[Z(x,ξ)−λ∥ξ−ξ^​i​∥].
  1. Display (33): Z(x)=inf⁡{ϵλ+1I∑isup⁡p≥0, W⊤p=q h(x)⊤p+(T(x)⊤p)⊤ξ^i : λ≥0, ∥T(x)⊤p∥∗≤λ ∀p≥0, W⊤p=q}\mathcal Z(x)=\inf\{\epsilon\lambda+\frac1I\sum_i\sup_{p\ge0,\,W^\top p=q}\,h(x)^\top p+(T(x)^\top p)^\top\hat\xi_i\ :\ \lambda\ge0,\ \|T(x)^\top p\|_*\le\lambda\ \forall p\ge0,\,W^\top p=q\}Z(x)=inf{ϵλ+I1​∑i​supp≥0,W⊤p=q​h(x)⊤p+(T(x)⊤p)⊤ξ^​i​ : λ≥0, ∥T(x)⊤p∥∗​≤λ ∀p≥0,W⊤p=q}.
  2. The dual norm of (31): ∥z∥∗=max⁡kmax⁡{zk/w+, −zk/w−}\|z\|_*=\max_{k}\max\{z_k/w_+,\,-z_k/w_-\}∥z∥∗​=maxk​max{zk​/w+​,−zk​/w−​}.
  3. The constraint decomposition: the semi-infinite constraint of (33) holds if and only if, for each kkk, there are ϕk,ψk\phi_k,\psi_kϕk​,ψk​ satisfying the four linear inequalities of (32).

Significance

Theorem 6 shows that the two-stage distributionally robust linear program over a 1-Wasserstein ball, which is a priori an optimization over infinitely many distributions, has a linear-programming reformulation with O(I+K)O(I+K)O(I+K) blocks of variables and constraints. It covers distributionally robust least-absolute-deviation regression (Example 2 of the paper), where the reformulation becomes the empirical loss plus a dual-norm regularizer, and it contrasts with the paper's Theorem 7, which shows that for ppp-norm reference distances with p>1p>1p>1 the same problem is NP-hard.

The result is proved in the paper; there is no machine-checked proof. A formalization adds a verified chain from the measure-theoretic worst-case expectation to a finite linear program, including the conventions the paper leaves implicit: the extended-real values (Z(x)\mathcal Z(x)Z(x) may be +∞+\infty+∞, and (32) may then be infeasible), the restriction ϵ>0\epsilon>0ϵ>0, and the first-stage cost in the objective.

Difficulty

Each step of the proof is classical, but the chain crosses several regimes. Theorem 1 is a Wasserstein strong duality result, and here it is applied to a loss Z(x,⋅)Z(x,\cdot)Z(x,⋅) that is convex, possibly +∞+\infty+∞ on part of RK\mathbb R^KRK, and not upper semicontinuous, with a cost that is not symmetric; the standard published duality theorems assume an upper semicontinuous real-valued loss or a metric. The passage to (33) interchanges a supremum over ξ\xiξ with an infimum over the dual-norm ball and must handle the case where the dual recourse polyhedron is unbounded. Finally, every equivalence must hold in the extended reals: an argument that tacitly assumes finiteness proves a statement that fails exactly when the dual polyhedron has a recession direction.

Formalization scope

Vectors are Fin n → ℝ, samples are ξhat : Fin I → (Fin K → ℝ) with I≥1I\ge1I≥1, and RK\mathbb R^KRK carries its product (Borel) σ-algebra. TTT and hhh are affine maps. The transport cost is the platform definition RWPI.SqrtLasso.transportCost (couplings with first marginal P\mathbb PP, second P^I\hat{\mathbb P}_IP^I​), the empirical distribution is WassersteinDRO.Duality.empiricalDistribution, and expectations of the extended-real recourse value use WassersteinDRO.Duality.erealExpectation (value +∞+\infty+∞ whenever the positive part has infinite integral). Every optimal value is an extended-real infimum or supremum over its feasible set; no Bochner integral and no real-valued sInf/sSup is used.

Conventions made explicit, with reasons:

  • ϵ>0\epsilon>0ϵ>0. The paper does not restrict ϵ\epsilonϵ in Theorem 6, but its proof starts from the dual (6), stated only for ϵ>0\epsilon>0ϵ>0, and the identity is false at ϵ=0\epsilon=0ϵ=0 when the dual recourse polyhedron has a recession direction rrr with T(x)⊤r≠0T(x)^\top r\ne0T(x)⊤r=0: then (32) is infeasible while Z(x)\mathcal Z(x)Z(x) is the finite sample average.
  • c⊤xc^\top xc⊤x in (32). The printed objective of (32) omits the first-stage cost. The proof establishes the pointwise identity Z(x)=\mathcal Z(x)=Z(x)= value of (32) at xxx, which is the goal's first part; the problem-level equivalence restores c⊤xc^\top xc⊤x.
  • Asymmetric gauge. For w+≠w−w_+\ne w_-w+​=w−​, (31) is not a norm, and Theorem 1 of the paper is stated for a metric. The paper applies it to (31) anyway; the milestone states that application, with the gauge cost in the orientation d(ξ,ξ^i)=∥ξ−ξ^i∥d(\xi,\hat\xi_i)=\|\xi-\hat\xi_i\|d(ξ,ξ^​i​)=∥ξ−ξ^​i​∥. The case w+=w−w_+=w_-w+​=w−​ is not imposed.
  • Finite first moment. Membership in M1(RK)\mathcal M^1(\mathbb R^K)M1(RK) is implied by finite transport cost to P^I\hat{\mathbb P}_IP^I​ and is not repeated.
  • The two "1/N1/N1/N" factors in the paper's proof are misprints for 1/I1/I1/I.

A formalization in which Z\mathcal ZZ is defined by (6), (33) or (32), in which the gauge is secretly symmetric, or in which expectations are Bochner integrals (zero for non-integrable functions) would make the goal trivial or different; the definitions here exclude each of these.

A complete development needs Wasserstein strong duality for a lower semicontinuous loss and cost (with a disintegration of couplings to pass to the moment problem (5)), LP strong duality and Farkas' lemma in the extended-real form, and a minimax interchange over a compact dual-norm ball. Wasserstein duality for general costs and extended-real LP duality are reusable well beyond this mission; contributions of either are welcome.

Selected references

  • G. A. Hanasusanto, D. Kuhn, Conic Programming Reformulations of Two-Stage Distributionally Robust Linear Programs over Wasserstein Balls, Operations Research 66(3), 2018. Pinned version: arXiv:1609.07505v3. DOI 10.1287/opre.2017.1698.
  • P. Mohajerin Esfahani, D. Kuhn, Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations, Mathematical Programming 171, 2018. doi:10.1007/s10107-017-1172-1
  • J. Blanchet, K. Murthy, Quantifying distributional model risk via optimal transport, Mathematics of Operations Research 44(2), 2019. doi:10.1287/moor.2018.0936
  • R. Gao, A. Kleywegt, Distributionally robust stochastic optimization with Wasserstein distance, Mathematics of Operations Research 48(2), 2023. doi:10.1287/moor.2022.1275
  • D. P. Bertsekas, Convex Optimization Theory, Athena Scientific, 2009 (Proposition 5.5.4, the minimax theorem used in the proof).
11 thms2 active usersReviewed
CombinatoricsDiscrete GeometryOperations Research·Captain: mikedeng1

An Improved Kalai-Kleitman Bound for the Diameter of a Polyhedron: Every d-Polyhedron with n Facets, Bounded or Not, Has Graph Diameter at Most (n-d)^(log2 d)Research Paper

Motivation

The simplex method for linear programming moves from vertex to vertex along the edges of a polyhedron. A lower bound on the number of pivots of any edge-following method is the graph diameter of the feasible polyhedron: the largest number of edges needed to connect two of its vertices. Whether this diameter is bounded by a polynomial in the dimension ddd and the number nnn of facets is the polynomial Hirsch conjecture, open since the 1950s. The original Hirsch conjecture, n−dn-dn−d, was refuted for unbounded polyhedra by Klee and Walkup (1967) and for bounded ones by Santos (2012) (doi:10.4007/annals.2012.176.1.7).

Timeline.

  • 1964–1966. Klee proves that a three-dimensional polyhedron with nnn facets, bounded or not, has diameter at most n−3n-3n−3 (doi:10.4153/CJM-1964-058-3, doi:10.1137/0113061, doi:10.2140/pjm.1966.17.249).
  • 1967. Klee and Walkup show that the Hirsch bound fails for unbounded polyhedra in dimension four (doi:10.1007/BF02395039).
  • 1992. Kalai and Kleitman prove the first subexponential bound, nlog⁡2d+2n^{\log_2 d+2}nlog2​d+2, for all polyhedra (doi:10.1090/S0273-0979-1992-00285-9, arXiv:math/9204233).
  • 2010. Eisenbrand, Hähnle, Razborov and Rothvoss show that nlog⁡2d+1n^{\log_2 d+1}nlog2​d+1 holds for a broad combinatorial abstraction of polyhedra (doi:10.1287/moor.1100.0470).
  • 2014. Todd sharpens the Kalai–Kleitman bound to (n−d)log⁡2d(n-d)^{\log_2 d}(n−d)log2​d for all polyhedra, bounded or not (arXiv:1402.3579; SIAM J. Discrete Math. 28 (2014), doi:10.1137/140962310). This is the result of this mission.

Setting

A polyhedron P⊆RdP\subseteq\mathbb R^dP⊆Rd is the set of solutions of finitely many linear inequalities,

P=Hpoly⁡(a,b)={x∈Rd: ⟨ai,x⟩≤bi, i=1,…,n}.P=\operatorname{Hpoly}(a,b)=\{x\in\mathbb R^d:\ \langle a_i,x\rangle\le b_i,\ i=1,\dots,n\}.P=Hpoly(a,b)={x∈Rd: ⟨ai​,x⟩≤bi​, i=1,…,n}.

It need not be bounded. A vertex of PPP is a point vvv for which some half-space HHH satisfies P∩H={v}P\cap H=\{v\}P∩H={v}, equivalently an extreme point of PPP. Two vertices v≠wv\neq wv=w are adjacent when P∩H=[v,w]P\cap H=[v,w]P∩H=[v,w] for some half-space HHH; the segment [v,w][v,w][v,w] is then an edge. A path of length kkk is a sequence of vertices v=v0,…,vk=wv=v_0,\dots,v_k=wv=v0​,…,vk​=w with consecutive vertices adjacent, ρP(v,w)\rho_P(v,w)ρP​(v,w) is the least such kkk, and the diameter is δ(P)=max⁡ρP(v,w)\delta(P)=\max\rho_P(v,w)δ(P)=maxρP​(v,w) over pairs of vertices. A (d,n)(d,n)(d,n)-polyhedron is a ddd-dimensional polyhedron with nnn facets, and

Δ(d,n)=max⁡{δ(P): P a (d,n)-polyhedron},\Delta(d,n)=\max\{\delta(P):\ P \text{ a } (d,n)\text{-polyhedron}\},Δ(d,n)=max{δ(P): P a (d,n)-polyhedron},

the maximum taken over bounded and unbounded polyhedra alike. All logarithms are to base 2.

Formalization targets

Goal: Theorem 1

Δ(d,n)≤(n−d)log⁡d(1≤d≤n),Δ(1,1)=0.\Delta(d,n)\le (n-d)^{\log d}\quad(1\le d\le n),\qquad \Delta(1,1)=0.Δ(d,n)≤(n−d)logd(1≤d≤n),Δ(1,1)=0.

The goal fixes no constant beyond the paper's own exponent and leaves no case of ddd, nnn or boundedness open.

Milestones, in the order the proof uses them

  1. The identity (n−d)log⁡d=dlog⁡(n−d)(n-d)^{\log d}=d^{\log(n-d)}(n−d)logd=dlog(n−d) (p. 2).
  2. Two vertices on a common facet are at distance at most Δ(d−1,n−1)\Delta(d-1,n-1)Δ(d−1,n−1) (p. 2, in the proof of Lemma 1).
  3. Lemma 1 (Kalai–Kleitman): for 2≤d≤⌊n/2⌋2\le d\le\lfloor n/2\rfloor2≤d≤⌊n/2⌋, Δ(d,n)≤Δ(d−1,n−1)+2Δ(d,⌊n/2⌋)+2\Delta(d,n)\le\Delta(d-1,n-1)+2\Delta(d,\lfloor n/2\rfloor)+2Δ(d,n)≤Δ(d−1,n−1)+2Δ(d,⌊n/2⌋)+2.
  4. Δ(d,d)=0\Delta(d,d)=0Δ(d,d)=0.
  5. Δ(1,n)≤1\Delta(1,n)\le 1Δ(1,n)≤1.
  6. Δ(2,n)≤n−2\Delta(2,n)\le n-2Δ(2,n)≤n−2.
  7. Δ(3,n)≤n−3\Delta(3,n)\le n-3Δ(3,n)≤n−3 (Klee), for unbounded polyhedra too.
  8. If n<2dn<2dn<2d, then Δ(d,n)≤Δ(d−1,n−1)\Delta(d,n)\le\Delta(d-1,n-1)Δ(d,n)≤Δ(d−1,n−1).
  9. In the ten cases d=4, 8≤n≤11d=4,\ 8\le n\le 11d=4, 8≤n≤11; d=5, 10≤n≤12d=5,\ 10\le n\le 12d=5, 10≤n≤12; d=6, 12≤n≤13d=6,\ 12\le n\le 13d=6, 12≤n≤13; d=7, n=14d=7,\ n=14d=7, n=14, the bound ⌊(n−d)log⁡d⌋\lfloor (n-d)^{\log d}\rfloor⌊(n−d)logd⌋ satisfies the recursion of Lemma 1.
  10. For d≥4d\ge4d≥4, n−d≥8n-d\ge8n−d≥8, n≥2dn\ge 2dn≥2d: (d−1)log⁡(n−d)+2(n/2−d)log⁡d+2≤dlog⁡(n−d)(d-1)^{\log(n-d)}+2(n/2-d)^{\log d}+2\le d^{\log(n-d)}(d−1)log(n−d)+2(n/2−d)logd+2≤dlog(n−d). For n>2dn>2dn>2d this is the displayed inequality; at n=2dn=2dn=2d the second power is zero, consistent with Δ(d,d)=0\Delta(d,d)=0Δ(d,d)=0.

Significance

The result. The bound (n−d)log⁡d(n-d)^{\log d}(n−d)logd is never larger than the Kalai–Kleitman bound. It equals the true value n−dn-dn−d in dimensions 1 and 2, and it depends on nnn only through the Hirsch quantity n−dn-dn−d. Since (n−d)log⁡d=dlog⁡(n−d)(n-d)^{\log d}=d^{\log(n-d)}(n−d)logd=dlog(n−d), it is also symmetric under linear-programming duality, which exchanges the roles of ddd and n−dn-dn−d. For fixed n−dn-dn−d it is polynomial in ddd. It applies to the unbounded feasible regions that arise in practice in linear programming.

Formalizing it. The theorem has been proved since 2014. The platform has a proof of the bounded case only: Hirsch.todd_bound assumes d≥3d\ge3d≥3, a nonempty interior and Bornology.IsBounded. This mission's goal extends it to all polyhedra, bounded or not, and to d=1,2d=1,2d=1,2. That is the statement the paper proves, and the one an analysis of the simplex method on unbounded feasible regions needs. The unbounded form of Lemma 1 and the common-facet bound are open on the platform as items of the Kalai–Kleitman series and are reused here. Klee's unbounded three-dimensional bound has no formal proof on the platform: the published Hirsch.klee_three_dimensional_bound and Hirsch.dimension_three_bound cover bounded polyhedra only. The bounded recursion Hirsch.kalai_kleitman_recursion and the bounded facet reduction Hirsch.facet_reduction are proved and may serve as models.

Difficulty

Two steps are hard. The first is the unbounded case. Statements proved for polytopes do not transfer directly, because an unbounded polyhedron may have no vertices or a single one, unbounded edges (rays) that are not edges of the graph, and redundant or implicit-equality rows. Each geometric milestone must hold for these. The second is Klee's three-dimensional bound, which the paper cites without proof. Assuming boundedness to apply the published polytope versions is ruled out: Klee and Walkup showed that unbounded and bounded diameters differ from dimension four on, so the unbounded case carries content of its own. The arithmetic milestones are elementary but sensitive to edge values of log⁡\loglog and the real power.

Formalization scope

All statements use the published definitions Hirsch.Hpoly, Hirsch.Adj and Hirsch.DiamLE (Hirsch_model). Vertices are Set.extremePoints ℝ. DiamLE P B says that any two extreme points are joined by a walk of exactly BBB steps, each step staying put or crossing an edge. So the bound includes connectivity of the vertex–edge graph.

  • Inequality reading. "Δ(d,n)≤B\Delta(d,n)\le BΔ(d,n)≤B" is stated as: for every a:Fin n→Rda:\mathrm{Fin}\,n\to\mathbb R^da:Finn→Rd and bbb, DiamLE (Hpoly a b) B. This ranges over all polyhedra given by nnn inequalities in Rd\mathbb R^dRd, including lower-dimensional, empty and redundant ones. It is equivalent to the paper's statement: a lower-dimensional polyhedron of dimension d′d'd′ with n′n'n′ facets has n′−d′≤n−dn'-d'\le n-dn′−d′≤n−d.
  • No boundedness, nonemptiness or full-dimensionality is assumed anywhere.
  • The logarithm is Real.logb 2 and the power is Real.rpow. A distance is at most (n−d)log⁡d(n-d)^{\log d}(n−d)logd exactly when it is at most the floor ⌊(n−d)log⁡d⌋\lfloor (n-d)^{\log d}\rfloor⌊(n−d)logd⌋, abbreviated toddBound d n in the milestone on the ten cases. The clause Δ(1,1)=0\Delta(1,1)=0Δ(1,1)=0 is a separate conjunct, because 00=10^0=100=1 in Real.rpow.
  • Disclosed additions: nonzero rows in the n<2dn<2dn<2d step (as in the referenced Lemma 1 and the d=2d=2d=2 bound). In the general step, n≥2dn\ge2dn≥2d: the paper secures it by treating n<2dn<2dn<2d first. The second power is written with base n/2−dn/2-dn/2−d; it equals the printed expression when n>2dn>2dn>2d and takes the intended value zero when n=2dn=2dn=2d, where the printed logarithm is undefined.
  • Natural-number subtraction appears in n−3n-3n−3 and n−2n-2n−2 (both harmless, since for small nnn there are no vertices) and in Rd−1\mathbb R^{d-1}Rd−1 for facets.

Trivializing encodings are excluded: no Bornology.IsBounded hypothesis; no definition of Δ\DeltaΔ by sSup over N\mathbb NN, which would be 000 on unbounded families; no use of Hirsch.gdist, which is 000 when no walk exists; and no dropping of the Δ(1,1)=0\Delta(1,1)=0Δ(1,1)=0 clause.

Contributions are welcome on every milestone. A complete development needs facial structure of unbounded polyhedra (facets as polyhedra one dimension lower, tight rows at vertices), the relaxation argument of Lemma 1, Klee's three-dimensional argument, and real-power and logarithm estimates. The facet machinery and Klee's bound are reusable for any diameter result on unbounded polyhedra.

Selected references

  • M. J. Todd, An improved Kalai–Kleitman bound for the diameter of a polyhedron, SIAM J. Discrete Math. 28 (2014); arXiv:1402.3579v2. arXiv:1402.3579, doi:10.1137/140962310
  • G. Kalai and D. J. Kleitman, A quasi-polynomial bound for the diameter of graphs of polyhedra, Bull. Amer. Math. Soc. 26 (1992), 315–316. doi:10.1090/S0273-0979-1992-00285-9
  • V. Klee, Diameters of polyhedral graphs, Canad. J. Math. 16 (1964), 602–614. doi:10.4153/CJM-1964-058-3
  • V. Klee, Paths on polyhedra I, J. SIAM 13 (1965), 946–956. doi:10.1137/0113061
  • V. Klee, Paths on polyhedra II, Pacific J. Math. 17 (1966), 249–262. doi:10.2140/pjm.1966.17.249
  • V. Klee and D. W. Walkup, The d-step conjecture for polyhedra of dimension d < 6, Acta Math. 117 (1967), 53–78. doi:10.1007/BF02395039
  • F. Eisenbrand, N. Hähnle, A. Razborov, T. Rothvoss, Diameter of polyhedra: limits of abstraction, Math. Oper. Res. 35 (2010), 786–794. doi:10.1287/moor.1100.0470
  • F. Santos, A counterexample to the Hirsch conjecture, Ann. of Math. 176 (2012), 383–412. doi:10.4007/annals.2012.176.1.7
13 thms2 active usersReviewed
Convex OptimizationOperations Research·Captain: mikedeng1

Retailer-Supplier Flexible Commitments Contracts: A Robust Optimization Approach: With Box Demand Uncertainty the Min-Max RSFC Problem Has the Same Optimal Value on the Extreme DemandsResearch Paper

Motivation

In a flexible commitments contract a retailer announces, before a selling horizon starts, a vector of planned orders (commitments) to its supplier, who uses them to plan capacity. During the horizon the retailer may deviate from the commitments, but pays penalties for each deviation and for changes between successive commitments. Such contracts were studied with stochastic demand by Bassok and Anupindi, Tsay and Lovejoy, and others, typically by dynamic programming over a discretized state space.

Ben-Tal, Golany, Nemirovski and Vial (2005) treat the retailer's problem as a robust multiperiod linear program: demand is only known to lie in an uncertainty set, decisions may adapt to observed demand, and the retailer minimizes its worst-case total cost. Most of the paper approximates this problem by affinely adjustable decision rules. For one important case, however, the paper shows that the problem can be solved exactly: when the uncertainty set is a box, nature may be restricted to the finitely many corner trajectories of the box. That reduction, Proposition 1 of the Appendix, is the subject of this mission, together with the general principle behind it (Lemma 2), which applies to any multistage worst-case problem with polyhedral dynamics and convex polyhedral costs.

Setting

Data. There are TTT periods. Period ttt carries an ordering cost ctc_tct​, a holding cost hth_tht​, a shortage cost ptp_tpt​, penalties αt+,αt−\alpha_t^{+}, \alpha_t^{-}αt+​,αt−​ for ordering above or below the commitment, and penalties βt+,βt−\beta_t^{+}, \beta_t^{-}βt+​,βt−​ for raising or lowering the commitment relative to the previous one. A salvage value sss applies to the final inventory; put hˉt=ht\bar h_t = h_thˉt​=ht​ for t<Tt < Tt<T and hˉT=hT−s\bar h_T = h_T - shˉT​=hT​−s. The initial inventory x1x_1x1​ and a nominal previous commitment w0w_0w0​ are given, as are order bounds Lt≤qt≤UtL_t \le q_t \le U_tLt​≤qt​≤Ut​ and cumulative bounds L^t≤∑τ≤tqτ≤U^t\widehat L_t \le \sum_{\tau \le t} q_\tau \le \widehat U_tLt​≤∑τ≤t​qτ​≤Ut​, possibly infinite.

Decisions. Before any demand is observed the retailer fixes commitments wt≥0w_t \ge 0wt​≥0 and amounts ztz_tzt​. Demand d=(d1,…,dT)d = (d_1, \dots, d_T)d=(d1​,…,dT​) lies in a product set UT=U1×⋯×UT\mathcal U^T = \mathcal U_1 \times \dots \times \mathcal U_TUT=U1​×⋯×UT​. The order qtq_tqt​ and the cost bounds yt,uty_t, u_tyt​,ut​ of period ttt are decision rules, functions of the past demands dt−1=(d1,…,dt−1)d^{t-1} = (d_1, \dots, d_{t-1})dt−1=(d1​,…,dt−1​); the inventory xt+1x_{t+1}xt+1​ is a function of dtd^tdt. This nonanticipativity is required on trajectories of UT\mathcal U^TUT.

The min-max RSFC problem (5)–(6). A policy is feasible if for every d∈UTd \in \mathcal U^Td∈UT and every ttt: xt+1=xt+qt−dtx_{t+1} = x_t + q_t - d_txt+1​=xt​+qt​−dt​; the order and cumulative-order bounds hold; yt≥hˉtxt+1y_t \ge \bar h_t x_{t+1}yt​≥hˉt​xt+1​ and yt≥−ptxt+1y_t \ge -p_t x_{t+1}yt​≥−pt​xt+1​; ut≥αt+(qt−wt)u_t \ge \alpha_t^{+}(q_t - w_t)ut​≥αt+​(qt​−wt​) and ut≥−αt−(qt−wt)u_t \ge -\alpha_t^{-}(q_t - w_t)ut​≥−αt−​(qt​−wt​); and zt≥βt+(wt−wt−1)z_t \ge \beta_t^{+}(w_t - w_{t-1})zt​≥βt+​(wt​−wt−1​), zt≥−βt−(wt−wt−1)z_t \ge -\beta_t^{-}(w_t - w_{t-1})zt​≥−βt−​(wt​−wt−1​). The optimal value is

value⁡(U)=inf⁡feasible policies sup⁡d∈UT ∑t=1T[ctqt(dt−1)+yt(dt−1)+ut(dt−1)+zt]∈[−∞,+∞].\operatorname{value}(\mathcal U) = \inf_{\text{feasible policies}}\ \sup_{d \in \mathcal U^T}\ \sum_{t=1}^T \big[c_t q_t(d^{t-1}) + y_t(d^{t-1}) + u_t(d^{t-1}) + z_t\big] \in [-\infty, +\infty].value(U)=feasible policiesinf​ d∈UTsup​ t=1∑T​[ct​qt​(dt−1)+yt​(dt−1)+ut​(dt−1)+zt​]∈[−∞,+∞].

Box uncertainty (9)–(10). Ut=[dtmin⁡,dtmax⁡]\mathcal U_t = [d_t^{\min}, d_t^{\max}]Ut​=[dtmin​,dtmax​] with dtmin⁡<dtmax⁡d_t^{\min} < d_t^{\max}dtmin​<dtmax​; its extreme points are {dtmin⁡,dtmax⁡}\{d_t^{\min}, d_t^{\max}\}{dtmin​,dtmax​}.

Convex polyhedral functions. A function f:Rm→R∪{+∞}f : \mathbb R^m \to \mathbb R \cup \{+\infty\}f:Rm→R∪{+∞} is a c.p.f. if its domain {f<∞}\{f < \infty\}{f<∞} is the solution set of finitely many linear inequalities and fff is convex and lower semicontinuous on it. Lemma 2 concerns the generic problem (P[F0,…,FT])(P[F_0, \dots, F_T])(P[F0​,…,FT​]): minimize, over decision rules St(dt−1)∈RmtS_t(d^{t-1}) \in \mathbb R^{m_t}St​(dt−1)∈Rmt​, the worst case over d∈F0×⋯×FTd \in F_0 \times \dots \times F_Td∈F0​×⋯×FT​ of ∑t=1T+1ft(St(dt−1))\sum_{t=1}^{T+1} f_t(S_t(d^{t-1}))∑t=1T+1​ft​(St​(dt−1)), subject to A1S1≥b1A_1 S_1 \ge b_1A1​S1​≥b1​, At+1St+1≥Bt+1dt+Ct+1St+bt+1A_{t+1} S_{t+1} \ge B_{t+1} d_t + C_{t+1} S_t + b_{t+1}At+1​St+1​≥Bt+1​dt​+Ct+1​St​+bt+1​ and ∥St∥∞≤R\|S_t\|_\infty \le R∥St​∥∞​≤R.

Formalization targets

Goal: Proposition 1 (p. 269)

value⁡(∏t=1T[dtmin⁡,dtmax⁡])=value⁡(∏t=1T{dtmin⁡,dtmax⁡}).\operatorname{value}\Big(\prod_{t=1}^T [d_t^{\min}, d_t^{\max}]\Big) = \operatorname{value}\Big(\prod_{t=1}^T \{d_t^{\min}, d_t^{\max}\}\Big).value(t=1∏T​[dtmin​,dtmax​])=value(t=1∏T​{dtmin​,dtmax​}).

The data are arbitrary reals (bounds in [−∞,+∞][-\infty, +\infty][−∞,+∞]) and the values are compared in the extended reals, so the statement covers infeasible and unbounded instances.

Milestones

  1. The extreme points of a segment [a,b][a,b][a,b], a<ba<ba<b, are aaa and bbb.
  2. (38): for a c.p.f. val⁡\operatorname{val}val and a polytope DDD, sup⁡d∈Dval⁡(Bd+Cs+b)=sup⁡d∈ext⁡Dval⁡(Bd+Cs+b)\sup_{d \in D} \operatorname{val}(Bd + Cs + b) = \sup_{d \in \operatorname{ext} D} \operatorname{val}(Bd + Cs + b)supd∈D​val(Bd+Cs+b)=supd∈extD​val(Bd+Cs+b).
  3. val⁡(b)=min⁡{f(s):As≥b,∥s∥∞≤R}\operatorname{val}(b) = \min\{f(s) : As \ge b, \|s\|_\infty \le R\}val(b)=min{f(s):As≥b,∥s∥∞​≤R} is a c.p.f. when fff is.
  4. A c.p.f. composed with an affine map is a c.p.f.
  5. Item (a): φ(sT)=max⁡dT∈DTΦT(sT,dT)\varphi(s_T) = \max_{d_T \in D_T} \Phi_T(s_T, d_T)φ(sT​)=maxdT​∈DT​​ΦT​(sT​,dT​) and fT+φf_T + \varphifT​+φ are c.p.f.s.
  6. The Bellman reduction opt⁡(P[F0,…,FT])=opt⁡(P+[F0,…,FT−1])\operatorname{opt}(P[F_0, \dots, F_T]) = \operatorname{opt}(P_+[F_0, \dots, F_{T-1}])opt(P[F0​,…,FT​])=opt(P+​[F0​,…,FT−1​]).
  7. (39): replacing the last polytope by its extreme points leaves the optimal value unchanged.
  8. Lemma 2: opt⁡(P[D0,…,DT])=opt⁡(P[ext⁡D0,…,ext⁡DT])\operatorname{opt}(P[D_0, \dots, D_T]) = \operatorname{opt}(P[\operatorname{ext} D_0, \dots, \operatorname{ext} D_T])opt(P[D0​,…,DT​])=opt(P[extD0​,…,extDT​]) for convex polytopes DτD_\tauDτ​, D0D_0D0​ a singleton, and c.p.f. costs.
  9. For every RRR, the RSFC problem with every decision bounded by RRR has the same value on the box and on its corners.
  10. The RRR-box step, in corrected form: value⁡(box)≤value⁡R(box)\operatorname{value}(\text{box}) \le \operatorname{value}_R(\text{box})value(box)≤valueR​(box) for all RRR, value⁡(corners)≤value⁡(box)\operatorname{value}(\text{corners}) \le \operatorname{value}(\text{box})value(corners)≤value(box), and value⁡(corners)=inf⁡Rvalue⁡R(corners)\operatorname{value}(\text{corners}) = \inf_R \operatorname{value}_R(\text{corners})value(corners)=infR​valueR​(corners).

Significance

Proposition 1 turns a semi-infinite multistage problem into a finite one: with box uncertainty, the min-max RSFC problem is equivalent to a linear program over the scenario tree of the 2T2^T2T corner trajectories, problem PextP_{\text{ext}}Pext​ of §2.3. The paper uses this exact value as a benchmark for its affinely adjustable approximation in the simulation study. Lemma 2 is the transferable statement: in any multistage worst-case problem whose stage costs are convex polyhedral and whose dynamics are linear with a uniform box on the decisions, the adversary may be restricted to the vertices of each period's uncertainty polytope.

The result is proved in the paper; to the best of current knowledge it has no machine-checked proof. Formalizing it produces a reusable notion of convex polyhedral function in the extended reals, closure properties of that class (partial minimization over a polyhedral box, affine substitution, finite maxima, sums), and a formal worst-case Bellman equation for nonanticipative policies. The corrected form of the RRR-box step also records precisely when the paper's informal "for RRR large enough" argument is valid.

Difficulty

The natural argument, "a convex function attains its maximum over a polytope at a vertex", applies to one stage only. In a multistage problem the cost of the last stage depends on the earlier decisions, which depend on earlier demands, so the worst case is not a convex function of the whole trajectory. The proof must therefore pass through a dynamic programming recursion, and the class of stage costs must be closed under the recursion: the optimal last-stage value as a function of the previous decision must again be convex polyhedral. That closure (the value of a parametric problem with a convex polyhedral objective and a box constraint) is where the work is: the domain is a projection of a polyhedron, and attainment and lower semicontinuity have to be shown with infinite values allowed.

A second difficulty is bookkeeping. The RSFC problem must be rewritten as an instance of Lemma 2 with the right stage vectors so that nonanticipativity of yty_tyt​ in dt−1d^{t-1}dt−1 is preserved, and the bounded problem must be related back to the unbounded one, which can have value −∞-\infty−∞.

Formalization scope

Periods of the RSFC model are Fin T, 0-based. Policies are functions of the whole demand trajectory with nonanticipativity imposed on trajectories of the uncertainty set; a policy that sees future demand is not admissible, which rules out the clairvoyant reading under which the statement changes. Optimal values are EReal infima of suprema: +∞+\infty+∞ for infeasible problems and possibly −∞-\infty−∞, never a real sInf that would turn both into 000. The c.p.f. definition requires the domain to be exactly a finite system of linear inequalities, so it cannot be satisfied vacuously.

The standing assumptions of §2.2, s<cTs < c_Ts<cT​ and (1) hT−s≥−pTh_T - s \ge -p_ThT​−s≥−pT​, are not imposed, and no sign is assumed on any cost or penalty: Proposition 1 holds without them, so the formal statement is a generalization. The norm ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ is Mathlib's default norm on Fin m → ℝ. Lemma 2's families are indexed by N\mathbb NN with the paper's indices; B t, C t stand for Bt+1B_{t+1}Bt+1​, Ct+1C_{t+1}Ct+1​. Two printed slips are corrected in the statements: (38) keeps the + bT+1+\,b_{T+1}+bT+1​ that the page drops, and the RRR-box step is stated in the corrected sandwich form because the literal claim fails when the value is −∞-\infty−∞.

Useful infrastructure: convex polyhedral functions in EReal, Fourier–Motzkin projection of polyhedra, maximum principle for convex functions on polytopes, extreme points of convex hulls of finite sets. Contributions to any milestone, and to general lemmas on these topics, are welcome.

Selected references

  • A. Ben-Tal, B. Golany, A. Nemirovski, J.-P. Vial, Retailer-Supplier Flexible Commitments Contracts: A Robust Optimization Approach, Manufacturing & Service Operations Management 7(3):248–271, 2005. https://doi.org/10.1287/msom.1050.0081
  • A. Ben-Tal, A. Goryashko, E. Guslitzer, A. Nemirovski, Adjustable robust solutions of uncertain linear programs, Mathematical Programming 99(2):351–376, 2004. https://doi.org/10.1007/s10107-003-0454-y
  • G. Iyengar, Robust dynamic programming, Mathematics of Operations Research 30:257–280, 2005. https://doi.org/10.1287/moor.1040.0129
13 thms2 active usersReviewed
Operations ResearchOptimizationProbability·Captain: mikedeng1

Overbooking with Substitutable Inventory Classes: With Semigroup Survivals the Expected Net Revenue Is Componentwise Concave and Submodular in the Overbooking LevelsResearch Paper

Motivation

Airlines, hotels and car-rental firms sell reservations ahead of service, and a fraction of those reservations cancel or do not show up. Overbooking — accepting more reservations than there is capacity — recovers revenue that cancellations would otherwise destroy, at the risk of denying service to some customers. In practice inventory is often substitutable: a passenger booked in economy can be upgraded to business, a guest booked in a standard room can be given a suite. With substitution, the right overbooking level for one reservation class depends on the levels of all the others.

Karaesmen and van Ryzin (Operations Research 52(1):83–104, 2004) model this as a two-period problem: overbooking decisions in a reservation period, followed by an optimal assignment of the customers who actually show up to inventory classes in a service period. Their structural result, Theorem 2, establishes the shape of the expected net revenue as a function of the overbooking levels. That shape is what justifies critical-level booking policies and the stochastic-gradient method of their §4, and it is the textbook account of joint overbooking with substitution (Talluri and van Ryzin, The Theory and Practice of Revenue Management, 2004, Proposition 4.4).

Setting

There are nnn reservation classes i=1,…,ni = 1, \dots, ni=1,…,n and m+1m + 1m+1 inventory classes j=0,1,…,mj = 0, 1, \dots, mj=0,1,…,m. Class j=0j = 0j=0 is virtual: assigning a customer to it means the customer is denied service.

Reservation period. The firm holds xix_ixi​ reservations of class iii and chooses overbooking levels ui≥xiu_i \ge x_iui​≥xi​. Accepting a class-iii reservation earns rir_iri​; a cancellation of class iii is refunded qiq_iqi​, with qi≤riq_i \le r_iqi​≤ri​. The number of class-iii customers who survive to the service period is a random variable Zi(ui)Z_i(u_i)Zi​(ui​) with values in {0,1,2,… }\{0, 1, 2, \dots\}{0,1,2,…}. The family {Zi(ui)}\{Z_i(u_i)\}{Zi​(ui​)} has the semigroup property: if Y1Y_1Y1​ and Y2Y_2Y2​ are independent with the laws of Zi(ui)Z_i(u_i)Zi​(ui​) and Zi(si)Z_i(s_i)Zi​(si​), then Y1+Y2Y_1 + Y_2Y1​+Y2​ has the law of Zi(ui+si)Z_i(u_i + s_i)Zi​(ui​+si​). The binomial model (Zi(ui)∼Bin(ui,pi)Z_i(u_i) \sim \mathrm{Bin}(u_i, p_i)Zi​(ui​)∼Bin(ui​,pi​) for integer uiu_iui​) and the Poisson model (Zi(ui)∼Poisson(uipi)Z_i(u_i) \sim \mathrm{Poisson}(u_i p_i)Zi​(ui​)∼Poisson(ui​pi​)) both have it. The survivals of different classes are independent.

Service period. Given the survivals z=(z1,…,zn)≥0z = (z_1, \dots, z_n) \ge 0z=(z1​,…,zn​)≥0, net benefits aija_{ij}aij​ (of either sign) and capacities cjc_jcj​, the firm solves the transportation problem

V0(z,c)=max⁡∑i=1n∑j=0maijyijs.t.∑j=0myij=zi,  ∑i=1nyij≤cj,  yij≥0.V_0(z, c) = \max \sum_{i=1}^n \sum_{j=0}^m a_{ij} y_{ij} \quad \text{s.t.} \quad \sum_{j=0}^m y_{ij} = z_i, \ \ \sum_{i=1}^n y_{ij} \le c_j, \ \ y_{ij} \ge 0.V0​(z,c)=maxi=1∑n​j=0∑m​aij​yij​s.t.j=0∑m​yij​=zi​,  i=1∑n​yij​≤cj​,  yij​≥0.

Expected net revenue. The objective of the reservation period is

G(u)=∑i=1nri(ui−xi)−E[∑i=1nqi(ui−Zi(ui))]+E[V0(Z(u),c)],G(u) = \sum_{i=1}^n r_i (u_i - x_i) - \mathbb E\Big[\sum_{i=1}^n q_i\big(u_i - Z_i(u_i)\big)\Big] + \mathbb E\big[V_0(Z(u), c)\big],G(u)=i=1∑n​ri​(ui​−xi​)−E[i=1∑n​qi​(ui​−Zi​(ui​))]+E[V0​(Z(u),c)],

to be maximized over u≥xu \ge xu≥x.

A function fff on Rn\mathbb R^nRn is submodular on SSS if f(s∨s′)+f(s∧s′)≤f(s)+f(s′)f(s \vee s') + f(s \wedge s') \le f(s) + f(s')f(s∨s′)+f(s∧s′)≤f(s)+f(s′) for s,s′∈Ss, s' \in Ss,s′∈S, with ∨,∧\vee, \wedge∨,∧ the componentwise maximum and minimum.

Formalization targets

Goal: Theorem 2

For every uuu with levels in the parameter set PPP, every class iii and all ε,α∈P\varepsilon, \alpha \in Pε,α∈P,

G(u+(ε+α)ei)−G(u+αei)≤G(u+εei)−G(u),G(u + (\varepsilon + \alpha) e_i) - G(u + \alpha e_i) \le G(u + \varepsilon e_i) - G(u),G(u+(ε+α)ei​)−G(u+αei​)≤G(u+εei​)−G(u),

and GGG is submodular on PnP^nPn:

G(u∨u′)+G(u∧u′)≤G(u)+G(u′).G(u \vee u') + G(u \wedge u') \le G(u) + G(u').G(u∨u′)+G(u∧u′)≤G(u)+G(u′).

The first statement is the paper's componentwise concavity (6); the second is its submodularity, proved in the paper through the pairwise inequality (7) and Theorem 1.

Milestones

  1. LP duality for the transportation problem (§2.2, p. 86): for z≥0z \ge 0z≥0 the primal attains its optimum and equals the dual optimum.
  2. Lemma 1: V0(⋅,c)V_0(\cdot, c)V0​(⋅,c) is submodular on R≥0n\mathbb R^n_{\ge 0}R≥0n​.
  3. Lemma 2: V0V_0V0​ is concave in (z1,…,zn)(z_1, \dots, z_n)(z1​,…,zn​) and concave in (c1,…,cm)(c_1, \dots, c_m)(c1​,…,cm​).
  4. Theorem 1: on a product set, submodularity is equivalent to decreasing differences.
  5. Under the semigroup property, E[Zi(ui)]\mathbb E[Z_i(u_i)]E[Zi​(ui​)] is additive in uiu_iui​.
  6. The semigroup representation E[V0(Z(u+εei))]=E[V0(Z(u)+Yei)]\mathbb E[V_0(Z(u + \varepsilon e_i))] = \mathbb E[V_0(Z(u) + Y e_i)]E[V0​(Z(u+εei​))]=E[V0​(Z(u)+Yei​)] with YYY independent of Z(u)Z(u)Z(u) and distributed as Zi(ε)Z_i(\varepsilon)Zi​(ε).
  7. The sample-path inequalities of the proof: nonincreasing increments of V0V_0V0​ along one coordinate, and the pairwise submodularity inequality for two coordinates.

Significance

Componentwise concavity of GGG implies that for each reservation class there is a critical booking level beyond which expected revenue does not increase, other levels held fixed. Submodularity implies that these critical levels are nonincreasing in the bookings accepted for any other class: heavier overbooking in one class leaves less spare substitute capacity for the others. These two properties underpin the heuristics and the stochastic-gradient optimization of §4–§5 of the paper.

The result is proved in the paper (for n=2n = 2n=2, with the general case described as straightforward). A machine-checked version would cover the general semigroup case, which includes the binomial model the paper calls realistic, real-valued levels and arbitrary step sizes. The platform already holds a proved special case, RevenueManagement.joint_overbooking_concave_submodular (Talluri–van Ryzin, Proposition 4.4): Poisson survivals, integer levels and unit steps only. This mission generalizes it in all three respects and also formalizes the transportation-problem facts (LP duality, submodularity and concavity of V0V_0V0​) as reusable statements.

Difficulty

The obvious route — differentiate GGG and use concavity of V0V_0V0​ — fails twice. First, V0V_0V0​ is piecewise linear and the survivals are discrete, so there is nothing to differentiate; under the binomial model GGG is only defined at integer levels. Second, concavity of V0V_0V0​ alone does not survive the expectation: E[V0(Z(u))]\mathbb E[V_0(Z(u))]E[V0​(Z(u))] is a mixture over laws that change with uuu, and a concave function of a random vector whose law moves with the parameter need not be concave in the parameter. The semigroup property is what replaces a change of law by the addition of an independent block of survivors, and that coupling must be built for every coordinate and every pair of coordinates at once. On the LP side, submodularity of a transportation-problem value in its demands is a lattice-programming fact (Topkis, Theorem 3.4.1; Shapley 1962), not a consequence of concavity.

Formalization scope

All declarations are in the namespace SubstOverbooking.Structure. Reservation classes are Fin n (0-based), inventory classes Fin (m + 1) with 0 the virtual denied-service class. Conventions committed to:

  • Uncapacitated virtual class. The paper gives class 0 "finite but very high capacity" and then needs it to absorb every survivor; with Poisson survivals no finite capacity does. Constraint (4) is imposed only for j≠0j \ne 0j=0, c0c_0c0​ is unused, and the dual fixes λ0=0\lambda_0 = 0λ0​=0. Capacities satisfy cj≥0c_j \ge 0cj​≥0 for j≠0j \ne 0j=0.
  • V0V_0V0​ on real demands. V0V_0V0​ is the supremum of the TP objective over feasible assignments, for real zzz; every statement assumes z≥0z \ge 0z≥0, where the supremum is attained and finite.
  • Survival laws. Each class has a family u↦Li(u)u \mapsto L_i(u)u↦Li​(u) of probability mass functions on N\mathbb NN, with finite means. Levels range over a parameter set P⊆[0,∞)P \subseteq [0, \infty)P⊆[0,∞) that contains 000 and is closed under addition and under nonnegative differences: P=NP = \mathbb NP=N covers the binomial model, P=[0,∞)P = [0, \infty)P=[0,∞) the Poisson model. The semigroup property is the identity of laws Li(u+s)=(Li(u)⊗Li(s))∘(+)−1L_i(u + s) = (L_i(u) \otimes L_i(s)) \circ (+)^{-1}Li​(u+s)=(Li​(u)⊗Li​(s))∘(+)−1 for u,s∈Pu, s \in Pu,s∈P, and independence across classes is the product law.
  • Concavity is stated as the increment inequality (6), which is meaningful on a discrete PPP; submodularity of GGG is lattice submodularity on PnP^nPn via the published SupermodularOn applied to −G-G−G.
  • Theorem 1 is stated for product sets S=T1×⋯×TnS = T_1 \times \dots \times T_nS=T1​×⋯×Tn​; as printed for arbitrary S⊂RnS \subset \mathbb R^nS⊂Rn it is false, and every set the paper applies it to is a product.
  • The refund condition qi≤riq_i \le r_iqi​≤ri​ is kept as a hypothesis of the goal, as on the page.

A formalization that fixes Poisson laws, integer levels or unit steps, or that defines GGG or V0V_0V0​ through the inequalities to be proved, is the already-proved special case or an empty statement, and is not the goal.

A complete development needs finite LP duality for the transportation problem, the lattice-programming argument for Lemma 1, product measures and image measures on Nn\mathbb N^nNn, and the coupling of the semigroup property. The LP and lattice parts are reusable beyond this mission. Proofs of any milestone are welcome, as are alternative arguments for Lemma 1 (for instance via monotonicity of optimal duals, after Erlenkotter 1970).

Selected references

  • I. Karaesmen and G. van Ryzin, Overbooking with Substitutable Inventory Classes, Operations Research 52(1):83–104, 2004. https://doi.org/10.1287/opre.1030.0079
  • K. T. Talluri and G. J. van Ryzin, The Theory and Practice of Revenue Management, Springer, 2004, §4.4. https://doi.org/10.1007/b139000
  • D. M. Topkis, Supermodularity and Complementarity, Princeton University Press, 1998, Theorem 3.4.1. https://doi.org/10.1515/9781400822539
  • R. K. Sundaram, A First Course in Optimization Theory, Cambridge University Press, 1996. https://doi.org/10.1017/CBO9780511804526
  • L. S. Shapley, Complements and substitutes in the optimal assignment problem, Naval Research Logistics Quarterly 9(1):45–48, 1962. https://doi.org/10.1002/nav.3800090106
  • M. Shaked and J. G. Shanthikumar, Stochastic convexity and its applications, Advances in Applied Probability 20(2):427–446, 1988. https://doi.org/10.2307/1427398
11 thms2 active usersReviewed
Operations ResearchOptimizationTheoretical Computer Science·Captain: mikedeng1

Fast Approximation Algorithms for Fractional Packing and Covering Problems 3: An ε-Relaxed Decision Procedure for the General Problem Ax ≤ b, x ∈ P Using O(ρ²ε⁻² log(mρ/ε)) Oracle CallsResearch Paper

Motivation

Many linear programs that arise in combinatorial optimization have a few "complicating" constraints Ax≤bAx \le bAx≤b on top of a set PPP over which linear optimization is easy: multicommodity flow, where PPP is a product of single-commodity flow polytopes; scheduling and the Held–Karp bound, where PPP is a polytope of assignments or trees. Plotkin, Shmoys and Tardos showed that for such problems an approximate solution can be found with a number of calls to the linear optimizer over PPP that depends on the required accuracy and on a structural quantity, the width, but only logarithmically on the number of constraints. Their packing and covering algorithms (§§2–3 of the paper) assume nonnegative data. Section 4 removes that assumption and treats an arbitrary system of linear inequalities over a convex set. This framework, later known as the multiplicative-weights method for linear programs, is among the standard tools of approximation algorithms (Arora, Hazan and Kale's 2012 survey gives the modern account).

Timeline. Shahrokhi and Matula (1990) gave an exponential-potential algorithm for the maximum concurrent flow problem. Plotkin, Shmoys and Tardos (FOCS 1991; Cornell ORIE Technical Report 999, 1992; Mathematics of Operations Research 1995) generalized it to fractional packing, covering and the general problem of this mission. Grigoriadis and Khachiyan (1994–1996) obtained related bounds for block-angular and convex resource-sharing problems. Garg and Könemann (1998) and Arora, Hazan and Kale (2012) gave width-free or simplified variants.

Setting

An instance of the GENERAL problem consists of an arbitrary real m×nm\times nm×n matrix AAA with rows a1,…,ama_1,\dots,a_ma1​,…,am​, an arbitrary vector b∈Rmb\in\mathbb R^mb∈Rm, a convex set P⊆RnP\subseteq\mathbb R^nP⊆Rn, and a positive vector d∈Rmd\in\mathbb R^md∈Rm that sets the scale of the allowed error. The question is whether some x∈Px\in Px∈P satisfies Ax≤bAx\le bAx≤b. Such a point is an exact solution; a point x∈Px\in Px∈P with Ax≤b+εdAx\le b+\varepsilon dAx≤b+εd is an ε\varepsilonε-approximate solution.

For x∈Px\in Px∈P write

λ(x)=max⁡1≤i≤maix−bidi,\lambda(x)=\max_{1\le i\le m}\frac{a_ix-b_i}{d_i},λ(x)=1≤i≤mmax​di​ai​x−bi​​,

the least λ\lambdaλ with Ax≤b+λdAx\le b+\lambda dAx≤b+λd; it may be negative. The width is ρ=max⁡imax⁡x∈P∣aix−bi∣/di\rho=\max_i\max_{x\in P}|a_ix-b_i|/d_iρ=maxi​maxx∈P​∣ai​x−bi​∣/di​. Access to PPP is through subroutine (10): given y≥0y\ge 0y≥0 in Rm\mathbb R^mRm, return x~∈P\tilde x\in Px~∈P minimizing ytAxy^tAxytAx over PPP. For a dual vector y≥0y\ge0y≥0 let CG(y)=min⁡{yt(Ax−b):x∈P}C_{\mathcal G}(y)=\min\{y^t(Ax-b):x\in P\}CG​(y)=min{yt(Ax−b):x∈P}. The relaxed optimality conditions for a point xxx with λ=λ(x)\lambda=\lambda(x)λ=λ(x) and a dual vector yyy are

(G1)  λ ytd≤4 yt(Ax−b),(G2)  yt(Ax−b)−CG(y)≤λ5 ytd.(\mathcal G1)\ \ \lambda\,y^td\le 4\,y^t(Ax-b),\qquad(\mathcal G2)\ \ y^t(Ax-b)-C_{\mathcal G}(y)\le\tfrac{\lambda}{5}\,y^td.(G1)  λytd≤4yt(Ax−b),(G2)  yt(Ax−b)−CG​(y)≤5λ​ytd.

The dual solution corresponding to xxx with parameter α\alphaα is yi=di−1eα(aix−bi)/diy_i=d_i^{-1}e^{\alpha(a_ix-b_i)/d_i}yi​=di−1​eα(ai​x−bi​)/di​, and its potential is Φ=ytd\Phi=y^tdΦ=ytd. Procedure IMPROVE-GENERAL (Figure 4) starts from x0∈Px_0\in Px0​∈P with λ0=λ(x0)\lambda_0=\lambda(x_0)λ0​=λ(x0​), fixes α\alphaα and a step size σ\sigmaσ, and, while λ(x)≥λ0/2\lambda(x)\ge\lambda_0/2λ(x)≥λ0​/2 and (G2)(\mathcal G2)(G2) fails, replaces xxx by (1−σ)x+σx~(1-\sigma)x+\sigma\tilde x(1−σ)x+σx~, where x~\tilde xx~ is the oracle's answer for the current dual solution. The driver calls IMPROVE-GENERAL repeatedly, stopping with an ε\varepsilonε-approximate solution or with a report that none exists.

Formalization targets

Goal: Theorem 4.5

For every ε∈(0,1)\varepsilon\in(0,1)ε∈(0,1), every start x0∈Px_0\in Px0​∈P and every exact minimizing oracle, the driver stops; an output point is an ε\varepsilonε-approximate solution; an infeasibility report is correct (∄x∈P\nexists x\in P∄x∈P with Ax≤bAx\le bAx≤b); and the number of oracle calls is at most

N=2(⌊log⁡2(ρ/ε)⌋+1)+11520 ρ2ε2ln⁡12 m max⁡(ρ,ε)ε=O ⁣(ρ2ε−2log⁡mρε).N=2\big(\lfloor\log_2(\rho/\varepsilon)\rfloor+1\big)+11520\,\frac{\rho^2}{\varepsilon^2}\ln\frac{12\,m\,\max(\rho,\varepsilon)}{\varepsilon}=O\!\Big(\rho^2\varepsilon^{-2}\log\frac{m\rho}{\varepsilon}\Big).N=2(⌊log2​(ρ/ε)⌋+1)+11520ε2ρ2​lnε12mmax(ρ,ε)​=O(ρ2ε−2logεmρ​).

Milestones

  1. Lemma 4.1. If x∈Px\in Px∈P, y≥0y\ge0y≥0, y≠0y\ne0y=0 satisfy (G1)(\mathcal G1)(G1) and (G2)(\mathcal G2)(G2) with λ(x)>0\lambda(x)>0λ(x)>0, no exact solution exists.
  2. Lemma 4.2. If α≥2λ−1ln⁡(6mρλ−1)\alpha\ge2\lambda^{-1}\ln(6m\rho\lambda^{-1})α≥2λ−1ln(6mρλ−1), then xxx and its dual solution satisfy (G1)(\mathcal G1)(G1).
  3. Lemma 4.3. If (G2)(\mathcal G2)(G2) fails and 0≤σ≤λ/(24αρ2)0\le\sigma\le\lambda/(24\alpha\rho^2)0≤σ≤λ/(24αρ2), the step to (1−σ)x+σx~(1-\sigma)x+\sigma\tilde x(1−σ)x+σx~ lowers the potential: Φ−Φ^≥ασλΦ/30\Phi-\hat\Phi\ge\alpha\sigma\lambda\Phi/30Φ−Φ^≥ασλΦ/30.
  4. Theorem 4.4. IMPROVE-GENERAL started with λ0>0\lambda_0>0λ0​>0 stops after at most 2+8640ρ2λ0−2ln⁡(12mρλ0−1)2+8640\rho^2\lambda_0^{-2}\ln(12m\rho\lambda_0^{-1})2+8640ρ2λ0−2​ln(12mρλ0−1​) oracle calls.

Significance

The result gives an ε\varepsilonε-relaxed decision procedure for any system of linear inequalities over a convex set with a linear-optimization oracle, with no sign conditions on the data. Its oracle-call count is independent of nnn and logarithmic in mmm, which is what makes it useful when mmm is large and PPP has a fast combinatorial optimizer. The simultaneous packing-and-covering problem is the special case where every row is either nonnegative or nonpositive; the paper's width-reduction techniques (§5) and applications (§6) build on this procedure and on its packing and covering counterparts.

The paper's statements use O(⋅)O(\cdot)O(⋅) and Ω(⋅)\Omega(\cdot)Ω(⋅); this mission states the explicit constants that the paper's own proofs give. The result is proved in the literature; no machine-checked proof of it is known on Prove2Me or in Mathlib. It also records a gap in Figure 4 (below) and states the theorem for the smallest correction that makes the paper's proof go through. Formalizing the analysis yields reusable potential-function arguments (second-order bounds on ex+δe^{x+\delta}ex+δ, geometric decrease of a potential between two levels) of the kind used throughout multiplicative-weights analyses.

Difficulty

The correctness half is short; the complexity half carries the weight. Lemma 4.3 needs a second-order bound on the exponential that is valid only when the step changes each exponent by at most 1/21/21/2, so the step size must be tied to λ\lambdaλ and ρ\rhoρ. Theorem 4.4 then has to control the potential between a ceiling meαλ0me^{\alpha\lambda_0}meαλ0​ and a floor eαλ0/2e^{\alpha\lambda_0/2}eαλ0​/2 while λ\lambdaλ moves, and Theorem 4.5 has to sum the per-call bounds over a sequence of calls whose λ0\lambda_0λ0​ halves each time, so that the last call dominates.

The first reading of Figure 4 fails here: Figure 4 fixes α=4λ0−1ln⁡(6mρλ0−1)\alpha=4\lambda_0^{-1}\ln(6m\rho\lambda_0^{-1})α=4λ0−1​ln(6mρλ0−1​) and σ=λ0/(24αρ2)\sigma=\lambda_0/(24\alpha\rho^2)σ=λ0​/(24αρ2) from λ0\lambda_0λ0​, but the loop runs for every λ≥λ0/2\lambda\ge\lambda_0/2λ≥λ0​/2. For λ<λ0\lambda<\lambda_0λ<λ0​ the hypothesis σ≤λ/(24αρ2)\sigma\le\lambda/(24\alpha\rho^2)σ≤λ/(24αρ2) of Lemma 4.3 fails, and the decrease bound from its proof becomes negative for λ<5λ0/6\lambda<5\lambda_0/6λ<5λ0​/6. At λ=λ0/2\lambda=\lambda_0/2λ=λ0​/2, the hypothesis of Lemma 4.2 requires α≥4λ0−1ln⁡(12mρλ0−1)\alpha\ge4\lambda_0^{-1}\ln(12m\rho\lambda_0^{-1})α≥4λ0−1​ln(12mρλ0−1​), which the printed α\alphaα does not meet, so (G1)(\mathcal G1)(G1) and the infeasibility certificate are not guaranteed. With the printed parameters, the iteration bound is not established by the paper's argument.

Formalization scope

  • Representation. Constraints are indexed by Fin m with m≥1m\ge1m≥1 ([NeZero m]), coordinates by Fin n; AAA is a real matrix and bbb, ddd real vectors with d>0d>0d>0; PPP is a convex set. No sign hypothesis is put on AAA, bbb or PPP.
  • Width. ρ>0\rho>0ρ>0 is an upper bound on the width (∣aix−bi∣≤ρdi|a_ix-b_i|\le\rho d_i∣ai​x−bi​∣≤ρdi​ on PPP), not a supremum; the algorithm uses ρ\rhoρ in its parameters, and the theorems hold for every such bound, the exact width included.
  • Oracle. Subroutine (10) is an arbitrary function from dual vectors to points; theorems assume that for every y≥0y\ge0y≥0 it returns a point of PPP minimizing ytAxy^tAxytAx over PPP, and quantify over every such oracle.
  • Corrected parameters. IMPROVE-GENERAL uses α=4λ0−1ln⁡(12mρλ0−1)\alpha=4\lambda_0^{-1}\ln(12m\rho\lambda_0^{-1})α=4λ0−1​ln(12mρλ0−1​) and σ=λ0/(48αρ2)\sigma=\lambda_0/(48\alpha\rho^2)σ=λ0​/(48αρ2), i.e. Figure 4's formulas with λ0/2\lambda_0/2λ0​/2 for λ0\lambda_0λ0​. Lemmas 4.1–4.3 are stated as printed; they do not mention Figure 4.
  • Runs and cost. Procedure and driver are defined with a fuel bound; the theorems assert that the loop test fails before the fuel is exhausted. One oracle call is charged per evaluation of the loop test that reaches (G2)(\mathcal G2)(G2); the loop body reuses its answer. The driver checks λ(x)≤ε\lambda(x)\le\varepsilonλ(x)≤ε before every call, so no call is made with λ0≤ε\lambda_0\le\varepsilonλ0​≤ε, and it reports infeasibility only when a call stopped on its (G2)(\mathcal G2)(G2) test with λ>ε\lambda>\varepsilonλ>ε.
  • Explicit constants replacing O(⋅)O(\cdot)O(⋅) and Ω(⋅)\Omega(\cdot)Ω(⋅). Lemma 4.3: Ω(ασλΦ)\Omega(\alpha\sigma\lambda\Phi)Ω(ασλΦ) becomes ασλΦ/30\alpha\sigma\lambda\Phi/30ασλΦ/30. Theorem 4.4: O(ρ2λ0−2log⁡(mρλ0−1))O(\rho^2\lambda_0^{-2}\log(m\rho\lambda_0^{-1}))O(ρ2λ0−2​log(mρλ0−1​)) becomes 2+8640ρ2λ0−2ln⁡(12mρλ0−1)2+8640\rho^2\lambda_0^{-2}\ln(12m\rho\lambda_0^{-1})2+8640ρ2λ0−2​ln(12mρλ0−1​) oracle calls. Theorem 4.5: O(ρ2ε−2log⁡(mρε−1))O(\rho^2\varepsilon^{-2}\log(m\rho\varepsilon^{-1}))O(ρ2ε−2log(mρε−1)) becomes NNN above; max⁡(ρ,ε)\max(\rho,\varepsilon)max(ρ,ε) equals ρ\rhoρ whenever a call is made. The "time to compute AxAxAx" clause of Theorem 4.5 is not formalized.
  • Ruled out. A formalization that assumes termination, takes the oracle's optimality only at the points visited, lets the constant depend on the instance, or allows a call with λ0≤0\lambda_0\le0λ0​≤0 (where ln⁡\lnln and division return junk values) is not the paper's theorem.
  • Needed. Finite sums and maxima over Fin m, second-order bounds on Real.exp and monotonicity of Real.log, convex combinations, induction over fuelled recursions. The potential-decrease lemmas are reusable for the packing and covering missions of the same paper. Proofs of any milestone are welcome independently.

Selected references

  • S. A. Plotkin, D. B. Shmoys, É. Tardos, Fast Approximation Algorithms for Fractional Packing and Covering Problems, Cornell University School of ORIE, Technical Report No. 999, 1992 (§4, pp. 23–27). Journal version: Mathematics of Operations Research 20(2):257–301, 1995. https://doi.org/10.1287/moor.20.2.257
  • F. Shahrokhi, D. W. Matula, The maximum concurrent flow problem, Journal of the ACM 37(2):318–334, 1990. https://doi.org/10.1145/77600.77620
  • M. D. Grigoriadis, L. G. Khachiyan, Fast approximation schemes for convex programs with many blocks and coupling constraints, SIAM Journal on Optimization 4(1):86–107, 1994. https://doi.org/10.1137/0804004
  • N. Garg, J. Könemann, Faster and simpler algorithms for multicommodity flow and other fractional packing problems, SIAM Journal on Computing 37(2):630–652, 2007. https://doi.org/10.1137/S0097539704446232
  • S. Arora, E. Hazan, S. Kale, The multiplicative weights update method: a meta-algorithm and applications, Theory of Computing 8:121–164, 2012. https://doi.org/10.4086/toc.2012.v008a006
9 thms2 active usersReviewed
Complexity TheoryOperations ResearchOptimization·Captain: mikedeng1

An O(√nL)-Iteration Homogeneous and Self-Dual Linear Programming Algorithm 1: In O(√nL) Predictor-Corrector Iterations It Finds LP and Dual Optima or Detects InfeasibilityResearch Paper

Motivation

Interior-point methods solve linear programs in polynomially many iterations, but the classical analyses assume something about the instance before the algorithm starts: a known strictly feasible primal–dual pair, a nonempty interior, or a big-MMM bound on the feasible region of order 2L2^L2L, where LLL is the bit length of the data. In practice none of this is known in advance, and an infeasible or unbounded instance should be reported rather than assumed away.

Ye, Todd and Mizuno (1994) removed these assumptions. They embed a standard-form linear program and its dual into a single homogeneous and self-dual artificial program (HLP), which always has a known interior starting point, and apply the Mizuno–Todd–Ye predictor–corrector method to it. The resulting algorithm needs no regularity assumption, no big-MMM parameter, and an O(nL)O(\sqrt n L)O(n​L) iteration bound, the best known for interior-point methods. Self-dual embeddings of this kind are now the standard initialization in interior-point solvers for linear and conic programs.

Timeline. Karmarkar (1984) gave the first polynomial interior-point method on a homogeneous canonical form. Mizuno, Todd and Ye (1990) introduced the predictor–corrector method with O(nL)O(\sqrt nL)O(n​L) iterations under a known interior start. Kojima, Mizuno and Yoshise (1993) built a self-dual big-MMM artificial problem. Ye, Todd and Mizuno (1994) combined homogeneity and self-duality without big MMM, obtaining the result formalized here.

Setting

Given A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n, b∈Rmb\in\mathbb R^mb∈Rm, c∈Rnc\in\mathbb R^nc∈Rn, the primal problem is (LP) min⁡{cTx:Ax=b, x≥0}\min\{c^Tx : Ax=b,\ x\ge0\}min{cTx:Ax=b, x≥0} and its dual is (LD) max⁡{bTy:ATy≤c}\max\{b^Ty : A^Ty\le c\}max{bTy:ATy≤c}, with dual slacks s=c−ATys=c-A^Tys=c−ATy.

Fix x0>0x^0>0x0>0, s0>0s^0>0s0>0, y0y^0y0 and put bˉ=b−Ax0\bar b=b-Ax^0bˉ=b−Ax0, cˉ=c−ATy0−s0\bar c=c-A^Ty^0-s^0cˉ=c−ATy0−s0, zˉ=cTx0+1−bTy0\bar z=c^Tx^0+1-b^Ty^0zˉ=cTx0+1−bTy0. The homogeneous self-dual program (HLP) in the variables (y,x,τ,θ,s,κ)(y,x,\tau,\theta,s,\kappa)(y,x,τ,θ,s,κ) is

min⁡ ((x0)Ts0+1) θs.t. Ax−bτ+bˉθ=0,s=−ATy+cτ−cˉθ≥0,κ=bTy−cTx+zˉθ≥0,−bˉTy+cˉTx−zˉτ=−(x0)Ts0−1,x≥0, τ≥0.\begin{aligned} \min\ & ((x^0)^Ts^0+1)\,\theta\\ \text{s.t. } & Ax-b\tau+\bar b\theta=0,\qquad s=-A^Ty+c\tau-\bar c\theta\ge0,\qquad \kappa=b^Ty-c^Tx+\bar z\theta\ge0,\\ & -\bar b^Ty+\bar c^Tx-\bar z\tau=-(x^0)^Ts^0-1,\qquad x\ge0,\ \tau\ge0 . \end{aligned}min s.t. ​((x0)Ts0+1)θAx−bτ+bˉθ=0,s=−ATy+cτ−cˉθ≥0,κ=bTy−cTx+zˉθ≥0,−bˉTy+cˉTx−zˉτ=−(x0)Ts0−1,x≥0, τ≥0.​

Its feasible set is Fh\mathcal F_hFh​, and Fh0\mathcal F_h^0Fh0​ is the subset with (x,τ,s,κ)>0(x,\tau,s,\kappa)>0(x,τ,s,κ)>0. A strictly self-complementary solution is an optimal solution with θ=0\theta=0θ=0 and (x+s;τ+κ)>0(x+s;\tau+\kappa)>0(x+s;τ+κ)>0. The paper then fixes y0=0y^0=0y0=0, x0=s0=ex^0=s^0=ex0=s0=e, so the objective is (n+1)θ(n+1)\theta(n+1)θ and (0,e,1,1,e,1)∈Fh0(0,e,1,1,e,1)\in\mathcal F_h^0(0,e,1,1,e,1)∈Fh0​.

With μ=(xTs+τκ)/(n+1)\mu=(x^Ts+\tau\kappa)/(n+1)μ=(xTs+τκ)/(n+1), the neighborhood of the central path is N(β)={z∈Fh0:∥(Xs;τκ)−μe∥≤βμ}\mathcal N(\beta)=\{z\in\mathcal F_h^0 : \|(Xs;\tau\kappa)-\mu e\|\le\beta\mu\}N(β)={z∈Fh0​:∥(Xs;τκ)−μe∥≤βμ} (Euclidean norm). The predictor–corrector algorithm starts at (0,e,1,1,e,1)(0,e,1,1,e,1)(0,e,1,1,e,1). At even steps it solves a Newton system with centering parameter γ=0\gamma=0γ=0 and moves by the largest step keeping the iterate in N(1/2)\mathcal N(1/2)N(1/2). At odd steps it takes a full Newton step with γ=1\gamma=1γ=1. A termination projection then solves a least-squares problem on the columns where xjk≥sjkx_j^k\ge s_j^kxjk​≥sjk​ and produces a candidate exact solution.

Formalization targets

Goal: Corollary 7

For integer data with bit length LLL and n≥1n\ge1n≥1, there is an absolute constant CCC and a finite predictor–corrector run that reaches, within

k≤Cn Lk\le C\sqrt n\,Lk≤Cn​L

iterations, an iterate whose termination output u=(y∗,x∗,τ∗,θ∗,s∗,κ∗)u=(y^*,x^*,\tau^*,\theta^*,s^*,\kappa^*)u=(y∗,x∗,τ∗,θ∗,s∗,κ∗) either has τ∗>0\tau^*>0τ∗>0 with x∗/τ∗x^*/\tau^*x∗/τ∗ optimal for (LP) and (y∗/τ∗,s∗/τ∗)(y^*/\tau^*,s^*/\tau^*)(y∗/τ∗,s∗/τ∗) optimal for (LD), or has τ∗=0\tau^*=0τ∗=0 with cTx∗<0c^Tx^*<0cTx∗<0 and (LD) infeasible, or −bTy∗<0-b^Ty^*<0−bTy∗<0 and (LP) infeasible.

Theorem 6

The same bound, with the conclusion that the termination output, rescaled to the normalization eTx+eTs+τ+κ−(n+1)θ=n+1e^Tx+e^Ts+\tau+\kappa-(n+1)\theta=n+1eTx+eTs+τ+κ−(n+1)θ=n+1, is a strictly self-complementary solution of (HLP).

Milestones

Proposition 1 (self-duality of skew-symmetric programs), Theorem 2 (ii), (iv), (v), Theorem 5 (ii), the two Mizuno–Todd–Ye estimates in the proof of Theorem 6, the predictor-step and corrector-step claims, the termination claim, the integrality and O(L)O(L)O(L) size of the (HLP) data, and Theorem 3 (i), (ii).

Significance

The result. Corollary 7 gives a single polynomial algorithm that decides the status of an arbitrary linear program. It returns optimal primal and dual solutions when they exist and an infeasibility certificate otherwise. It needs no Phase I, no big-MMM constant and no interior assumption, and its O(nL)O(\sqrt nL)O(n​L) iteration count matches the best bound known under those assumptions. Theorem 3 is the bridge: an exact strictly self-complementary solution of (HLP) determines the status of (LP) and (LD).

Formalizing it. The paper's result is proved; no machine-checked proof of it is known. The mission produces a formal account of the self-dual embedding, the central-path neighborhood analysis for (HLP), an exact finite-termination step from an approximate iterate, and the reading of a bit-length complexity bound with explicit quantifier order. The neighborhood estimates and the bit-length machinery are reusable for other interior-point and complexity results.

Difficulty

The per-step estimates are short calculations once the orthogonality dxTds+dτdκ=0d_x^Td_s+d_\tau d_\kappa=0dxT​ds​+dτ​dκ​=0 is available. The step that resists is termination. Geometric decrease of the gap reaches 2−O(L)2^{-O(L)}2−O(L) in O(nL)O(\sqrt nL)O(n​L) iterations, but turning such an iterate into an exact strictly self-complementary solution requires a quantitative separation: on N(1/2)\mathcal N(1/2)N(1/2), once the gap is below 2−O(L)2^{-O(L)}2−O(L), the comparison xj≥sjx_j\ge s_jxj​≥sj​ must identify the optimal partition and the least-squares projection must land in the positive orthant. That separation bound rests on determinant estimates for integer matrices (Hadamard-type bounds in terms of LLL) and on the strict complementarity of (HLP), neither of which comes from the iteration analysis itself. A second subtlety is that the algorithm is not a function: without a rank assumption the Newton system leaves dyd_ydy​ undetermined.

Formalization scope

  • Data for the complexity statements are integer matrices and vectors, cast to R\mathbb RR; all optimization objects are real. LLL is Schrijver's encoding size, ∑(1+⌈log⁡2(∣v∣+1)⌉)\sum(1+\lceil\log_2(|v|+1)\rceil)∑(1+⌈log2​(∣v∣+1)⌉) over the entries plus the dimensions, so L≥1L\ge1L≥1 whenever n≥1n\ge1n≥1.
  • Every O(⋅)O(\cdot)O(⋅) is pinned with an absolute constant chosen before mmm, nnn and the data: O(nL)O(\sqrt nL)O(n​L) as Cn LC\sqrt n\,LCn​L, 2−O(L)2^{-O(L)}2−O(L) as 2−C′L2^{-C'L}2−C′L, and O(L)O(L)O(L) as C⋅LC\cdot LC⋅L. The hypothesis n≥1n\ge1n≥1, implicit in the paper, is explicit.
  • The algorithm is a relation on finite runs: any solution of the Newton system may be used, and each predictor step taken before termination must attain the maximum in (13). The conclusion asserts a successful run and its output. Stopping at the successful iterate avoids requiring a later step whose maximum may not exist.
  • The termination projection is defined relationally (an output is built from a minimizer) and its existence is part of the conclusion. Theorem 6 is stated for the output rescaled to the normalization (9): the projection imposes only homogeneous constraints, so the unscaled output need not be feasible for (HLP).
  • "(LP) has a solution (feasible and bounded)" is read as "(LP) has an optimal solution". "An indication that (LP) or (LD) is infeasible" is the negative sign of cTx∗c^Tx^*cTx∗ or −bTy∗-b^Ty^*−bTy∗ together with the infeasibility it certifies, not the bare disjunction "one of them is infeasible".
  • "Optimal for (HLP)" means minimizing the objective over Fh\mathcal F_hFh​. It is not defined as θ=0\theta=0θ=0, which would make Theorem 2 (iv) definitional.
  • Norms are Euclidean and written out explicitly, since Lean's default norm on Rn\mathbb R^nRn is the sup norm.
  • (LP) and (LD) are built on the published general-form LP definitions (LinearOptimization_DualLP). The self-dual objects of the Vanderbei and Matoušek series are different embeddings and are not reused.

A complete development needs: skew-symmetric LP duality and strict complementarity (Goldman–Tucker) for (HLP), the Mizuno–Todd–Ye neighborhood calculus, and Hadamard-type bounds on integer determinants. Contributions to any milestone, or to these supporting libraries, are welcome.

Selected references

  • Y. Ye, M. J. Todd, S. Mizuno, An O(nL)O(\sqrt nL)O(n​L)-iteration homogeneous and self-dual linear programming algorithm, Mathematics of Operations Research 19(1), 53–67, 1994. https://doi.org/10.1287/moor.19.1.53
  • S. Mizuno, M. J. Todd, Y. Ye, On adaptive-step primal-dual interior-point algorithms for linear programming, Mathematics of Operations Research 18(4), 964–981, 1993. https://doi.org/10.1287/moor.18.4.964
  • S. Mehrotra, Y. Ye, Finding an interior point in the optimal face of linear programs, Mathematical Programming 62, 497–515, 1993. https://doi.org/10.1007/BF01585180
  • M. Kojima, S. Mizuno, A. Yoshise, A little theorem of the big M in interior point algorithms, Mathematical Programming 59, 361–375, 1993. https://doi.org/10.1007/BF01581253
  • N. Karmarkar, A new polynomial-time algorithm for linear programming, Combinatorica 4, 373–395, 1984. https://doi.org/10.1007/BF02579150
  • A. Schrijver, Theory of Linear and Integer Programming, Wiley, 1986.
22 thms2 active usersReviewed
PreviousPage 1 of 6Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me