The Traveling-Salesman Problem and Minimum Spanning Trees, Part II: Convergence of the Constant-Step Ascent to the 1-Tree BoundResearch Paper
Motivation
The traveling-salesman problem (TSP) asks for a cheapest cycle through all vertices of a weighted complete graph. Exact algorithms for it are branch-and-bound searches, and their size depends almost entirely on the quality of the lower bounds used to prune the search. In 1970 Held and Karp introduced the 1-tree bound: a Lagrangian relaxation of the degree-2 constraints of a tour, whose value can be evaluated by one minimum-spanning-tree computation (Held & Karp, Part I, 1970). Part II (Held & Karp, 1971) replaces the ascent procedure of Part I by an iterative method related to the relaxation method for linear inequalities of Agmon and of Motzkin and Schoenberg (1954), and with it solved to proven optimality every instance presented to it, up to 64 cities. The iteration is the prototype of what is now called the subgradient method with Polyak-type step sizes, and the 1-tree bound remains a standard lower bound in exact TSP codes.
Timeline:
- 1954 — Agmon; Motzkin and Schoenberg: the relaxation method for systems of linear inequalities, and convergence of Féjer-monotone sequences relative to full-dimensional sets.
- 1970 — Held and Karp (Part I): the 1-tree bound and a column-generation / ascent method for it.
- 1971 — Held and Karp (Part II): the iteration , its relaxation-method analysis (Lemmas 1–3) and the constant-step guarantee (Theorem 1).
- 1974 — Held, Wolfe and Crowder validate the method as general subgradient optimization.
Setting
Let and let be a symmetric real matrix of weights on the edges of the complete graph with vertex set ; weights may be negative and need not satisfy the triangle inequality. A subgraph has weight equal to the sum of its edge weights. A tour is a cycle through every vertex exactly once; is the weight of a minimum tour.
A 1-tree is a tree on the vertex set together with two distinct edges at vertex . Index the 1-trees by ; let be the weight of the -th 1-tree, the degree of vertex in it, and the degree-excess vector with components . For define
A tour is a 1-tree with , so for every (Eq. (2)); the best bound is . For a point , denotes a minimum-weight 1-tree at , a 1-tree attaining the minimum defining . The ascent iteration (3) is
For a target value , is the polyhedron of solutions of for all (system (5)). All norms are Euclidean.
Formalization targets
Goal: Theorem 1
With constant step , any starting point and any choice of minimum-weight 1-trees,
Milestones
- Eq. (2): for every .
- Lemma 1: if then .
- Lemma 2: if then .
- Féjer-monotone convergence (Motzkin–Schoenberg, quoted in the proof of Lemma 3): a sequence whose distance to every point of a set with nonempty interior is nonincreasing converges.
- Lemma 3, Case 1: for and the relaxation iteration
with , the iterates enter or converge to a boundary point of . 6. Lemma 3, Case 2: with the iterates enter . 7. §3 bound: the restricted minimum over 1-trees containing the edges and avoiding the edges is a lower bound on every tour of the derived problem.
Milestones 1–5 are the steps of the paper's proof of Theorem 1; 6 and 7 are further results of the paper on the same objects.
Significance
Theorem 1 is the paper's justification of the step rule actually used in its computations: a fixed step loses at most times the asymptotic squared deviation of the generated 1-trees from being tours. Since is an even integer that vanishes exactly on tours, and the paper observes it is typically small in practice, the bound explains why the constant-step ascent reaches bounds sharp enough for branch-and-bound. Lemmas 1–3 are the first analysis of a subgradient-type method for a nonsmooth concave function, cast as the relaxation method for the (exponentially large) system (5).
All results are proved in the paper (except the Féjer-monotone convergence and Case 2 of Lemma 3, which it cites from Motzkin and Schoenberg). None is formalized: the platform has the 1-tree lower bound only under a metric assumption on the weights (SupplyChainTheory.held_karp_bound, SupplyChainTheory.one_tree_lower_bound), and the subtour-LP bound MetricTSP.held_karp_le_opt, a different object. This mission produces the bound for arbitrary real weights, the supergradient property of , and a machine-checked convergence analysis of the relaxation iteration.
Difficulty
Lemmas 1 and 2 and Eq. (2) are short once the finite minimum defining is handled. The difficulty is in Lemma 3 and Theorem 1. The iteration is not monotone in , so no descent argument applies; progress is measured by the Euclidean distance to the target polyhedron , and turning distance decrease into convergence requires the Féjer-monotonicity theorem, which in turn needs to have nonempty interior (from ). In Theorem 1 the step is constant rather than of the relaxation form (6), and the target polyhedron is not given in advance: the relevant relaxation parameters are admissible only eventually and must be kept away from zero, which requires controlling degenerate directions and the behaviour of along an iteration that is not known a priori to stay bounded. A direct argument that increases fails, since single steps can decrease .
Formalization scope
Vertices are Fin n, the paper's vertex 1 is 0 : Fin n, and graphs are SimpleGraph (Fin n). Weights are c : Sym2 (Fin n) → ℝ, arbitrary reals. A 1-tree is a graph whose restriction to the vertices other than 0 is a tree and in which 0 has degree 2; a tour is a connected graph with all degrees 2. w(π) is the minimum of weight c G + ∑ i, π i * (deg G i − 2) over 1-trees, written as an sInf over a finite set that is nonempty for n ≥ 3; every theorem assumes 3 ≤ n. Euclidean norms and inner products are written as coordinate sums of squares and products, never Mathlib's sup norm on Fin n → ℝ. The minimum-weight 1-tree is a hypothesis at every step, and ties may be broken arbitrarily. The goal is stated as "for every and some iterate has ", which is equivalent to the printed inequality; is the limsup of a sequence with finitely many values, a genuine real.
The statements exclude trivializing readings: the 1-tree predicate rejects graphs without exactly two edges at vertex 1; w is never a minimum over an empty set under the standing hypothesis 3 ≤ n; no ⨆ of a possibly unbounded family is used; the step size and the parameter are strictly positive.
A complete development needs finite minima of affine functions (concavity, attainment), 1-tree and tour combinatorics on simple graphs, and Féjer-monotone sequences in ; the last two are reusable beyond this mission. Proofs of any milestone, and alternative arguments for Lemma 3, are welcome.
Selected references
- M. Held and R. M. Karp, The traveling-salesman problem and minimum spanning trees: Part II, Mathematical Programming 1 (1971) 6–25. https://doi.org/10.1007/BF01584070
- M. Held and R. M. Karp, The traveling-salesman problem and minimum spanning trees, Operations Research 18 (1970) 1138–1162. https://doi.org/10.1287/opre.18.6.1138
- T. S. Motzkin and I. J. Schoenberg, The relaxation method for linear inequalities, Canadian Journal of Mathematics 6 (1954) 393–404. https://doi.org/10.4153/CJM-1954-038-x
- S. Agmon, The relaxation method for linear inequalities, Canadian Journal of Mathematics 6 (1954) 382–392. https://doi.org/10.4153/CJM-1954-037-2
- M. Held, P. Wolfe and H. P. Crowder, Validation of subgradient optimization, Mathematical Programming 6 (1974) 62–88. https://doi.org/10.1007/BF01580223