Rounding of Polytopes in the Real Number Model of Computation: Barycentric Coordinate Descent Finds a (1+ε)n-Rounding Ellipsoid of m Points in O(n(1/ε + ln n + ln ln m)) IterationsResearch Paper
Motivation
Many algorithms for convex bodies need the body to be well rounded: sandwiched between two concentric ellipsoids whose size ratio is controlled by the dimension. The ellipsoid method, volume and integration algorithms, and preconditioning for linear programming use such roundings. For a polytope given by its vertices , John's theorem guarantees an ellipsoid with
the minimum-volume circumscribed (Löwner–John) ellipsoid scaled about its centre; for centrally symmetric sets the factor improves to . The associated D-optimal design problem is a convex optimization problem. Khachiyan (1996) uses this connection to obtain a finite approximation algorithm.
Khachiyan shows that barycentric coordinate descent (BCD) computes a -rounding in arithmetic operations. For fixed dimension and tolerance, this is linear in the number of points; the iteration bound depends on that number only through . Khachiyan (1996)
The paper builds on the Kiefer–Wolfowitz optimality conditions (1960). Later work revisits the method's complexity and variants; see Todd and Yıldırım (2007).
Setting
Let and let be the unit simplex of weights , . For write
and let . Maximizing over is the D-optimal design problem (2.3); is its optimal value. A point satisfies the -relaxed optimality conditions (2.10) if for every ; the accuracy is the least such .
The BCD method starts at and repeats
where is an index with largest and is the th vertex of : it moves weight towards the worst-covered point by the exact line-search step.
For a centrally symmetric set () the ellipsoid is the candidate rounding. For a general set the method runs on the lift , and the rounding ellipsoid is the intersection of with the hyperplane , where is the ellipsoid (3.4) of the block matrix with blocks , and , and aggregates the weights of .
Formalization targets
Goal: Theorem 2 (p. 317)
There is a universal constant such that for every , every with affine hull , every and every BCD run on , some iterate with
meets the stopping test with and yields an ellipsoid with
the shrinking taken about the centre of .
The centrally symmetric case: Theorem 1 (p. 314)
For centrally symmetric full-dimensional , : within iterations,
Milestones
Lemma 1 (), existence of a maximizer, the line identity (2.6), the Kiefer–Wolfowitz conditions (2.9), Lemma 2(i)–(ii) (relaxed optimality gives value and rounding guarantees), Lemma 3 (the per-step increase and the gap bound), the three steps (2.25), (2.27) and the halving bound of the proof of Lemma 4, Lemma 4 (the iteration bound), the rank-one update of , Theorem 1, and Lemma 5 (from the lift back to ). Three further items complete §4: Lemma 2(iii), the slicing property (4.1) and Theorem 3 (approximating the Löwner ellipsoid to relative volume accuracy ).
Significance
The result gives a rounding of a vertex-described polytope at nearly the cost of reading the input, using only rank-one updates; the same iteration approximates the minimum-volume enclosing ellipsoid, a basic primitive in statistics (D-optimal design, outlier detection), computational geometry (core sets) and convex optimization (initialization of interior-point and ellipsoid methods). The doubly logarithmic dependence on is what makes the method practical for large point sets, and the analysis is the template for the later Frank–Wolfe-type analyses of minimum-volume ellipsoid algorithms.
The results are proved in the paper; none of them has a machine-checked proof. The platform has the Löwner–John ellipsoid itself (existence, uniqueness, John's -rounding) and the concavity of , but no algorithmic statement about it. This mission produces a verified iteration bound for a concrete method, together with the D-optimal design identities (Lemma 1, (2.6), (2.9)) and the rank-one update, which are reusable for any later formalization of optimal design or of Frank–Wolfe methods on the simplex.
Difficulty
The accuracy need not decrease at every step, so a bound based on per-step improvement in fails. The determinant objective and the geometric rounding condition are different quantities: controlling one must be shown to control the other, including the inner inclusion of the ellipsoid. For a general set, the lift changes the dimension and the relevant ellipsoid is a slice at ; the inner inclusion for this slice needs a separate geometric justification.
Formalization scope
Points are vectors Fin n → ℝ; is the range of a family a : Fin m → Fin n → ℝ (repetitions allowed). The definitions take any finite index, so they apply both to and to the lift, indexed by Fin m ⊕ Fin m. is Mathlib's stdSimplex. uses Real.log, which returns rather than on singular matrices, so every comparison of values of is restricted to and is the supremum over . Ellipsoids are the published LinearOptimization.ellipsoid; scaled ellipsoids about the origin use the pointwise scalar multiple, and shrinking a non-centred ellipsoid is the homothety about its centre.
Standing assumptions are hypotheses: in §2, central symmetry (2.1), full dimension (2.2) and (p. 309); in §3, full dimension (3.1) and . Items that do not need them drop them. The BCD run is a predicate on sequences that allows any maximizing index at every step, with no tolerance parameter; the tolerance enters only through the stopping test.
Each is a universal constant quantified before the dimension, the points, and the run. The paper counts arithmetic operations; the formal statements bound the index of an iterate meeting the stopping test, and the cost per iteration and the initialization are not formalized. The goal's bound is stated in the lifted parameters , which agrees with the page's up to the constant and stays positive at .
The goal assumes nothing about the run beyond its definition: the stopping test, the positive definiteness of , the rounding inclusions and the iteration bound are all conclusions. A statement in which the constant may depend on the instance, or in which a shrunken ellipsoid is scaled about the origin, would be a different, trivial or false, theorem.
Contributions welcome: the determinant and inverse identities ((2.6), Lemma 1, the rank-one update) are self-contained linear algebra; Lemma 2 needs the KKT characterisation of the minimum-volume ellipsoid; Lemma 5 is finite-dimensional convex geometry.
Selected references
- L. G. Khachiyan, Rounding of polytopes in the real number model of computation, Mathematics of Operations Research 21(2):307–320, 1996. https://doi.org/10.1287/moor.21.2.307
- J. Kiefer, J. Wolfowitz, The equivalence of two extremum problems, Canadian Journal of Mathematics 12:363–366, 1960. https://doi.org/10.4153/CJM-1960-030-4
- L. G. Khachiyan, M. J. Todd, On the complexity of approximating the maximal inscribed ellipsoid for a polytope, Mathematical Programming 61:137–159, 1993. https://doi.org/10.1007/BF01582144
- M. J. Todd, E. A. Yıldırım, On Khachiyan's algorithm for the computation of minimum-volume enclosing ellipsoids, Discrete Applied Mathematics 155:1731–1744, 2007. https://doi.org/10.1016/j.dam.2007.02.013