A Fast Lewis-weight Interior Point Method for Linear Optimization over Product-Domain: Solving Linear Programs over Products of Convex Sets in Time Research Paper
Motivation
Many problems in statistics, control and data science minimize a linear objective over a product of small convex sets subject to a few linear equations: regression, entropy-regularized transport, and second-order cone programs with small cones. When the number of variables is much larger than the number of equations , the running time in terms of decides what is practical.
For linear programs, the Lee–Sidford line of interior point methods replaced the iterations of the classical path-following method with iterations.
- 1988. Renegar: iterations of path following.
- 2014, 2019. Lee and Sidford (FOCS 2014, arXiv:1910.08033): iterations using Lewis weights, for scalar LPs with the logarithmic barrier.
- 2021. van den Brand, Lee, Liu, Saranurak, Sidford, Song, Wang: scalar LPs in time .
- 2025. Liu, Peng, Tang, Weng, Yang: products of constant-dimensional convex sets with general barriers in time , with iterations. They note that extending Lee–Sidford to such barriers is open.
- 2026. Zhang and Wright (this manuscript): that extension, in time .
Setting
The program is
with , , , compact convex and .
Each carries a -self-concordant barrier : a convex function that tends to at the boundary, with and . Its Fenchel conjugate is . The algorithm reaches and only through constant-time oracles.
The regularized block Lewis weight of solves , where is block diagonal with blocks , is the orthogonal projection onto the column space, and is the vector of block traces. The method follows the central path weighted by , where is the smoothed preconditioner, the root of over the uniform law on the unit ball.
Formalization targets
Goal: Theorem 54, corrected
For every there are one program of a real RAM with the two oracles, and constants , such that for every instance with , every bounding , and and admitting a feasible with , and every : with probability at least the run halts within
steps, with an output , and . The manuscript's statement has no feasibility hypothesis and is false on infeasible instances; the corrections are declared on the item.
Milestones
In the order of the proof: the extended program with its start point and transfer (Lemma 49); stability of Lewis weights (Lemma 21); the smoothing estimates (Lemmas 23, 24); one-step stability of , , (Lemmas 28, 30, 31); potential change and contraction (Lemmas 34, 20); approximate feasibility and sampling (Lemmas 37, 38); finite-sum smoothing (the display in the proof of Lemma 42); the nearby sequence (Lemmas 51, 52); and exact feasibility with the final gap (Lemma 50). Matrix Bernstein and the bound are referenced from existing platform theorems.
Significance
The result gives the first -iteration path following for black-box self-concordant barriers on constant-dimensional blocks, and removes the of the earlier bound, moving the nearly linear time threshold from to . The smoothed preconditioner replaces the higher-order self-concordance that earlier Lewis-weight analyses need.
The theorem is claimed in an unpublished manuscript; nothing in it is machine-checked. This mission adds block Lewis weights, the Bregman potential and a concrete model of computation with oracles to the platform, and states the main theorem and its key steps. Its corrected statements have counterexamples recorded on the items: Theorem 54, Lemma 37, Lemma 38, Lemma 49. The goal is open as a formal statement, and its proof must also handle points the manuscript leaves to adaptation, such as rank-deficient .
Difficulty
The direct extension of scalar Lewis-weight arguments fails. A block carries one weight but a matrix-valued local geometry, and a small multiplicative change of a general positive definite preconditioner need not change the weights by a small relative amount. The analysis needs a Lipschitz derivative of along sampled sparse updates, and ordinary self-concordance controls only one derivative of the Hessian: the naive use of as preconditioner, as in the scalar proof, therefore has no second-order estimate.
A second obstacle is that the time bound rests on lazy data structures against adaptive updates by matrix-valued blocks. A count of iterations does not give the time.
Formalization scope
Coordinates are pairs (block, position). The model is a real RAM with a finite program, rational literals, , comparisons, integer pointers, a tape of Gaussian reals, and the two oracles, with charges and . A primal query outside stops the run. There is no floor, sort, or matrix instruction, the program is chosen before the instance, and , and are not in memory, which rules out a trivial solution by hard-coding or free computation. The minimum is written as feasible , so no junk infimum enters.
Milestones use one constant order: hidden constants for each bound on the block sizes, then , then . They assume and full column rank where the page uses . Expectations in one-step lemmas are conditional on the good event of the sampling definition, since is known only there.
The definitions of self-concordant barrier, real RAM and the uniform law on the ball are reused from the platform. Block Lewis weights, mixed norms and the machine are reusable beyond this mission. Contributions welcome: proofs of any milestone, the Lewis-weight existence and uniqueness of Lemma 57, Lemma 3-style Hessian comparisons for the barrier predicate, and data structures in the machine.
Selected references
- P. Zhang, S. Wright, A Fast Lewis-weight Interior Point Method for Linear Optimization over Product-Domain, manuscript, November 2026, sha256 66072000….
- J. Renegar, A polynomial-time algorithm, based on Newton's method, for linear programming, Math. Programming 40, 1988. https://doi.org/10.1007/BF01580724
- Y. T. Lee, A. Sidford, Path finding methods for linear programming, FOCS 2014. https://arxiv.org/abs/1312.6677
- Y. T. Lee, A. Sidford, Solving linear programs with Sqrt(rank) linear system solves, 2019. https://arxiv.org/abs/1910.08033
- J. van den Brand, Y. T. Lee, Y. P. Liu, T. Saranurak, A. Sidford, Z. Song, D. Wang, Minimum cost flows, MDPs, and -regression in nearly linear time for dense instances, STOC 2021. https://arxiv.org/abs/2101.05719
- Y. P. Liu, R. Peng, C. Tang, A. Weng, J. Yang, Adaptive matrix sparsification and applications to empirical risk minimization, 2025. https://arxiv.org/abs/2512.02003