Contextual Inverse Optimization: Offline and Online Learning 4: The Polyhedral Cone of η-Separated Effective Differences Has Uncertainty Angle at Most arccos(η^(d−1)/d^(3/2))Research Paper
Motivation
In contextual inverse optimization a decision-maker repeatedly faces linear problems whose cost vector is unknown. After each period it observes an action that an expert who knows would have taken. Every observation is a set of linear inequalities on , so the costs consistent with the data form a cone, the knowledge set. Besbes, Fonseca and Lobel (arXiv:2106.14015, published in Operations Research, 2025) measure the residual ignorance of such a set by its uncertainty angle, the half-aperture of the narrowest revolution cone containing it, and show that offline regret is governed exactly by this angle.
Online, their algorithms are efficient only when the knowledge set is pointed, i.e. has uncertainty angle below . When it is not, the general algorithm of §5 (ProjectedCones) works inside a growing subspace spanned by the observations that were sufficiently new. Each time the subspace grows, the algorithm replaces the knowledge set by a polyhedral cone and needs a bound on the uncertainty angle of that depends only on the separation parameter and the dimension. Lemma 10 of the paper provides that bound. This mission formalizes it, together with the chain of lemmas in Appendix B on which its proof rests.
Setting
Let carry the Euclidean inner product and norm , and let be its unit sphere. The angle between and is , with when either vector is . The uncertainty angle of a set is
and a minimizer is a circumcenter of . The circumradius of a cone is .
For vectors , write for the orthogonal projection onto their span and . The vector is the residual of regressing on .
The algorithm's effective differences are unit vectors . A difference triggers a subspace update when its residual against the current subspace exceeds . The differences that triggered updates, in order of arrival, therefore satisfy
They span the subspace , and the polyhedral cone of (14) is
Two further cone quantities appear. The simplicial cone of linearly independent is . The inradius of a cone is , and the dual cone is . With the matrix of columns , and are the extreme eigenvalues of the Gram matrix.
Formalization targets
Goal: Lemma 10, angle bound (p. 25)
For , and unit vectors obeying the separation rule,
The bound depends on and only, not on the number of vectors or their configuration.
Milestones (Appendix B)
- Lemma B-4 (App-28). Backward separation implies two-sided separation:
- Lemma B-3 (App-27). With ,
- Lemma B-2 (App-25). .
- (B-9) (App-20). , for every closed convex pointed cone .
- (B-8) (App-19). For with separated unit ,
Significance
The bound is what makes the subspace stage of ProjectedCones restartable. After each update the algorithm discards its previous ellipsoidal cone and starts afresh from a revolution cone of aperture around the circumcenter of . Lemma 10 guarantees that this cone contains , and with it the projected knowledge set, and that it is pointed. The number of later ellipsoid steps grows with the logarithm of the tangent of this aperture, so the shape of the bound enters the paper's regret analysis directly. The lemmas behind it are statements about general vector families: a residual inequality of Frisch–Waugh–Lovell type, a condition-number bound for correlation matrices, an inradius bound for simplicial cones, and the circumradius–inradius duality of Henrion and Seeger. Each is usable outside this paper.
The result is proved on paper; no part of it is formalized. The mission asks for machine-checked proofs of Lemma 10's angle bound and of the five appendix statements. Henrion–Seeger duality is cited, not proved, in the source. Its formalization would be new.
Difficulty
The separation rule controls each new vector only against the earlier ones. A bound on the cone's aperture needs control of each vector against all the others, and later vectors can lie close to the span of an earlier vector together with the remaining ones. The loss compounds, which is where the exponential factor comes from. A direct estimate of the circumcenter of is not available in closed form: the circumcenter is the solution of a quadratic program. The natural first attempt, bounding the angle between the circumcenter candidate and the extreme rays of , requires the extreme rays of , which are the columns of a dual basis whose norms are not controlled by the separation rule alone.
A second difficulty is dimensional. lives in the subspace , possibly of dimension , while the uncertainty angle is measured on the sphere of . The appendix statements are posed in , in coordinates of . Transferring them requires an isometry onto that preserves the cone, the angles and the projections.
Formalization scope
Vectors live in EuclideanSpace ℝ (Fin d); families are indexed by Fin p, so all indices are 0-based and Lean's is the paper's . Projections are Submodule.starProjection onto Submodule.span. The uncertainty angle is a real infimum of real suprema of angles in . The angle at the zero vector is , as in the paper, not Mathlib's . The inradius is a real supremum of Metric.infDist to the frontier. It equals the paper's maximum on every cone of this mission. The dual cone is the platform's ConvexOptimization.dualCone. Eigenvalue ratios are stated without spectra: Lemma B-3 in the Rayleigh form , and Lemma B-2 with arbitrary bracket constants . Both forms are equivalent to the printed ones.
Conventions and pins:
- The separation rule is "residual ", the form of (B-14). The algorithm's strict "" is a special case, so the goal is stronger than the page needs. The first vector carries no condition.
- Lemma 10's inclusion is not posed: it concerns the algorithm's run. The polynomial-time computation of the circumcenter is not posed either: it is a complexity claim. "For every period " becomes "for every family obeying the separation rule"; is the first period, with .
- is the paper's standing assumption (§2), and is the real power.
- Lemma B-3 as printed takes as the minimum over only. With that minimum the bound is false. The printed proof bounds every , and the proof of Lemma 10 applies it so. The minimum over all is stated.
- (B-9) is stated on the page for every closed convex cone. It is posed for every closed convex pointed cone in : App-19 defines for pointed cones, and is excluded because its dual has empty boundary.
- Lemmas B-3 and B-4 are posed in for every , which is equivalent to the page's . Lemma B-4 assumes no range for , since only and even powers occur.
The cone in the goal is intersected with . A formalization of as would be false for (that set contains a line, so ). A separation hypothesis that does not exclude nearly collinear vectors would make the bound unobtainable, and one that is never satisfiable would make it empty. The sanity check in the drafting workspace exhibits the hypotheses at , .
Contributions welcome: proofs of any milestone; the passage from to the subspace (an isometry lemma for cones and angles); Gram-matrix facts (the inverse correlation matrix diagonal ) as reusable lemmas.
Selected references
- O. Besbes, Y. Fonseca, I. Lobel, Contextual Inverse Optimization: Offline and Online Learning, arXiv:2106.14015v3, 2023 (the version formalized; published in Operations Research, 2025). https://arxiv.org/abs/2106.14015
- R. Henrion, A. Seeger, Inradius and circumradius of various convex cones arising in applications, Set-Valued and Variational Analysis 18, 483–511, 2010. https://doi.org/10.1007/s11228-010-0150-z
- M. C. Lovell, A simple proof of the FWL theorem, Journal of Economic Education 39(1), 88–91, 2008. https://doi.org/10.3200/JECE.39.1.88-91