On the Power and Limitations of Affine Policies in Two-Stage Adaptive Optimization IV: When A ≥ 0 the Best Affine Policy Costs at Most 3√m Times the Fully Adaptable OptimumResearch Paper
Motivation
Two-stage adaptive optimization models decisions taken in two steps: a first-stage decision is fixed before an uncertain right-hand side is revealed, and a second-stage decision is chosen after it, as a function of . The objective protects against the worst in an uncertainty set . Computing an optimal fully adaptable solution is intractable in general (Feige, Jain, Mahdian and Mirrokni, IPCO 2007), so practitioners restrict the second stage to affine policies , introduced in robust optimization by Ben-Tal, Goryashko, Guslitzer and Nemirovski (Math. Program. 2004). An optimal affine policy is computed by a single convex program, but its cost may exceed the adaptive optimum.
Bertsimas and Goyal (Math. Program. Ser. A, 2012) quantify this loss. Earlier, Bertsimas, Iancu and Parrilo (Math. Oper. Res. 2010) proved affine policies optimal for a class of one-dimensional multistage problems. The present paper shows that affine policies are optimal when is a simplex (Theorem 1), that they can lose a factor in general (Theorem 3), and — the subject of this mission — that when the first-stage constraint matrix is nonnegative they never lose more than (Theorem 4). Nonnegative first-stage matrices occur in network design, facility location, capacity planning and other covering problems.
Setting
Let , , , , and let be convex, compact and full-dimensional. The problem is
where the minimum is over first-stage vectors and arbitrary maps . The problem is assumed feasible. The value is the same minimum restricted to affine second stages , which must still satisfy on .
For each coordinate put and fix a maximizer with (display (38)). The scaled sum of over an index set is .
Algorithm (Fig. 1 of the paper) starts with and . While some has scaled sum over larger than , it picks a maximizer of that scaled sum, adds to the running vector on the coordinates of , and moves to every coordinate whose running value has reached . It returns the number of iterations , the vectors , their sum , and the partition .
In the -uncertain variant (60)–(63), only right-hand sides are uncertain and the remaining are fixed at ; all data are nonnegative. Its values are and .
Formalization targets
Goal: Theorem 4
If entrywise, then a feasible affine solution exists and
Milestones
- for every (after (38)).
- Lemma 9. For every complete run of Algorithm : for all , and for all and .
- Lemma 10. Algorithm executes at most iterations.
- Feasibility (48)–(55). For any feasible , the solution , with is feasible.
- Cost (56)–(59). If bounds the worst-case cost of , then bounds that of .
Companion results
- Algorithm has a complete run when is compact.
- Lemma 11. and for the uncertain and deterministic parts of the -uncertain problem.
- Theorem 5. , the paper's bound with its proof's constant.
- Special case (39)–(45). If on , then .
Significance
Theorem 4 is an upper bound on the price of restricting to affine policies, and Theorem 3 of the same paper shows it is tight up to a constant factor: for every there are instances with where the gap is . Together they settle the order of the approximation ratio of affine policies for covering-type two-stage problems. Theorem 5 refines the bound to when only of the right-hand sides are uncertain, which is the regime of many applications. The construction is also the template for the paper's Theorem 6, a -approximation for general obtained from a single dominating simplex.
The results are proved in the paper. To the knowledge of this mission, none of them has a machine-checked proof. Formalizing them produces a reusable model of two-stage adaptive linear programs with affine policies, a verified analysis of a greedy covering procedure (Algorithm ), and an explicit-constant version of an statement.
Difficulty
The obvious attempt scales the fully adaptable solution at the extreme points linearly in : . This is feasible at cost factor only when the scaled sums stay below on (condition (39)); in general they can reach , and the linear rule then costs a factor . The difficulty is to handle the coordinates where has large scaled mass. Algorithm isolates them, and the delicate point is the iteration count: each round must add scaled mass above , while the total scaled mass that can be absorbed before every coordinate leaves is at most . A formal proof must also track the algorithm's state through its recursion, because the argmax choices are not unique and the statements must hold for every run.
Formalization scope
Vectors are Fin m → ℝ with the componentwise order, indices are 0-based, and matrices are Matrix (Fin m) (Fin n) ℝ. Nonnegativity of a matrix is stated entrywise. and are infima of the set of worst-case cost bounds achieved by feasible solutions; the goal and Theorem 5 assert the existence of a feasible affine solution, which rules out the trivializing reading in which is the infimum of an empty set (Lean's junk value ) and the inequality holds for free. The goal does not mention , or Algorithm ; these appear only in milestones.
and are given with their defining properties ( is the greatest value of on , and with ). Algorithm is encoded as a recursion on a choice sequence , with step 2(d) read as . A complete run requires the loop test and the argmax property at each iteration and the failure of the loop test at the end. The milestones on the constructed policy are stated for every feasible and every cost bound , so that no attainment of the optimum is assumed.
Standing assumptions of (1) carried by the goal: ; convex, compact, with nonempty interior; feasibility. Milestones drop the ones they do not use. Theorem 5 carries compactness and full-dimensionality of , which §5.1 does not repeat but its proof uses through Theorem 4. Lemma 11 assumes that is finite, since the paper's inequality is between extended reals.
A complete development needs: finite-dimensional linear programming facts (existence of optimal solutions is not needed), compactness arguments for the argmax in Algorithm , and manipulation of finite sums over Finset. The model of (1) and the analysis of Algorithm are reusable by the companion mission on Theorem 6. Contributions of proofs of any milestone, and of supporting lemmas about the recursion of Algorithm , are welcome.
Selected references
- D. Bertsimas and V. Goyal, On the power and limitations of affine policies in two-stage adaptive optimization, Math. Program. Ser. A, 2012. https://doi.org/10.1007/s10107-011-0444-4
- A. Ben-Tal, A. Goryashko, E. Guslitzer and A. Nemirovski, Adjustable robust solutions of uncertain linear programs, Math. Program. 99(2), 351–376, 2004. https://doi.org/10.1007/s10107-003-0454-y
- D. Bertsimas, D. A. Iancu and P. A. Parrilo, Optimality of affine policies in multistage robust optimization, Math. Oper. Res. 35(2), 363–394, 2010.
- U. Feige, K. Jain, M. Mahdian and V. Mirrokni, Robust combinatorial optimization with exponential scenarios, Lect. Notes Comput. Sci. 4513, 439–453, 2007.