Optimality Conditions and Finite Convergence of Lasserre's Hierarchy II: Off a Proper Zariski-Closed Set of Input Data, the Classical Optimality Conditions Hold at Every Local MinimizerResearch Paper
Motivation
Lasserre's hierarchy is a sequence of semidefinite relaxations for minimizing a polynomial over a set defined by polynomial equations and inequalities (Lasserre 2001). Under the archimedean condition its optimal values converge to the true minimum, but only asymptotically in general; in practice the hierarchy is often exact at a small relaxation order. J. Nie's paper (arXiv:1206.0319v2, Math. Program. 146 (2014)) explains this gap in two steps. Its Theorem 1.1 shows that finite convergence follows when the classical optimality conditions of nonlinear programming hold at every global minimizer. Its Theorem 1.2, the subject of this mission, shows that those optimality conditions hold at every local minimizer for all input data outside the zero set of finitely many polynomials in the coefficients. Together the two results give finite convergence of Lasserre's hierarchy for generic archimedean problems.
The genericity statement is also of independent interest in nonlinear programming: it says that degenerate local minimizers (failing constraint qualification, strict complementarity or second order sufficiency) are an algebraically exceptional phenomenon for polynomial data of fixed degrees.
Setting
Fix variables and write for the real polynomials of degree at most . Problem (1.1) is
with feasible set . For the active set is . At :
- the constraint qualification condition (CQC) holds if () are linearly independent;
- Lagrange multipliers satisfy (1.3) and (1.4) , ;
- strict complementarity (1.5) is for all ;
- with , the second order sufficiency condition (1.7) is for every orthogonal to all active constraint gradients.
The input data are the coefficient vectors of ; a polynomial in the coefficients is a real polynomial evaluated at that vector. The paper's Condition 4.3 lists four families of such polynomials: resultants and discriminants (§2.4) of subsets of the constraints, and the polynomials of (4.6) and of (4.11), which detect a complex projective solution of the homogenised critical-point systems (4.5) and (4.10). Homogenisation is at the nominal degree , with .
Formalization targets
Goal: Theorem 1.2
For positive degrees there are polynomials in the coefficients such that
Milestones
- Proposition 4.1: there is with iff (4.5) has a solution ; and excludes solutions of (4.4) in .
- Proposition 4.2: there is with iff (4.10) has a solution with , ; and makes the KKT system (4.2) nonsingular.
- Proposition 4.4: at with multipliers satisfying (1.3) and , items (a)–(d) of Condition 4.3 give at most active constraints, CQC, and on , and for .
- Lemma 4.6: at a local minimizer where has full rank, (1.7) holds iff .
- Proposition 4.5: Condition 4.3 implies CQC, strict complementarity and SOSC at every local minimizer.
- Appendix A: and do not vanish identically on the input space of given positive degrees.
Significance
The theorem gives the second half of the paper's explanation of finite convergence: combined with Theorem 1.1, Lasserre's hierarchy converges in finitely many steps for all archimedean problems with input outside a proper algebraic subset. Section 5 of the paper derives further consequences, for instance that Marshall's boundary Hessian condition holds on a Zariski open set of data, and that Putinar-type certificates exist generically on the boundary of the cone of nonnegative polynomials. Beyond polynomial optimization, the statement is a precise algebraic form of the folklore that "generic nonlinear programs are nondegenerate".
The result is proved in the paper; no machine-checked version is known. A formalization fixes the exact quantifier structure (the printed statement is vacuous without a nonvanishing clause, and two items of Proposition 4.4 need an extra hypothesis), and builds reusable infrastructure: projective elimination over , homogenisation at a nominal degree, and the bordered-Hessian characterization of second order sufficiency.
Difficulty
The local part (Proposition 4.4, Lemma 4.6, Proposition 4.5) is linear algebra plus first and second order necessary conditions. The global part is not. Proposition 4.1 and 4.2 need the main theorem of elimination theory: the set of coefficient vectors for which a homogeneous (or bihomogeneous) system has a nonzero complex solution is Zariski closed, defined by polynomials in the coefficients. Mathlib has the univariate resultant only. Appendix A, which shows these polynomials do not vanish identically, has to control the homogenised systems both at finite points and at points at infinity (), where only the leading forms of the data are seen. Reasoning over alone does not suffice: the set of data whose real system is solvable is not the zero set of a polynomial.
Formalization scope
Polynomials are MvPolynomial (Fin n) ℝ, points are Fin n → ℝ, and gradients and Hessians are formal partial derivatives. Homogenised polynomials have complex coefficients in n + 1 variables, variable 0 being , and homogenisation uses the nominal degree , not the actual degree. CQC is linear independence of an indexed family (repeated gradients count twice). The optimality conditions are bundled: CQC together with one multiplier pair satisfying (1.3), (1.4), (1.5) and (1.7); under CQC the multipliers are unique.
Condition 4.3 is encoded through the defining properties of Res, Δ, and (unsolvability of the corresponding complex projective systems) rather than through the polynomials themselves; since the goal is existential in the polynomials, this is not a weakening. Coefficient variables exist for monomials of every degree, so the goal's nonvanishing clause is asserted at an admissible input: a formal polynomial that is nonzero but vanishes on all admissible data (such as the variable of a monomial of degree ) does not satisfy it. Without that clause the printed theorem would be satisfied by .
Hypotheses added to the page, each disclosed in the statements: in Propositions 4.4 and 4.5 (Condition 4.3's standing assumption; Theorem 1.2 is stated for all , as printed), the nonvanishing clause in Theorem 1.2, and item (a) of Condition 4.3 in Proposition 4.4 ii)–iv) (with item (b) alone, , , , violates CQC). Proposition 4.2's nonsingularity is asserted at all complex critical pairs.
A complete development needs projective elimination theory over (reusable well beyond this mission), multivariate resultants and discriminants as polynomial functions of coefficients, Euler's identity for forms, and genericity facts about critical points of polynomial programs. Contributions to any of these, and direct proofs of the local milestones, are welcome.
Selected references
- J. Nie, Optimality conditions and finite convergence of Lasserre's hierarchy, Math. Program. 146 (2014); preprint arXiv:1206.0319v2, 2013. https://arxiv.org/abs/1206.0319v2, https://doi.org/10.1007/s10107-013-0680-x
- J.B. Lasserre, Global optimization with polynomials and the problem of moments, SIAM J. Optim. 11(3) (2001) 796–817. https://doi.org/10.1137/S1052623400366802
- R. Hartshorne, Algebraic Geometry, GTM 52, Springer, 1977 (Theorem I.5.7A, elimination). https://doi.org/10.1007/978-1-4757-3849-0
- I. Gelfand, M. Kapranov, A. Zelevinsky, Discriminants, Resultants, and Multidimensional Determinants, Birkhäuser, 1994. https://doi.org/10.1007/978-0-8176-4771-1