On the tightness of SDP relaxations of QCQPs 4: Quadratic Eigenvalue Multiplicity k ≥ m + 1 Gives conv(D ∩ H) = D_SDP ∩ H and Opt = Opt_SDPResearch Paper
Motivation
A quadratically constrained quadratic program (QCQP) minimizes a quadratic function subject to quadratic inequality and equality constraints. QCQPs model trust-region subproblems, max-cut and other binary programs, phase retrieval, and many problems in signal processing and control; in general they are NP-hard. The standard tool for bounding and solving them is the Shor semidefinite relaxation (Shor 1990), which lifts the variable to a matrix and replaces every quadratic term by a linear function of . The relaxation is a convex program, so it can be solved efficiently, but it is only useful when one knows that it is tight: that its optimal value equals that of the QCQP, or, more strongly, that it describes the convex hull of the QCQP's epigraph.
Wang and Kılınç-Karzan (arXiv:1911.09195v3, Math. Program. 2021) give sufficient conditions for tightness. Section 6 of the paper concerns QCQPs with symmetry: when every quadratic form is identical copies of one smaller form, . Such problems arise as quadratic matrix programs in the sense of Beck 2007, where the variable is a matrix and the objective and constraints are traces of quadratic matrix expressions. Beck showed (Corollary 4.4) that gives value exactness under a regularity assumption; Theorem 7 of the paper gives the convex-hull result for ; this mission's Theorem 8 covers .
Setting
Fix variables and constraints. For let with symmetric, , . The QCQP is
and its epigraph is .
With , the SDP relaxation has value
and its projected epigraph is the set of for which some satisfies the constraints with . Always and .
For write and , and let . Assumption 1 requires that the QCQP be feasible and that some with on the inequalities have .
The quadratic eigenvalue multiplicity (Definition 3) is the largest integer such that and every , , equals for some . Finally,
is the hyperplane on which the SDP relaxation attains its value.
Formalization targets
Goal: Theorem 8 (p. 30)
Under Assumption 1, if , then
Milestones (App. B, pp. 35–36)
- Lemma 1 (p. 7): and .
- Dual attainment: every has with
- Feasibility of (20): if , some unit has for all .
- The objective direction vanishes: on , with , , and as in (20), .
- Rank induction: if , every with some satisfying (19) lies in .
Significance
Theorem 8 says that one copy of symmetry fewer than Theorem 7 requires still makes the SDP relaxation exact in value, and identifies the relaxation's optimal set: every optimal point of the relaxation, projected to , is a convex combination of optimal epigraph points of the QCQP. In particular the relaxation's optimal points can be decomposed into QCQP optima, which is what makes the relaxation a solution method and not only a bound. Remark 14 of the paper places the result between Beck's (only ) and Theorem 7's (the full convex hull), and records the conjecture that all three thresholds are sharp.
The theorem is proved in the paper (Appendix B). No machine-checked proof of it, or of the multiplicity results of Section 6, is known to exist. A formal proof needs a Lean development of the Shor relaxation, its Lagrangian dual, conic strong duality with dual attainment for an SDP with sign-constrained multipliers, and the Kronecker structure of the data.
Difficulty
The inclusion is routine. The converse needs, for an SDP-optimal point, a decomposition into feasible QCQP points that are themselves optimal. A rank-one decomposition of the SDP matrix does not suffice in general: its terms leave the feasible set unless the perturbation directions are orthogonal to all the linear parts , including the objective's. With multiplicity there is room for all orthogonality conditions; with only the constraint conditions can be imposed, and the objective condition has to come from elsewhere. The difficulty sits in that last condition and in the conic duality step, whose dual must attain its value under Assumption 1 alone (no polyhedrality of , no attainment assumption).
Formalization scope
The Lean development lives in the namespace QCQPTightness.MultTight. The data are a structure QCQP N m with symmetric , constraints indexed by Fin m, and constraint i an inequality exactly when (i : ℕ) < mI (the paper's inequalities come first). Vectors are Fin N → ℝ; points of are pairs (x, t). and are infima in EReal, and is defined from that EReal value; this is why the goal states as a separate conjunct: if were , would be empty and the first conjunct trivial. is (Q * Y).trace; is PosSemidef; is y ⬝ᵥ y = 1. The identification sends block , entry to coordinate s + n * j.
Standing assumptions: the goal carries (p. 1) and Assumption 1. The multiplicity is the largest (IsGreatest), as on the page. The milestones take an explicit representation instead, which makes them apply to every representation, and drop and Assumption 1 where the step does not use them. The rank-induction milestone carries , which the page's sentence omits but its proof uses ("by minimality of "); without it the claim is false.
A trivializing formalization would assume system (19), or the vanishing of , in the goal; the goal assumes neither, and both are milestones to be proved.
Reusable infrastructure: the QCQP and Shor-relaxation definitions are shared with the other missions of this series, and a general SDP strong-duality statement exists on the platform (ConvexOptimization.sdp_strong_duality) in a different form (a minimization without sign-constrained variables). Contributions welcome: proofs of the milestones, a conic duality lemma with sign-constrained multipliers, and Kronecker-product lemmas such as .
Selected references
- A. L. Wang, F. Kılınç-Karzan, On the tightness of SDP relaxations of QCQPs, Math. Program. (2021); arXiv:1911.09195v3 (2020). https://arxiv.org/abs/1911.09195, https://doi.org/10.1007/s10107-020-01589-9
- A. Beck, Quadratic matrix programming, SIAM J. Optim. 17(4):1224–1238, 2007. https://doi.org/10.1137/050644471
- N. Z. Shor, Dual quadratic estimates in polynomial and boolean programming, Ann. Oper. Res. 25:163–168, 1990.
- T. Fujie, M. Kojima, Semidefinite programming relaxation for nonconvex quadratic programs, J. Global Optim. 10(4):367–380, 1997.