Motivation
A mathematical program with complementarity constraints (MPCC) minimizes a smooth function subject to constraints of the form F1,j(x)≥0, F2,j(x)≥0, F1,j(x)⋅F2,j(x)=0. MPCCs arise in generalized Nash equilibrium problems, bilevel optimization and semi-infinite programming. Their feasible sets are nonsmooth: standard constraint qualifications fail at every feasible point, so the theory and algorithms of nonlinear programming (NLP) do not apply directly.
The Scholtes regularization (Scholtes 2001) relaxes F1,jF2,j=0 to F1,jF2,j≤t with a parameter t>0 and solves a sequence of regular NLPs as t→0. Numerical comparisons rank it among the most effective regularizations (Hoheisel–Kanzow–Schwartz 2013). Scholtes showed that limits of KKT points of the regularized problems are C-stationary for the MPCC. Lämmel and Shikhman (arXiv:2501.07383v2) ask a finer question: does the regularization preserve the topological type of stationary points, measured by Morse-theoretic indices?
Timeline:
- 2001: Scholtes proves that, under MPCC-LICQ, limits of KKT points of the regularization are C-stationary, with explicit multiplier limits, and proves a well-posedness result.
- 2004: Ralph and Wright prove further convergence and well-posedness properties of regularization and penalization schemes.
- 2009: Jongen, Shikhman and Rückmann develop the critical point theory of MPCC: nondegenerate C-stationary points and their C-index.
- 2011: Ralph and Stein use the C-index as a stability concept for quadratic programs with complementarity constraints.
- 2025: Lämmel and Shikhman compare the C-index of a limit point with the quadratic index of the approximating KKT points (Theorem 1) and prove well-posedness under NDC4 (Theorem 2).
Setting
Fix n,κ≥0 and C2 functions f:Rn→R and F1,j,F2,j:Rn→R, j=1,…,κ. The MPCC feasible set is M={x∣F1,jF2,j=0, F1,j≥0, F2,j≥0}, and the regularized set is MS={x∣F1,jF2,j≤t, F1,j≥0, F2,j≥0}.
At xˉ∈M the indices split into a01(xˉ) (F1=0<F2), a10(xˉ) (F2=0<F1) and the biactive set a00(xˉ). The point xˉ is C-stationary with multipliers (σˉ,ϱˉ) if Df(xˉ)=∑a01σˉ1,jDF1,j+∑a10σˉ2,jDF2,j+∑a00(ϱˉ1,jDF1,j+ϱˉ2,jDF2,j) and ϱˉ1,jϱˉ2,j≥0 on a00. It is nondegenerate if MPCC-LICQ holds (NDC1), ϱˉ1,jϱˉ2,j>0 on a00 (NDC2), and the Hessian D2L(xˉ) of the Lagrange function is nonsingular on the tangent space Txˉ (NDC3). Its C-index is CI=QI+BI: QI is the number of negative eigenvalues of D2L(xˉ)↾Txˉ, and BI is the number of biactive indices with both multipliers negative. NDC4 asks σˉ1,j=0 on a01 and σˉ2,j=0 on a10.
For the regularized problem, a KKT point x with multipliers (η,ν) is nondegenerate if LICQ holds, all active multipliers are positive, and D2LS(x) is nonsingular on TxS. Its quadratic index q is the number of negative eigenvalues of that restriction.
Formalization targets
Goal: Theorem 1 (Convergence)
Let tk↓0 and let xk be nondegenerate KKT points of the regularization with parameter tk and quadratic index q, with xk→xˉ. If xˉ∈M is a nondegenerate C-stationary point with multipliers (σˉ,ϱˉ), then
max{q−∣{j∈a01(xˉ)∣σˉ1,j=0}∣−∣{j∈a10(xˉ)∣σˉ2,j=0}∣,0}≤CI≤q,
and CI=q if NDC4 holds. All three conclusions are part of the goal.
Milestones
- Uniqueness of the MPCC multipliers under MPCC-LICQ (p.6).
- Proposition 1: C-stationarity of the limit, with the multipliers as limits of νk or −ηkFi,j(xk).
- Corollary 1: negative multipliers make the product constraint eventually active, positive ones make F1,j=0 or F2,j=0 eventually active.
- Step 1 of the proof: the codimensions of Txˉ and TxS equal the numbers of active constraints, and display (14) bounds their difference.
- Step 3b: identification of the active sets of xk from the signs at xˉ.
- Step 4: the negative index grows by at most the dimension gap when the subspace grows, and the lower bound of (11).
- Step 5d: the upper bound CI≤q.
Significance
Theorem 1 says that the Scholtes regularization cannot create spurious saddle points in the limit beyond what vanishing multipliers allow. If nondegenerate local minimizers (q=0) of the regularized problems converge to a nondegenerate C-stationary point, that point has C-index 0 and is therefore a local minimizer of the MPCC (p.6 of the paper). Under NDC4, which holds generically (Proposition 2 of the paper), the regularization preserves the index exactly; this is the basis for the well-posedness result (Theorem 2) and for the comparison with earlier convergence theory in the paper. Example 2 of the paper shows that without NDC4 the lower bound is attained with CI<q.
The results are proved in the paper; none of them has a machine-checked proof. The mission produces a reusable Lean vocabulary for MPCC and its regularization (active sets, MPCC-LICQ, C-stationarity, restricted Hessians, quadratic and C-indices) and formal statements of Proposition 1, Corollary 1 and Theorem 1. It is also the first formal account of index counting on restricted Hessians in this setting.
Difficulty
The obvious argument compares the quadratic forms D2LS(xk) and D2L(xˉ) on the tangent spaces and passes to the limit. It fails for two reasons. First, the tangent spaces TxkS and Txˉ have different dimensions: a biactive index contributes two constraints at xˉ but only one, the product constraint, at xk when its multipliers are negative. Second, the multiplier ηjk of a biactive index with negative multipliers is unbounded as tk→0, so D2LS(xk) does not converge. The extra negative directions come from a blow-up along the hyperbolas F1,jF2,j=t, and they account exactly for the biactive index. Indices with vanishing multiplier σˉ can be active in either way along the sequence, and this is the source of the gap in (11).
The printed proof works in a normalized coordinate system and its inclusion (18) between two tangent spaces does not hold in general (it fails when an index with σˉ1,j=0 is in H(xt)); a complete proof must use the product row of TxtS in place of the coordinate row there.
Formalization scope
Rn is EuclideanSpace ℝ (Fin n) and indices are Fin κ (0-based). The data and their C2 regularity are the structure ScholtesStab.MPCC n κ. There are no other constraints. Differentials are fderiv, Hessians are fderiv ℝ (fderiv ℝ L). Multipliers are total functions Fin κ → ℝ, and only their values on the relevant index sets are used. Linear independence is that of indexed families, so for a biactive index both gradients count. The number of negative eigenvalues of a restricted Hessian is negIndex, the largest dimension of a subspace of the tangent space on which the form is negative definite; by Sylvester's law of inertia this is the eigenvalue count. Nonsingularity of the restriction is NonsingularOn, which is not nonsingularity on all of Rn. "xt→xˉ for t→0" is a sequence tk>0, tk→0, xk→xˉ. The multipliers of each xk are existential; they are unique under LICQ. The inequality (11) is stated in Z.
A trivializing formalization is ruled out: the limit point is required to be nondegenerate C-stationary with the given multipliers, every approximating point must be a nondegenerate KKT point of the same quadratic index, and the C-index is computed on the tangent space Txˉ, not on Rn.
The milestones from the proof are stated in general coordinates. The paper's simplification a10(xˉ)=∅ is not assumed, and the a10 terms are kept. A full proof needs convergence of multipliers under LICQ, perturbation of subspaces, inertia arguments for restricted forms, and the blow-up analysis of Step 5. Contributions of reusable inertia lemmas for negIndex (monotonicity, continuity of the negative index under convergence of forms on converging subspaces) are welcome independently of this mission.
Selected references
- S. Lämmel, V. Shikhman, On stability of the Scholtes regularization for mathematical programs with complementarity constraints, arXiv:2501.07383v2, 2025. https://arxiv.org/abs/2501.07383
- S. Scholtes, Convergence properties of a regularization scheme for mathematical programs with complementarity constraints, SIAM J. Optim. 11(4):918–936, 2001. https://doi.org/10.1137/S1052623499361233
- H. Th. Jongen, V. Shikhman, J.-J. Rückmann, MPCC: critical point theory, SIAM J. Optim. 20(1):473–484, 2009. https://doi.org/10.1137/080733693
- D. Ralph, S. J. Wright, Some properties of regularization and penalization schemes for MPECs, Optim. Methods Softw. 19(5):527–556, 2004. https://doi.org/10.1080/10556780410001709439
- D. Ralph, O. Stein, The C-index: a new stability concept for quadratic programs with complementarity constraints, Math. Oper. Res. 36(3):504–526, 2011. https://doi.org/10.1287/moor.1110.0501
- T. Hoheisel, C. Kanzow, A. Schwartz, Theoretical and numerical comparison of relaxation methods for mathematical programs with complementarity constraints, Math. Program. 137(1):257–288, 2013. https://doi.org/10.1007/s10107-011-0488-5