A Generalized Newton Method for Subgradient Systems 1: Under Metric Regularity and Semismoothness*, the Prox-Based Newton Algorithm Converges Superlinearly for Prox-Regular FunctionsResearch Paper
Motivation
Many problems in optimization reduce to a subgradient inclusion : for a smooth this is the gradient equation , and for an extended-real-valued (a smooth loss plus an indicator or a nonsmooth regularizer) it is the first-order optimality condition of a composite problem. Newton's method is the classical way to solve such equations with a superlinear rate, but its textbook form needs and a nonsingular Hessian. Khanh, Mordukhovich and Phat (arXiv:2009.10551v2, 2022; Mathematics of Operations Research, 2023) design a Newton-type method in which the Hessian is replaced by Mordukhovich's second-order subdifferential , and prove local superlinear convergence under two assumptions that are weaker than the usual ones: metric regularity (instead of strong metric regularity or tilt stability) and the semismooth* property of Gfrerer and Outrata.
Timeline of the ingredients:
- 1996: Poliquin and Rockafellar introduce prox-regular functions and show that, for small parameters, their Moreau envelopes are near the reference point and their proximal mappings are single-valued and Lipschitz there (Trans. AMS 348).
- 2002: Klatte and Kummer develop Newton methods for Lipschitzian equations through generalized derivatives (Nonsmooth Equations in Optimization, Kluwer).
- 2021: Gfrerer and Outrata define semismooth* set-valued maps and a semismooth* Newton method (SIAM J. Optim. 31).
- 2021: Mordukhovich and Sarabi give a generalized Newton method for tilt-stable minimizers of prox-regular functions (SIAM J. Optim. 31).
- 2020/2022: Khanh, Mordukhovich and Phat replace tilt stability and strong metric regularity by metric regularity of .
Setting
Let be proper. Its limiting subdifferential collects the limits of Fréchet subgradients at points with . For a set , the regular normal cone contains the vectors with for ; the limiting normal cone contains the limits of regular normals at nearby points. For a set-valued , the coderivative is , and the second-order subdifferential is .
The function is prox-regular at for with modulus if it is l.s.c. around and, for some , whenever lie within of , and lies within of . It is continuously prox-regular if, in addition, along every with . It is prox-bounded if it is bounded below by a quadratic function.
For , the Moreau envelope and proximal mapping are
Algorithm 6.2 starts at . While it sets , picks any with , and moves to .
The standing assumptions at a solution are:
- (H1) the inclusion is solvable for every near ;
- (H2) is metrically regular around ;
- (H3) is semismooth* at .
Formalization targets
Goal: Theorem 6.6 (corrected parameter range)
If is proper, prox-bounded, continuously prox-regular at for with constants , and (H1)–(H3) hold, then
Milestones
- Lemma 5.4: for continuous , metric regularity around holds iff for all , near .
- Lemma 5.6: for locally Lipschitz .
- Lemma 5.5: for , is semismooth* at iff .
- Theorem 5.7: the Newton method (Algorithm 5.3) converges locally Q-superlinearly under (H1)–(H3) for .
- Lemma 6.3 (i)–(iii), corrected: near , and for small, is , is single-valued, monotone and Lipschitz, and .
- Lemma 6.4, corrected: .
- Remark 6.5, corrected: the steps of Algorithm 6.2 are the steps of Algorithm 5.3 for .
Significance
The result gives a Newton method for nonsmooth, nonconvex subgradient inclusions whose convergence does not require strong metric regularity. Example 5.2 of the paper exhibits a function whose gradient is metrically regular and semismooth* but not strongly metrically regular, so the theorem covers solutions that earlier generalized Newton theories exclude. Through the Moreau envelope, the method reduces to a gradient equation; the same reduction, with the forward–backward envelope, drives the paper's composite algorithm (the companion mission) and its applications to Lasso-type problems.
The paper's results are proved on paper; none of them, nor the underlying theory of coderivatives, second-order subdifferentials or semismooth* maps, is formalized in Mathlib. This mission produces a machine-checked development of that layer and of the convergence theorem. It also fixes a defect: as printed, Lemma 6.3 and Theorem 6.6 claim their conclusions for every , which is false (see Formalization scope); the formal statements are the corrected ones.
Difficulty
The obvious argument says "Algorithm 6.2 is Algorithm 5.3 for , so apply Theorem 5.7". Each step of that sentence carries the difficulty. Transferring (H1)–(H3) from to requires the coderivative of the inverse , which needs a local graphical calculus for limiting normals that Mathlib does not have. The property of the envelope and single-valuedness of the proximal map hold only for small and near : prox-regularity is local while minimizes globally, so a far-away deep well can capture the proximal point. Theorem 5.7 itself rests on a uniform coderivative bound from metric regularity (Lemma 5.4, a pointwise-to-uniform form of the Mordukhovich coderivative criterion) and on the semismooth* estimate (Lemma 5.5), which combines directional normal cones with the symmetry of generalized Hessians.
Formalization scope
- is
EuclideanSpace ℝ (Fin n); definitions are stated on real inner product spaces, and carries the sup norm (the cones are norm-independent). - is the published analytic limiting subdifferential
NonconvexSplitting.Shared.LimitingSubdiff. It agrees with the paper's geometric (2.9) for functions l.s.c. around the point, which covers every function is applied to here. - takes values in
ERealand is assumed proper; the envelope isEReal-valued, and finiteness is asserted wherever it is differentiated. - is the argmin set. A run of an algorithm selects any proximal point and any direction solving the Newton inclusion. The stop of Step 1 is a constant tail. Well-definedness means every partial run from can be continued.
- Metric regularity uses . Q-superlinear convergence is stated in -form, avoiding . is local to a neighbourhood.
- Correction. Lemma 6.3, Lemma 6.4, Remark 6.5 and Theorem 6.6 are posed as "there is such that for every ", on neighbourhoods instead of . As printed they fail for on , on , elsewhere, with , , : there near , and Algorithm 6.2 jumps to the stationary point . Lemmas 5.4–5.6 and Theorem 5.7 are posed as printed.
- Trivializing formalizations are ruled out: is part of the conclusion, so the is never vacuous; conclusions hold for every run rather than for a run chosen by
Classical.choose; and is not specialized (no convexity, which would make ; no ; no strong metric regularity; no assumption that is a minimizer). - Reusable infrastructure: normal cones to graphs, limiting and directional coderivatives, metric regularity, semismooth*, prox-regularity, Moreau envelopes. Formalizations of Mordukhovich's coderivative criterion, of the scalarization formula for Lipschitz , and of Poliquin–Rockafellar's Theorem 4.4 are especially welcome.
Selected references
- P. D. Khanh, B. S. Mordukhovich, V. T. Phat, A Generalized Newton Method for Subgradient Systems, arXiv:2009.10551v2, 2022; Math. Oper. Res., 2023. https://arxiv.org/abs/2009.10551
- R. A. Poliquin, R. T. Rockafellar, Prox-regular functions in variational analysis, Trans. Amer. Math. Soc. 348, 1996. https://doi.org/10.1090/S0002-9947-96-01544-9
- H. Gfrerer, J. V. Outrata, On a semismooth Newton method for solving generalized equations*, SIAM J. Optim. 31, 2021. https://doi.org/10.1137/19M1257408
- B. S. Mordukhovich, M. E. Sarabi, Generalized Newton algorithms for tilt-stable minimizers in nonsmooth optimization, SIAM J. Optim. 31, 2021. https://doi.org/10.1137/20M1329937
- B. S. Mordukhovich, Variational Analysis and Generalized Differentiation I, Springer, 2006. https://doi.org/10.1007/3-540-31247-1
- R. T. Rockafellar, R. J.-B. Wets, Variational Analysis, Springer, 1998. https://doi.org/10.1007/978-3-642-02431-3