The gradient of : where and where
ProvedNonsmoothNewton.AugLagrangian.eta_fderiv_formulaaugmented-lagrangiancalculusnonsmooth-analysissource-faithful-child
Let and be , and assume is . Then the gradient of at is where , and where . On the open regions and the function is the polynomial and respectively , whose differentials are the displayed expressions; continuity of supplied by extends the identity across the surface , and there the two formulas coincide because . This is the displayed gradient formula, item 2 of Theorem 4.1.
Formal statement
import Mathlib
import Definitions.Def_NonsmoothNewton_Shared_clarkeJac
import Definitions.Def_NonsmoothNewton_AugLagrangian_SemismoothAt
import Definitions.Def_NonsmoothNewton_AugLagrangian_augLagrangian
namespace NonsmoothNewton.AugLagrangian
/-- Child of `eta_C1_grad_locLip`, second step of Qi-Sun (1993), Section 4, proof of Theorem 4.1,
pp. 363-364: the displayed formula for $\nabla\eta$ (item 2 of the theorem).
The gradient is represented by the Fréchet derivative, a continuous linear functional on
$\mathbb{R}^n\times\mathbb{R}$: in the first case $(h,\alpha)\mapsto (s+rg(x))\,Dg(x)h+g(x)\,\alpha$,
and in the second $(h,\alpha)\mapsto -\frac sr\,\alpha$. The two agree where $s+rg(x)=0$, because
there $g(x)=-\frac sr$, so the two non-strict cases are consistent. -/
theorem eta_fderiv_formula {n : ℕ} (r : ℝ) (hr : 0 < r)
(g : EuclideanSpace ℝ (Fin n) → ℝ) (hg : ContDiff ℝ 2 g)
(hη : ContDiff ℝ 1 (eta r g)) :
(∀ z : EuclideanSpace ℝ (Fin n) × ℝ, 0 ≤ z.2 + r * g z.1 →
fderiv ℝ (eta r g) z =
(z.2 + r * g z.1) • (fderiv ℝ g z.1).comp
(ContinuousLinearMap.fst ℝ (EuclideanSpace ℝ (Fin n)) ℝ)
+ g z.1 • ContinuousLinearMap.snd ℝ (EuclideanSpace ℝ (Fin n)) ℝ) ∧
(∀ z : EuclideanSpace ℝ (Fin n) × ℝ, z.2 + r * g z.1 ≤ 0 →
fderiv ℝ (eta r g) z =
(-(z.2 / r)) • ContinuousLinearMap.snd ℝ (EuclideanSpace ℝ (Fin n)) ℝ) := by sorry
end NonsmoothNewton.AugLagrangianSource
Qi, Sun, A nonsmooth version of Newton's method, Math. Programming 58 (1993), pp. 363-364, Section 4, proof of Theorem 4.1, the display of (item 2 of the theorem).