§2, (2), p. 2 — an -Lipschitz gradient gives
ProvedKarimiPL.Prox.quadUpper_of_lipschitzdescent-lemmap2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-paperp2o-v1smoothness
Let be differentiable with an -Lipschitz continuous gradient,
Then for all ,
This is the quadratic upper bound (2) that the paper derives from its standing assumption of an -Lipschitz gradient, and the only place the Lipschitz assumption enters the proof of Theorem 5.
Formalization Note The conclusion is the published predicate ShiOptRates.QuadUpper f (gradient f) L. The same statement is a milestone of mission I of this series; drafts cannot import drafts, so it is restated here.
Preamble
import Mathlib import Definitions.Def_ShiOptrates_FunctionClass import Definitions.Def_KarimiPL_Prox_Setting open InnerProductSpace
Formal statement
namespace KarimiPL.Prox
theorem quadUpper_of_lipschitz {d : ℕ} (f : EuclideanSpace ℝ (Fin d) → ℝ)
(hdiff : Differentiable ℝ f) (L : ℝ)
(hLip : ∀ x y, ‖gradient f x - gradient f y‖ ≤ L * ‖x - y‖) :
ShiOptRates.QuadUpper f (gradient f) L := by sorry
end KarimiPL.Prox
Source
Karimi, Nutini, Schmidt, arXiv:1608.04636v4, §2, (2), p. 2
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.