Eq. (47): optimality condition of the proximal gradient step
ProvedNonconvexSplitting.ProxGrad.eq47_inclusionnonconvex-optimizationp2o-batch-p200bp2o-gran-per-chapterp2o-plan-paperp2o-v1proximal-gradientvariational-analysis
Let and satisfy the standing assumptions, let , and let be generated by the proximal gradient update (43). Then for every ,
where is the limiting subdifferential; that is, some satisfies .
Passing to the limit in this inclusion along a convergent subsequence yields stationarity of cluster points.
Preamble
import Mathlib import Definitions.Def_NonconvexSplitting_Shared_LimitingSubdiff import Definitions.Def_NonconvexSplitting_ProxGrad_StandingAssumptions import Definitions.Def_NonconvexSplitting_ProxGrad_IsProxGradSeq open NonconvexSplitting.Shared
Formal statement
namespace NonconvexSplitting.ProxGrad
/-- Eq. (47) of Li–Pong (p. 19): the optimality condition of the update (43),
`0 ∈ ∇h(x^t) + (1/β)(x^{t+1} - x^t) + ∂P(x^{t+1})`, for every `t`. -/
theorem eq47_inclusion {n : ℕ} (h : EuclideanSpace ℝ (Fin n) → ℝ)
(P : EuclideanSpace ℝ (Fin n) → EReal) (β : ℝ) (x : ℕ → EuclideanSpace ℝ (Fin n))
(hSA : StandingAssumptions h P) (hβ : 0 < β) (hx : IsProxGradSeq h P β x) (t : ℕ) :
∃ w ∈ LimitingSubdiff P (x (t + 1)),
gradient h (x t) + (1 / β) • (x (t + 1) - x t) + w = 0 := by sorry
end NonconvexSplitting.ProxGrad
Source
Li & Pong, Global Convergence of Splitting Methods for Nonconvex Composite Optimization, arXiv:1407.0753v6, p. 19, Eq. (47)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.