(2.1) — auxiliary-term decrease inequality
ProvedRelaxedPRS.Linear.eq_2_1convex-optimizationlinear-convergencep2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-paperp2o-v1relaxed-peaceman-rachford
Suppose are proper closed convex functions, with nonnegative strong-convexity and gradient-regularity parameters . Let follow relaxed PRS with and , and let be a fixed point of . Set and let be the terms of (1.14) at the auxiliary proximal points and their selected proximal subgradients, relative to and the subgradients at . For every ,
This is the one-step decrease inequality used by each regularity case in the paper's rate analysis.
Formalization Note When a parameter is positive, its function is assumed real valued with a -Lipschitz gradient; when , no differentiability is imposed.
Preamble
import Mathlib import Definitions.Def_RelaxedPRS_Linear_Setting
Formal statement
namespace RelaxedPRS.Linear
/-- (2.1) of Theorem 2.1, p. 8: one-step auxiliary-term bound. -/
theorem eq_2_1 {H : Type*} [NormedAddCommGroup H] [InnerProductSpace ℝ H] [CompleteSpace H]
(f g : H → EReal)
(hf : ThreeOpSplitting.ConvexRates.IsProperClosedConvex f)
(hg : ThreeOpSplitting.ConvexRates.IsProperClosedConvex g)
(γ : ℝ) (hγ : 0 < γ) (Pf Pg : H → H)
(hPf : ThreeOpSplitting.ConvexRates.IsProx γ f Pf)
(hPg : ThreeOpSplitting.ConvexRates.IsProx γ g Pg)
(lam : ℕ → ℝ) (hlam : ∀ k, 0 < lam k ∧ lam k ≤ 1)
(z : ℕ → H) (hz : RelaxedPRS.StrongCvx.IsPRSRun Pf Pg lam z)
(zs : H) (hzs : RelaxedPRS.StrongCvx.TPRS Pf Pg zs = zs)
(μf βf μg βg : ℝ)
(hμf : 0 ≤ μf) (hβf : 0 ≤ βf) (hμg : 0 ≤ μg) (hβg : 0 ≤ βg)
(hscf : RelaxedPRS.StrongCvx.IsStrongCvxE μf f) (hscg : RelaxedPRS.StrongCvx.IsStrongCvxE μg g)
(hlf : 0 < βf → RelaxedPRS.StrongCvx.HasLipGrad βf f)
(hlg : 0 < βg → RelaxedPRS.StrongCvx.HasLipGrad βg g) :
let Sf : ℕ → ℝ := fun k =>
RelaxedPRS.StrongCvx.auxS μf βf (RelaxedPRS.StrongCvx.xf Pf Pg (z k)) (RelaxedPRS.StrongCvx.xg Pg zs)
(RelaxedPRS.StrongCvx.gtF γ Pf Pg (z k)) (RelaxedPRS.StrongCvx.gtF γ Pf Pg zs)
let Sg : ℕ → ℝ := fun k =>
RelaxedPRS.StrongCvx.auxS μg βg (RelaxedPRS.StrongCvx.xg Pg (z k)) (RelaxedPRS.StrongCvx.xg Pg zs)
(RelaxedPRS.StrongCvx.gtG γ Pg (z k)) (RelaxedPRS.StrongCvx.gtG γ Pg zs)
∀ k, 8 * γ * lam k * (Sf k + Sg k) ≤
‖z k - zs‖ ^ 2 - ‖z (k + 1) - zs‖ ^ 2 +
(1 - 1 / lam k) * ‖z (k + 1) - z k‖ ^ 2 := by sorry
end RelaxedPRS.Linear
Source
Davis & Yin, Faster convergence rates of relaxed Peaceman-Rachford and ADMM under regularity assumptions, arXiv:1407.5210v3, p. 8, Theorem 2.1, (2.1)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.